[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:59:46.167423  7335 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.41.254:46411
I20260709 12:59:46.168978  7335 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:59:46.170447  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:46.187273  7342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:46.187548  7341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:46.187865  7344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:46.189043  7335 server_base.cc:1061] running on GCE node
I20260709 12:59:47.399398  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:47.399638  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:47.399883  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783601987399861 us; error 0 us; skew 500 ppm
I20260709 12:59:47.400858  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:47.408063  7335 webserver.cc:533] Webserver started at http://127.7.41.254:39803/ using document root <none> and password file <none>
I20260709 12:59:47.409039  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:47.409466  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:47.410151  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:47.415937  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/master-0-root/instance:
uuid: "ba76490f309c4b76950e4251d9066c89"
format_stamp: "Formatted at 2026-07-09 12:59:47 on dist-test-slave-fh5z"
I20260709 12:59:47.423561  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 12:59:47.428581  7350 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:47.429891  7335 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:59:47.430348  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/master-0-root
uuid: "ba76490f309c4b76950e4251d9066c89"
format_stamp: "Formatted at 2026-07-09 12:59:47 on dist-test-slave-fh5z"
I20260709 12:59:47.430691  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:47.486310  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:47.487789  7335 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:59:47.488273  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:47.558494  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.254:46411
I20260709 12:59:47.558565  7401 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.254:46411 every 8 connection(s)
I20260709 12:59:47.566664  7402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:47.589983  7402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89: Bootstrap starting.
I20260709 12:59:47.596349  7402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.598372  7402 log.cc:826] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89: Log is configured to *not* fsync() on all Append() calls
I20260709 12:59:47.603179  7402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89: No bootstrap required, opened a new log
I20260709 12:59:47.625540  7402 raft_consensus.cc:359] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba76490f309c4b76950e4251d9066c89" member_type: VOTER }
I20260709 12:59:47.626174  7402 raft_consensus.cc:385] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.626474  7402 raft_consensus.cc:740] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba76490f309c4b76950e4251d9066c89, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.627457  7402 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba76490f309c4b76950e4251d9066c89" member_type: VOTER }
I20260709 12:59:47.628001  7402 raft_consensus.cc:399] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:47.628361  7402 raft_consensus.cc:493] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:47.628751  7402 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.633396  7402 raft_consensus.cc:515] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba76490f309c4b76950e4251d9066c89" member_type: VOTER }
I20260709 12:59:47.634233  7402 leader_election.cc:304] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba76490f309c4b76950e4251d9066c89; no voters: 
I20260709 12:59:47.636020  7402 leader_election.cc:290] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:47.636340  7405 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:47.638656  7405 raft_consensus.cc:697] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 1 LEADER]: Becoming Leader. State: Replica: ba76490f309c4b76950e4251d9066c89, State: Running, Role: LEADER
I20260709 12:59:47.639592  7405 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba76490f309c4b76950e4251d9066c89" member_type: VOTER }
I20260709 12:59:47.640779  7402 sys_catalog.cc:565] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:47.649757  7406 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba76490f309c4b76950e4251d9066c89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba76490f309c4b76950e4251d9066c89" member_type: VOTER } }
I20260709 12:59:47.650391  7406 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:47.650117  7407 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba76490f309c4b76950e4251d9066c89. Latest consensus state: current_term: 1 leader_uuid: "ba76490f309c4b76950e4251d9066c89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba76490f309c4b76950e4251d9066c89" member_type: VOTER } }
I20260709 12:59:47.650876  7407 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:47.653622  7413 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:47.666555  7413 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:47.668877  7335 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:47.682220  7413 catalog_manager.cc:1383] Generated new cluster ID: 67e424add11e4bcaa13003e616c58e6d
I20260709 12:59:47.682543  7413 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:47.699609  7413 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:47.701807  7413 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:47.719070  7413 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89: Generated new TSK 0
I20260709 12:59:47.720256  7413 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:47.735329  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:47.743618  7424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:47.746513  7425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:47.748502  7427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:47.750484  7335 server_base.cc:1061] running on GCE node
I20260709 12:59:47.751368  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:47.751564  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:47.751811  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783601987751773 us; error 0 us; skew 500 ppm
I20260709 12:59:47.752476  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:47.757200  7335 webserver.cc:533] Webserver started at http://127.7.41.193:34925/ using document root <none> and password file <none>
I20260709 12:59:47.757797  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:47.758026  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:47.758378  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:47.759574  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-0-root/instance:
uuid: "94ec8b45c91240f98bfd0bab03ee1699"
format_stamp: "Formatted at 2026-07-09 12:59:47 on dist-test-slave-fh5z"
I20260709 12:59:47.766096  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:59:47.771202  7432 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:47.772063  7335 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.003s
I20260709 12:59:47.772409  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-0-root
uuid: "94ec8b45c91240f98bfd0bab03ee1699"
format_stamp: "Formatted at 2026-07-09 12:59:47 on dist-test-slave-fh5z"
I20260709 12:59:47.772789  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:47.797691  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:47.799456  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:47.802253  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:47.807590  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:47.807883  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:47.808208  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:47.808439  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:47.898313  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.193:36829
I20260709 12:59:47.898404  7494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.193:36829 every 8 connection(s)
I20260709 12:59:47.906049  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:47.914824  7499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:47.925226  7500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:47.925395  7502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:47.928105  7335 server_base.cc:1061] running on GCE node
I20260709 12:59:47.929149  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:47.929432  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:47.929629  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783601987929609 us; error 0 us; skew 500 ppm
I20260709 12:59:47.930338  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:47.933625  7335 webserver.cc:533] Webserver started at http://127.7.41.194:44517/ using document root <none> and password file <none>
I20260709 12:59:47.934260  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:47.934515  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:47.934859  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:47.935698  7495 heartbeater.cc:344] Connected to a master server at 127.7.41.254:46411
I20260709 12:59:47.936172  7495 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:47.936305  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-1-root/instance:
uuid: "a7ceba849111420fb4503a8df965f1f5"
format_stamp: "Formatted at 2026-07-09 12:59:47 on dist-test-slave-fh5z"
I20260709 12:59:47.937398  7495 heartbeater.cc:507] Master 127.7.41.254:46411 requested a full tablet report, sending...
I20260709 12:59:47.940784  7367 ts_manager.cc:194] Registered new tserver with Master: 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829)
I20260709 12:59:47.943399  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:59:47.943745  7367 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54854
I20260709 12:59:47.948673  7507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:47.949502  7335 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:59:47.949786  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-1-root
uuid: "a7ceba849111420fb4503a8df965f1f5"
format_stamp: "Formatted at 2026-07-09 12:59:47 on dist-test-slave-fh5z"
I20260709 12:59:47.950091  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:47.964571  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:47.965866  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:47.967998  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:47.971302  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:47.971522  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:47.971766  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:47.971944  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:48.068513  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.194:43143
I20260709 12:59:48.068622  7569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.194:43143 every 8 connection(s)
I20260709 12:59:48.077718  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:48.086241  7573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:48.088752  7574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:48.092803  7570 heartbeater.cc:344] Connected to a master server at 127.7.41.254:46411
I20260709 12:59:48.093176  7570 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:48.094280  7570 heartbeater.cc:507] Master 127.7.41.254:46411 requested a full tablet report, sending...
W20260709 12:59:48.096051  7577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:48.097085  7367 ts_manager.cc:194] Registered new tserver with Master: a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143)
I20260709 12:59:48.098963  7367 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54868
I20260709 12:59:48.102816  7335 server_base.cc:1061] running on GCE node
I20260709 12:59:48.103955  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:48.104228  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:48.104441  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783601988104423 us; error 0 us; skew 500 ppm
I20260709 12:59:48.105242  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:48.108204  7335 webserver.cc:533] Webserver started at http://127.7.41.195:41523/ using document root <none> and password file <none>
I20260709 12:59:48.108871  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:48.109122  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:48.109462  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:48.111109  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-2-root/instance:
uuid: "db0041a163dc4558b2b3c59afc3996b3"
format_stamp: "Formatted at 2026-07-09 12:59:48 on dist-test-slave-fh5z"
I20260709 12:59:48.117107  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:59:48.121208  7581 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:48.122124  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:48.122450  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-2-root
uuid: "db0041a163dc4558b2b3c59afc3996b3"
format_stamp: "Formatted at 2026-07-09 12:59:48 on dist-test-slave-fh5z"
I20260709 12:59:48.122793  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601985998407-7335-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:48.145092  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:48.146756  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:48.149323  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:48.151932  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:48.152163  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:48.152406  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:48.152575  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:48.237140  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.195:33693
I20260709 12:59:48.237296  7643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.195:33693 every 8 connection(s)
I20260709 12:59:48.255121  7644 heartbeater.cc:344] Connected to a master server at 127.7.41.254:46411
I20260709 12:59:48.255527  7644 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:48.256278  7644 heartbeater.cc:507] Master 127.7.41.254:46411 requested a full tablet report, sending...
I20260709 12:59:48.258436  7367 ts_manager.cc:194] Registered new tserver with Master: db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:48.259080  7335 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014466892s
I20260709 12:59:48.260120  7367 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54876
I20260709 12:59:48.315290  7367 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54888:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:48.319165  7367 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:48.435720  7609 tablet_service.cc:1511] Processing CreateTablet for tablet 76435aa2977d43e0a701a4672b183511 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:48.436424  7606 tablet_service.cc:1511] Processing CreateTablet for tablet 1e310b1b76404260958260e6ee358084 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:48.437320  7609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76435aa2977d43e0a701a4672b183511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.437021  7607 tablet_service.cc:1511] Processing CreateTablet for tablet 1099dfe065314ab6abfa57cd3932f500 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:48.438058  7606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e310b1b76404260958260e6ee358084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.435771  7608 tablet_service.cc:1511] Processing CreateTablet for tablet f5437381224640a4ba3bc8b50c56868d (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:48.439466  7608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5437381224640a4ba3bc8b50c56868d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.441581  7605 tablet_service.cc:1511] Processing CreateTablet for tablet 25ffb5c4430d4fc587687d29b9359c75 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:48.442834  7607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1099dfe065314ab6abfa57cd3932f500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.447124  7605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ffb5c4430d4fc587687d29b9359c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.449501  7604 tablet_service.cc:1511] Processing CreateTablet for tablet 44b058fd0d934cc4892523c4d528d32e (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:48.450103  7603 tablet_service.cc:1511] Processing CreateTablet for tablet 2a61a34e48f2410797f2a36f3bb4a23f (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:48.451808  7604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b058fd0d934cc4892523c4d528d32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.450553  7602 tablet_service.cc:1511] Processing CreateTablet for tablet 4918b1d7228f42dfaefaeef25c5debb9 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:48.455611  7603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a61a34e48f2410797f2a36f3bb4a23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.455464  7601 tablet_service.cc:1511] Processing CreateTablet for tablet 94a1f710b74d4c31ab13f4cdf2fc9d4d (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:48.457664  7602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4918b1d7228f42dfaefaeef25c5debb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.460716  7601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a1f710b74d4c31ab13f4cdf2fc9d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.474958  7534 tablet_service.cc:1511] Processing CreateTablet for tablet f5437381224640a4ba3bc8b50c56868d (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:48.479415  7535 tablet_service.cc:1511] Processing CreateTablet for tablet 76435aa2977d43e0a701a4672b183511 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:48.479482  7532 tablet_service.cc:1511] Processing CreateTablet for tablet 1e310b1b76404260958260e6ee358084 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:48.482746  7535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76435aa2977d43e0a701a4672b183511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.482502  7533 tablet_service.cc:1511] Processing CreateTablet for tablet 1099dfe065314ab6abfa57cd3932f500 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:48.480007  7531 tablet_service.cc:1511] Processing CreateTablet for tablet 25ffb5c4430d4fc587687d29b9359c75 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:48.489763  7530 tablet_service.cc:1511] Processing CreateTablet for tablet 44b058fd0d934cc4892523c4d528d32e (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:48.491997  7534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5437381224640a4ba3bc8b50c56868d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.496762  7529 tablet_service.cc:1511] Processing CreateTablet for tablet 2a61a34e48f2410797f2a36f3bb4a23f (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:48.503691  7530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b058fd0d934cc4892523c4d528d32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.508291  7459 tablet_service.cc:1511] Processing CreateTablet for tablet f5437381224640a4ba3bc8b50c56868d (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:48.510643  7459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5437381224640a4ba3bc8b50c56868d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.514345  7457 tablet_service.cc:1511] Processing CreateTablet for tablet 1e310b1b76404260958260e6ee358084 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:48.515676  7457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e310b1b76404260958260e6ee358084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.518793  7662 tablet_bootstrap.cc:492] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3: Bootstrap starting.
I20260709 12:59:48.520696  7533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1099dfe065314ab6abfa57cd3932f500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.519922  7460 tablet_service.cc:1511] Processing CreateTablet for tablet 76435aa2977d43e0a701a4672b183511 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:48.521082  7458 tablet_service.cc:1511] Processing CreateTablet for tablet 1099dfe065314ab6abfa57cd3932f500 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:48.512687  7528 tablet_service.cc:1511] Processing CreateTablet for tablet 4918b1d7228f42dfaefaeef25c5debb9 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:48.544466  7531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ffb5c4430d4fc587687d29b9359c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.544425  7460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76435aa2977d43e0a701a4672b183511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.553618  7527 tablet_service.cc:1511] Processing CreateTablet for tablet 94a1f710b74d4c31ab13f4cdf2fc9d4d (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:48.562861  7454 tablet_service.cc:1511] Processing CreateTablet for tablet 2a61a34e48f2410797f2a36f3bb4a23f (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:48.565089  7456 tablet_service.cc:1511] Processing CreateTablet for tablet 25ffb5c4430d4fc587687d29b9359c75 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:48.551326  7453 tablet_service.cc:1511] Processing CreateTablet for tablet 4918b1d7228f42dfaefaeef25c5debb9 (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:48.567611  7455 tablet_service.cc:1511] Processing CreateTablet for tablet 44b058fd0d934cc4892523c4d528d32e (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:48.569664  7458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1099dfe065314ab6abfa57cd3932f500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.570920  7528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4918b1d7228f42dfaefaeef25c5debb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.572167  7527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a1f710b74d4c31ab13f4cdf2fc9d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.571295  7452 tablet_service.cc:1511] Processing CreateTablet for tablet 94a1f710b74d4c31ab13f4cdf2fc9d4d (DEFAULT_TABLE table=test-workload [id=1d51d41187054fc3b1b65ec6c69f24d1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:48.577730  7454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a61a34e48f2410797f2a36f3bb4a23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.598235  7532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e310b1b76404260958260e6ee358084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.598220  7452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a1f710b74d4c31ab13f4cdf2fc9d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.600136  7529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a61a34e48f2410797f2a36f3bb4a23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.601625  7455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b058fd0d934cc4892523c4d528d32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.602473  7453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4918b1d7228f42dfaefaeef25c5debb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:48.603727  7456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ffb5c4430d4fc587687d29b9359c75. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:48.657559  7415 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:48.657559  7662 tablet_bootstrap.cc:654] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.695499  7663 tablet_bootstrap.cc:492] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699: Bootstrap starting.
I20260709 12:59:48.703008  7664 tablet_bootstrap.cc:492] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5: Bootstrap starting.
I20260709 12:59:48.715812  7662 tablet_bootstrap.cc:492] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3: No bootstrap required, opened a new log
I20260709 12:59:48.716365  7662 ts_tablet_manager.cc:1403] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3: Time spent bootstrapping tablet: real 0.198s	user 0.015s	sys 0.024s
I20260709 12:59:48.726636  7662 raft_consensus.cc:359] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:48.727557  7662 raft_consensus.cc:385] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.727895  7662 raft_consensus.cc:740] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.728319  7664 tablet_bootstrap.cc:654] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.728691  7662 consensus_queue.cc:260] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:48.731662  7663 tablet_bootstrap.cc:654] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.738241  7662 ts_tablet_manager.cc:1434] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3: Time spent starting tablet: real 0.022s	user 0.015s	sys 0.002s
I20260709 12:59:48.740935  7644 heartbeater.cc:499] Master 127.7.41.254:46411 was elected leader, sending a full tablet report...
I20260709 12:59:48.741362  7662 tablet_bootstrap.cc:492] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3: Bootstrap starting.
I20260709 12:59:48.741575  7663 tablet_bootstrap.cc:492] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699: No bootstrap required, opened a new log
I20260709 12:59:48.741986  7663 ts_tablet_manager.cc:1403] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.008s
I20260709 12:59:48.744804  7663 raft_consensus.cc:359] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.745522  7663 raft_consensus.cc:385] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.745795  7663 raft_consensus.cc:740] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.746465  7663 consensus_queue.cc:260] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
W20260709 12:59:48.747957  7645 tablet.cc:2406] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:59:48.751044  7662 tablet_bootstrap.cc:654] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.748071  7664 tablet_bootstrap.cc:492] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5: No bootstrap required, opened a new log
I20260709 12:59:48.754714  7664 ts_tablet_manager.cc:1403] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5: Time spent bootstrapping tablet: real 0.056s	user 0.005s	sys 0.017s
I20260709 12:59:48.757943  7664 raft_consensus.cc:359] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.759032  7664 raft_consensus.cc:385] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.759384  7664 raft_consensus.cc:740] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.760103  7664 consensus_queue.cc:260] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.767429  7662 tablet_bootstrap.cc:492] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3: No bootstrap required, opened a new log
I20260709 12:59:48.778268  7662 ts_tablet_manager.cc:1403] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.002s
I20260709 12:59:48.782047  7662 raft_consensus.cc:359] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.784267  7495 heartbeater.cc:499] Master 127.7.41.254:46411 was elected leader, sending a full tablet report...
I20260709 12:59:48.785534  7662 raft_consensus.cc:385] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.785856  7662 raft_consensus.cc:740] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.786239  7664 ts_tablet_manager.cc:1434] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5: Time spent starting tablet: real 0.031s	user 0.015s	sys 0.010s
I20260709 12:59:48.786582  7662 consensus_queue.cc:260] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.787287  7664 tablet_bootstrap.cc:492] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5: Bootstrap starting.
I20260709 12:59:48.785034  7570 heartbeater.cc:499] Master 127.7.41.254:46411 was elected leader, sending a full tablet report...
I20260709 12:59:48.789618  7662 ts_tablet_manager.cc:1434] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:59:48.790472  7662 tablet_bootstrap.cc:492] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3: Bootstrap starting.
I20260709 12:59:48.796600  7662 tablet_bootstrap.cc:654] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.804231  7664 tablet_bootstrap.cc:654] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.785432  7663 ts_tablet_manager.cc:1434] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699: Time spent starting tablet: real 0.043s	user 0.017s	sys 0.023s
I20260709 12:59:48.817562  7663 tablet_bootstrap.cc:492] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699: Bootstrap starting.
I20260709 12:59:48.824505  7664 tablet_bootstrap.cc:492] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5: No bootstrap required, opened a new log
I20260709 12:59:48.825106  7664 ts_tablet_manager.cc:1403] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.012s
I20260709 12:59:48.827842  7664 raft_consensus.cc:359] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.828557  7664 raft_consensus.cc:385] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.828840  7664 raft_consensus.cc:740] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.829660  7664 consensus_queue.cc:260] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.831881  7664 ts_tablet_manager.cc:1434] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:48.832793  7664 tablet_bootstrap.cc:492] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5: Bootstrap starting.
I20260709 12:59:48.838948  7664 tablet_bootstrap.cc:654] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.844566  7663 tablet_bootstrap.cc:654] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.850203  7664 tablet_bootstrap.cc:492] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5: No bootstrap required, opened a new log
I20260709 12:59:48.855916  7664 ts_tablet_manager.cc:1403] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 12:59:48.857093  7662 tablet_bootstrap.cc:492] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3: No bootstrap required, opened a new log
I20260709 12:59:48.857538  7662 ts_tablet_manager.cc:1403] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3: Time spent bootstrapping tablet: real 0.067s	user 0.032s	sys 0.033s
I20260709 12:59:48.859112  7664 raft_consensus.cc:359] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.859871  7664 raft_consensus.cc:385] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.860234  7664 raft_consensus.cc:740] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.860860  7662 raft_consensus.cc:359] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.861702  7662 raft_consensus.cc:385] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.861016  7664 consensus_queue.cc:260] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.862135  7662 raft_consensus.cc:740] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.864208  7664 ts_tablet_manager.cc:1434] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:48.865501  7662 consensus_queue.cc:260] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.867870  7662 ts_tablet_manager.cc:1434] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:59:48.868628  7664 tablet_bootstrap.cc:492] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5: Bootstrap starting.
I20260709 12:59:48.873127  7662 tablet_bootstrap.cc:492] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3: Bootstrap starting.
I20260709 12:59:48.881904  7662 tablet_bootstrap.cc:654] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.882117  7663 tablet_bootstrap.cc:492] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699: No bootstrap required, opened a new log
I20260709 12:59:48.882603  7663 ts_tablet_manager.cc:1403] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.015s
I20260709 12:59:48.885818  7663 raft_consensus.cc:359] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.886600  7663 raft_consensus.cc:385] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.886941  7663 raft_consensus.cc:740] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.888698  7664 tablet_bootstrap.cc:654] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.888545  7663 consensus_queue.cc:260] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.890002  7662 tablet_bootstrap.cc:492] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3: No bootstrap required, opened a new log
I20260709 12:59:48.890470  7662 ts_tablet_manager.cc:1403] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:59:48.898087  7663 ts_tablet_manager.cc:1434] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:59:48.898416  7662 raft_consensus.cc:359] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.899103  7662 raft_consensus.cc:385] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.899401  7662 raft_consensus.cc:740] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.900228  7664 tablet_bootstrap.cc:492] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5: No bootstrap required, opened a new log
I20260709 12:59:48.900170  7662 consensus_queue.cc:260] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.900787  7664 ts_tablet_manager.cc:1403] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.007s
I20260709 12:59:48.902100  7669 raft_consensus.cc:493] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.902590  7669 raft_consensus.cc:515] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.904280  7664 raft_consensus.cc:359] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.905048  7664 raft_consensus.cc:385] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.905390  7664 raft_consensus.cc:740] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.905627  7669 leader_election.cc:290] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:48.906368  7664 consensus_queue.cc:260] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.909492  7664 ts_tablet_manager.cc:1434] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 12:59:48.910418  7671 raft_consensus.cc:493] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.907408  7662 ts_tablet_manager.cc:1434] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.005s
I20260709 12:59:48.911119  7671 raft_consensus.cc:515] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.911888  7662 tablet_bootstrap.cc:492] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3: Bootstrap starting.
I20260709 12:59:48.918540  7662 tablet_bootstrap.cc:654] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.921666  7663 tablet_bootstrap.cc:492] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699: Bootstrap starting.
I20260709 12:59:48.925630  7671 leader_election.cc:290] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:48.928790  7663 tablet_bootstrap.cc:654] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.938522  7664 tablet_bootstrap.cc:492] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5: Bootstrap starting.
I20260709 12:59:48.943126  7663 tablet_bootstrap.cc:492] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699: No bootstrap required, opened a new log
I20260709 12:59:48.943847  7663 ts_tablet_manager.cc:1403] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 12:59:48.967017  7663 raft_consensus.cc:359] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.968200  7663 raft_consensus.cc:385] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.975430  7663 raft_consensus.cc:740] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.976595  7663 consensus_queue.cc:260] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:48.979233  7663 ts_tablet_manager.cc:1434] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 12:59:48.980307  7663 tablet_bootstrap.cc:492] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699: Bootstrap starting.
I20260709 12:59:49.004236  7663 tablet_bootstrap.cc:654] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.010718  7664 tablet_bootstrap.cc:654] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.014950  7671 raft_consensus.cc:493] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.014772  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e310b1b76404260958260e6ee358084" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5" is_pre_election: true
I20260709 12:59:49.015887  7671 raft_consensus.cc:515] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.016634  7545 raft_consensus.cc:2468] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 0.
I20260709 12:59:49.017609  7662 tablet_bootstrap.cc:492] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3: No bootstrap required, opened a new log
I20260709 12:59:49.019001  7436 leader_election.cc:304] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, a7ceba849111420fb4503a8df965f1f5; no voters: 
I20260709 12:59:49.019469  7671 leader_election.cc:290] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.020176  7669 raft_consensus.cc:2804] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.020982  7669 raft_consensus.cc:493] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.021693  7669 raft_consensus.cc:3060] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.021036  7469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b058fd0d934cc4892523c4d528d32e" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699" is_pre_election: true
I20260709 12:59:49.021639  7470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699" is_pre_election: true
I20260709 12:59:49.032303  7662 ts_tablet_manager.cc:1403] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3: Time spent bootstrapping tablet: real 0.121s	user 0.043s	sys 0.038s
W20260709 12:59:49.037413  7510 leader_election.cc:343] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.038954  7671 raft_consensus.cc:493] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.039491  7671 raft_consensus.cc:515] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.040316  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.040812  7618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b058fd0d934cc4892523c4d528d32e" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
W20260709 12:59:49.041991  7510 leader_election.cc:343] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.042227  7618 raft_consensus.cc:2468] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 0.
I20260709 12:59:49.044047  7511 leader_election.cc:304] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:49.043690  7671 leader_election.cc:290] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.045377  7619 raft_consensus.cc:2468] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 0.
I20260709 12:59:49.046041  7671 raft_consensus.cc:2804] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.046729  7671 raft_consensus.cc:493] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.046829  7469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699" is_pre_election: true
I20260709 12:59:49.047454  7671 raft_consensus.cc:3060] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:49.051123  7510 leader_election.cc:343] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.053457  7669 raft_consensus.cc:515] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.056545  7669 leader_election.cc:290] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 election: Requested vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.039110  7662 raft_consensus.cc:359] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.058812  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e310b1b76404260958260e6ee358084" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:49.072577  7662 raft_consensus.cc:385] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.072755  7545 raft_consensus.cc:3060] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.072932  7662 raft_consensus.cc:740] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.061360  7618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e310b1b76404260958260e6ee358084" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:49.062175  7664 tablet_bootstrap.cc:492] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5: No bootstrap required, opened a new log
I20260709 12:59:49.073736  7664 ts_tablet_manager.cc:1403] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5: Time spent bootstrapping tablet: real 0.136s	user 0.018s	sys 0.000s
W20260709 12:59:49.074339  7436 leader_election.cc:343] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.076407  7664 raft_consensus.cc:359] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.076915  7664 raft_consensus.cc:385] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.077101  7664 raft_consensus.cc:740] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.077593  7664 consensus_queue.cc:260] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.078503  7662 consensus_queue.cc:260] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.080317  7545 raft_consensus.cc:2468] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 1.
I20260709 12:59:49.081374  7662 ts_tablet_manager.cc:1434] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:59:49.081666  7436 leader_election.cc:304] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, a7ceba849111420fb4503a8df965f1f5; no voters: db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:49.082393  7662 tablet_bootstrap.cc:492] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3: Bootstrap starting.
I20260709 12:59:49.082587  7669 raft_consensus.cc:2804] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.085825  7664 ts_tablet_manager.cc:1434] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:59:49.086794  7664 tablet_bootstrap.cc:492] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5: Bootstrap starting.
I20260709 12:59:49.071617  7671 raft_consensus.cc:515] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.071995  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.060451  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e310b1b76404260958260e6ee358084" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.072822  7511 leader_election.cc:304] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:49.093850  7469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b058fd0d934cc4892523c4d528d32e" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:49.095264  7663 tablet_bootstrap.cc:492] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699: No bootstrap required, opened a new log
W20260709 12:59:49.095283  7510 leader_election.cc:343] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.096079  7663 ts_tablet_manager.cc:1403] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699: Time spent bootstrapping tablet: real 0.116s	user 0.028s	sys 0.027s
W20260709 12:59:49.091586  7436 leader_election.cc:343] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.097201  7671 leader_election.cc:290] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.097739  7671 raft_consensus.cc:2804] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.099056  7671 raft_consensus.cc:493] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.099401  7671 raft_consensus.cc:3060] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.105571  7669 raft_consensus.cc:697] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Becoming Leader. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:49.108033  7689 raft_consensus.cc:493] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.110651  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b058fd0d934cc4892523c4d528d32e" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:49.111279  7619 raft_consensus.cc:3060] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.109377  7689 raft_consensus.cc:515] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.117707  7671 raft_consensus.cc:515] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.120886  7619 raft_consensus.cc:2468] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 1.
W20260709 12:59:49.119175  7511 leader_election.cc:343] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.122391  7511 leader_election.cc:304] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5; no voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:49.123558  7687 raft_consensus.cc:2749] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.123117  7469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:49.123023  7663 raft_consensus.cc:359] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
W20260709 12:59:49.125634  7510 leader_election.cc:343] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.125711  7663 raft_consensus.cc:385] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.126197  7663 raft_consensus.cc:740] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.127743  7662 tablet_bootstrap.cc:654] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.128417  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1099dfe065314ab6abfa57cd3932f500" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5" is_pre_election: true
I20260709 12:59:49.129184  7689 leader_election.cc:290] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
W20260709 12:59:49.130172  7436 leader_election.cc:343] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.130369  7664 tablet_bootstrap.cc:654] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.131111  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1099dfe065314ab6abfa57cd3932f500" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.124254  7671 leader_election.cc:290] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.130451  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:49.133435  7617 raft_consensus.cc:3060] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.131808  7619 raft_consensus.cc:2468] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 0.
I20260709 12:59:49.133600  7511 leader_election.cc:304] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:49.111959  7669 consensus_queue.cc:237] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.135833  7436 leader_election.cc:304] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: a7ceba849111420fb4503a8df965f1f5
I20260709 12:59:49.136682  7689 raft_consensus.cc:2804] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.137027  7689 raft_consensus.cc:493] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.137342  7689 raft_consensus.cc:3060] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.134070  7663 consensus_queue.cc:260] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.142515  7690 raft_consensus.cc:2804] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.143071  7690 raft_consensus.cc:697] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Becoming Leader. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:49.144181  7690 consensus_queue.cc:237] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.148406  7617 raft_consensus.cc:2468] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 1.
I20260709 12:59:49.150200  7663 ts_tablet_manager.cc:1434] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.002s
I20260709 12:59:49.150071  7511 leader_election.cc:304] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:49.146390  7662 tablet_bootstrap.cc:492] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3: No bootstrap required, opened a new log
I20260709 12:59:49.150902  7671 raft_consensus.cc:2804] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.152880  7671 raft_consensus.cc:697] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Becoming Leader. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:49.153120  7663 tablet_bootstrap.cc:492] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699: Bootstrap starting.
I20260709 12:59:49.153680  7671 consensus_queue.cc:237] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.152362  7662 ts_tablet_manager.cc:1403] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.011s
I20260709 12:59:49.156389  7666 raft_consensus.cc:493] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.156847  7666 raft_consensus.cc:515] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.165102  7666 leader_election.cc:290] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829)
I20260709 12:59:49.167582  7662 raft_consensus.cc:359] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.172871  7662 raft_consensus.cc:385] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.178783  7662 raft_consensus.cc:740] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.179641  7662 consensus_queue.cc:260] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.181624  7366 catalog_manager.cc:5697] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.184782  7662 ts_tablet_manager.cc:1434] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 12:59:49.185837  7662 tablet_bootstrap.cc:492] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3: Bootstrap starting.
I20260709 12:59:49.200227  7689 raft_consensus.cc:515] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.172518  7663 tablet_bootstrap.cc:654] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.194465  7367 catalog_manager.cc:5697] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ceba849111420fb4503a8df965f1f5 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "a7ceba849111420fb4503a8df965f1f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.203213  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1099dfe065314ab6abfa57cd3932f500" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
W20260709 12:59:49.204690  7436 leader_election.cc:343] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.207988  7689 leader_election.cc:290] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 election: Requested vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.209611  7662 tablet_bootstrap.cc:654] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.210386  7664 tablet_bootstrap.cc:492] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5: No bootstrap required, opened a new log
I20260709 12:59:49.210886  7664 ts_tablet_manager.cc:1403] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.003s
I20260709 12:59:49.215134  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1099dfe065314ab6abfa57cd3932f500" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:49.215756  7617 raft_consensus.cc:3060] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.217057  7671 raft_consensus.cc:493] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.217459  7664 raft_consensus.cc:359] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.217525  7671 raft_consensus.cc:515] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.218328  7664 raft_consensus.cc:385] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.218653  7664 raft_consensus.cc:740] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.219676  7671 leader_election.cc:290] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.220669  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ffb5c4430d4fc587687d29b9359c75" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.221235  7619 raft_consensus.cc:2468] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 0.
I20260709 12:59:49.221179  7469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ffb5c4430d4fc587687d29b9359c75" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699" is_pre_election: true
I20260709 12:59:49.221997  7469 raft_consensus.cc:2468] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 0.
I20260709 12:59:49.222682  7511 leader_election.cc:304] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:49.223425  7671 raft_consensus.cc:2804] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.223783  7671 raft_consensus.cc:493] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.219375  7664 consensus_queue.cc:260] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.224118  7671 raft_consensus.cc:3060] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.226529  7663 tablet_bootstrap.cc:492] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699: No bootstrap required, opened a new log
I20260709 12:59:49.226543  7617 raft_consensus.cc:2468] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 1.
I20260709 12:59:49.227054  7663 ts_tablet_manager.cc:1403] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.003s
I20260709 12:59:49.227968  7436 leader_election.cc:304] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: a7ceba849111420fb4503a8df965f1f5
I20260709 12:59:49.228917  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5" is_pre_election: true
I20260709 12:59:49.229537  7545 raft_consensus.cc:2468] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 0.
I20260709 12:59:49.230638  7671 raft_consensus.cc:515] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.230909  7585 leader_election.cc:304] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:49.231197  7662 tablet_bootstrap.cc:492] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3: No bootstrap required, opened a new log
I20260709 12:59:49.231743  7666 raft_consensus.cc:2804] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.231840  7689 raft_consensus.cc:2804] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.232132  7666 raft_consensus.cc:493] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.232486  7666 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.232811  7662 ts_tablet_manager.cc:1403] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.005s
I20260709 12:59:49.234664  7671 leader_election.cc:290] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.235288  7469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ffb5c4430d4fc587687d29b9359c75" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:49.235901  7469 raft_consensus.cc:3060] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.237138  7662 raft_consensus.cc:359] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.239145  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ffb5c4430d4fc587687d29b9359c75" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:49.252864  7617 raft_consensus.cc:3060] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.253355  7662 raft_consensus.cc:385] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.232486  7689 raft_consensus.cc:697] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Becoming Leader. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:49.255021  7470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699" is_pre_election: true
I20260709 12:59:49.253806  7662 raft_consensus.cc:740] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.255146  7666 raft_consensus.cc:515] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.256080  7662 consensus_queue.cc:260] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.254662  7689 consensus_queue.cc:237] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
W20260709 12:59:49.256572  7584 leader_election.cc:343] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.263219  7617 raft_consensus.cc:2468] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 1.
I20260709 12:59:49.257987  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:49.264376  7545 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.264413  7511 leader_election.cc:304] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:49.265290  7671 raft_consensus.cc:2804] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.265798  7671 raft_consensus.cc:697] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Becoming Leader. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:49.266601  7671 consensus_queue.cc:237] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.269200  7470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
W20260709 12:59:49.270627  7584 leader_election.cc:343] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.258728  7469 raft_consensus.cc:2468] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 1.
I20260709 12:59:49.259786  7664 ts_tablet_manager.cc:1434] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.005s
I20260709 12:59:49.276999  7662 ts_tablet_manager.cc:1434] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.003s
I20260709 12:59:49.277558  7664 tablet_bootstrap.cc:492] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5: Bootstrap starting.
I20260709 12:59:49.278062  7662 tablet_bootstrap.cc:492] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3: Bootstrap starting.
I20260709 12:59:49.279518  7545 raft_consensus.cc:2468] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 1.
I20260709 12:59:49.281399  7585 leader_election.cc:304] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:49.260550  7666 leader_election.cc:290] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 election: Requested vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829)
I20260709 12:59:49.229970  7663 raft_consensus.cc:359] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.282370  7663 raft_consensus.cc:385] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.282582  7666 raft_consensus.cc:2804] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.282677  7663 raft_consensus.cc:740] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.283125  7666 raft_consensus.cc:697] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 1 LEADER]: Becoming Leader. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:49.283448  7663 consensus_queue.cc:260] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.283946  7666 consensus_queue.cc:237] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.286042  7663 ts_tablet_manager.cc:1434] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:59:49.286985  7663 tablet_bootstrap.cc:492] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699: Bootstrap starting.
I20260709 12:59:49.264585  7669 raft_consensus.cc:493] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.287727  7669 raft_consensus.cc:515] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.289816  7669 leader_election.cc:290] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.291426  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a61a34e48f2410797f2a36f3bb4a23f" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.291463  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a61a34e48f2410797f2a36f3bb4a23f" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5" is_pre_election: true
W20260709 12:59:49.292687  7436 leader_election.cc:343] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:49.293365  7436 leader_election.cc:343] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.293746  7436 leader_election.cc:304] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699; no voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:49.294512  7663 tablet_bootstrap.cc:654] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.295724  7365 catalog_manager.cc:5697] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.298178  7662 tablet_bootstrap.cc:654] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.298353  7669 raft_consensus.cc:2749] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.301565  7664 tablet_bootstrap.cc:654] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.311143  7663 tablet_bootstrap.cc:492] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699: No bootstrap required, opened a new log
I20260709 12:59:49.311604  7663 ts_tablet_manager.cc:1403] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.003s
I20260709 12:59:49.311024  7367 catalog_manager.cc:5697] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "db0041a163dc4558b2b3c59afc3996b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.320233  7663 raft_consensus.cc:359] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.321158  7663 raft_consensus.cc:385] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.321489  7663 raft_consensus.cc:740] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.322309  7663 consensus_queue.cc:260] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.323351  7662 tablet_bootstrap.cc:492] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3: No bootstrap required, opened a new log
I20260709 12:59:49.323642  7664 tablet_bootstrap.cc:492] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5: No bootstrap required, opened a new log
I20260709 12:59:49.323800  7662 ts_tablet_manager.cc:1403] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.001s
I20260709 12:59:49.324191  7664 ts_tablet_manager.cc:1403] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.006s
I20260709 12:59:49.324996  7663 ts_tablet_manager.cc:1434] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 12:59:49.325977  7663 tablet_bootstrap.cc:492] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699: Bootstrap starting.
I20260709 12:59:49.326460  7662 raft_consensus.cc:359] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.327070  7662 raft_consensus.cc:385] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.327339  7662 raft_consensus.cc:740] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.327973  7662 consensus_queue.cc:260] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.329909  7662 ts_tablet_manager.cc:1434] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:59:49.330782  7662 tablet_bootstrap.cc:492] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3: Bootstrap starting.
I20260709 12:59:49.332980  7663 tablet_bootstrap.cc:654] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.336129  7664 raft_consensus.cc:359] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.337193  7664 raft_consensus.cc:385] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.337550  7664 raft_consensus.cc:740] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.338387  7664 consensus_queue.cc:260] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.339955  7662 tablet_bootstrap.cc:654] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.347272  7664 ts_tablet_manager.cc:1434] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:59:49.348368  7664 tablet_bootstrap.cc:492] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5: Bootstrap starting.
I20260709 12:59:49.351020  7663 tablet_bootstrap.cc:492] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699: No bootstrap required, opened a new log
I20260709 12:59:49.351517  7662 tablet_bootstrap.cc:492] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3: No bootstrap required, opened a new log
I20260709 12:59:49.351985  7663 ts_tablet_manager.cc:1403] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 12:59:49.354925  7664 tablet_bootstrap.cc:654] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.352073  7662 ts_tablet_manager.cc:1403] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.006s
I20260709 12:59:49.355520  7663 raft_consensus.cc:359] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.356266  7663 raft_consensus.cc:385] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.356518  7663 raft_consensus.cc:740] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.357044  7671 raft_consensus.cc:493] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.358062  7671 raft_consensus.cc:515] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.358682  7662 raft_consensus.cc:359] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.359360  7662 raft_consensus.cc:385] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.359618  7662 raft_consensus.cc:740] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.360435  7671 leader_election.cc:290] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.360234  7662 consensus_queue.cc:260] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.357547  7663 consensus_queue.cc:260] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.361209  7469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1099dfe065314ab6abfa57cd3932f500" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699" is_pre_election: true
I20260709 12:59:49.354979  7367 catalog_manager.cc:5697] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ceba849111420fb4503a8df965f1f5 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "a7ceba849111420fb4503a8df965f1f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.362710  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1099dfe065314ab6abfa57cd3932f500" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.363059  7663 ts_tablet_manager.cc:1434] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:59:49.363529  7617 raft_consensus.cc:2393] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ceba849111420fb4503a8df965f1f5 in current term 1: Already voted for candidate 94ec8b45c91240f98bfd0bab03ee1699 in this term.
I20260709 12:59:49.363950  7663 tablet_bootstrap.cc:492] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699: Bootstrap starting.
I20260709 12:59:49.363808  7367 catalog_manager.cc:5697] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ceba849111420fb4503a8df965f1f5 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "a7ceba849111420fb4503a8df965f1f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.366588  7662 ts_tablet_manager.cc:1434] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:59:49.365870  7510 leader_election.cc:304] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5; no voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:49.368191  7671 raft_consensus.cc:3060] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.370664  7663 tablet_bootstrap.cc:654] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.377092  7664 tablet_bootstrap.cc:492] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5: No bootstrap required, opened a new log
I20260709 12:59:49.381031  7664 ts_tablet_manager.cc:1403] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.003s
I20260709 12:59:49.384408  7664 raft_consensus.cc:359] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.380270  7671 raft_consensus.cc:2749] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.385946  7664 raft_consensus.cc:385] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.386420  7664 raft_consensus.cc:740] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.387370  7664 consensus_queue.cc:260] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.390314  7664 ts_tablet_manager.cc:1434] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:59:49.391536  7664 tablet_bootstrap.cc:492] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5: Bootstrap starting.
I20260709 12:59:49.397359  7664 tablet_bootstrap.cc:654] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.400278  7671 raft_consensus.cc:493] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.400780  7671 raft_consensus.cc:515] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.402868  7671 leader_election.cc:290] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.404242  7663 tablet_bootstrap.cc:492] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699: No bootstrap required, opened a new log
I20260709 12:59:49.404337  7469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a61a34e48f2410797f2a36f3bb4a23f" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699" is_pre_election: true
I20260709 12:59:49.404688  7663 ts_tablet_manager.cc:1403] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.019s
I20260709 12:59:49.404760  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a61a34e48f2410797f2a36f3bb4a23f" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.404989  7469 raft_consensus.cc:2468] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 0.
I20260709 12:59:49.405393  7617 raft_consensus.cc:2468] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 0.
I20260709 12:59:49.406219  7669 raft_consensus.cc:493] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.406219  7510 leader_election.cc:304] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, a7ceba849111420fb4503a8df965f1f5; no voters: 
I20260709 12:59:49.406788  7669 raft_consensus.cc:515] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.407366  7663 raft_consensus.cc:359] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.407970  7663 raft_consensus.cc:385] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.408221  7663 raft_consensus.cc:740] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.408941  7669 leader_election.cc:290] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.409195  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1f710b74d4c31ab13f4cdf2fc9d4d" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5" is_pre_election: true
I20260709 12:59:49.408955  7663 consensus_queue.cc:260] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.410629  7671 raft_consensus.cc:2804] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.411324  7671 raft_consensus.cc:493] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:49.410910  7436 leader_election.cc:343] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.411788  7671 raft_consensus.cc:3060] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.412165  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1f710b74d4c31ab13f4cdf2fc9d4d" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.412767  7617 raft_consensus.cc:2468] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 0.
I20260709 12:59:49.414204  7666 raft_consensus.cc:493] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.414234  7669 raft_consensus.cc:493] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.414795  7666 raft_consensus.cc:515] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.415010  7669 raft_consensus.cc:515] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.411005  7663 ts_tablet_manager.cc:1434] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:59:49.416836  7666 leader_election.cc:290] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143)
I20260709 12:59:49.417225  7663 tablet_bootstrap.cc:492] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699: Bootstrap starting.
I20260709 12:59:49.418062  7669 leader_election.cc:290] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.422415  7671 raft_consensus.cc:515] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.423729  7663 tablet_bootstrap.cc:654] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.423805  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5" is_pre_election: true
I20260709 12:59:49.424568  7545 raft_consensus.cc:2468] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 0.
I20260709 12:59:49.425153  7671 leader_election.cc:290] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.426175  7585 leader_election.cc:304] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:49.427008  7664 tablet_bootstrap.cc:492] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5: No bootstrap required, opened a new log
I20260709 12:59:49.428582  7664 ts_tablet_manager.cc:1403] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.002s
I20260709 12:59:49.428653  7666 raft_consensus.cc:2804] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.428526  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a61a34e48f2410797f2a36f3bb4a23f" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:49.429152  7666 raft_consensus.cc:493] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.429277  7617 raft_consensus.cc:3060] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.429557  7666 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.429656  7470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a61a34e48f2410797f2a36f3bb4a23f" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:49.430352  7470 raft_consensus.cc:3060] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.434487  7469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699" is_pre_election: true
I20260709 12:59:49.435575  7617 raft_consensus.cc:2468] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 1.
W20260709 12:59:49.435863  7584 leader_election.cc:343] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.435663  7666 raft_consensus.cc:515] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.436740  7664 raft_consensus.cc:359] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.437000  7511 leader_election.cc:304] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:49.437595  7666 leader_election.cc:290] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143)
I20260709 12:59:49.437780  7671 raft_consensus.cc:2804] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.438349  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b058fd0d934cc4892523c4d528d32e" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5" is_pre_election: true
I20260709 12:59:49.438377  7671 raft_consensus.cc:697] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Becoming Leader. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:49.439481  7436 leader_election.cc:304] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: a7ceba849111420fb4503a8df965f1f5
I20260709 12:59:49.440205  7669 raft_consensus.cc:2804] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.439944  7671 consensus_queue.cc:237] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.440546  7669 raft_consensus.cc:493] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.440881  7669 raft_consensus.cc:3060] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.441807  7469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:49.437480  7664 raft_consensus.cc:385] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:49.443243  7584 leader_election.cc:343] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.443352  7664 raft_consensus.cc:740] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.444145  7664 consensus_queue.cc:260] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.447304  7669 raft_consensus.cc:515] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.449174  7664 ts_tablet_manager.cc:1434] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.005s
I20260709 12:59:49.446862  7663 tablet_bootstrap.cc:492] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699: No bootstrap required, opened a new log
I20260709 12:59:49.444572  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:49.450763  7663 ts_tablet_manager.cc:1403] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.003s
I20260709 12:59:49.450601  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1f710b74d4c31ab13f4cdf2fc9d4d" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:49.451228  7544 raft_consensus.cc:3060] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.450982  7545 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.449222  7669 leader_election.cc:290] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 election: Requested vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.453688  7663 raft_consensus.cc:359] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.454113  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1f710b74d4c31ab13f4cdf2fc9d4d" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:49.454389  7663 raft_consensus.cc:385] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.454655  7619 raft_consensus.cc:3060] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.454668  7663 raft_consensus.cc:740] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.455569  7663 consensus_queue.cc:260] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.462301  7470 raft_consensus.cc:2468] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 1.
I20260709 12:59:49.463629  7663 ts_tablet_manager.cc:1434] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:59:49.463050  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b058fd0d934cc4892523c4d528d32e" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.465145  7617 raft_consensus.cc:2393] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94ec8b45c91240f98bfd0bab03ee1699 in current term 1: Already voted for candidate a7ceba849111420fb4503a8df965f1f5 in this term.
I20260709 12:59:49.465656  7545 raft_consensus.cc:2468] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 1.
I20260709 12:59:49.466171  7436 leader_election.cc:304] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699; no voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:49.466779  7585 leader_election.cc:304] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:49.467079  7669 raft_consensus.cc:3060] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.467562  7666 raft_consensus.cc:2804] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.468050  7666 raft_consensus.cc:697] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 1 LEADER]: Becoming Leader. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:49.468936  7544 raft_consensus.cc:2468] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 1.
I20260709 12:59:49.468869  7666 consensus_queue.cc:237] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.470206  7436 leader_election.cc:304] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, a7ceba849111420fb4503a8df965f1f5; no voters: 
I20260709 12:59:49.471057  7689 raft_consensus.cc:2804] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.471515  7689 raft_consensus.cc:697] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Becoming Leader. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:49.470906  7366 catalog_manager.cc:5697] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ceba849111420fb4503a8df965f1f5 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "a7ceba849111420fb4503a8df965f1f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.472529  7669 raft_consensus.cc:2749] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.472285  7689 consensus_queue.cc:237] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.481477  7619 raft_consensus.cc:2468] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 1.
I20260709 12:59:49.491039  7365 catalog_manager.cc:5697] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "db0041a163dc4558b2b3c59afc3996b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.501562  7367 catalog_manager.cc:5697] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.525861  7689 raft_consensus.cc:493] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.526397  7689 raft_consensus.cc:515] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.529017  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.529518  7689 leader_election.cc:290] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693), a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143)
I20260709 12:59:49.529757  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5" is_pre_election: true
I20260709 12:59:49.530614  7544 raft_consensus.cc:2393] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94ec8b45c91240f98bfd0bab03ee1699 in current term 1: Already voted for candidate db0041a163dc4558b2b3c59afc3996b3 in this term.
I20260709 12:59:49.531555  7436 leader_election.cc:304] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699; no voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:49.532279  7689 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.539145  7689 raft_consensus.cc:2749] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.546788  7619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76435aa2977d43e0a701a4672b183511"
dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
mode: GRACEFUL
new_leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
 from {username='slave'} at 127.0.0.1:56988
I20260709 12:59:49.547550  7619 raft_consensus.cc:606] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 1 LEADER]: Received request to transfer leadership to TS 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:49.560948  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
mode: GRACEFUL
new_leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
 from {username='slave'} at 127.0.0.1:42922
I20260709 12:59:49.561430  7544 raft_consensus.cc:606] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Received request to transfer leadership to TS 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:49.578045  7619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9"
dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
mode: GRACEFUL
new_leader_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:56988
I20260709 12:59:49.578675  7619 raft_consensus.cc:606] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 1 LEADER]: Received request to transfer leadership to TS a7ceba849111420fb4503a8df965f1f5
I20260709 12:59:49.580143  7671 consensus_queue.cc:1048] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.595098  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94a1f710b74d4c31ab13f4cdf2fc9d4d"
dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
mode: GRACEFUL
new_leader_uuid: "db0041a163dc4558b2b3c59afc3996b3"
 from {username='slave'} at 127.0.0.1:36536
I20260709 12:59:49.595721  7468 raft_consensus.cc:606] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Received request to transfer leadership to TS db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:49.603293  7690 consensus_queue.cc:1048] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.618978  7619 raft_consensus.cc:3060] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.625706  7689 consensus_queue.cc:1048] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.639694  7688 consensus_queue.cc:1048] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:49.663589  7688 raft_consensus.cc:493] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.664094  7688 raft_consensus.cc:515] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.666157  7690 consensus_queue.cc:1048] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.668092  7688 leader_election.cc:290] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.668892  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db0041a163dc4558b2b3c59afc3996b3" is_pre_election: true
I20260709 12:59:49.671473  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ceba849111420fb4503a8df965f1f5" is_pre_election: true
I20260709 12:59:49.672230  7544 raft_consensus.cc:2393] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94ec8b45c91240f98bfd0bab03ee1699 in current term 1: Already voted for candidate db0041a163dc4558b2b3c59afc3996b3 in this term.
I20260709 12:59:49.673482  7436 leader_election.cc:304] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699; no voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:49.675192  7688 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.682334  7688 raft_consensus.cc:2749] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.685006  7468 raft_consensus.cc:3060] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.693076  7687 consensus_queue.cc:1048] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.697044  7688 consensus_queue.cc:1048] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.704457  7687 raft_consensus.cc:993] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5: : Instructing follower 94ec8b45c91240f98bfd0bab03ee1699 to start an election
I20260709 12:59:49.704885  7687 raft_consensus.cc:1081] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Signalling peer 94ec8b45c91240f98bfd0bab03ee1699 to start an election
I20260709 12:59:49.712672  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d"
dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
 from {username='slave'} at 127.0.0.1:36514
I20260709 12:59:49.713743  7669 consensus_queue.cc:1048] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.721540  7468 raft_consensus.cc:493] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:49.722303  7468 raft_consensus.cc:3060] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:49.729599  7468 raft_consensus.cc:515] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.731680  7468 leader_election.cc:290] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 2 election: Requested vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.732679  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:49.733263  7544 raft_consensus.cc:3055] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:49.733563  7544 raft_consensus.cc:740] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:49.734364  7544 consensus_queue.cc:260] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.735687  7544 raft_consensus.cc:3060] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:49.738766  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:49.739243  7619 raft_consensus.cc:3060] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:49.742080  7544 raft_consensus.cc:2468] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 2.
I20260709 12:59:49.743291  7436 leader_election.cc:304] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, a7ceba849111420fb4503a8df965f1f5; no voters: 
I20260709 12:59:49.744099  7669 raft_consensus.cc:2804] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:49.744302  7619 raft_consensus.cc:2468] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 2.
I20260709 12:59:49.744582  7669 raft_consensus.cc:697] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Becoming Leader. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:49.745777  7669 consensus_queue.cc:237] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.753041  7365 catalog_manager.cc:5697] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 reported cstate change: term changed from 1 to 2, leader changed from a7ceba849111420fb4503a8df965f1f5 (127.7.41.194) to 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193). New cstate: current_term: 2 leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.763442  7687 consensus_queue.cc:1048] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.774298  7671 consensus_queue.cc:1048] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.822578  7666 consensus_queue.cc:1048] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:49.831218  7705 raft_consensus.cc:993] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3: : Instructing follower 94ec8b45c91240f98bfd0bab03ee1699 to start an election
I20260709 12:59:49.832748  7735 raft_consensus.cc:1081] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 1 LEADER]: Signalling peer 94ec8b45c91240f98bfd0bab03ee1699 to start an election
I20260709 12:59:49.837836  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76435aa2977d43e0a701a4672b183511"
dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:59:49.838620  7468 raft_consensus.cc:493] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:49.839074  7468 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:49.845034  7735 consensus_queue.cc:1048] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:49.846695  7468 raft_consensus.cc:515] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.848973  7468 leader_election.cc:290] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 2 election: Requested vote from peers db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693), a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143)
I20260709 12:59:49.849993  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:49.852896  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:49.853499  7619 raft_consensus.cc:3055] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:49.853827  7619 raft_consensus.cc:740] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:49.854661  7619 consensus_queue.cc:260] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.856185  7619 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:49.864094  7619 raft_consensus.cc:2468] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 2.
I20260709 12:59:49.865264  7436 leader_election.cc:304] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: a7ceba849111420fb4503a8df965f1f5
I20260709 12:59:49.865890  7735 consensus_queue.cc:1048] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.866216  7669 raft_consensus.cc:2804] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:49.866804  7669 raft_consensus.cc:697] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Becoming Leader. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:49.867679  7669 consensus_queue.cc:237] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:49.875378  7366 catalog_manager.cc:5697] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 reported cstate change: term changed from 1 to 2, leader changed from db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195) to 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193). New cstate: current_term: 2 leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.884419  7705 consensus_queue.cc:1048] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.894495  7735 raft_consensus.cc:993] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3: : Instructing follower a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:49.895144  7705 raft_consensus.cc:1081] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 1 LEADER]: Signalling peer a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:49.897184  7544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:42910
I20260709 12:59:49.897723  7544 raft_consensus.cc:493] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:49.898128  7544 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:49.905516  7544 raft_consensus.cc:515] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.908226  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:49.908831  7468 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:49.909008  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:49.909600  7619 raft_consensus.cc:3055] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:49.909930  7619 raft_consensus.cc:740] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:49.910745  7619 consensus_queue.cc:260] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.911775  7619 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:49.913160  7544 leader_election.cc:290] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 2 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:49.915367  7468 raft_consensus.cc:2468] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 2.
I20260709 12:59:49.916348  7510 leader_election.cc:304] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, a7ceba849111420fb4503a8df965f1f5; no voters: 
I20260709 12:59:49.917002  7671 raft_consensus.cc:2804] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:49.917421  7671 raft_consensus.cc:697] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Becoming Leader. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:49.918213  7671 consensus_queue.cc:237] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:49.918402  7619 raft_consensus.cc:2468] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 2.
I20260709 12:59:49.924759  7366 catalog_manager.cc:5697] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 reported cstate change: term changed from 1 to 2, leader changed from db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195) to a7ceba849111420fb4503a8df965f1f5 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "a7ceba849111420fb4503a8df965f1f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.971331  7669 consensus_queue.cc:1048] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.978183  7688 raft_consensus.cc:993] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699: : Instructing follower db0041a163dc4558b2b3c59afc3996b3 to start an election
I20260709 12:59:49.978619  7688 raft_consensus.cc:1081] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Signalling peer db0041a163dc4558b2b3c59afc3996b3 to start an election
I20260709 12:59:49.980027  7688 consensus_queue.cc:1048] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.984550  7617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94a1f710b74d4c31ab13f4cdf2fc9d4d"
dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:59:49.986388  7617 raft_consensus.cc:493] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:49.986799  7617 raft_consensus.cc:3060] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:49.994181  7617 raft_consensus.cc:515] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:50.000600  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1f710b74d4c31ab13f4cdf2fc9d4d" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:50.001101  7468 raft_consensus.cc:3055] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:50.001412  7468 raft_consensus.cc:740] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:50.002200  7468 consensus_queue.cc:260] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:50.003295  7468 raft_consensus.cc:3060] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:50.008356  7468 raft_consensus.cc:2468] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 2.
I20260709 12:59:50.009269  7584 leader_election.cc:304] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:50.010078  7705 raft_consensus.cc:2804] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:50.010545  7705 raft_consensus.cc:697] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 2 LEADER]: Becoming Leader. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:50.011255  7705 consensus_queue.cc:237] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:50.009586  7617 leader_election.cc:290] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 2 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143)
I20260709 12:59:50.013356  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a1f710b74d4c31ab13f4cdf2fc9d4d" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:50.013936  7544 raft_consensus.cc:3060] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:50.018378  7365 catalog_manager.cc:5697] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 reported cstate change: term changed from 1 to 2, leader changed from 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193) to db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "db0041a163dc4558b2b3c59afc3996b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:50.021173  7544 raft_consensus.cc:2468] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 2.
I20260709 12:59:50.024283  7671 consensus_queue.cc:1048] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:50.038872  7690 consensus_queue.cc:1048] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:50.132041  7617 raft_consensus.cc:1275] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Refusing update from remote peer 94ec8b45c91240f98bfd0bab03ee1699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:50.133287  7689 consensus_queue.cc:1048] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:50.140587  7544 raft_consensus.cc:1275] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Refusing update from remote peer 94ec8b45c91240f98bfd0bab03ee1699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:50.143061  7669 consensus_queue.cc:1048] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:50.285713  7544 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:50.291020  7544 raft_consensus.cc:1275] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Refusing update from remote peer 94ec8b45c91240f98bfd0bab03ee1699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:50.292243  7669 consensus_queue.cc:1048] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:50.302768  7617 raft_consensus.cc:1275] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Refusing update from remote peer 94ec8b45c91240f98bfd0bab03ee1699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:50.304066  7689 consensus_queue.cc:1048] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:50.334826  7617 raft_consensus.cc:1275] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:50.336043  7742 consensus_queue.cc:1048] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:50.343708  7468 raft_consensus.cc:1275] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:50.345121  7687 consensus_queue.cc:1048] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:50.502672  7468 raft_consensus.cc:1275] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Refusing update from remote peer db0041a163dc4558b2b3c59afc3996b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:50.504062  7705 consensus_queue.cc:1048] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:50.514371  7544 raft_consensus.cc:1275] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Refusing update from remote peer db0041a163dc4558b2b3c59afc3996b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:50.518410  7705 consensus_queue.cc:1048] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:52.623721  7335 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:59:52.624850  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:52.641530  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
mode: GRACEFUL
new_leader_uuid: "db0041a163dc4558b2b3c59afc3996b3"
 from {username='slave'} at 127.0.0.1:56324
I20260709 12:59:52.642005  7544 raft_consensus.cc:606] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Received request to transfer leadership to TS db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:52.651727  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76435aa2977d43e0a701a4672b183511"
dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
mode: GRACEFUL
new_leader_uuid: "db0041a163dc4558b2b3c59afc3996b3"
 from {username='slave'} at 127.0.0.1:53404
I20260709 12:59:52.652262  7468 raft_consensus.cc:606] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Received request to transfer leadership to TS db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:52.653344  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:52.653784  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:52.901369  7669 raft_consensus.cc:993] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699: : Instructing follower db0041a163dc4558b2b3c59afc3996b3 to start an election
I20260709 12:59:52.901816  7748 raft_consensus.cc:1081] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Signalling peer db0041a163dc4558b2b3c59afc3996b3 to start an election
I20260709 12:59:52.903174  7619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76435aa2977d43e0a701a4672b183511"
dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:59:52.903638  7619 raft_consensus.cc:493] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:52.903928  7619 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.909021  7619 raft_consensus.cc:515] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:52.910512  7619 leader_election.cc:290] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 3 election: Requested vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829)
I20260709 12:59:52.911233  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:52.911453  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:52.911819  7544 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.911942  7468 raft_consensus.cc:3055] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:52.912292  7468 raft_consensus.cc:740] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:52.913065  7468 consensus_queue.cc:260] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:52.914242  7468 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.918241  7544 raft_consensus.cc:2468] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 3.
I20260709 12:59:52.919415  7585 leader_election.cc:304] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:52.920068  7746 raft_consensus.cc:2804] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:52.920156  7468 raft_consensus.cc:2468] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 3.
I20260709 12:59:52.921316  7746 raft_consensus.cc:697] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 3 LEADER]: Becoming Leader. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:52.922125  7746 consensus_queue.cc:237] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:52.928267  7365 catalog_manager.cc:5697] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 reported cstate change: term changed from 2 to 3, leader changed from 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193) to db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "db0041a163dc4558b2b3c59afc3996b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.013499  7687 raft_consensus.cc:993] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5: : Instructing follower db0041a163dc4558b2b3c59afc3996b3 to start an election
I20260709 12:59:53.013911  7758 raft_consensus.cc:1081] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Signalling peer db0041a163dc4558b2b3c59afc3996b3 to start an election
I20260709 12:59:53.015501  7619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9"
dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
 from {username='slave'} at 127.0.0.1:56966
I20260709 12:59:53.015990  7619 raft_consensus.cc:493] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:53.016302  7619 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.020591  7619 raft_consensus.cc:515] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:53.022176  7619 leader_election.cc:290] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 3 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143)
I20260709 12:59:53.023048  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:53.023157  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:53.023538  7468 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.023690  7544 raft_consensus.cc:3055] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:53.024060  7544 raft_consensus.cc:740] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:53.024799  7544 consensus_queue.cc:260] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:53.025836  7544 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.029119  7468 raft_consensus.cc:2468] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 3.
I20260709 12:59:53.029992  7584 leader_election.cc:304] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:53.030592  7544 raft_consensus.cc:2468] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 3.
I20260709 12:59:53.030689  7746 raft_consensus.cc:2804] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:53.031334  7746 raft_consensus.cc:697] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 3 LEADER]: Becoming Leader. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:53.032101  7746 consensus_queue.cc:237] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:53.039045  7365 catalog_manager.cc:5697] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 reported cstate change: term changed from 2 to 3, leader changed from a7ceba849111420fb4503a8df965f1f5 (127.7.41.194) to db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "db0041a163dc4558b2b3c59afc3996b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:53.327903  7468 raft_consensus.cc:1275] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Refusing update from remote peer db0041a163dc4558b2b3c59afc3996b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:53.329144  7746 consensus_queue.cc:1048] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.338388  7544 raft_consensus.cc:1275] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Refusing update from remote peer db0041a163dc4558b2b3c59afc3996b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:53.340092  7752 consensus_queue.cc:1048] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.517334  7468 raft_consensus.cc:1275] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Refusing update from remote peer db0041a163dc4558b2b3c59afc3996b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:53.518563  7752 consensus_queue.cc:1048] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.527637  7545 raft_consensus.cc:1275] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Refusing update from remote peer db0041a163dc4558b2b3c59afc3996b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:53.529219  7766 consensus_queue.cc:1048] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.654601  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:53.664795  7619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76435aa2977d43e0a701a4672b183511"
dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
mode: GRACEFUL
new_leader_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:56988
I20260709 12:59:53.665313  7619 raft_consensus.cc:606] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 3 LEADER]: Received request to transfer leadership to TS a7ceba849111420fb4503a8df965f1f5
I20260709 12:59:53.670198  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d"
dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
mode: GRACEFUL
new_leader_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:36536
I20260709 12:59:53.670627  7468 raft_consensus.cc:606] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Received request to transfer leadership to TS a7ceba849111420fb4503a8df965f1f5
I20260709 12:59:53.675146  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1099dfe065314ab6abfa57cd3932f500"
dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
mode: GRACEFUL
new_leader_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:36536
I20260709 12:59:53.675556  7468 raft_consensus.cc:606] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Received request to transfer leadership to TS a7ceba849111420fb4503a8df965f1f5
I20260709 12:59:53.679662  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e310b1b76404260958260e6ee358084"
dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
mode: GRACEFUL
new_leader_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:36536
I20260709 12:59:53.680083  7468 raft_consensus.cc:606] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Received request to transfer leadership to TS a7ceba849111420fb4503a8df965f1f5
I20260709 12:59:53.691046  7619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9"
dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
mode: GRACEFUL
new_leader_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:56988
I20260709 12:59:53.691476  7619 raft_consensus.cc:606] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 3 LEADER]: Received request to transfer leadership to TS a7ceba849111420fb4503a8df965f1f5
I20260709 12:59:53.847488  7752 raft_consensus.cc:993] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3: : Instructing follower a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:53.848013  7766 raft_consensus.cc:1081] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 3 LEADER]: Signalling peer a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:53.849385  7544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76435aa2977d43e0a701a4672b183511"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:42910
I20260709 12:59:53.849900  7544 raft_consensus.cc:493] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:53.850270  7544 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.854918  7544 raft_consensus.cc:515] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:53.856796  7544 leader_election.cc:290] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 4 election: Requested vote from peers db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693), 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829)
I20260709 12:59:53.857472  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:53.857897  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:53.858011  7619 raft_consensus.cc:3055] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:53.858461  7619 raft_consensus.cc:740] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:53.858505  7468 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.859179  7619 consensus_queue.cc:260] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:53.860044  7619 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.863334  7468 raft_consensus.cc:2468] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 4.
I20260709 12:59:53.864261  7510 leader_election.cc:304] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, a7ceba849111420fb4503a8df965f1f5; no voters: 
I20260709 12:59:53.864476  7619 raft_consensus.cc:2468] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 4.
I20260709 12:59:53.865056  7758 raft_consensus.cc:2804] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:53.866228  7758 raft_consensus.cc:697] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 4 LEADER]: Becoming Leader. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:53.867046  7758 consensus_queue.cc:237] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:53.872788  7367 catalog_manager.cc:5697] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 reported cstate change: term changed from 3 to 4, leader changed from db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195) to a7ceba849111420fb4503a8df965f1f5 (127.7.41.194). New cstate: current_term: 4 leader_uuid: "a7ceba849111420fb4503a8df965f1f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:53.960551  7748 raft_consensus.cc:993] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699: : Instructing follower a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:53.961017  7772 raft_consensus.cc:1081] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Signalling peer a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:53.962340  7544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e310b1b76404260958260e6ee358084"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:42906
I20260709 12:59:53.962704  7544 raft_consensus.cc:493] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:53.962939  7544 raft_consensus.cc:3060] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:53.966813  7544 raft_consensus.cc:515] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:53.968130  7544 leader_election.cc:290] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 2 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:53.968915  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e310b1b76404260958260e6ee358084" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:53.969116  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e310b1b76404260958260e6ee358084" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:53.969424  7468 raft_consensus.cc:3055] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:53.969651  7619 raft_consensus.cc:3060] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:53.969744  7468 raft_consensus.cc:740] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:53.970485  7468 consensus_queue.cc:260] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:53.971252  7468 raft_consensus.cc:3060] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:53.973959  7619 raft_consensus.cc:2468] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 2.
I20260709 12:59:53.975016  7468 raft_consensus.cc:2468] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 2.
I20260709 12:59:53.974995  7511 leader_election.cc:304] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:53.975837  7758 raft_consensus.cc:2804] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:53.976298  7758 raft_consensus.cc:697] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Becoming Leader. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:53.976941  7758 consensus_queue.cc:237] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:53.984578  7367 catalog_manager.cc:5697] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 reported cstate change: term changed from 1 to 2, leader changed from 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193) to a7ceba849111420fb4503a8df965f1f5 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "a7ceba849111420fb4503a8df965f1f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.014005  7748 raft_consensus.cc:993] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699: : Instructing follower a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:54.014485  7772 raft_consensus.cc:1081] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Signalling peer a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:54.015786  7544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1099dfe065314ab6abfa57cd3932f500"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:42906
I20260709 12:59:54.016279  7544 raft_consensus.cc:493] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:54.016597  7544 raft_consensus.cc:3060] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:54.020298  7544 raft_consensus.cc:515] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:54.021489  7544 leader_election.cc:290] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 2 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:54.022277  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1099dfe065314ab6abfa57cd3932f500" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:54.022522  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1099dfe065314ab6abfa57cd3932f500" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:54.022804  7468 raft_consensus.cc:3055] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:54.022986  7619 raft_consensus.cc:3060] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:54.023110  7468 raft_consensus.cc:740] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:54.023820  7468 consensus_queue.cc:260] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:54.024883  7468 raft_consensus.cc:3060] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:54.028707  7619 raft_consensus.cc:2468] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 2.
I20260709 12:59:54.029958  7511 leader_election.cc:304] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ceba849111420fb4503a8df965f1f5, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:54.030224  7468 raft_consensus.cc:2468] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 2.
I20260709 12:59:54.030762  7758 raft_consensus.cc:2804] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:54.031163  7758 raft_consensus.cc:697] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Becoming Leader. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:54.031869  7758 consensus_queue.cc:237] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:54.037506  7367 catalog_manager.cc:5697] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 reported cstate change: term changed from 1 to 2, leader changed from 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193) to a7ceba849111420fb4503a8df965f1f5 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "a7ceba849111420fb4503a8df965f1f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.089553  7748 raft_consensus.cc:993] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699: : Instructing follower a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:54.090065  7772 raft_consensus.cc:1081] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Signalling peer a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:54.091472  7544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:42906
I20260709 12:59:54.091902  7544 raft_consensus.cc:493] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:54.092164  7544 raft_consensus.cc:3060] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.096004  7544 raft_consensus.cc:515] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:54.097311  7544 leader_election.cc:290] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 3 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:54.098220  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:54.098328  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5437381224640a4ba3bc8b50c56868d" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:54.098658  7468 raft_consensus.cc:3055] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:54.098827  7619 raft_consensus.cc:3060] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.098948  7468 raft_consensus.cc:740] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:54.099694  7468 consensus_queue.cc:260] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:54.100483  7468 raft_consensus.cc:3060] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:54.105680  7468 raft_consensus.cc:2468] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 3.
I20260709 12:59:54.106197  7619 raft_consensus.cc:2468] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 3.
I20260709 12:59:54.106552  7510 leader_election.cc:304] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, a7ceba849111420fb4503a8df965f1f5; no voters: 
I20260709 12:59:54.107225  7758 raft_consensus.cc:2804] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:54.107647  7758 raft_consensus.cc:697] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 3 LEADER]: Becoming Leader. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:54.108335  7758 consensus_queue.cc:237] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:54.113827  7367 catalog_manager.cc:5697] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 reported cstate change: term changed from 2 to 3, leader changed from 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193) to a7ceba849111420fb4503a8df965f1f5 (127.7.41.194). New cstate: current_term: 3 leader_uuid: "a7ceba849111420fb4503a8df965f1f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.133857  7766 raft_consensus.cc:993] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3: : Instructing follower a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:54.134327  7746 raft_consensus.cc:1081] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 3 LEADER]: Signalling peer a7ceba849111420fb4503a8df965f1f5 to start an election
I20260709 12:59:54.135680  7544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
 from {username='slave'} at 127.0.0.1:42910
I20260709 12:59:54.136113  7544 raft_consensus.cc:493] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:54.136461  7544 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.140586  7544 raft_consensus.cc:515] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:54.142078  7544 leader_election.cc:290] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 4 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:54.143164  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:54.143203  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4918b1d7228f42dfaefaeef25c5debb9" candidate_uuid: "a7ceba849111420fb4503a8df965f1f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:54.143959  7468 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.144023  7619 raft_consensus.cc:3055] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:54.144435  7619 raft_consensus.cc:740] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:54.145257  7619 consensus_queue.cc:260] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:54.146551  7619 raft_consensus.cc:3060] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.149477  7468 raft_consensus.cc:2468] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 4.
I20260709 12:59:54.150380  7510 leader_election.cc:304] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, a7ceba849111420fb4503a8df965f1f5; no voters: 
I20260709 12:59:54.151136  7758 raft_consensus.cc:2804] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:54.151580  7758 raft_consensus.cc:697] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 4 LEADER]: Becoming Leader. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:54.152562  7619 raft_consensus.cc:2468] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ceba849111420fb4503a8df965f1f5 in term 4.
I20260709 12:59:54.152324  7758 consensus_queue.cc:237] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:54.157737  7367 catalog_manager.cc:5697] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 reported cstate change: term changed from 3 to 4, leader changed from db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195) to a7ceba849111420fb4503a8df965f1f5 (127.7.41.194). New cstate: current_term: 4 leader_uuid: "a7ceba849111420fb4503a8df965f1f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.286775  7468 raft_consensus.cc:1275] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 4 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:54.287963  7758 consensus_queue.cc:1048] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.297924  7619 raft_consensus.cc:1275] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 4 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:54.299675  7778 consensus_queue.cc:1048] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.484169  7468 raft_consensus.cc:1275] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:54.485491  7778 consensus_queue.cc:1048] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:54.493554  7619 raft_consensus.cc:1275] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:54.495819  7468 raft_consensus.cc:1275] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:54.496074  7768 consensus_queue.cc:1048] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:54.497186  7758 consensus_queue.cc:1048] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:54.509583  7617 raft_consensus.cc:1275] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:54.511245  7768 consensus_queue.cc:1048] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:54.572443  7468 raft_consensus.cc:1275] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 4 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:54.573439  7768 consensus_queue.cc:1048] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.581770  7617 raft_consensus.cc:1275] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 4 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:54.583885  7758 consensus_queue.cc:1048] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.671869  7468 raft_consensus.cc:1275] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:54.672979  7758 consensus_queue.cc:1048] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:54.682773  7617 raft_consensus.cc:1275] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Refusing update from remote peer a7ceba849111420fb4503a8df965f1f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:54.684329  7778 consensus_queue.cc:1048] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:56.695693  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:56.703495  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e310b1b76404260958260e6ee358084"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
mode: GRACEFUL
new_leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
 from {username='slave'} at 127.0.0.1:56324
I20260709 12:59:56.704262  7544 raft_consensus.cc:606] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Received request to transfer leadership to TS 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:56.706972  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25ffb5c4430d4fc587687d29b9359c75"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
mode: GRACEFUL
new_leader_uuid: "db0041a163dc4558b2b3c59afc3996b3"
 from {username='slave'} at 127.0.0.1:56324
I20260709 12:59:56.707399  7544 raft_consensus.cc:606] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Received request to transfer leadership to TS db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:56.709542  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a61a34e48f2410797f2a36f3bb4a23f"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
mode: GRACEFUL
new_leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
 from {username='slave'} at 127.0.0.1:56324
I20260709 12:59:56.709959  7544 raft_consensus.cc:606] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Received request to transfer leadership to TS 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:56.711975  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44b058fd0d934cc4892523c4d528d32e"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
mode: GRACEFUL
new_leader_uuid: "db0041a163dc4558b2b3c59afc3996b3"
 from {username='slave'} at 127.0.0.1:56324
I20260709 12:59:56.712389  7544 raft_consensus.cc:606] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Received request to transfer leadership to TS db0041a163dc4558b2b3c59afc3996b3
I20260709 12:59:56.714588  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76435aa2977d43e0a701a4672b183511"
dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
mode: GRACEFUL
new_leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
 from {username='slave'} at 127.0.0.1:56324
I20260709 12:59:56.714993  7544 raft_consensus.cc:606] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 4 LEADER]: Received request to transfer leadership to TS 94ec8b45c91240f98bfd0bab03ee1699
I20260709 12:59:56.715974  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:56.716420  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:56.885070  7778 raft_consensus.cc:993] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5: : Instructing follower 94ec8b45c91240f98bfd0bab03ee1699 to start an election
I20260709 12:59:56.885638  7789 raft_consensus.cc:1081] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 4 LEADER]: Signalling peer 94ec8b45c91240f98bfd0bab03ee1699 to start an election
I20260709 12:59:56.887368  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76435aa2977d43e0a701a4672b183511"
dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
 from {username='slave'} at 127.0.0.1:36514
I20260709 12:59:56.887959  7468 raft_consensus.cc:493] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.888399  7468 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.889627  7789 raft_consensus.cc:993] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5: : Instructing follower db0041a163dc4558b2b3c59afc3996b3 to start an election
I20260709 12:59:56.890147  7778 raft_consensus.cc:1081] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Signalling peer db0041a163dc4558b2b3c59afc3996b3 to start an election
I20260709 12:59:56.891702  7617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44b058fd0d934cc4892523c4d528d32e"
dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
 from {username='slave'} at 127.0.0.1:56966
I20260709 12:59:56.892241  7617 raft_consensus.cc:493] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.892582  7617 raft_consensus.cc:3060] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.896396  7468 raft_consensus.cc:515] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:56.898859  7468 leader_election.cc:290] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 5 election: Requested vote from peers db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693), a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143)
I20260709 12:59:56.899612  7617 raft_consensus.cc:515] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:56.899972  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:56.900060  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76435aa2977d43e0a701a4672b183511" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:56.900823  7619 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.900866  7544 raft_consensus.cc:3055] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:56.901358  7544 raft_consensus.cc:740] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:56.902226  7617 leader_election.cc:290] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 2 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143)
I20260709 12:59:56.902549  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b058fd0d934cc4892523c4d528d32e" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:56.902197  7544 consensus_queue.cc:260] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:56.903112  7468 raft_consensus.cc:3060] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.903630  7544 raft_consensus.cc:3060] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.907627  7468 raft_consensus.cc:2468] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 2.
I20260709 12:59:56.907662  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b058fd0d934cc4892523c4d528d32e" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:56.908324  7619 raft_consensus.cc:2468] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 5.
I20260709 12:59:56.908337  7545 raft_consensus.cc:3055] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:56.908931  7545 raft_consensus.cc:740] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:56.909085  7584 leader_election.cc:304] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:56.910056  7544 raft_consensus.cc:2468] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 5.
I20260709 12:59:56.910163  7746 raft_consensus.cc:2804] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:56.909718  7545 consensus_queue.cc:260] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:56.910725  7436 leader_election.cc:304] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:56.911195  7545 raft_consensus.cc:3060] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.911598  7746 raft_consensus.cc:697] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 2 LEADER]: Becoming Leader. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:56.912643  7746 consensus_queue.cc:237] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:56.920024  7791 raft_consensus.cc:2804] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:56.921279  7791 raft_consensus.cc:697] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 5 LEADER]: Becoming Leader. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:56.921917  7545 raft_consensus.cc:2468] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 2.
I20260709 12:59:56.921895  7366 catalog_manager.cc:5697] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 reported cstate change: term changed from 1 to 2, leader changed from a7ceba849111420fb4503a8df965f1f5 (127.7.41.194) to db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "db0041a163dc4558b2b3c59afc3996b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.922248  7791 consensus_queue.cc:237] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } }
I20260709 12:59:56.931083  7367 catalog_manager.cc:5697] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 reported cstate change: term changed from 4 to 5, leader changed from a7ceba849111420fb4503a8df965f1f5 (127.7.41.194) to 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193). New cstate: current_term: 5 leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.968024  7789 raft_consensus.cc:993] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5: : Instructing follower 94ec8b45c91240f98bfd0bab03ee1699 to start an election
I20260709 12:59:56.968468  7789 raft_consensus.cc:1081] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Signalling peer 94ec8b45c91240f98bfd0bab03ee1699 to start an election
I20260709 12:59:56.969777  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a61a34e48f2410797f2a36f3bb4a23f"
dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
 from {username='slave'} at 127.0.0.1:36514
I20260709 12:59:56.970325  7468 raft_consensus.cc:493] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:56.970577  7468 raft_consensus.cc:3060] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.974472  7468 raft_consensus.cc:515] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:56.975817  7468 leader_election.cc:290] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 2 election: Requested vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:56.976847  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a61a34e48f2410797f2a36f3bb4a23f" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:56.977010  7619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a61a34e48f2410797f2a36f3bb4a23f" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:56.977391  7545 raft_consensus.cc:3055] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:56.977535  7619 raft_consensus.cc:3060] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.977782  7545 raft_consensus.cc:740] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:56.978670  7545 consensus_queue.cc:260] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:56.979846  7545 raft_consensus.cc:3060] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:56.982349  7619 raft_consensus.cc:2468] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 2.
I20260709 12:59:56.983281  7436 leader_election.cc:304] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:56.984094  7791 raft_consensus.cc:2804] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:56.984508  7791 raft_consensus.cc:697] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Becoming Leader. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:56.985335  7791 consensus_queue.cc:237] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:56.985617  7545 raft_consensus.cc:2468] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 2.
I20260709 12:59:56.993278  7367 catalog_manager.cc:5697] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 reported cstate change: term changed from 1 to 2, leader changed from a7ceba849111420fb4503a8df965f1f5 (127.7.41.194) to 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193). New cstate: current_term: 2 leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.092149  7778 raft_consensus.cc:993] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5: : Instructing follower 94ec8b45c91240f98bfd0bab03ee1699 to start an election
I20260709 12:59:57.092624  7789 raft_consensus.cc:1081] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Signalling peer 94ec8b45c91240f98bfd0bab03ee1699 to start an election
I20260709 12:59:57.093957  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e310b1b76404260958260e6ee358084"
dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
 from {username='slave'} at 127.0.0.1:36514
I20260709 12:59:57.094200  7778 raft_consensus.cc:993] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5: : Instructing follower db0041a163dc4558b2b3c59afc3996b3 to start an election
I20260709 12:59:57.094548  7468 raft_consensus.cc:493] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:57.094691  7789 raft_consensus.cc:1081] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Signalling peer db0041a163dc4558b2b3c59afc3996b3 to start an election
I20260709 12:59:57.094949  7468 raft_consensus.cc:3060] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.096091  7619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25ffb5c4430d4fc587687d29b9359c75"
dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
 from {username='slave'} at 127.0.0.1:56966
I20260709 12:59:57.096575  7619 raft_consensus.cc:493] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:57.096855  7619 raft_consensus.cc:3060] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.099272  7468 raft_consensus.cc:515] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:57.100736  7468 leader_election.cc:290] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 3 election: Requested vote from peers a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143), db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195:33693)
I20260709 12:59:57.100889  7619 raft_consensus.cc:515] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:57.101711  7617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e310b1b76404260958260e6ee358084" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "db0041a163dc4558b2b3c59afc3996b3"
I20260709 12:59:57.101841  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e310b1b76404260958260e6ee358084" candidate_uuid: "94ec8b45c91240f98bfd0bab03ee1699" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:57.102166  7617 raft_consensus.cc:3060] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.102464  7545 raft_consensus.cc:3055] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:57.102883  7545 raft_consensus.cc:740] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:57.103562  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ffb5c4430d4fc587687d29b9359c75" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94ec8b45c91240f98bfd0bab03ee1699"
I20260709 12:59:57.103801  7619 leader_election.cc:290] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 2 election: Requested vote from peers 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829), a7ceba849111420fb4503a8df965f1f5 (127.7.41.194:43143)
I20260709 12:59:57.104126  7468 raft_consensus.cc:3060] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.103897  7545 consensus_queue.cc:260] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:57.105232  7545 raft_consensus.cc:3060] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:57.106429  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25ffb5c4430d4fc587687d29b9359c75" candidate_uuid: "db0041a163dc4558b2b3c59afc3996b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ceba849111420fb4503a8df965f1f5"
I20260709 12:59:57.106974  7544 raft_consensus.cc:3055] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:57.107302  7544 raft_consensus.cc:740] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ceba849111420fb4503a8df965f1f5, State: Running, Role: LEADER
I20260709 12:59:57.107803  7617 raft_consensus.cc:2468] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 3.
I20260709 12:59:57.108031  7544 consensus_queue.cc:260] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:57.108801  7436 leader_election.cc:304] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:57.109150  7544 raft_consensus.cc:3060] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.109570  7791 raft_consensus.cc:2804] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:57.109824  7468 raft_consensus.cc:2468] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 2.
I20260709 12:59:57.110422  7791 raft_consensus.cc:697] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 LEADER]: Becoming Leader. State: Replica: 94ec8b45c91240f98bfd0bab03ee1699, State: Running, Role: LEADER
I20260709 12:59:57.110888  7584 leader_election.cc:304] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94ec8b45c91240f98bfd0bab03ee1699, db0041a163dc4558b2b3c59afc3996b3; no voters: 
I20260709 12:59:57.111713  7746 raft_consensus.cc:2804] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:57.112182  7746 raft_consensus.cc:697] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 2 LEADER]: Becoming Leader. State: Replica: db0041a163dc4558b2b3c59afc3996b3, State: Running, Role: LEADER
I20260709 12:59:57.113302  7545 raft_consensus.cc:2468] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94ec8b45c91240f98bfd0bab03ee1699 in term 3.
I20260709 12:59:57.113095  7746 consensus_queue.cc:237] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:57.113878  7791 consensus_queue.cc:237] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } }
I20260709 12:59:57.115617  7544 raft_consensus.cc:2468] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db0041a163dc4558b2b3c59afc3996b3 in term 2.
I20260709 12:59:57.121167  7367 catalog_manager.cc:5697] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 reported cstate change: term changed from 2 to 3, leader changed from a7ceba849111420fb4503a8df965f1f5 (127.7.41.194) to 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193). New cstate: current_term: 3 leader_uuid: "94ec8b45c91240f98bfd0bab03ee1699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.122251  7366 catalog_manager.cc:5697] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 reported cstate change: term changed from 1 to 2, leader changed from a7ceba849111420fb4503a8df965f1f5 (127.7.41.194) to db0041a163dc4558b2b3c59afc3996b3 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "db0041a163dc4558b2b3c59afc3996b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.304483  7544 raft_consensus.cc:1275] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Refusing update from remote peer db0041a163dc4558b2b3c59afc3996b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:57.305720  7746 consensus_queue.cc:1048] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:57.315356  7468 raft_consensus.cc:1275] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Refusing update from remote peer db0041a163dc4558b2b3c59afc3996b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:57.317348  7790 consensus_queue.cc:1048] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:57.415859  7544 raft_consensus.cc:1275] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Refusing update from remote peer 94ec8b45c91240f98bfd0bab03ee1699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:57.417089  7791 consensus_queue.cc:1048] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:57.426075  7617 raft_consensus.cc:1275] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Refusing update from remote peer 94ec8b45c91240f98bfd0bab03ee1699: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:57.428069  7793 consensus_queue.cc:1048] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:57.431757  7619 raft_consensus.cc:1275] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 5 FOLLOWER]: Refusing update from remote peer 94ec8b45c91240f98bfd0bab03ee1699: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:57.433084  7793 consensus_queue.cc:1048] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:57.443288  7544 raft_consensus.cc:1275] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 5 FOLLOWER]: Refusing update from remote peer 94ec8b45c91240f98bfd0bab03ee1699: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:57.446115  7791 consensus_queue.cc:1048] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:57.564312  7544 raft_consensus.cc:1275] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Refusing update from remote peer 94ec8b45c91240f98bfd0bab03ee1699: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:57.565516  7791 consensus_queue.cc:1048] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.574497  7619 raft_consensus.cc:1275] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Refusing update from remote peer 94ec8b45c91240f98bfd0bab03ee1699: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:57.576589  7811 consensus_queue.cc:1048] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db0041a163dc4558b2b3c59afc3996b3" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 33693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.680445  7544 raft_consensus.cc:1275] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Refusing update from remote peer db0041a163dc4558b2b3c59afc3996b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:57.681540  7790 consensus_queue.cc:1048] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ceba849111420fb4503a8df965f1f5" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:57.689641  7468 raft_consensus.cc:1275] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Refusing update from remote peer db0041a163dc4558b2b3c59afc3996b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:57.691011  7790 consensus_queue.cc:1048] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94ec8b45c91240f98bfd0bab03ee1699" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:57.717213  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:57.722350  7335 tablet_server.cc:179] TabletServer@127.7.41.193:0 shutting down...
W20260709 12:59:57.733423  7584 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:59:57.738343  7584 consensus_peers.cc:597] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 -> Peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Couldn't send request to peer 94ec8b45c91240f98bfd0bab03ee1699. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:57.756357  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:57.757205  7335 tablet_replica.cc:333] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699: stopping tablet replica
I20260709 12:59:57.758128  7335 raft_consensus.cc:2243] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.758665  7335 raft_consensus.cc:2272] T 4918b1d7228f42dfaefaeef25c5debb9 P 94ec8b45c91240f98bfd0bab03ee1699 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.760780  7335 tablet_replica.cc:333] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699: stopping tablet replica
I20260709 12:59:57.761271  7335 raft_consensus.cc:2243] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:59:57.761951  7335 raft_consensus.cc:2272] T 76435aa2977d43e0a701a4672b183511 P 94ec8b45c91240f98bfd0bab03ee1699 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.763983  7335 tablet_replica.cc:333] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699: stopping tablet replica
I20260709 12:59:57.764475  7335 raft_consensus.cc:2243] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.764945  7335 raft_consensus.cc:2272] T f5437381224640a4ba3bc8b50c56868d P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.766515  7335 tablet_replica.cc:333] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699: stopping tablet replica
I20260709 12:59:57.766981  7335 raft_consensus.cc:2243] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:57.767634  7335 raft_consensus.cc:2272] T 1e310b1b76404260958260e6ee358084 P 94ec8b45c91240f98bfd0bab03ee1699 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.769490  7335 tablet_replica.cc:333] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699: stopping tablet replica
I20260709 12:59:57.769986  7335 raft_consensus.cc:2243] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.770458  7335 raft_consensus.cc:2272] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.771940  7335 tablet_replica.cc:333] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699: stopping tablet replica
I20260709 12:59:57.772397  7335 raft_consensus.cc:2243] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.772761  7335 raft_consensus.cc:2272] T 25ffb5c4430d4fc587687d29b9359c75 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.774690  7335 tablet_replica.cc:333] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699: stopping tablet replica
I20260709 12:59:57.775326  7335 raft_consensus.cc:2243] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.775825  7335 raft_consensus.cc:2272] T 44b058fd0d934cc4892523c4d528d32e P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:57.778215  7584 consensus_peers.cc:597] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 -> Peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Couldn't send request to peer 94ec8b45c91240f98bfd0bab03ee1699. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:57.778584  7335 tablet_replica.cc:333] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699: stopping tablet replica
I20260709 12:59:57.779238  7335 raft_consensus.cc:2243] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:57.780064  7335 raft_consensus.cc:2272] T 2a61a34e48f2410797f2a36f3bb4a23f P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.781872  7335 tablet_replica.cc:333] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699: stopping tablet replica
I20260709 12:59:57.782315  7335 raft_consensus.cc:2243] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.782639  7335 raft_consensus.cc:2272] T 1099dfe065314ab6abfa57cd3932f500 P 94ec8b45c91240f98bfd0bab03ee1699 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.878829  7335 tablet_server.cc:196] TabletServer@127.7.41.193:0 shutdown complete.
W20260709 12:59:57.879961  7510 consensus_peers.cc:597] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 -> Peer 94ec8b45c91240f98bfd0bab03ee1699 (127.7.41.193:36829): Couldn't send request to peer 94ec8b45c91240f98bfd0bab03ee1699. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:36829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:57.895972  7335 tablet_server.cc:179] TabletServer@127.7.41.194:0 shutting down...
I20260709 12:59:57.916227  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:57.916934  7335 tablet_replica.cc:333] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5: stopping tablet replica
I20260709 12:59:57.917480  7335 raft_consensus.cc:2243] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:57.918289  7335 raft_consensus.cc:2272] T 1099dfe065314ab6abfa57cd3932f500 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.919956  7335 tablet_replica.cc:333] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5: stopping tablet replica
I20260709 12:59:57.920447  7335 raft_consensus.cc:2243] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.920833  7335 raft_consensus.cc:2272] T 76435aa2977d43e0a701a4672b183511 P a7ceba849111420fb4503a8df965f1f5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.922775  7335 tablet_replica.cc:333] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5: stopping tablet replica
I20260709 12:59:57.923273  7335 raft_consensus.cc:2243] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.923651  7335 raft_consensus.cc:2272] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.925230  7335 tablet_replica.cc:333] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5: stopping tablet replica
I20260709 12:59:57.925666  7335 raft_consensus.cc:2243] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.926122  7335 raft_consensus.cc:2272] T 1e310b1b76404260958260e6ee358084 P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.928433  7335 tablet_replica.cc:333] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5: stopping tablet replica
I20260709 12:59:57.928918  7335 raft_consensus.cc:2243] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:57.929615  7335 raft_consensus.cc:2272] T 4918b1d7228f42dfaefaeef25c5debb9 P a7ceba849111420fb4503a8df965f1f5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.931213  7335 tablet_replica.cc:333] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5: stopping tablet replica
I20260709 12:59:57.931663  7335 raft_consensus.cc:2243] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.932034  7335 raft_consensus.cc:2272] T 25ffb5c4430d4fc587687d29b9359c75 P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.933699  7335 tablet_replica.cc:333] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5: stopping tablet replica
I20260709 12:59:57.934223  7335 raft_consensus.cc:2243] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:57.934933  7335 raft_consensus.cc:2272] T f5437381224640a4ba3bc8b50c56868d P a7ceba849111420fb4503a8df965f1f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.936474  7335 tablet_replica.cc:333] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5: stopping tablet replica
I20260709 12:59:57.936911  7335 raft_consensus.cc:2243] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.937269  7335 raft_consensus.cc:2272] T 2a61a34e48f2410797f2a36f3bb4a23f P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.939066  7335 tablet_replica.cc:333] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5: stopping tablet replica
I20260709 12:59:57.939476  7335 raft_consensus.cc:2243] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.939833  7335 raft_consensus.cc:2272] T 44b058fd0d934cc4892523c4d528d32e P a7ceba849111420fb4503a8df965f1f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.966804  7335 tablet_server.cc:196] TabletServer@127.7.41.194:0 shutdown complete.
I20260709 12:59:57.983018  7335 tablet_server.cc:179] TabletServer@127.7.41.195:0 shutting down...
I20260709 12:59:58.008327  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:58.009012  7335 tablet_replica.cc:333] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3: stopping tablet replica
I20260709 12:59:58.009843  7335 raft_consensus.cc:2243] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.010466  7335 raft_consensus.cc:2272] T 4918b1d7228f42dfaefaeef25c5debb9 P db0041a163dc4558b2b3c59afc3996b3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.012038  7335 tablet_replica.cc:333] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3: stopping tablet replica
I20260709 12:59:58.012472  7335 raft_consensus.cc:2243] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.013114  7335 raft_consensus.cc:2272] T 94a1f710b74d4c31ab13f4cdf2fc9d4d P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.014685  7335 tablet_replica.cc:333] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3: stopping tablet replica
I20260709 12:59:58.015110  7335 raft_consensus.cc:2243] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.015430  7335 raft_consensus.cc:2272] T 1e310b1b76404260958260e6ee358084 P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.017140  7335 tablet_replica.cc:333] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3: stopping tablet replica
I20260709 12:59:58.017553  7335 raft_consensus.cc:2243] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.017867  7335 raft_consensus.cc:2272] T 2a61a34e48f2410797f2a36f3bb4a23f P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.020184  7335 tablet_replica.cc:333] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3: stopping tablet replica
I20260709 12:59:58.020581  7335 raft_consensus.cc:2243] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.021162  7335 raft_consensus.cc:2272] T 44b058fd0d934cc4892523c4d528d32e P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.022838  7335 tablet_replica.cc:333] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3: stopping tablet replica
I20260709 12:59:58.023226  7335 raft_consensus.cc:2243] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.023533  7335 raft_consensus.cc:2272] T f5437381224640a4ba3bc8b50c56868d P db0041a163dc4558b2b3c59afc3996b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.025046  7335 tablet_replica.cc:333] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3: stopping tablet replica
I20260709 12:59:58.025421  7335 raft_consensus.cc:2243] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.026010  7335 raft_consensus.cc:2272] T 25ffb5c4430d4fc587687d29b9359c75 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.027680  7335 tablet_replica.cc:333] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3: stopping tablet replica
I20260709 12:59:58.028067  7335 raft_consensus.cc:2243] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.028432  7335 raft_consensus.cc:2272] T 1099dfe065314ab6abfa57cd3932f500 P db0041a163dc4558b2b3c59afc3996b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.029805  7335 tablet_replica.cc:333] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3: stopping tablet replica
I20260709 12:59:58.030226  7335 raft_consensus.cc:2243] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:58.030547  7335 raft_consensus.cc:2272] T 76435aa2977d43e0a701a4672b183511 P db0041a163dc4558b2b3c59afc3996b3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.055473  7335 tablet_server.cc:196] TabletServer@127.7.41.195:0 shutdown complete.
I20260709 12:59:58.071604  7335 master.cc:562] Master@127.7.41.254:46411 shutting down...
I20260709 12:59:58.271145  7335 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:58.271834  7335 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:58.272248  7335 tablet_replica.cc:333] T 00000000000000000000000000000000 P ba76490f309c4b76950e4251d9066c89: stopping tablet replica
I20260709 12:59:58.291600  7335 master.cc:584] Master@127.7.41.254:46411 shutdown complete.
94ec8b45c91240f98bfd0bab03ee1699  4
a7ceba849111420fb4503a8df965f1f5  4
db0041a163dc4558b2b3c59afc3996b3  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12167 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:59:58.332015  7335 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.41.254:36225
I20260709 12:59:58.333042  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:58.338402  7823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:58.338663  7822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:58.340117  7825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:58.340839  7335 server_base.cc:1061] running on GCE node
I20260709 12:59:58.341604  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:58.341775  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:58.341961  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783601998341929 us; error 0 us; skew 500 ppm
I20260709 12:59:58.342540  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:58.344857  7335 webserver.cc:533] Webserver started at http://127.7.41.254:41685/ using document root <none> and password file <none>
I20260709 12:59:58.345332  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:58.345510  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:58.345795  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:58.346927  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/master-0-root/instance:
uuid: "abfece10bef54b849e7d9abb9d23b586"
format_stamp: "Formatted at 2026-07-09 12:59:58 on dist-test-slave-fh5z"
I20260709 12:59:58.351179  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:59:58.354287  7830 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:58.354993  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:59:58.355281  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/master-0-root
uuid: "abfece10bef54b849e7d9abb9d23b586"
format_stamp: "Formatted at 2026-07-09 12:59:58 on dist-test-slave-fh5z"
I20260709 12:59:58.355561  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:58.368119  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:58.369264  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:58.405561  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.254:36225
I20260709 12:59:58.405661  7881 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.254:36225 every 8 connection(s)
I20260709 12:59:58.409341  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.418190  7882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586: Bootstrap starting.
I20260709 12:59:58.422478  7882 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.426354  7882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586: No bootstrap required, opened a new log
I20260709 12:59:58.428324  7882 raft_consensus.cc:359] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfece10bef54b849e7d9abb9d23b586" member_type: VOTER }
I20260709 12:59:58.428699  7882 raft_consensus.cc:385] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.428936  7882 raft_consensus.cc:740] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abfece10bef54b849e7d9abb9d23b586, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.429486  7882 consensus_queue.cc:260] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfece10bef54b849e7d9abb9d23b586" member_type: VOTER }
I20260709 12:59:58.429914  7882 raft_consensus.cc:399] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:58.430161  7882 raft_consensus.cc:493] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:58.430437  7882 raft_consensus.cc:3060] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.434128  7882 raft_consensus.cc:515] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfece10bef54b849e7d9abb9d23b586" member_type: VOTER }
I20260709 12:59:58.434612  7882 leader_election.cc:304] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abfece10bef54b849e7d9abb9d23b586; no voters: 
I20260709 12:59:58.435643  7882 leader_election.cc:290] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:58.435935  7885 raft_consensus.cc:2804] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.437247  7885 raft_consensus.cc:697] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 1 LEADER]: Becoming Leader. State: Replica: abfece10bef54b849e7d9abb9d23b586, State: Running, Role: LEADER
I20260709 12:59:58.437893  7885 consensus_queue.cc:237] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfece10bef54b849e7d9abb9d23b586" member_type: VOTER }
I20260709 12:59:58.438524  7882 sys_catalog.cc:565] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:58.440663  7886 sys_catalog.cc:455] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abfece10bef54b849e7d9abb9d23b586" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfece10bef54b849e7d9abb9d23b586" member_type: VOTER } }
I20260709 12:59:58.440872  7887 sys_catalog.cc:455] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abfece10bef54b849e7d9abb9d23b586. Latest consensus state: current_term: 1 leader_uuid: "abfece10bef54b849e7d9abb9d23b586" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfece10bef54b849e7d9abb9d23b586" member_type: VOTER } }
I20260709 12:59:58.441388  7887 sys_catalog.cc:458] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:58.441290  7886 sys_catalog.cc:458] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:58.444746  7891 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:58.452693  7891 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:58.453584  7335 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:58.460969  7891 catalog_manager.cc:1383] Generated new cluster ID: 4209a593d05d4ef4b2f5ca0a233f6838
I20260709 12:59:58.461259  7891 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:58.474244  7891 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:58.475593  7891 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:58.487111  7891 catalog_manager.cc:6070] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586: Generated new TSK 0
I20260709 12:59:58.487671  7891 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:58.519943  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:58.525678  7903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:58.526707  7904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:58.528491  7335 server_base.cc:1061] running on GCE node
W20260709 12:59:58.528460  7906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:58.529482  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:58.529704  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:58.529888  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783601998529864 us; error 0 us; skew 500 ppm
I20260709 12:59:58.530407  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:58.532471  7335 webserver.cc:533] Webserver started at http://127.7.41.193:37185/ using document root <none> and password file <none>
I20260709 12:59:58.532936  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:58.533138  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:58.533398  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:58.534502  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-0-root/instance:
uuid: "46d6067a96d8491dabe4cd898456117b"
format_stamp: "Formatted at 2026-07-09 12:59:58 on dist-test-slave-fh5z"
I20260709 12:59:58.538730  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:58.541894  7911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:58.542711  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:59:58.542999  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-0-root
uuid: "46d6067a96d8491dabe4cd898456117b"
format_stamp: "Formatted at 2026-07-09 12:59:58 on dist-test-slave-fh5z"
I20260709 12:59:58.543303  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:58.559016  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:58.560237  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:58.561594  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:58.563733  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:58.563947  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:58.564178  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:58.564361  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:58.601630  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.193:36543
I20260709 12:59:58.601724  7973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.193:36543 every 8 connection(s)
I20260709 12:59:58.606345  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:58.613062  7978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:58.613942  7979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:58.618518  7335 server_base.cc:1061] running on GCE node
W20260709 12:59:58.619047  7981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:58.620061  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:58.620325  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:58.620549  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783601998620522 us; error 0 us; skew 500 ppm
I20260709 12:59:58.621232  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:58.622452  7974 heartbeater.cc:344] Connected to a master server at 127.7.41.254:36225
I20260709 12:59:58.622846  7974 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:58.623494  7974 heartbeater.cc:507] Master 127.7.41.254:36225 requested a full tablet report, sending...
I20260709 12:59:58.624084  7335 webserver.cc:533] Webserver started at http://127.7.41.194:34843/ using document root <none> and password file <none>
I20260709 12:59:58.624634  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:58.624874  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:58.625185  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:58.625582  7847 ts_manager.cc:194] Registered new tserver with Master: 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543)
I20260709 12:59:58.626425  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-1-root/instance:
uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
format_stamp: "Formatted at 2026-07-09 12:59:58 on dist-test-slave-fh5z"
I20260709 12:59:58.627390  7847 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49984
I20260709 12:59:58.630800  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:58.633894  7986 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:58.634780  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:59:58.635005  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-1-root
uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
format_stamp: "Formatted at 2026-07-09 12:59:58 on dist-test-slave-fh5z"
I20260709 12:59:58.635226  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:58.646358  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:58.647436  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:58.648830  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:58.651000  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:58.651165  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:58.651448  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:58.651585  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:58.690781  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.194:38695
I20260709 12:59:58.690879  8048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.194:38695 every 8 connection(s)
I20260709 12:59:58.695282  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:58.701937  8052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:58.702596  8053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:58.706079  7335 server_base.cc:1061] running on GCE node
W20260709 12:59:58.706284  8055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:58.707312  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:59:58.707429  8049 heartbeater.cc:344] Connected to a master server at 127.7.41.254:36225
W20260709 12:59:58.707602  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:58.707828  8049 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:58.707813  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783601998707794 us; error 0 us; skew 500 ppm
I20260709 12:59:58.708688  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:58.708752  8049 heartbeater.cc:507] Master 127.7.41.254:36225 requested a full tablet report, sending...
I20260709 12:59:58.711035  7847 ts_manager.cc:194] Registered new tserver with Master: 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 12:59:58.711213  7335 webserver.cc:533] Webserver started at http://127.7.41.195:40813/ using document root <none> and password file <none>
I20260709 12:59:58.711766  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:58.711989  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:58.712249  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:58.712527  7847 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49990
I20260709 12:59:58.713429  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-2-root/instance:
uuid: "18cfbeb6506c485aa6568747de8e32f6"
format_stamp: "Formatted at 2026-07-09 12:59:58 on dist-test-slave-fh5z"
I20260709 12:59:58.717504  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:59:58.720667  8060 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:58.721378  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:59:58.721657  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-2-root
uuid: "18cfbeb6506c485aa6568747de8e32f6"
format_stamp: "Formatted at 2026-07-09 12:59:58 on dist-test-slave-fh5z"
I20260709 12:59:58.721940  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601985998407-7335-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:58.745815  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:58.746951  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:58.748566  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:58.750631  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:58.750854  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:58.751087  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:58.751266  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:58.788837  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.195:36219
I20260709 12:59:58.788924  8122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.195:36219 every 8 connection(s)
I20260709 12:59:58.801896  8123 heartbeater.cc:344] Connected to a master server at 127.7.41.254:36225
I20260709 12:59:58.802320  8123 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:58.803009  8123 heartbeater.cc:507] Master 127.7.41.254:36225 requested a full tablet report, sending...
I20260709 12:59:58.804783  7847 ts_manager.cc:194] Registered new tserver with Master: 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:58.805011  7335 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013228731s
I20260709 12:59:58.806209  7847 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50004
I20260709 12:59:58.828293  7847 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50012:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:58.831077  7847 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:58.900734  8088 tablet_service.cc:1511] Processing CreateTablet for tablet c0f551a2fd9d46769f8729b9dc89cbdb (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:58.901345  8087 tablet_service.cc:1511] Processing CreateTablet for tablet bc75cf5a579941eda24e56ebdeb14fdc (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:58.902267  8088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f551a2fd9d46769f8729b9dc89cbdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.902889  8087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc75cf5a579941eda24e56ebdeb14fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.908510  8086 tablet_service.cc:1511] Processing CreateTablet for tablet d59a33378da84409ae824861a1975495 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:58.909878  8086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d59a33378da84409ae824861a1975495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.911505  8014 tablet_service.cc:1511] Processing CreateTablet for tablet c0f551a2fd9d46769f8729b9dc89cbdb (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:58.912879  8014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f551a2fd9d46769f8729b9dc89cbdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.915282  8012 tablet_service.cc:1511] Processing CreateTablet for tablet d59a33378da84409ae824861a1975495 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:58.915333  8013 tablet_service.cc:1511] Processing CreateTablet for tablet bc75cf5a579941eda24e56ebdeb14fdc (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:58.916683  8012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d59a33378da84409ae824861a1975495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.922622  8013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc75cf5a579941eda24e56ebdeb14fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.932936  8011 tablet_service.cc:1511] Processing CreateTablet for tablet 82028f91f7b34469914eb751cb976770 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:58.933598  8085 tablet_service.cc:1511] Processing CreateTablet for tablet 82028f91f7b34469914eb751cb976770 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:58.934438  8011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82028f91f7b34469914eb751cb976770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.935037  8085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82028f91f7b34469914eb751cb976770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.943485  8084 tablet_service.cc:1511] Processing CreateTablet for tablet a5489fc78c6e464ca0aa0ad89a40a31f (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:58.946399  8084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5489fc78c6e464ca0aa0ad89a40a31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.962473  8009 tablet_service.cc:1511] Processing CreateTablet for tablet c759d15664924d049e64d0327f4fd88e (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:58.963891  8009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c759d15664924d049e64d0327f4fd88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.971241  7938 tablet_service.cc:1511] Processing CreateTablet for tablet bc75cf5a579941eda24e56ebdeb14fdc (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:58.972700  7938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc75cf5a579941eda24e56ebdeb14fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.975309  7937 tablet_service.cc:1511] Processing CreateTablet for tablet d59a33378da84409ae824861a1975495 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:58.976727  7937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d59a33378da84409ae824861a1975495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.960201  8010 tablet_service.cc:1511] Processing CreateTablet for tablet a5489fc78c6e464ca0aa0ad89a40a31f (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:58.980436  8138 tablet_bootstrap.cc:492] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6: Bootstrap starting.
I20260709 12:59:58.980103  7939 tablet_service.cc:1511] Processing CreateTablet for tablet c0f551a2fd9d46769f8729b9dc89cbdb (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:58.980764  8010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5489fc78c6e464ca0aa0ad89a40a31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.980657  7936 tablet_service.cc:1511] Processing CreateTablet for tablet 82028f91f7b34469914eb751cb976770 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:58.981539  7939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f551a2fd9d46769f8729b9dc89cbdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.982235  7936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82028f91f7b34469914eb751cb976770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.987742  8139 tablet_bootstrap.cc:492] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954: Bootstrap starting.
I20260709 12:59:58.988056  7934 tablet_service.cc:1511] Processing CreateTablet for tablet c759d15664924d049e64d0327f4fd88e (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:58.989535  7934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c759d15664924d049e64d0327f4fd88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.991609  7935 tablet_service.cc:1511] Processing CreateTablet for tablet a5489fc78c6e464ca0aa0ad89a40a31f (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:58.992957  7935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5489fc78c6e464ca0aa0ad89a40a31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:58.994793  8139 tablet_bootstrap.cc:654] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.023030  8138 tablet_bootstrap.cc:654] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.023381  7933 tablet_service.cc:1511] Processing CreateTablet for tablet ff0891e7dd5644c3a2eb1061b9bb4405 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:59.025192  7933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0891e7dd5644c3a2eb1061b9bb4405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.035629  8141 tablet_bootstrap.cc:492] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b: Bootstrap starting.
I20260709 12:59:59.037053  8087 tablet_service.cc:1511] Processing CreateTablet for tablet c759d15664924d049e64d0327f4fd88e (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:59.043397  8087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c759d15664924d049e64d0327f4fd88e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.043883  8010 tablet_service.cc:1511] Processing CreateTablet for tablet ff0891e7dd5644c3a2eb1061b9bb4405 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:59.045073  8010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0891e7dd5644c3a2eb1061b9bb4405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.045514  8086 tablet_service.cc:1511] Processing CreateTablet for tablet ff0891e7dd5644c3a2eb1061b9bb4405 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:59.047003  8086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0891e7dd5644c3a2eb1061b9bb4405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.054934  8014 tablet_service.cc:1511] Processing CreateTablet for tablet f9ad8e40ca6f4cedbd97dd1566fd477f (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:59.056368  8014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ad8e40ca6f4cedbd97dd1566fd477f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.061519  8138 tablet_bootstrap.cc:492] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6: No bootstrap required, opened a new log
I20260709 12:59:59.061237  8013 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0cccdbe51448a1a2d4c6f816428011 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:59.061995  8138 ts_tablet_manager.cc:1403] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.000s
I20260709 12:59:59.062688  8013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0cccdbe51448a1a2d4c6f816428011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.061758  8141 tablet_bootstrap.cc:654] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.065192  8138 raft_consensus.cc:359] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.065963  8138 raft_consensus.cc:385] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.066329  8138 raft_consensus.cc:740] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.068765  8085 tablet_service.cc:1511] Processing CreateTablet for tablet f9ad8e40ca6f4cedbd97dd1566fd477f (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:59.070148  8085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ad8e40ca6f4cedbd97dd1566fd477f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.075114  7937 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0cccdbe51448a1a2d4c6f816428011 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:59.076416  7937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0cccdbe51448a1a2d4c6f816428011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.080072  8088 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0cccdbe51448a1a2d4c6f816428011 (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:59.081410  8088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0cccdbe51448a1a2d4c6f816428011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.067369  8138 consensus_queue.cc:260] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.097478  7934 tablet_service.cc:1511] Processing CreateTablet for tablet f9ad8e40ca6f4cedbd97dd1566fd477f (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:59.098764  7934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ad8e40ca6f4cedbd97dd1566fd477f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.108155  8141 tablet_bootstrap.cc:492] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b: No bootstrap required, opened a new log
I20260709 12:59:59.110860  8141 ts_tablet_manager.cc:1403] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.004s
I20260709 12:59:59.112288  7933 tablet_service.cc:1511] Processing CreateTablet for tablet 078001b9f4b248a19ca7cb703a53620c (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:59.110387  8139 tablet_bootstrap.cc:492] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954: No bootstrap required, opened a new log
I20260709 12:59:59.113494  7933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078001b9f4b248a19ca7cb703a53620c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.113832  8139 ts_tablet_manager.cc:1403] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent bootstrapping tablet: real 0.126s	user 0.024s	sys 0.044s
I20260709 12:59:59.113509  8141 raft_consensus.cc:359] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 12:59:59.114624  8141 raft_consensus.cc:385] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.114970  8141 raft_consensus.cc:740] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.115828  8141 consensus_queue.cc:260] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 12:59:59.116711  8139 raft_consensus.cc:359] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.117496  8139 raft_consensus.cc:385] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.117899  8139 raft_consensus.cc:740] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.118801  8139 consensus_queue.cc:260] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.129217  8013 tablet_service.cc:1511] Processing CreateTablet for tablet 078001b9f4b248a19ca7cb703a53620c (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:59.130443  8013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078001b9f4b248a19ca7cb703a53620c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.131805  7974 heartbeater.cc:499] Master 127.7.41.254:36225 was elected leader, sending a full tablet report...
I20260709 12:59:59.147585  8123 heartbeater.cc:499] Master 127.7.41.254:36225 was elected leader, sending a full tablet report...
I20260709 12:59:59.147961  8086 tablet_service.cc:1511] Processing CreateTablet for tablet 078001b9f4b248a19ca7cb703a53620c (DEFAULT_TABLE table=test-workload [id=530126105ce845569c921b31aa539477]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:59.148749  8138 ts_tablet_manager.cc:1434] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.002s
I20260709 12:59:59.149274  8086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078001b9f4b248a19ca7cb703a53620c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.149854  8138 tablet_bootstrap.cc:492] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6: Bootstrap starting.
I20260709 12:59:59.157327  8141 ts_tablet_manager.cc:1434] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b: Time spent starting tablet: real 0.046s	user 0.012s	sys 0.008s
I20260709 12:59:59.160809  8138 tablet_bootstrap.cc:654] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.162907  8049 heartbeater.cc:499] Master 127.7.41.254:36225 was elected leader, sending a full tablet report...
I20260709 12:59:59.164919  8139 ts_tablet_manager.cc:1434] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent starting tablet: real 0.051s	user 0.014s	sys 0.020s
I20260709 12:59:59.165563  8141 tablet_bootstrap.cc:492] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b: Bootstrap starting.
I20260709 12:59:59.167263  8139 tablet_bootstrap.cc:492] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954: Bootstrap starting.
I20260709 12:59:59.173208  8139 tablet_bootstrap.cc:654] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.180550  8138 tablet_bootstrap.cc:492] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6: No bootstrap required, opened a new log
I20260709 12:59:59.180958  8138 ts_tablet_manager.cc:1403] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.015s
I20260709 12:59:59.182667  8141 tablet_bootstrap.cc:654] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.183347  8138 raft_consensus.cc:359] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.184109  8138 raft_consensus.cc:385] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.184396  8138 raft_consensus.cc:740] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.185441  8139 tablet_bootstrap.cc:492] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954: No bootstrap required, opened a new log
I20260709 12:59:59.185122  8138 consensus_queue.cc:260] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.185932  8139 ts_tablet_manager.cc:1403] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 12:59:59.186971  8138 ts_tablet_manager.cc:1434] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:59:59.187677  8138 tablet_bootstrap.cc:492] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6: Bootstrap starting.
I20260709 12:59:59.189004  8139 raft_consensus.cc:359] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 12:59:59.189715  8139 raft_consensus.cc:385] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.190070  8139 raft_consensus.cc:740] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.190812  8139 consensus_queue.cc:260] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 12:59:59.192862  8145 raft_consensus.cc:493] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.193168  8139 ts_tablet_manager.cc:1434] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:59:59.193359  8145 raft_consensus.cc:515] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 12:59:59.194136  8139 tablet_bootstrap.cc:492] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954: Bootstrap starting.
I20260709 12:59:59.194674  8138 tablet_bootstrap.cc:654] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.200959  8139 tablet_bootstrap.cc:654] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.202845  8145 leader_election.cc:290] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 12:59:59.224867  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f551a2fd9d46769f8729b9dc89cbdb" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" is_pre_election: true
I20260709 12:59:59.225802  8024 raft_consensus.cc:2468] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 0.
I20260709 12:59:59.228024  7912 leader_election.cc:304] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 12:59:59.229209  8145 raft_consensus.cc:2804] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.229687  8145 raft_consensus.cc:493] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.230129  8145 raft_consensus.cc:3060] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.255957  8139 tablet_bootstrap.cc:492] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954: No bootstrap required, opened a new log
I20260709 12:59:59.256088  8098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f551a2fd9d46769f8729b9dc89cbdb" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 12:59:59.256521  8139 ts_tablet_manager.cc:1403] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.014s
W20260709 12:59:59.257680  7914 leader_election.cc:343] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.259439  8139 raft_consensus.cc:359] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.260140  8139 raft_consensus.cc:385] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.260440  8139 raft_consensus.cc:740] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.261267  8139 consensus_queue.cc:260] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.263409  8139 ts_tablet_manager.cc:1434] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:59.264317  8139 tablet_bootstrap.cc:492] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954: Bootstrap starting.
I20260709 12:59:59.267385  8144 raft_consensus.cc:493] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.267903  8144 raft_consensus.cc:515] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.270581  8139 tablet_bootstrap.cc:654] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.274508  8144 leader_election.cc:290] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 12:59:59.286278  8145 raft_consensus.cc:515] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 12:59:59.290309  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f551a2fd9d46769f8729b9dc89cbdb" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 12:59:59.290505  8098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f551a2fd9d46769f8729b9dc89cbdb" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 12:59:59.291019  8024 raft_consensus.cc:3060] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:59.292392  7914 leader_election.cc:343] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.300119  8024 raft_consensus.cc:2468] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 1.
I20260709 12:59:59.301093  8145 leader_election.cc:290] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 election: Requested vote from peers 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 12:59:59.302258  7912 leader_election.cc:304] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 18cfbeb6506c485aa6568747de8e32f6
I20260709 12:59:59.304595  8145 raft_consensus.cc:2804] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:59.306891  8145 raft_consensus.cc:697] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 12:59:59.308300  8145 consensus_queue.cc:237] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 12:59:59.308987  8138 tablet_bootstrap.cc:492] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6: No bootstrap required, opened a new log
I20260709 12:59:59.309501  8138 ts_tablet_manager.cc:1403] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6: Time spent bootstrapping tablet: real 0.122s	user 0.031s	sys 0.054s
I20260709 12:59:59.308665  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d59a33378da84409ae824861a1975495" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" is_pre_election: true
I20260709 12:59:59.310835  8024 raft_consensus.cc:2468] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 0.
I20260709 12:59:59.312140  8139 tablet_bootstrap.cc:492] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954: No bootstrap required, opened a new log
I20260709 12:59:59.312590  8139 ts_tablet_manager.cc:1403] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.035s
I20260709 12:59:59.312342  8138 raft_consensus.cc:359] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 12:59:59.313058  8138 raft_consensus.cc:385] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.312959  8061 leader_election.cc:304] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 12:59:59.313380  8138 raft_consensus.cc:740] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.313899  8144 raft_consensus.cc:2804] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.314275  8144 raft_consensus.cc:493] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.314145  8138 consensus_queue.cc:260] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 12:59:59.314601  8144 raft_consensus.cc:3060] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.315382  8139 raft_consensus.cc:359] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.316062  8139 raft_consensus.cc:385] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.316358  8139 raft_consensus.cc:740] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.316776  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d59a33378da84409ae824861a1975495" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b" is_pre_election: true
I20260709 12:59:59.317051  8139 consensus_queue.cc:260] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
W20260709 12:59:59.318336  8063 leader_election.cc:343] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.321565  8139 ts_tablet_manager.cc:1434] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:59:59.322521  8139 tablet_bootstrap.cc:492] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954: Bootstrap starting.
I20260709 12:59:59.323606  8141 tablet_bootstrap.cc:492] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b: No bootstrap required, opened a new log
I20260709 12:59:59.324203  8141 ts_tablet_manager.cc:1403] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b: Time spent bootstrapping tablet: real 0.166s	user 0.043s	sys 0.066s
I20260709 12:59:59.328249  8144 raft_consensus.cc:515] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.330554  8139 tablet_bootstrap.cc:654] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.331072  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d59a33378da84409ae824861a1975495" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 12:59:59.331506  8141 raft_consensus.cc:359] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.332186  8141 raft_consensus.cc:385] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:59.332414  8063 leader_election.cc:343] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.332479  8141 raft_consensus.cc:740] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.333259  8141 consensus_queue.cc:260] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.334748  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d59a33378da84409ae824861a1975495" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 12:59:59.335330  8141 ts_tablet_manager.cc:1434] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:59:59.335304  8024 raft_consensus.cc:3060] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.336365  8141 tablet_bootstrap.cc:492] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b: Bootstrap starting.
I20260709 12:59:59.342181  8144 leader_election.cc:290] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 12:59:59.344797  8141 tablet_bootstrap.cc:654] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.345378  8024 raft_consensus.cc:2468] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 1.
I20260709 12:59:59.346637  8061 leader_election.cc:304] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 46d6067a96d8491dabe4cd898456117b
I20260709 12:59:59.347862  8144 raft_consensus.cc:2804] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:59.348464  8144 raft_consensus.cc:697] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 LEADER]: Becoming Leader. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 12:59:59.349509  8144 consensus_queue.cc:237] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.353513  7845 catalog_manager.cc:5697] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 0 to 1, leader changed from <none> to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.355571  8138 ts_tablet_manager.cc:1434] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.014s
I20260709 12:59:59.356830  8138 tablet_bootstrap.cc:492] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6: Bootstrap starting.
I20260709 12:59:59.363456  8138 tablet_bootstrap.cc:654] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.367776  8139 tablet_bootstrap.cc:492] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954: No bootstrap required, opened a new log
I20260709 12:59:59.368398  8141 tablet_bootstrap.cc:492] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b: No bootstrap required, opened a new log
I20260709 12:59:59.368300  8139 ts_tablet_manager.cc:1403] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.016s
I20260709 12:59:59.368971  8141 ts_tablet_manager.cc:1403] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.003s
I20260709 12:59:59.372177  8139 raft_consensus.cc:359] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.373117  8139 raft_consensus.cc:385] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.372654  8141 raft_consensus.cc:359] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.373495  8139 raft_consensus.cc:740] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.373697  8141 raft_consensus.cc:385] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.374200  8141 raft_consensus.cc:740] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.374915  8139 consensus_queue.cc:260] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.375206  8141 consensus_queue.cc:260] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.377218  8139 ts_tablet_manager.cc:1434] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:59.378218  8139 tablet_bootstrap.cc:492] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954: Bootstrap starting.
I20260709 12:59:59.378387  8141 ts_tablet_manager.cc:1434] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:59:59.379617  8141 tablet_bootstrap.cc:492] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b: Bootstrap starting.
I20260709 12:59:59.387219  8139 tablet_bootstrap.cc:654] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.388358  8141 tablet_bootstrap.cc:654] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.388732  8138 tablet_bootstrap.cc:492] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6: No bootstrap required, opened a new log
I20260709 12:59:59.389181  8138 ts_tablet_manager.cc:1403] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.018s
I20260709 12:59:59.392822  8138 raft_consensus.cc:359] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.393747  8138 raft_consensus.cc:385] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.394147  8138 raft_consensus.cc:740] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.395164  8138 consensus_queue.cc:260] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.397073  8146 raft_consensus.cc:493] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.397883  8138 ts_tablet_manager.cc:1434] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:59.399705  8138 tablet_bootstrap.cc:492] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6: Bootstrap starting.
I20260709 12:59:59.397627  8146 raft_consensus.cc:515] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.408027  8138 tablet_bootstrap.cc:654] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.408785  8139 tablet_bootstrap.cc:492] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954: No bootstrap required, opened a new log
I20260709 12:59:59.408955  8146 leader_election.cc:290] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.409243  8139 ts_tablet_manager.cc:1403] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.002s
I20260709 12:59:59.412267  8139 raft_consensus.cc:359] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.413025  8139 raft_consensus.cc:385] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.413362  8139 raft_consensus.cc:740] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.414232  8139 consensus_queue.cc:260] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.416375  8139 ts_tablet_manager.cc:1434] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:59.417528  8139 tablet_bootstrap.cc:492] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954: Bootstrap starting.
I20260709 12:59:59.426133  8139 tablet_bootstrap.cc:654] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:59.455730  7895 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:59.446746  7845 catalog_manager.cc:5697] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "18cfbeb6506c485aa6568747de8e32f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.460659  8139 tablet_bootstrap.cc:492] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954: No bootstrap required, opened a new log
I20260709 12:59:59.461289  8139 ts_tablet_manager.cc:1403] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.017s
I20260709 12:59:59.465668  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b" is_pre_election: true
I20260709 12:59:59.465960  8098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 12:59:59.466552  8098 raft_consensus.cc:2468] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 0.
I20260709 12:59:59.466578  8139 raft_consensus.cc:359] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.467567  8139 raft_consensus.cc:385] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.467931  8139 raft_consensus.cc:740] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.469138  7989 leader_election.cc:304] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 12:59:59.468837  8139 consensus_queue.cc:260] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.470227  8146 raft_consensus.cc:2804] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.470671  8146 raft_consensus.cc:493] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.471026  8146 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.473680  8141 tablet_bootstrap.cc:492] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b: No bootstrap required, opened a new log
W20260709 12:59:59.470181  7989 leader_election.cc:343] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.474191  8138 tablet_bootstrap.cc:492] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6: No bootstrap required, opened a new log
I20260709 12:59:59.474313  8141 ts_tablet_manager.cc:1403] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b: Time spent bootstrapping tablet: real 0.095s	user 0.034s	sys 0.058s
I20260709 12:59:59.474617  8138 ts_tablet_manager.cc:1403] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.019s
I20260709 12:59:59.477456  8138 raft_consensus.cc:359] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.478292  8138 raft_consensus.cc:385] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.478649  8138 raft_consensus.cc:740] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.479480  8138 consensus_queue.cc:260] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.479640  8141 raft_consensus.cc:359] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.480667  8141 raft_consensus.cc:385] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.481061  8141 raft_consensus.cc:740] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.482244  8138 ts_tablet_manager.cc:1434] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:59.482133  8141 consensus_queue.cc:260] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.483332  8138 tablet_bootstrap.cc:492] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6: Bootstrap starting.
I20260709 12:59:59.485432  8141 ts_tablet_manager.cc:1434] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:59:59.488242  8141 tablet_bootstrap.cc:492] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b: Bootstrap starting.
I20260709 12:59:59.492336  8138 tablet_bootstrap.cc:654] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.496371  8141 tablet_bootstrap.cc:654] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.509449  8141 tablet_bootstrap.cc:492] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b: No bootstrap required, opened a new log
I20260709 12:59:59.510066  8141 ts_tablet_manager.cc:1403] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 12:59:59.513769  8146 raft_consensus.cc:515] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.513895  8141 raft_consensus.cc:359] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.514950  8141 raft_consensus.cc:385] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.515340  8141 raft_consensus.cc:740] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.516427  8141 consensus_queue.cc:260] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.517310  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 12:59:59.519742  8141 ts_tablet_manager.cc:1434] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:59:59.521337  8141 tablet_bootstrap.cc:492] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b: Bootstrap starting.
W20260709 12:59:59.522532  7989 leader_election.cc:343] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.532202  8141 tablet_bootstrap.cc:654] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.536729  8172 raft_consensus.cc:493] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.537528  8172 raft_consensus.cc:515] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.543998  8146 leader_election.cc:290] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.544697  8098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 12:59:59.545300  8098 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.545823  8172 leader_election.cc:290] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.550410  8144 raft_consensus.cc:493] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.550870  8144 raft_consensus.cc:515] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.552073  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b" is_pre_election: true
I20260709 12:59:59.552821  8144 leader_election.cc:290] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
W20260709 12:59:59.553395  7989 leader_election.cc:343] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.554392  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 12:59:59.555521  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc75cf5a579941eda24e56ebdeb14fdc" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" is_pre_election: true
I20260709 12:59:59.555840  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc75cf5a579941eda24e56ebdeb14fdc" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b" is_pre_election: true
I20260709 12:59:59.556120  8024 raft_consensus.cc:2468] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 0.
I20260709 12:59:59.556418  7949 raft_consensus.cc:2468] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 0.
I20260709 12:59:59.557346  8061 leader_election.cc:304] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
W20260709 12:59:59.559087  7989 leader_election.cc:343] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.559486  7989 leader_election.cc:304] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 18cfbeb6506c485aa6568747de8e32f6, 46d6067a96d8491dabe4cd898456117b
I20260709 12:59:59.560272  8172 raft_consensus.cc:2749] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:59.560590  8144 raft_consensus.cc:2804] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.560981  8144 raft_consensus.cc:493] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.561287  8144 raft_consensus.cc:3060] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.563200  8098 raft_consensus.cc:2468] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 1.
I20260709 12:59:59.565276  7989 leader_election.cc:304] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 46d6067a96d8491dabe4cd898456117b
I20260709 12:59:59.565809  8139 ts_tablet_manager.cc:1434] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent starting tablet: real 0.104s	user 0.054s	sys 0.046s
I20260709 12:59:59.566208  8169 raft_consensus.cc:2804] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:59.566888  8169 raft_consensus.cc:697] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Becoming Leader. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 12:59:59.566890  8139 tablet_bootstrap.cc:492] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954: Bootstrap starting.
I20260709 12:59:59.567946  8169 consensus_queue.cc:237] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.569371  8144 raft_consensus.cc:515] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.572464  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc75cf5a579941eda24e56ebdeb14fdc" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 12:59:59.573001  7949 raft_consensus.cc:3060] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.573086  8141 tablet_bootstrap.cc:492] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b: No bootstrap required, opened a new log
I20260709 12:59:59.573189  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc75cf5a579941eda24e56ebdeb14fdc" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 12:59:59.573630  8139 tablet_bootstrap.cc:654] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.573829  8024 raft_consensus.cc:3060] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.573807  8141 ts_tablet_manager.cc:1403] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.022s
I20260709 12:59:59.577544  8141 raft_consensus.cc:359] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.578297  8141 raft_consensus.cc:385] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.578637  8141 raft_consensus.cc:740] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.579840  7949 raft_consensus.cc:2468] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 1.
I20260709 12:59:59.579504  8141 consensus_queue.cc:260] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.581036  8063 leader_election.cc:304] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 12:59:59.582054  8157 raft_consensus.cc:2804] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:59.584431  8141 ts_tablet_manager.cc:1434] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:59:59.585664  8141 tablet_bootstrap.cc:492] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b: Bootstrap starting.
I20260709 12:59:59.585134  7845 catalog_manager.cc:5697] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.587783  8139 tablet_bootstrap.cc:492] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954: No bootstrap required, opened a new log
I20260709 12:59:59.580193  8024 raft_consensus.cc:2468] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 1.
I20260709 12:59:59.588238  8139 ts_tablet_manager.cc:1403] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.002s
I20260709 12:59:59.590407  8138 tablet_bootstrap.cc:492] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6: No bootstrap required, opened a new log
I20260709 12:59:59.590850  8138 ts_tablet_manager.cc:1403] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6: Time spent bootstrapping tablet: real 0.108s	user 0.033s	sys 0.029s
I20260709 12:59:59.590996  8139 raft_consensus.cc:359] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.591754  8139 raft_consensus.cc:385] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.592047  8139 raft_consensus.cc:740] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.592836  8139 consensus_queue.cc:260] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.593305  8141 tablet_bootstrap.cc:654] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.595063  8139 ts_tablet_manager.cc:1434] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:59.596045  8139 tablet_bootstrap.cc:492] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954: Bootstrap starting.
I20260709 12:59:59.597307  8144 leader_election.cc:290] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 12:59:59.599145  8157 raft_consensus.cc:697] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 1 LEADER]: Becoming Leader. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 12:59:59.600021  8157 consensus_queue.cc:237] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.603973  8139 tablet_bootstrap.cc:654] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.593585  8138 raft_consensus.cc:359] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.604689  8138 raft_consensus.cc:385] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.605015  8138 raft_consensus.cc:740] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.606066  8141 tablet_bootstrap.cc:492] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b: No bootstrap required, opened a new log
I20260709 12:59:59.605787  8138 consensus_queue.cc:260] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.606769  8141 ts_tablet_manager.cc:1403] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.010s
I20260709 12:59:59.610562  8169 raft_consensus.cc:493] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.611016  8169 raft_consensus.cc:515] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.611375  8141 raft_consensus.cc:359] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.612592  8141 raft_consensus.cc:385] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.612972  8169 leader_election.cc:290] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.613138  8141 raft_consensus.cc:740] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.614574  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b" is_pre_election: true
I20260709 12:59:59.615433  7949 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 0.
I20260709 12:59:59.614620  8141 consensus_queue.cc:260] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.617200  8098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 12:59:59.617780  8098 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 0.
I20260709 12:59:59.619242  8138 ts_tablet_manager.cc:1434] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:59:59.620218  8138 tablet_bootstrap.cc:492] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6: Bootstrap starting.
I20260709 12:59:59.621798  8141 ts_tablet_manager.cc:1434] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:59:59.623139  8141 tablet_bootstrap.cc:492] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b: Bootstrap starting.
I20260709 12:59:59.626863  8138 tablet_bootstrap.cc:654] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.631633  8141 tablet_bootstrap.cc:654] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.634096  7847 catalog_manager.cc:5697] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "18cfbeb6506c485aa6568747de8e32f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.637908  8138 tablet_bootstrap.cc:492] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6: No bootstrap required, opened a new log
I20260709 12:59:59.638468  8138 ts_tablet_manager.cc:1403] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:59:59.641377  8138 raft_consensus.cc:359] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.642092  8138 raft_consensus.cc:385] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.642401  8138 raft_consensus.cc:740] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.643301  8138 consensus_queue.cc:260] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.644994  8141 tablet_bootstrap.cc:492] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b: No bootstrap required, opened a new log
I20260709 12:59:59.637992  7989 leader_election.cc:304] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 12:59:59.645815  8141 ts_tablet_manager.cc:1403] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.009s
I20260709 12:59:59.646059  8169 raft_consensus.cc:2804] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.646445  8169 raft_consensus.cc:493] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.646790  8169 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.649186  8141 raft_consensus.cc:359] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.649860  8141 raft_consensus.cc:385] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.650378  8141 raft_consensus.cc:740] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.650836  8139 tablet_bootstrap.cc:492] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954: No bootstrap required, opened a new log
I20260709 12:59:59.651243  8139 ts_tablet_manager.cc:1403] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent bootstrapping tablet: real 0.055s	user 0.037s	sys 0.016s
I20260709 12:59:59.651221  8141 consensus_queue.cc:260] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.653162  8169 raft_consensus.cc:515] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.653796  8139 raft_consensus.cc:359] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.654448  8139 raft_consensus.cc:385] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.654728  8139 raft_consensus.cc:740] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.655403  8139 consensus_queue.cc:260] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.655818  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 12:59:59.656390  7949 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.645781  8138 ts_tablet_manager.cc:1434] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:59.657599  8138 tablet_bootstrap.cc:492] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6: Bootstrap starting.
I20260709 12:59:59.659323  8139 ts_tablet_manager.cc:1434] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:59.660090  8139 tablet_bootstrap.cc:492] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954: Bootstrap starting.
I20260709 12:59:59.663802  8138 tablet_bootstrap.cc:654] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.665851  8139 tablet_bootstrap.cc:654] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.666370  8141 ts_tablet_manager.cc:1434] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:59:59.667436  8141 tablet_bootstrap.cc:492] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b: Bootstrap starting.
I20260709 12:59:59.672859  8145 raft_consensus.cc:493] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.673563  8172 raft_consensus.cc:493] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.673475  8145 raft_consensus.cc:515] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.674067  8172 raft_consensus.cc:515] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.675940  8145 leader_election.cc:290] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.676254  8172 leader_election.cc:290] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.678038  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d59a33378da84409ae824861a1975495" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" is_pre_election: true
I20260709 12:59:59.678943  8024 raft_consensus.cc:2393] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46d6067a96d8491dabe4cd898456117b in current term 1: Already voted for candidate 18cfbeb6506c485aa6568747de8e32f6 in this term.
I20260709 12:59:59.679514  7948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c759d15664924d049e64d0327f4fd88e" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b" is_pre_election: true
I20260709 12:59:59.679968  8098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c759d15664924d049e64d0327f4fd88e" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 12:59:59.680241  7948 raft_consensus.cc:2468] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 0.
I20260709 12:59:59.680584  8098 raft_consensus.cc:2468] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 0.
I20260709 12:59:59.682742  7989 leader_election.cc:304] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 12:59:59.682909  7949 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 1.
I20260709 12:59:59.684227  7989 leader_election.cc:304] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 12:59:59.686470  8172 raft_consensus.cc:2804] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.686916  8172 raft_consensus.cc:493] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.687285  8172 raft_consensus.cc:3060] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.687680  8098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d59a33378da84409ae824861a1975495" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 12:59:59.689345  8169 leader_election.cc:290] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.689466  7914 leader_election.cc:304] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46d6067a96d8491dabe4cd898456117b; no voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954
I20260709 12:59:59.690835  8145 raft_consensus.cc:3060] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.693732  8146 raft_consensus.cc:2804] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:59.694298  8146 raft_consensus.cc:697] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Becoming Leader. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 12:59:59.694188  8138 tablet_bootstrap.cc:492] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6: No bootstrap required, opened a new log
I20260709 12:59:59.695032  8138 ts_tablet_manager.cc:1403] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.008s
I20260709 12:59:59.695240  8146 consensus_queue.cc:237] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.698423  8138 raft_consensus.cc:359] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.699278  8138 raft_consensus.cc:385] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.699628  8138 raft_consensus.cc:740] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.700587  8138 consensus_queue.cc:260] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.701541  8141 tablet_bootstrap.cc:654] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.703550  8098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 12:59:59.698871  8145 raft_consensus.cc:2749] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:59.704154  8098 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.705958  8138 ts_tablet_manager.cc:1434] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:59:59.706830  8138 tablet_bootstrap.cc:492] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6: Bootstrap starting.
I20260709 12:59:59.707464  8139 tablet_bootstrap.cc:492] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954: No bootstrap required, opened a new log
I20260709 12:59:59.707981  8139 ts_tablet_manager.cc:1403] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.022s
I20260709 12:59:59.711077  8139 raft_consensus.cc:359] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.713001  8139 raft_consensus.cc:385] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.712334  8138 tablet_bootstrap.cc:654] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.713402  8139 raft_consensus.cc:740] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.714296  8139 consensus_queue.cc:260] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.716472  8139 ts_tablet_manager.cc:1434] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:59.717171  8141 tablet_bootstrap.cc:492] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b: No bootstrap required, opened a new log
I20260709 12:59:59.712815  8172 raft_consensus.cc:515] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.717680  8141 ts_tablet_manager.cc:1403] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 12:59:59.719022  8172 leader_election.cc:290] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.719174  8169 raft_consensus.cc:493] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.719666  8169 raft_consensus.cc:515] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.720431  8141 raft_consensus.cc:359] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.721233  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c759d15664924d049e64d0327f4fd88e" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 12:59:59.721441  8141 raft_consensus.cc:385] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.721714  8141 raft_consensus.cc:740] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.721772  7949 raft_consensus.cc:3060] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.722084  8169 leader_election.cc:290] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.723448  8141 consensus_queue.cc:260] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.723730  7948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ad8e40ca6f4cedbd97dd1566fd477f" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b" is_pre_election: true
I20260709 12:59:59.724383  7948 raft_consensus.cc:2468] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 0.
I20260709 12:59:59.725447  7989 leader_election.cc:304] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 12:59:59.726338  8169 raft_consensus.cc:2804] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.726514  8096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ad8e40ca6f4cedbd97dd1566fd477f" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 12:59:59.720049  8098 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 1.
I20260709 12:59:59.727201  8096 raft_consensus.cc:2468] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 0.
I20260709 12:59:59.722393  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c759d15664924d049e64d0327f4fd88e" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 12:59:59.728127  8097 raft_consensus.cc:3060] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.726814  8169 raft_consensus.cc:493] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.728643  8169 raft_consensus.cc:3060] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.733078  8141 ts_tablet_manager.cc:1434] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 12:59:59.733996  8141 tablet_bootstrap.cc:492] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b: Bootstrap starting.
I20260709 12:59:59.735167  8169 raft_consensus.cc:515] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.738402  8169 leader_election.cc:290] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.739486  8096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ad8e40ca6f4cedbd97dd1566fd477f" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 12:59:59.739919  8097 raft_consensus.cc:2468] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 1.
I20260709 12:59:59.740139  8096 raft_consensus.cc:3060] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.738418  7949 raft_consensus.cc:2468] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 1.
I20260709 12:59:59.740586  7948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ad8e40ca6f4cedbd97dd1566fd477f" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 12:59:59.741163  7948 raft_consensus.cc:3060] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.741426  7989 leader_election.cc:304] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 12:59:59.742959  8146 raft_consensus.cc:2804] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:59.743466  8146 raft_consensus.cc:697] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Becoming Leader. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 12:59:59.744335  8146 consensus_queue.cc:237] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.746774  8157 consensus_queue.cc:1048] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:59.751164  8141 tablet_bootstrap.cc:654] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.758809  7844 catalog_manager.cc:5697] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.766925  8096 raft_consensus.cc:2468] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 1.
I20260709 12:59:59.768409  7989 leader_election.cc:304] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 12:59:59.763160  7948 raft_consensus.cc:2468] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 1.
I20260709 12:59:59.769332  8169 raft_consensus.cc:2804] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:59.769910  8169 raft_consensus.cc:697] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Becoming Leader. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 12:59:59.771327  8138 tablet_bootstrap.cc:492] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6: No bootstrap required, opened a new log
I20260709 12:59:59.770848  8169 consensus_queue.cc:237] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.771750  8138 ts_tablet_manager.cc:1403] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.000s
I20260709 12:59:59.774590  8138 raft_consensus.cc:359] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.775187  8138 raft_consensus.cc:385] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.775473  8138 raft_consensus.cc:740] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.776166  8138 consensus_queue.cc:260] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.780256  8138 ts_tablet_manager.cc:1434] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:59.781088  8138 tablet_bootstrap.cc:492] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6: Bootstrap starting.
I20260709 12:59:59.780711  8145 consensus_queue.cc:1048] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:59.792155  8141 tablet_bootstrap.cc:492] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b: No bootstrap required, opened a new log
I20260709 12:59:59.792989  8141 ts_tablet_manager.cc:1403] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.006s
I20260709 12:59:59.794437  8172 raft_consensus.cc:493] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.794957  8172 raft_consensus.cc:515] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.795631  8141 raft_consensus.cc:359] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.796280  8141 raft_consensus.cc:385] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.799240  8141 raft_consensus.cc:740] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.796231  8176 consensus_queue.cc:1048] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:59.799907  8141 consensus_queue.cc:260] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.800226  8096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0cccdbe51448a1a2d4c6f816428011" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 12:59:59.800932  8096 raft_consensus.cc:2468] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 0.
I20260709 12:59:59.801987  8141 ts_tablet_manager.cc:1434] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:59:59.798933  8138 tablet_bootstrap.cc:654] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.812466  8176 raft_consensus.cc:493] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.809729  7989 leader_election.cc:304] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 12:59:59.815249  8176 raft_consensus.cc:515] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 12:59:59.816767  8169 raft_consensus.cc:2804] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.817292  8169 raft_consensus.cc:493] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.817750  8169 raft_consensus.cc:3060] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.819711  8023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f551a2fd9d46769f8729b9dc89cbdb" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" is_pre_election: true
I20260709 12:59:59.797111  8172 leader_election.cc:290] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.822793  7948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0cccdbe51448a1a2d4c6f816428011" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b" is_pre_election: true
I20260709 12:59:59.823573  7948 raft_consensus.cc:2468] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 0.
I20260709 12:59:59.828377  8169 raft_consensus.cc:515] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.829587  8176 leader_election.cc:290] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543)
I20260709 12:59:59.829473  7847 catalog_manager.cc:5697] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.838717  8169 leader_election.cc:290] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.838536  7847 catalog_manager.cc:5697] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.841064  7947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0cccdbe51448a1a2d4c6f816428011" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 12:59:59.843535  8096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0cccdbe51448a1a2d4c6f816428011" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 12:59:59.844347  8096 raft_consensus.cc:3060] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.853617  8096 raft_consensus.cc:2468] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 1.
I20260709 12:59:59.831050  7948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f551a2fd9d46769f8729b9dc89cbdb" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6067a96d8491dabe4cd898456117b" is_pre_election: true
I20260709 12:59:59.836407  8194 raft_consensus.cc:493] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.854844  8194 raft_consensus.cc:515] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.855206  8063 leader_election.cc:304] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6; no voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b
I20260709 12:59:59.856395  7947 raft_consensus.cc:3060] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.858178  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0cccdbe51448a1a2d4c6f816428011" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" is_pre_election: true
I20260709 12:59:59.860275  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0cccdbe51448a1a2d4c6f816428011" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 12:59:59.862290  8176 raft_consensus.cc:2749] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:59.864629  7947 raft_consensus.cc:2468] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 1.
I20260709 12:59:59.860754  8194 leader_election.cc:290] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.862893  8024 raft_consensus.cc:2393] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46d6067a96d8491dabe4cd898456117b in current term 1: Already voted for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in this term.
I20260709 12:59:59.868031  8138 tablet_bootstrap.cc:492] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6: No bootstrap required, opened a new log
I20260709 12:59:59.867849  7912 leader_election.cc:304] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46d6067a96d8491dabe4cd898456117b; no voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954
I20260709 12:59:59.868559  8138 ts_tablet_manager.cc:1403] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6: Time spent bootstrapping tablet: real 0.088s	user 0.030s	sys 0.034s
I20260709 12:59:59.869190  8194 raft_consensus.cc:2749] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:59.871225  8138 raft_consensus.cc:359] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.871533  7989 leader_election.cc:304] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 12:59:59.871901  8138 raft_consensus.cc:385] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.872170  8138 raft_consensus.cc:740] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.872339  8169 raft_consensus.cc:2804] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:59.872941  8169 raft_consensus.cc:697] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Becoming Leader. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 12:59:59.873811  8169 consensus_queue.cc:237] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.872921  8138 consensus_queue.cc:260] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.878245  8138 ts_tablet_manager.cc:1434] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:59:59.884842  8097 raft_consensus.cc:3060] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.894122  7847 catalog_manager.cc:5697] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.896081  8197 consensus_queue.cc:1048] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:59.953819  8197 raft_consensus.cc:493] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.954355  8197 raft_consensus.cc:515] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 12:59:59.955895  8197 leader_election.cc:290] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 12:59:59.956722  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" is_pre_election: true
I20260709 12:59:59.956938  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 12:59:59.957636  8097 raft_consensus.cc:2393] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46d6067a96d8491dabe4cd898456117b in current term 1: Already voted for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in this term.
I20260709 12:59:59.958519  7914 leader_election.cc:304] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46d6067a96d8491dabe4cd898456117b; no voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954
I20260709 12:59:59.959115  8197 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.963315  8197 raft_consensus.cc:2749] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:59.997113  8169 consensus_queue.cc:1048] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.009583  8169 consensus_queue.cc:1048] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.042268  8197 raft_consensus.cc:493] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.042723  8197 raft_consensus.cc:515] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.044237  8197 leader_election.cc:290] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:00.045019  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" is_pre_election: true
I20260709 13:00:00.045123  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 13:00:00.045637  8024 raft_consensus.cc:2468] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 0.
I20260709 13:00:00.045703  8097 raft_consensus.cc:2468] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 0.
I20260709 13:00:00.046582  7912 leader_election.cc:304] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:00.047199  8197 raft_consensus.cc:2804] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:00.047540  8197 raft_consensus.cc:493] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.047817  8197 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.052006  8197 raft_consensus.cc:515] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.053572  8197 leader_election.cc:290] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:00.054266  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:00.054503  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:00.054865  8024 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.055016  8097 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.059500  8097 raft_consensus.cc:2468] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 1.
I20260709 13:00:00.060282  8024 raft_consensus.cc:2468] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 1.
I20260709 13:00:00.060385  7914 leader_election.cc:304] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:00.061076  8197 raft_consensus.cc:2804] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.061479  8197 raft_consensus.cc:697] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:00.062216  8197 consensus_queue.cc:237] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.069227  7847 catalog_manager.cc:5697] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 0 to 1, leader changed from <none> to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.070706  8197 raft_consensus.cc:493] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.071152  8197 raft_consensus.cc:515] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.072716  8197 leader_election.cc:290] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:00.073449  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078001b9f4b248a19ca7cb703a53620c" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" is_pre_election: true
I20260709 13:00:00.073549  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078001b9f4b248a19ca7cb703a53620c" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6" is_pre_election: true
I20260709 13:00:00.074097  8024 raft_consensus.cc:2468] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 0.
I20260709 13:00:00.074261  8097 raft_consensus.cc:2468] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 0.
I20260709 13:00:00.075155  7912 leader_election.cc:304] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:00.075919  8197 raft_consensus.cc:2804] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:00.076284  8197 raft_consensus.cc:493] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.076568  8197 raft_consensus.cc:3060] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.081295  8197 raft_consensus.cc:515] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.082844  8197 leader_election.cc:290] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:00.083588  8024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078001b9f4b248a19ca7cb703a53620c" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:00.083753  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078001b9f4b248a19ca7cb703a53620c" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:00.084125  8024 raft_consensus.cc:3060] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.084280  8097 raft_consensus.cc:3060] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.088467  8024 raft_consensus.cc:2468] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 1.
I20260709 13:00:00.088683  8097 raft_consensus.cc:2468] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 1.
I20260709 13:00:00.089462  7912 leader_election.cc:304] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:00.090096  8197 raft_consensus.cc:2804] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.090553  8197 raft_consensus.cc:697] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:00.091329  8197 consensus_queue.cc:237] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.093252  8176 consensus_queue.cc:1048] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.098559  7847 catalog_manager.cc:5697] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 0 to 1, leader changed from <none> to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.105154  8176 consensus_queue.cc:1048] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.125564  8169 consensus_queue.cc:1048] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.134778  8172 consensus_queue.cc:1048] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.156939  8172 consensus_queue.cc:1048] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.157774  8169 consensus_queue.cc:1048] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.172058  8146 consensus_queue.cc:1048] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.179869  8213 consensus_queue.cc:1048] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.260488  8146 consensus_queue.cc:1048] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.270867  8146 consensus_queue.cc:1048] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.362421  8097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc75cf5a579941eda24e56ebdeb14fdc"
dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
mode: GRACEFUL
new_leader_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:43748
I20260709 13:00:00.362883  8097 raft_consensus.cc:606] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 1 LEADER]: Received request to transfer leadership to TS 46d6067a96d8491dabe4cd898456117b
I20260709 13:00:00.368054  8097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d59a33378da84409ae824861a1975495"
dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
mode: GRACEFUL
new_leader_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:43748
I20260709 13:00:00.368661  8097 raft_consensus.cc:606] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 LEADER]: Received request to transfer leadership to TS 46d6067a96d8491dabe4cd898456117b
I20260709 13:00:00.381397  8024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82028f91f7b34469914eb751cb976770"
dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
mode: GRACEFUL
new_leader_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:34240
I20260709 13:00:00.381887  8024 raft_consensus.cc:606] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Received request to transfer leadership to TS 46d6067a96d8491dabe4cd898456117b
I20260709 13:00:00.386690  8024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f"
dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
mode: GRACEFUL
new_leader_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:34240
I20260709 13:00:00.387152  8024 raft_consensus.cc:606] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Received request to transfer leadership to TS 46d6067a96d8491dabe4cd898456117b
I20260709 13:00:00.400957  7949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
mode: GRACEFUL
new_leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
 from {username='slave'} at 127.0.0.1:36626
I20260709 13:00:00.401404  7949 raft_consensus.cc:606] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Received request to transfer leadership to TS 22f4ef8d8d414fe8ae9e857a8cb65954
I20260709 13:00:00.410748  7949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "078001b9f4b248a19ca7cb703a53620c"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
mode: GRACEFUL
new_leader_uuid: "18cfbeb6506c485aa6568747de8e32f6"
 from {username='slave'} at 127.0.0.1:36626
I20260709 13:00:00.411180  7949 raft_consensus.cc:606] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Received request to transfer leadership to TS 18cfbeb6506c485aa6568747de8e32f6
I20260709 13:00:00.529166  8176 raft_consensus.cc:993] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6: : Instructing follower 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:00.529582  8157 raft_consensus.cc:1081] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 1 LEADER]: Signalling peer 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:00.530994  7949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc75cf5a579941eda24e56ebdeb14fdc"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:36608
I20260709 13:00:00.531422  7949 raft_consensus.cc:493] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.531659  7949 raft_consensus.cc:3060] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.536765  8197 consensus_queue.cc:1048] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.536689  7949 raft_consensus.cc:515] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.539258  7949 leader_election.cc:290] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:00.539999  8023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc75cf5a579941eda24e56ebdeb14fdc" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:00.540395  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc75cf5a579941eda24e56ebdeb14fdc" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:00.540617  8023 raft_consensus.cc:3060] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.540934  8097 raft_consensus.cc:3055] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:00.541289  8097 raft_consensus.cc:740] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 13:00:00.542194  8097 consensus_queue.cc:260] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.543498  8097 raft_consensus.cc:3060] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.545634  8156 raft_consensus.cc:993] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b: : Instructing follower 22f4ef8d8d414fe8ae9e857a8cb65954 to start an election
I20260709 13:00:00.546115  8156 raft_consensus.cc:1081] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Signalling peer 22f4ef8d8d414fe8ae9e857a8cb65954 to start an election
I20260709 13:00:00.549237  8022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405"
dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
 from {username='slave'} at 127.0.0.1:34226
I20260709 13:00:00.549867  8022 raft_consensus.cc:493] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.550179  8097 raft_consensus.cc:2468] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:00.550275  8022 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.552101  7914 leader_election.cc:304] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:00.552845  8156 raft_consensus.cc:2804] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:00.553293  8156 raft_consensus.cc:697] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:00.554090  8156 consensus_queue.cc:237] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.555765  8023 raft_consensus.cc:2468] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:00.558174  8156 consensus_queue.cc:1048] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.558997  8022 raft_consensus.cc:515] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.562495  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 13:00:00.563097  7949 raft_consensus.cc:3055] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:00.563469  7949 raft_consensus.cc:740] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:00.562822  7845 catalog_manager.cc:5697] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 1 to 2, leader changed from 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195) to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.564409  7949 consensus_queue.cc:260] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.565451  7949 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.567947  8022 leader_election.cc:290] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 2 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:00.573253  7949 raft_consensus.cc:2468] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 2.
I20260709 13:00:00.573899  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:00.574452  8097 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.574568  7989 leader_election.cc:304] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:00.575377  8146 raft_consensus.cc:2804] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:00.575834  8146 raft_consensus.cc:697] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 LEADER]: Becoming Leader. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 13:00:00.576597  8146 consensus_queue.cc:237] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.580672  8097 raft_consensus.cc:2468] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 2.
I20260709 13:00:00.583578  7847 catalog_manager.cc:5697] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 reported cstate change: term changed from 1 to 2, leader changed from 46d6067a96d8491dabe4cd898456117b (127.7.41.193) to 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.596621  8213 raft_consensus.cc:993] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954: : Instructing follower 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:00.597060  8146 raft_consensus.cc:1081] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Signalling peer 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:00.598439  7949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:36622
I20260709 13:00:00.598878  7949 raft_consensus.cc:493] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.599166  7949 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.603467  7949 raft_consensus.cc:515] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.605122  7949 leader_election.cc:290] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:00.605821  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:00.606170  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:00.606391  8022 raft_consensus.cc:3055] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:00.606681  8097 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.606766  8022 raft_consensus.cc:740] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 13:00:00.607501  8022 consensus_queue.cc:260] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.608373  8022 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.611188  8097 raft_consensus.cc:2468] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:00.612170  7914 leader_election.cc:304] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:00.612932  8156 raft_consensus.cc:2804] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:00.613091  8022 raft_consensus.cc:2468] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:00.613382  8156 raft_consensus.cc:697] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:00.614217  8156 consensus_queue.cc:237] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.619974  7845 catalog_manager.cc:5697] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 1 to 2, leader changed from 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194) to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.625209  8156 consensus_queue.cc:1048] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.636601  8156 consensus_queue.cc:1048] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.644197  8197 raft_consensus.cc:993] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b: : Instructing follower 18cfbeb6506c485aa6568747de8e32f6 to start an election
I20260709 13:00:00.644630  8156 raft_consensus.cc:1081] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Signalling peer 18cfbeb6506c485aa6568747de8e32f6 to start an election
I20260709 13:00:00.646164  8097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "078001b9f4b248a19ca7cb703a53620c"
dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
 from {username='slave'} at 127.0.0.1:43724
I20260709 13:00:00.646641  8097 raft_consensus.cc:493] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.646997  8097 raft_consensus.cc:3060] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.651274  8097 raft_consensus.cc:515] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.652740  8097 leader_election.cc:290] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 2 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 13:00:00.653569  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078001b9f4b248a19ca7cb703a53620c" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 13:00:00.653839  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "078001b9f4b248a19ca7cb703a53620c" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:00.654603  7949 raft_consensus.cc:3055] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:00.654701  8022 raft_consensus.cc:3060] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.654932  7949 raft_consensus.cc:740] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:00.655718  7949 consensus_queue.cc:260] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.656570  7949 raft_consensus.cc:3060] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.659888  8022 raft_consensus.cc:2468] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 2.
I20260709 13:00:00.660823  8061 leader_election.cc:304] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 13:00:00.661180  7949 raft_consensus.cc:2468] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 2.
I20260709 13:00:00.661505  8157 raft_consensus.cc:2804] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:00.661963  8157 raft_consensus.cc:697] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 2 LEADER]: Becoming Leader. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 13:00:00.662734  8157 consensus_queue.cc:237] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.668272  7847 catalog_manager.cc:5697] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 reported cstate change: term changed from 1 to 2, leader changed from 46d6067a96d8491dabe4cd898456117b (127.7.41.193) to 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "18cfbeb6506c485aa6568747de8e32f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.702728  8176 raft_consensus.cc:993] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6: : Instructing follower 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:00.703152  8157 raft_consensus.cc:1081] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 LEADER]: Signalling peer 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:00.704471  7949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d59a33378da84409ae824861a1975495"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:36608
I20260709 13:00:00.704936  7949 raft_consensus.cc:493] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.705255  7949 raft_consensus.cc:3060] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.709604  7949 raft_consensus.cc:515] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.711433  7949 leader_election.cc:290] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:00.712507  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d59a33378da84409ae824861a1975495" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:00.712507  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d59a33378da84409ae824861a1975495" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:00.713284  8097 raft_consensus.cc:3055] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:00.713408  8022 raft_consensus.cc:3060] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.713611  8097 raft_consensus.cc:740] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 13:00:00.714401  8097 consensus_queue.cc:260] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.715401  8097 raft_consensus.cc:3060] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.719693  8022 raft_consensus.cc:2468] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:00.720702  7912 leader_election.cc:304] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:00.721231  8097 raft_consensus.cc:2468] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:00.721356  8156 raft_consensus.cc:2804] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:00.721868  8156 raft_consensus.cc:697] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:00.722671  8156 consensus_queue.cc:237] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.728317  7847 catalog_manager.cc:5697] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 1 to 2, leader changed from 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195) to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.739001  8169 raft_consensus.cc:993] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954: : Instructing follower 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:00.739449  8213 raft_consensus.cc:1081] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Signalling peer 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:00.740839  7949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82028f91f7b34469914eb751cb976770"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:36622
I20260709 13:00:00.741285  7949 raft_consensus.cc:493] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:00.741581  7949 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.747218  7949 raft_consensus.cc:515] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.748799  7949 leader_election.cc:290] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:00.749482  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:00.749677  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:00.750103  8022 raft_consensus.cc:3055] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:00.750211  8097 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.750423  8022 raft_consensus.cc:740] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 13:00:00.751114  8022 consensus_queue.cc:260] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.751953  8022 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:00.755160  8097 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:00.756170  7914 leader_election.cc:304] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:00.756973  8156 raft_consensus.cc:2804] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:00.757431  8156 raft_consensus.cc:697] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:00.758636  8022 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:00.758258  8156 consensus_queue.cc:237] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:00.764226  7847 catalog_manager.cc:5697] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 1 to 2, leader changed from 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194) to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.980208  8022 raft_consensus.cc:1275] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:00.981503  8197 consensus_queue.cc:1048] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:00.990257  8097 raft_consensus.cc:1275] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:00.992051  8156 consensus_queue.cc:1048] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.078934  8097 raft_consensus.cc:1275] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Refusing update from remote peer 22f4ef8d8d414fe8ae9e857a8cb65954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.080394  8146 consensus_queue.cc:1048] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:01.082175  7949 raft_consensus.cc:1275] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Refusing update from remote peer 22f4ef8d8d414fe8ae9e857a8cb65954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.083537  8146 consensus_queue.cc:1048] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.120438  8022 raft_consensus.cc:1275] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Refusing update from remote peer 18cfbeb6506c485aa6568747de8e32f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.121985  8157 consensus_queue.cc:1048] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.130119  7949 raft_consensus.cc:1275] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Refusing update from remote peer 18cfbeb6506c485aa6568747de8e32f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.131525  8226 consensus_queue.cc:1048] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.140408  8022 raft_consensus.cc:1275] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.141171  8097 raft_consensus.cc:1275] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.141738  8197 consensus_queue.cc:1048] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.143682  8197 consensus_queue.cc:1048] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.159102  8023 raft_consensus.cc:1275] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.164172  8097 raft_consensus.cc:1275] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.164004  8156 consensus_queue.cc:1048] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.166556  8156 consensus_queue.cc:1048] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.301928  8022 raft_consensus.cc:1275] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.303205  8194 consensus_queue.cc:1048] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:01.311162  8097 raft_consensus.cc:1275] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:01.312480  8197 consensus_queue.cc:1048] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:03.441488  7335 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:00:03.442250  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:03.457358  7947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82028f91f7b34469914eb751cb976770"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
mode: GRACEFUL
new_leader_uuid: "18cfbeb6506c485aa6568747de8e32f6"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:00:03.457860  7947 raft_consensus.cc:606] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Received request to transfer leadership to TS 18cfbeb6506c485aa6568747de8e32f6
I20260709 13:00:03.460106  7947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
mode: GRACEFUL
new_leader_uuid: "18cfbeb6506c485aa6568747de8e32f6"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:00:03.460566  7947 raft_consensus.cc:606] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Received request to transfer leadership to TS 18cfbeb6506c485aa6568747de8e32f6
I20260709 13:00:03.461513  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:03.461967  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:03.495748  8197 raft_consensus.cc:993] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b: : Instructing follower 18cfbeb6506c485aa6568747de8e32f6 to start an election
I20260709 13:00:03.496268  8234 raft_consensus.cc:1081] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Signalling peer 18cfbeb6506c485aa6568747de8e32f6 to start an election
I20260709 13:00:03.497830  8097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f"
dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
 from {username='slave'} at 127.0.0.1:43724
I20260709 13:00:03.498330  8097 raft_consensus.cc:493] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.498634  8097 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.503496  8097 raft_consensus.cc:515] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:03.505085  8097 leader_election.cc:290] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 3 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 13:00:03.505915  7947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 13:00:03.506152  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:03.506533  7947 raft_consensus.cc:3055] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:03.506734  8022 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.506903  7947 raft_consensus.cc:740] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:03.507632  7947 consensus_queue.cc:260] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:03.508543  7947 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.511737  8022 raft_consensus.cc:2468] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 3.
I20260709 13:00:03.512773  8061 leader_election.cc:304] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 13:00:03.512910  7947 raft_consensus.cc:2468] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 3.
I20260709 13:00:03.513499  8233 raft_consensus.cc:2804] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:03.514645  8233 raft_consensus.cc:697] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 3 LEADER]: Becoming Leader. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 13:00:03.515311  8233 consensus_queue.cc:237] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:03.521608  7847 catalog_manager.cc:5697] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 reported cstate change: term changed from 2 to 3, leader changed from 46d6067a96d8491dabe4cd898456117b (127.7.41.193) to 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "18cfbeb6506c485aa6568747de8e32f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:03.732651  8197 raft_consensus.cc:993] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b: : Instructing follower 18cfbeb6506c485aa6568747de8e32f6 to start an election
I20260709 13:00:03.733069  8234 raft_consensus.cc:1081] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Signalling peer 18cfbeb6506c485aa6568747de8e32f6 to start an election
I20260709 13:00:03.734359  8097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82028f91f7b34469914eb751cb976770"
dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
 from {username='slave'} at 127.0.0.1:43724
I20260709 13:00:03.734733  8097 raft_consensus.cc:493] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:03.734951  8097 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.738860  8097 raft_consensus.cc:515] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:03.740254  8097 leader_election.cc:290] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 3 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 13:00:03.741190  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:03.741091  7947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 13:00:03.741819  8022 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.741900  7947 raft_consensus.cc:3055] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:03.742312  7947 raft_consensus.cc:740] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:03.743089  7947 consensus_queue.cc:260] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:03.744275  7947 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.748591  8022 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 3.
I20260709 13:00:03.749677  8061 leader_election.cc:304] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 13:00:03.750353  8233 raft_consensus.cc:2804] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:03.750705  7947 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 3.
I20260709 13:00:03.750860  8233 raft_consensus.cc:697] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 LEADER]: Becoming Leader. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 13:00:03.751641  8233 consensus_queue.cc:237] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:03.757789  7847 catalog_manager.cc:5697] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 reported cstate change: term changed from 2 to 3, leader changed from 46d6067a96d8491dabe4cd898456117b (127.7.41.193) to 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "18cfbeb6506c485aa6568747de8e32f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:03.929179  7947 raft_consensus.cc:1275] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Refusing update from remote peer 18cfbeb6506c485aa6568747de8e32f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:03.930413  8233 consensus_queue.cc:1048] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:03.942620  8022 raft_consensus.cc:1275] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 3 FOLLOWER]: Refusing update from remote peer 18cfbeb6506c485aa6568747de8e32f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:03.943956  8233 consensus_queue.cc:1048] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.138294  7947 raft_consensus.cc:1275] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Refusing update from remote peer 18cfbeb6506c485aa6568747de8e32f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:04.139614  8233 consensus_queue.cc:1048] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.147991  8022 raft_consensus.cc:1275] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 3 FOLLOWER]: Refusing update from remote peer 18cfbeb6506c485aa6568747de8e32f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:04.149938  8233 consensus_queue.cc:1048] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.462754  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:04.481345  8097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82028f91f7b34469914eb751cb976770"
dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
mode: GRACEFUL
new_leader_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:43748
I20260709 13:00:04.481807  8097 raft_consensus.cc:606] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 LEADER]: Received request to transfer leadership to TS 46d6067a96d8491dabe4cd898456117b
I20260709 13:00:04.486081  8097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f"
dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
mode: GRACEFUL
new_leader_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:43748
I20260709 13:00:04.486565  8097 raft_consensus.cc:606] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 3 LEADER]: Received request to transfer leadership to TS 46d6067a96d8491dabe4cd898456117b
I20260709 13:00:04.490759  8022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c759d15664924d049e64d0327f4fd88e"
dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
mode: GRACEFUL
new_leader_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:34240
I20260709 13:00:04.491264  8022 raft_consensus.cc:606] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Received request to transfer leadership to TS 46d6067a96d8491dabe4cd898456117b
I20260709 13:00:04.495803  8022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405"
dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
mode: GRACEFUL
new_leader_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:34240
I20260709 13:00:04.496261  8022 raft_consensus.cc:606] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 LEADER]: Received request to transfer leadership to TS 46d6067a96d8491dabe4cd898456117b
I20260709 13:00:04.500741  8022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9ad8e40ca6f4cedbd97dd1566fd477f"
dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
mode: GRACEFUL
new_leader_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:34240
I20260709 13:00:04.501439  8022 raft_consensus.cc:606] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Received request to transfer leadership to TS 46d6067a96d8491dabe4cd898456117b
I20260709 13:00:04.613999  8233 raft_consensus.cc:993] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6: : Instructing follower 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:04.614547  8237 raft_consensus.cc:1081] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 LEADER]: Signalling peer 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:04.615789  7947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82028f91f7b34469914eb751cb976770"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:36608
I20260709 13:00:04.616255  7947 raft_consensus.cc:493] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:04.616573  7947 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:04.620832  7947 raft_consensus.cc:515] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:04.622412  7947 leader_election.cc:290] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 4 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:04.623063  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:04.623467  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:04.623687  8022 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:04.623979  8097 raft_consensus.cc:3055] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:04.624233  8097 raft_consensus.cc:740] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 13:00:04.624825  8097 consensus_queue.cc:260] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:04.625569  8097 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:04.628100  8022 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 4.
I20260709 13:00:04.629050  7912 leader_election.cc:304] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:04.629460  8097 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 4.
I20260709 13:00:04.629678  8234 raft_consensus.cc:2804] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:04.630643  8234 raft_consensus.cc:697] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 4 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:04.631356  8234 consensus_queue.cc:237] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:04.636528  7847 catalog_manager.cc:5697] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 3 to 4, leader changed from 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195) to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 4 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.827273  8244 raft_consensus.cc:993] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954: : Instructing follower 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:04.827705  8244 raft_consensus.cc:1081] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Signalling peer 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:04.829191  7947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c759d15664924d049e64d0327f4fd88e"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:36622
I20260709 13:00:04.829737  7947 raft_consensus.cc:493] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:04.830197  7947 raft_consensus.cc:3060] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:04.835348  7947 raft_consensus.cc:515] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:04.837327  7947 leader_election.cc:290] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:04.838054  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c759d15664924d049e64d0327f4fd88e" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:04.838446  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c759d15664924d049e64d0327f4fd88e" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:04.838680  8022 raft_consensus.cc:3055] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:04.839010  8097 raft_consensus.cc:3060] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:04.839036  8022 raft_consensus.cc:740] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 13:00:04.840003  8022 consensus_queue.cc:260] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:04.840981  8022 raft_consensus.cc:3060] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:04.842204  8257 raft_consensus.cc:993] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954: : Instructing follower 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:04.842690  8244 raft_consensus.cc:1081] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 LEADER]: Signalling peer 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:04.844305  7947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:36622
I20260709 13:00:04.844875  7947 raft_consensus.cc:493] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:04.844915  8097 raft_consensus.cc:2468] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:04.845389  7947 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:04.846261  7914 leader_election.cc:304] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:04.846941  8234 raft_consensus.cc:2804] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:04.847277  8022 raft_consensus.cc:2468] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:04.847363  8234 raft_consensus.cc:697] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:04.848405  8234 consensus_queue.cc:237] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:04.851600  7947 raft_consensus.cc:515] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:04.853874  7947 leader_election.cc:290] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 3 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:04.854676  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:04.855217  8022 raft_consensus.cc:3055] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:04.855370  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:04.855543  8022 raft_consensus.cc:740] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 13:00:04.855919  8097 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:04.856621  7847 catalog_manager.cc:5697] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 1 to 2, leader changed from 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194) to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.857110  8022 consensus_queue.cc:260] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:04.858279  8022 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:04.860810  8097 raft_consensus.cc:2468] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 3.
I20260709 13:00:04.861903  7914 leader_election.cc:304] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:04.862855  8234 raft_consensus.cc:2804] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:04.863292  8234 raft_consensus.cc:697] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 3 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:04.863420  8022 raft_consensus.cc:2468] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 3.
I20260709 13:00:04.864079  8234 consensus_queue.cc:237] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:04.870213  7847 catalog_manager.cc:5697] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 2 to 3, leader changed from 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194) to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 3 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:05.014382  8257 raft_consensus.cc:993] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954: : Instructing follower 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:05.014880  8244 raft_consensus.cc:1081] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Signalling peer 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:05.016305  7947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9ad8e40ca6f4cedbd97dd1566fd477f"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:36622
I20260709 13:00:05.016770  7947 raft_consensus.cc:493] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:05.017059  7947 raft_consensus.cc:3060] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:05.022253  7947 raft_consensus.cc:515] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:05.024284  7947 leader_election.cc:290] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:05.024885  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ad8e40ca6f4cedbd97dd1566fd477f" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:05.025324  8022 raft_consensus.cc:3055] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:05.025238  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ad8e40ca6f4cedbd97dd1566fd477f" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:05.025707  8022 raft_consensus.cc:740] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 13:00:05.025889  8097 raft_consensus.cc:3060] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:05.026760  8233 raft_consensus.cc:993] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6: : Instructing follower 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:05.026433  8022 consensus_queue.cc:260] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:05.027177  8237 raft_consensus.cc:1081] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 3 LEADER]: Signalling peer 46d6067a96d8491dabe4cd898456117b to start an election
I20260709 13:00:05.027420  8022 raft_consensus.cc:3060] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:05.028713  7949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
 from {username='slave'} at 127.0.0.1:36608
I20260709 13:00:05.029192  7949 raft_consensus.cc:493] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:05.029484  7949 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:05.030742  8097 raft_consensus.cc:2468] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:05.033179  8022 raft_consensus.cc:2468] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 2.
I20260709 13:00:05.033614  7914 leader_election.cc:304] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:05.034421  8234 raft_consensus.cc:2804] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:05.034924  8234 raft_consensus.cc:697] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:05.034925  7949 raft_consensus.cc:515] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:05.035790  8234 consensus_queue.cc:237] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:05.036623  7949 leader_election.cc:290] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 4 election: Requested vote from peers 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:05.037387  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:05.037775  8022 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:05.038939  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "46d6067a96d8491dabe4cd898456117b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:05.039532  8097 raft_consensus.cc:3055] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:05.039858  8097 raft_consensus.cc:740] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 13:00:05.040606  8097 consensus_queue.cc:260] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:05.041617  8097 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:05.042979  8022 raft_consensus.cc:2468] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 4.
I20260709 13:00:05.043938  7912 leader_election.cc:304] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22f4ef8d8d414fe8ae9e857a8cb65954, 46d6067a96d8491dabe4cd898456117b; no voters: 
I20260709 13:00:05.043995  7847 catalog_manager.cc:5697] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 1 to 2, leader changed from 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194) to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:05.044835  8234 raft_consensus.cc:2804] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:05.045291  8234 raft_consensus.cc:697] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 4 LEADER]: Becoming Leader. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:05.046139  8097 raft_consensus.cc:2468] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6067a96d8491dabe4cd898456117b in term 4.
I20260709 13:00:05.046054  8234 consensus_queue.cc:237] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:05.056492  7847 catalog_manager.cc:5697] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b reported cstate change: term changed from 3 to 4, leader changed from 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195) to 46d6067a96d8491dabe4cd898456117b (127.7.41.193). New cstate: current_term: 4 leader_uuid: "46d6067a96d8491dabe4cd898456117b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:05.148698  8097 raft_consensus.cc:1275] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:05.149839  8234 consensus_queue.cc:1048] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:05.158334  8022 raft_consensus.cc:1275] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:05.159790  8234 consensus_queue.cc:1048] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:05.353312  8097 raft_consensus.cc:1275] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:05.354486  8234 consensus_queue.cc:1048] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:05.363801  8022 raft_consensus.cc:1275] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:05.365447  8265 consensus_queue.cc:1048] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:05.367125  8023 raft_consensus.cc:1275] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 3 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:05.368969  8253 consensus_queue.cc:1048] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:05.377599  8097 raft_consensus.cc:1275] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:05.379328  8265 consensus_queue.cc:1048] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:05.478538  8022 raft_consensus.cc:1275] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:05.479769  8265 consensus_queue.cc:1048] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:05.487759  8097 raft_consensus.cc:1275] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:05.489858  8234 consensus_queue.cc:1048] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:05.560302  8097 raft_consensus.cc:1275] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:05.561722  8234 consensus_queue.cc:1048] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:05.569484  8022 raft_consensus.cc:1275] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 FOLLOWER]: Refusing update from remote peer 46d6067a96d8491dabe4cd898456117b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:05.570847  8253 consensus_queue.cc:1048] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:07.508737  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:07.516501  7949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82028f91f7b34469914eb751cb976770"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
mode: GRACEFUL
new_leader_uuid: "18cfbeb6506c485aa6568747de8e32f6"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:00:07.517223  7949 raft_consensus.cc:606] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 4 LEADER]: Received request to transfer leadership to TS 18cfbeb6506c485aa6568747de8e32f6
I20260709 13:00:07.519944  7949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
mode: GRACEFUL
new_leader_uuid: "18cfbeb6506c485aa6568747de8e32f6"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:00:07.520471  7949 raft_consensus.cc:606] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 4 LEADER]: Received request to transfer leadership to TS 18cfbeb6506c485aa6568747de8e32f6
I20260709 13:00:07.523103  7949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0f551a2fd9d46769f8729b9dc89cbdb"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
mode: GRACEFUL
new_leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:00:07.523613  7949 raft_consensus.cc:606] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Received request to transfer leadership to TS 22f4ef8d8d414fe8ae9e857a8cb65954
I20260709 13:00:07.525808  7949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405"
dest_uuid: "46d6067a96d8491dabe4cd898456117b"
mode: GRACEFUL
new_leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:00:07.526283  7949 raft_consensus.cc:606] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 3 LEADER]: Received request to transfer leadership to TS 22f4ef8d8d414fe8ae9e857a8cb65954
I20260709 13:00:07.527215  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:07.527657  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:07.564254  8234 raft_consensus.cc:993] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b: : Instructing follower 22f4ef8d8d414fe8ae9e857a8cb65954 to start an election
I20260709 13:00:07.564767  8278 raft_consensus.cc:1081] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Signalling peer 22f4ef8d8d414fe8ae9e857a8cb65954 to start an election
I20260709 13:00:07.566237  8022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0f551a2fd9d46769f8729b9dc89cbdb"
dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
 from {username='slave'} at 127.0.0.1:34226
I20260709 13:00:07.566674  8022 raft_consensus.cc:493] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.566931  8022 raft_consensus.cc:3060] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.571704  8022 raft_consensus.cc:515] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 13:00:07.573274  8022 leader_election.cc:290] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 2 election: Requested vote from peers 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219), 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543)
I20260709 13:00:07.574492  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f551a2fd9d46769f8729b9dc89cbdb" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 13:00:07.574298  8097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f551a2fd9d46769f8729b9dc89cbdb" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:07.575068  7949 raft_consensus.cc:3055] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:07.575111  8097 raft_consensus.cc:3060] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.575492  7949 raft_consensus.cc:740] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:07.576449  7949 consensus_queue.cc:260] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 13:00:07.577755  7949 raft_consensus.cc:3060] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:07.582141  8097 raft_consensus.cc:2468] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 2.
I20260709 13:00:07.583561  7989 leader_election.cc:304] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 13:00:07.584435  8244 raft_consensus.cc:2804] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:07.584465  7949 raft_consensus.cc:2468] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 2.
I20260709 13:00:07.585629  8244 raft_consensus.cc:697] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 LEADER]: Becoming Leader. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 13:00:07.586799  8244 consensus_queue.cc:237] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } }
I20260709 13:00:07.593823  7844 catalog_manager.cc:5697] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 reported cstate change: term changed from 1 to 2, leader changed from 46d6067a96d8491dabe4cd898456117b (127.7.41.193) to 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.740316  8234 raft_consensus.cc:993] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b: : Instructing follower 18cfbeb6506c485aa6568747de8e32f6 to start an election
I20260709 13:00:07.740778  8278 raft_consensus.cc:1081] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 4 LEADER]: Signalling peer 18cfbeb6506c485aa6568747de8e32f6 to start an election
I20260709 13:00:07.742295  8097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f"
dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
 from {username='slave'} at 127.0.0.1:43724
I20260709 13:00:07.742741  8097 raft_consensus.cc:493] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.743016  8097 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.747853  8097 raft_consensus.cc:515] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:07.749395  8097 leader_election.cc:290] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 5 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 13:00:07.750247  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 13:00:07.750468  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5489fc78c6e464ca0aa0ad89a40a31f" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:07.750771  7949 raft_consensus.cc:3055] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:07.750988  8022 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.751086  7949 raft_consensus.cc:740] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:07.751894  7949 consensus_queue.cc:260] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:07.752665  7949 raft_consensus.cc:3060] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.755159  8022 raft_consensus.cc:2468] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 5.
I20260709 13:00:07.756232  8061 leader_election.cc:304] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 13:00:07.756904  7949 raft_consensus.cc:2468] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 5.
I20260709 13:00:07.757015  8237 raft_consensus.cc:2804] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:07.758221  8237 raft_consensus.cc:697] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 5 LEADER]: Becoming Leader. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 13:00:07.758991  8237 consensus_queue.cc:237] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:07.765064  7844 catalog_manager.cc:5697] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 reported cstate change: term changed from 4 to 5, leader changed from 46d6067a96d8491dabe4cd898456117b (127.7.41.193) to 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195). New cstate: current_term: 5 leader_uuid: "18cfbeb6506c485aa6568747de8e32f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.903641  8234 raft_consensus.cc:993] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b: : Instructing follower 18cfbeb6506c485aa6568747de8e32f6 to start an election
I20260709 13:00:07.904090  8234 raft_consensus.cc:1081] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 4 LEADER]: Signalling peer 18cfbeb6506c485aa6568747de8e32f6 to start an election
I20260709 13:00:07.905395  8097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82028f91f7b34469914eb751cb976770"
dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
 from {username='slave'} at 127.0.0.1:43724
I20260709 13:00:07.905848  8097 raft_consensus.cc:493] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.906183  8097 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.910306  8097 raft_consensus.cc:515] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:07.911656  8097 leader_election.cc:290] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 5 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194:38695)
I20260709 13:00:07.912410  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 13:00:07.912669  8022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82028f91f7b34469914eb751cb976770" candidate_uuid: "18cfbeb6506c485aa6568747de8e32f6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
I20260709 13:00:07.912936  7949 raft_consensus.cc:3055] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:07.913273  8022 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.913250  7949 raft_consensus.cc:740] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:07.914222  7949 consensus_queue.cc:260] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:07.915390  7949 raft_consensus.cc:3060] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.917889  8022 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 5.
I20260709 13:00:07.918808  8061 leader_election.cc:304] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 13:00:07.919452  8237 raft_consensus.cc:2804] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:07.919776  7949 raft_consensus.cc:2468] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18cfbeb6506c485aa6568747de8e32f6 in term 5.
I20260709 13:00:07.919929  8237 raft_consensus.cc:697] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 5 LEADER]: Becoming Leader. State: Replica: 18cfbeb6506c485aa6568747de8e32f6, State: Running, Role: LEADER
I20260709 13:00:07.920804  8237 consensus_queue.cc:237] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:07.927541  7844 catalog_manager.cc:5697] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 reported cstate change: term changed from 4 to 5, leader changed from 46d6067a96d8491dabe4cd898456117b (127.7.41.193) to 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195). New cstate: current_term: 5 leader_uuid: "18cfbeb6506c485aa6568747de8e32f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.013217  8278 raft_consensus.cc:993] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b: : Instructing follower 22f4ef8d8d414fe8ae9e857a8cb65954 to start an election
I20260709 13:00:08.013671  8234 raft_consensus.cc:1081] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 3 LEADER]: Signalling peer 22f4ef8d8d414fe8ae9e857a8cb65954 to start an election
I20260709 13:00:08.015087  8022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405"
dest_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954"
 from {username='slave'} at 127.0.0.1:34226
I20260709 13:00:08.015506  8022 raft_consensus.cc:493] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:08.015789  8022 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.017669  8097 raft_consensus.cc:1275] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Refusing update from remote peer 22f4ef8d8d414fe8ae9e857a8cb65954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:08.018780  8244 consensus_queue.cc:1048] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:08.020510  8022 raft_consensus.cc:515] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:08.022535  8022 leader_election.cc:290] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 4 election: Requested vote from peers 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543), 18cfbeb6506c485aa6568747de8e32f6 (127.7.41.195:36219)
I20260709 13:00:08.023872  8096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "18cfbeb6506c485aa6568747de8e32f6"
I20260709 13:00:08.024533  8096 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.024802  7949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0891e7dd5644c3a2eb1061b9bb4405" candidate_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "46d6067a96d8491dabe4cd898456117b"
I20260709 13:00:08.025308  7949 raft_consensus.cc:3055] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:08.025609  7949 raft_consensus.cc:740] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 46d6067a96d8491dabe4cd898456117b, State: Running, Role: LEADER
I20260709 13:00:08.026322  7949 consensus_queue.cc:260] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:08.027505  7949 raft_consensus.cc:3060] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.031414  8096 raft_consensus.cc:2468] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 4.
I20260709 13:00:08.032378  7989 leader_election.cc:304] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18cfbeb6506c485aa6568747de8e32f6, 22f4ef8d8d414fe8ae9e857a8cb65954; no voters: 
I20260709 13:00:08.033200  8244 raft_consensus.cc:2804] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:08.034682  7949 raft_consensus.cc:2468] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22f4ef8d8d414fe8ae9e857a8cb65954 in term 4.
I20260709 13:00:08.035652  8244 raft_consensus.cc:697] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 LEADER]: Becoming Leader. State: Replica: 22f4ef8d8d414fe8ae9e857a8cb65954, State: Running, Role: LEADER
I20260709 13:00:08.038201  7949 raft_consensus.cc:1275] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Refusing update from remote peer 22f4ef8d8d414fe8ae9e857a8cb65954: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:08.039641  8290 consensus_queue.cc:1048] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:08.036926  8244 consensus_queue.cc:237] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } }
I20260709 13:00:08.054867  7844 catalog_manager.cc:5697] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 reported cstate change: term changed from 3 to 4, leader changed from 46d6067a96d8491dabe4cd898456117b (127.7.41.193) to 22f4ef8d8d414fe8ae9e857a8cb65954 (127.7.41.194). New cstate: current_term: 4 leader_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:08.199384  8022 raft_consensus.cc:1275] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 5 FOLLOWER]: Refusing update from remote peer 18cfbeb6506c485aa6568747de8e32f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:08.200642  8237 consensus_queue.cc:1048] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.210206  7949 raft_consensus.cc:1275] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 5 FOLLOWER]: Refusing update from remote peer 18cfbeb6506c485aa6568747de8e32f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:08.211918  8237 consensus_queue.cc:1048] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.375147  7949 raft_consensus.cc:1275] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 5 FOLLOWER]: Refusing update from remote peer 18cfbeb6506c485aa6568747de8e32f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:08.376214  8237 consensus_queue.cc:1048] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:08.384950  8022 raft_consensus.cc:1275] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 5 FOLLOWER]: Refusing update from remote peer 18cfbeb6506c485aa6568747de8e32f6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:08.386652  8300 consensus_queue.cc:1048] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22f4ef8d8d414fe8ae9e857a8cb65954" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:08.492035  8097 raft_consensus.cc:1275] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Refusing update from remote peer 22f4ef8d8d414fe8ae9e857a8cb65954: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:08.493360  8244 consensus_queue.cc:1048] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18cfbeb6506c485aa6568747de8e32f6" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.503557  7949 raft_consensus.cc:1275] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 4 FOLLOWER]: Refusing update from remote peer 22f4ef8d8d414fe8ae9e857a8cb65954: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:08.504803  8244 consensus_queue.cc:1048] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6067a96d8491dabe4cd898456117b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.528494  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:08.535185  7335 tablet_server.cc:179] TabletServer@127.7.41.193:0 shutting down...
I20260709 13:00:08.567967  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:08.568562  7335 tablet_replica.cc:333] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b: stopping tablet replica
I20260709 13:00:08.569164  7335 raft_consensus.cc:2243] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.569628  7335 raft_consensus.cc:2272] T 1e0cccdbe51448a1a2d4c6f816428011 P 46d6067a96d8491dabe4cd898456117b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.571466  7335 tablet_replica.cc:333] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b: stopping tablet replica
I20260709 13:00:08.571964  7335 raft_consensus.cc:2243] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.572355  7335 raft_consensus.cc:2272] T 82028f91f7b34469914eb751cb976770 P 46d6067a96d8491dabe4cd898456117b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.574728  7335 tablet_replica.cc:333] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b: stopping tablet replica
I20260709 13:00:08.575270  7335 raft_consensus.cc:2243] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.575753  7335 raft_consensus.cc:2272] T 078001b9f4b248a19ca7cb703a53620c P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.577483  7335 tablet_replica.cc:333] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b: stopping tablet replica
I20260709 13:00:08.578055  7335 raft_consensus.cc:2243] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.578809  7335 raft_consensus.cc:2272] T bc75cf5a579941eda24e56ebdeb14fdc P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.580649  7335 tablet_replica.cc:333] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b: stopping tablet replica
I20260709 13:00:08.581187  7335 raft_consensus.cc:2243] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.581979  7335 raft_consensus.cc:2272] T d59a33378da84409ae824861a1975495 P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.583773  7335 tablet_replica.cc:333] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b: stopping tablet replica
I20260709 13:00:08.584331  7335 raft_consensus.cc:2243] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.585044  7335 raft_consensus.cc:2272] T f9ad8e40ca6f4cedbd97dd1566fd477f P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.586831  7335 tablet_replica.cc:333] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b: stopping tablet replica
I20260709 13:00:08.587342  7335 raft_consensus.cc:2243] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.587743  7335 raft_consensus.cc:2272] T ff0891e7dd5644c3a2eb1061b9bb4405 P 46d6067a96d8491dabe4cd898456117b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.589949  7335 tablet_replica.cc:333] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b: stopping tablet replica
I20260709 13:00:08.590569  7335 raft_consensus.cc:2243] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.590988  7335 raft_consensus.cc:2272] T a5489fc78c6e464ca0aa0ad89a40a31f P 46d6067a96d8491dabe4cd898456117b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.593242  7335 tablet_replica.cc:333] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b: stopping tablet replica
I20260709 13:00:08.593745  7335 raft_consensus.cc:2243] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.594511  7335 raft_consensus.cc:2272] T c759d15664924d049e64d0327f4fd88e P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.596204  7335 tablet_replica.cc:333] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b: stopping tablet replica
I20260709 13:00:08.596666  7335 raft_consensus.cc:2243] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.597092  7335 raft_consensus.cc:2272] T c0f551a2fd9d46769f8729b9dc89cbdb P 46d6067a96d8491dabe4cd898456117b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:08.616039  8063 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.41.193:36543: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260709 13:00:08.619297  8063 consensus_peers.cc:597] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 -> Peer 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543): Couldn't send request to peer 46d6067a96d8491dabe4cd898456117b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:36543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:08.628309  7335 tablet_server.cc:196] TabletServer@127.7.41.193:0 shutdown complete.
I20260709 13:00:08.651580  7335 tablet_server.cc:179] TabletServer@127.7.41.194:0 shutting down...
I20260709 13:00:08.678740  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:08.679442  7335 tablet_replica.cc:333] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954: stopping tablet replica
I20260709 13:00:08.680068  7335 raft_consensus.cc:2243] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.680576  7335 raft_consensus.cc:2272] T 078001b9f4b248a19ca7cb703a53620c P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.682499  7335 tablet_replica.cc:333] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954: stopping tablet replica
I20260709 13:00:08.683035  7335 raft_consensus.cc:2243] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.683498  7335 raft_consensus.cc:2272] T d59a33378da84409ae824861a1975495 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.685281  7335 tablet_replica.cc:333] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954: stopping tablet replica
I20260709 13:00:08.685966  7335 raft_consensus.cc:2243] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.686523  7335 raft_consensus.cc:2272] T bc75cf5a579941eda24e56ebdeb14fdc P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.688978  7335 tablet_replica.cc:333] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954: stopping tablet replica
I20260709 13:00:08.689770  7335 raft_consensus.cc:2243] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.690259  7335 raft_consensus.cc:2272] T c759d15664924d049e64d0327f4fd88e P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:08.691440  7989 consensus_peers.cc:597] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 -> Peer 46d6067a96d8491dabe4cd898456117b (127.7.41.193:36543): Couldn't send request to peer 46d6067a96d8491dabe4cd898456117b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:36543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:08.692150  7335 tablet_replica.cc:333] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954: stopping tablet replica
I20260709 13:00:08.692678  7335 raft_consensus.cc:2243] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.693097  7335 raft_consensus.cc:2272] T f9ad8e40ca6f4cedbd97dd1566fd477f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.694875  7335 tablet_replica.cc:333] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954: stopping tablet replica
I20260709 13:00:08.695381  7335 raft_consensus.cc:2243] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.696074  7335 raft_consensus.cc:2272] T ff0891e7dd5644c3a2eb1061b9bb4405 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.697898  7335 tablet_replica.cc:333] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954: stopping tablet replica
I20260709 13:00:08.698419  7335 raft_consensus.cc:2243] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.698833  7335 raft_consensus.cc:2272] T a5489fc78c6e464ca0aa0ad89a40a31f P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.700644  7335 tablet_replica.cc:333] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954: stopping tablet replica
I20260709 13:00:08.701100  7335 raft_consensus.cc:2243] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.701761  7335 raft_consensus.cc:2272] T 1e0cccdbe51448a1a2d4c6f816428011 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.703490  7335 tablet_replica.cc:333] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954: stopping tablet replica
I20260709 13:00:08.703964  7335 raft_consensus.cc:2243] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.704375  7335 raft_consensus.cc:2272] T 82028f91f7b34469914eb751cb976770 P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.706331  7335 tablet_replica.cc:333] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954: stopping tablet replica
I20260709 13:00:08.706784  7335 raft_consensus.cc:2243] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.707469  7335 raft_consensus.cc:2272] T c0f551a2fd9d46769f8729b9dc89cbdb P 22f4ef8d8d414fe8ae9e857a8cb65954 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.735044  7335 tablet_server.cc:196] TabletServer@127.7.41.194:0 shutdown complete.
I20260709 13:00:08.752987  7335 tablet_server.cc:179] TabletServer@127.7.41.195:0 shutting down...
I20260709 13:00:08.773937  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:08.774592  7335 tablet_replica.cc:333] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6: stopping tablet replica
I20260709 13:00:08.775247  7335 raft_consensus.cc:2243] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.775708  7335 raft_consensus.cc:2272] T 1e0cccdbe51448a1a2d4c6f816428011 P 18cfbeb6506c485aa6568747de8e32f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.777397  7335 tablet_replica.cc:333] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6: stopping tablet replica
I20260709 13:00:08.777928  7335 raft_consensus.cc:2243] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.778707  7335 raft_consensus.cc:2272] T 82028f91f7b34469914eb751cb976770 P 18cfbeb6506c485aa6568747de8e32f6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.780616  7335 tablet_replica.cc:333] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6: stopping tablet replica
I20260709 13:00:08.781132  7335 raft_consensus.cc:2243] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.781598  7335 raft_consensus.cc:2272] T ff0891e7dd5644c3a2eb1061b9bb4405 P 18cfbeb6506c485aa6568747de8e32f6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.783746  7335 tablet_replica.cc:333] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6: stopping tablet replica
I20260709 13:00:08.784255  7335 raft_consensus.cc:2243] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.784647  7335 raft_consensus.cc:2272] T f9ad8e40ca6f4cedbd97dd1566fd477f P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.786314  7335 tablet_replica.cc:333] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6: stopping tablet replica
I20260709 13:00:08.786813  7335 raft_consensus.cc:2243] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.787236  7335 raft_consensus.cc:2272] T c759d15664924d049e64d0327f4fd88e P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.788782  7335 tablet_replica.cc:333] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6: stopping tablet replica
I20260709 13:00:08.789290  7335 raft_consensus.cc:2243] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.789960  7335 raft_consensus.cc:2272] T a5489fc78c6e464ca0aa0ad89a40a31f P 18cfbeb6506c485aa6568747de8e32f6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.791790  7335 tablet_replica.cc:333] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6: stopping tablet replica
I20260709 13:00:08.792263  7335 raft_consensus.cc:2243] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.792649  7335 raft_consensus.cc:2272] T c0f551a2fd9d46769f8729b9dc89cbdb P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.794588  7335 tablet_replica.cc:333] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6: stopping tablet replica
I20260709 13:00:08.795073  7335 raft_consensus.cc:2243] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.795832  7335 raft_consensus.cc:2272] T 078001b9f4b248a19ca7cb703a53620c P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.797396  7335 tablet_replica.cc:333] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6: stopping tablet replica
I20260709 13:00:08.797852  7335 raft_consensus.cc:2243] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.798291  7335 raft_consensus.cc:2272] T d59a33378da84409ae824861a1975495 P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.799798  7335 tablet_replica.cc:333] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6: stopping tablet replica
I20260709 13:00:08.800217  7335 raft_consensus.cc:2243] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.800611  7335 raft_consensus.cc:2272] T bc75cf5a579941eda24e56ebdeb14fdc P 18cfbeb6506c485aa6568747de8e32f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.827947  7335 tablet_server.cc:196] TabletServer@127.7.41.195:0 shutdown complete.
I20260709 13:00:08.845187  7335 master.cc:562] Master@127.7.41.254:36225 shutting down...
I20260709 13:00:08.865247  7335 raft_consensus.cc:2243] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:08.865778  7335 raft_consensus.cc:2272] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.866219  7335 tablet_replica.cc:333] T 00000000000000000000000000000000 P abfece10bef54b849e7d9abb9d23b586: stopping tablet replica
I20260709 13:00:08.885426  7335 master.cc:584] Master@127.7.41.254:36225 shutdown complete.
18cfbeb6506c485aa6568747de8e32f6  1
22f4ef8d8d414fe8ae9e857a8cb65954  4
46d6067a96d8491dabe4cd898456117b  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10593 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:00:08.925592  7335 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.41.254:45431
I20260709 13:00:08.926790  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:08.932548  8308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:08.932576  8309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:08.933494  8311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:08.934763  7335 server_base.cc:1061] running on GCE node
I20260709 13:00:08.935489  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:08.935658  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:08.935864  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602008935832 us; error 0 us; skew 500 ppm
I20260709 13:00:08.936403  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:08.938795  7335 webserver.cc:533] Webserver started at http://127.7.41.254:43273/ using document root <none> and password file <none>
I20260709 13:00:08.939280  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:08.939458  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:08.939747  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:08.940850  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/master-0-root/instance:
uuid: "9ac2f5f0926d4b9294bfce4452124031"
format_stamp: "Formatted at 2026-07-09 13:00:08 on dist-test-slave-fh5z"
I20260709 13:00:08.945596  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:00:08.948722  8316 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:08.949399  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:00:08.949676  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/master-0-root
uuid: "9ac2f5f0926d4b9294bfce4452124031"
format_stamp: "Formatted at 2026-07-09 13:00:08 on dist-test-slave-fh5z"
I20260709 13:00:08.949934  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:08.973678  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:08.974923  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:09.016630  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.254:45431
I20260709 13:00:09.016733  8367 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.254:45431 every 8 connection(s)
I20260709 13:00:09.020603  8368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.030295  8368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Bootstrap starting.
I20260709 13:00:09.034936  8368 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.039976  8368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: No bootstrap required, opened a new log
I20260709 13:00:09.041994  8368 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac2f5f0926d4b9294bfce4452124031" member_type: VOTER }
I20260709 13:00:09.042416  8368 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.042721  8368 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac2f5f0926d4b9294bfce4452124031, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.043318  8368 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac2f5f0926d4b9294bfce4452124031" member_type: VOTER }
I20260709 13:00:09.043759  8368 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:09.043998  8368 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:09.044274  8368 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:09.048424  8368 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac2f5f0926d4b9294bfce4452124031" member_type: VOTER }
I20260709 13:00:09.048930  8368 leader_election.cc:304] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ac2f5f0926d4b9294bfce4452124031; no voters: 
I20260709 13:00:09.049993  8368 leader_election.cc:290] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:09.050419  8371 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:09.051813  8371 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac2f5f0926d4b9294bfce4452124031, State: Running, Role: LEADER
I20260709 13:00:09.052496  8371 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac2f5f0926d4b9294bfce4452124031" member_type: VOTER }
I20260709 13:00:09.052940  8368 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:09.057616  8373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ac2f5f0926d4b9294bfce4452124031. Latest consensus state: current_term: 1 leader_uuid: "9ac2f5f0926d4b9294bfce4452124031" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac2f5f0926d4b9294bfce4452124031" member_type: VOTER } }
I20260709 13:00:09.058243  8373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:09.059788  8378 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:09.059700  8372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ac2f5f0926d4b9294bfce4452124031" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac2f5f0926d4b9294bfce4452124031" member_type: VOTER } }
I20260709 13:00:09.060283  8372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:09.066118  8378 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:09.067337  7335 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:09.074462  8378 catalog_manager.cc:1383] Generated new cluster ID: f20eaffa92c04a0fb4cf3e590066f6d1
I20260709 13:00:09.074690  8378 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:09.089666  8378 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:09.090961  8378 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:09.105285  8378 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Generated new TSK 0
I20260709 13:00:09.106048  8378 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:09.133757  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:09.139732  8389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:09.140842  8390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:09.142685  8392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:09.142880  7335 server_base.cc:1061] running on GCE node
I20260709 13:00:09.143822  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:09.144043  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:09.144253  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602009144213 us; error 0 us; skew 500 ppm
I20260709 13:00:09.144855  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:09.147397  7335 webserver.cc:533] Webserver started at http://127.7.41.193:33913/ using document root <none> and password file <none>
I20260709 13:00:09.147923  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:09.148123  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:09.148483  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:09.149602  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/instance:
uuid: "dacb523538a14c7cb335ab9c18f4111b"
format_stamp: "Formatted at 2026-07-09 13:00:09 on dist-test-slave-fh5z"
I20260709 13:00:09.154626  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:09.157733  8397 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:09.158442  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:09.158730  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root
uuid: "dacb523538a14c7cb335ab9c18f4111b"
format_stamp: "Formatted at 2026-07-09 13:00:09 on dist-test-slave-fh5z"
I20260709 13:00:09.158972  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:09.171736  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:09.172914  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:09.174441  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:09.176590  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:09.176812  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:09.177053  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:09.177241  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:09.222877  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.193:41353
I20260709 13:00:09.222980  8459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.193:41353 every 8 connection(s)
I20260709 13:00:09.227658  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:09.234520  8464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:09.235123  8465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:09.239090  7335 server_base.cc:1061] running on GCE node
W20260709 13:00:09.239032  8467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:09.240381  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:09.240602  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:09.240790  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602009240772 us; error 0 us; skew 500 ppm
I20260709 13:00:09.241448  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:09.244310  7335 webserver.cc:533] Webserver started at http://127.7.41.194:36799/ using document root <none> and password file <none>
I20260709 13:00:09.244787  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:09.244921  8460 heartbeater.cc:344] Connected to a master server at 127.7.41.254:45431
I20260709 13:00:09.245021  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:09.245339  8460 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:09.245404  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:09.246270  8460 heartbeater.cc:507] Master 127.7.41.254:45431 requested a full tablet report, sending...
I20260709 13:00:09.246958  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/instance:
uuid: "0b9f7467deed4381835a85ffd0e88af6"
format_stamp: "Formatted at 2026-07-09 13:00:09 on dist-test-slave-fh5z"
I20260709 13:00:09.248554  8333 ts_manager.cc:194] Registered new tserver with Master: dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:09.250309  8333 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57088
I20260709 13:00:09.251745  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:09.255039  8472 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:09.255750  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:00:09.256098  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root
uuid: "0b9f7467deed4381835a85ffd0e88af6"
format_stamp: "Formatted at 2026-07-09 13:00:09 on dist-test-slave-fh5z"
I20260709 13:00:09.256414  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:09.272320  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:09.273469  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:09.274861  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:09.277119  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:09.277347  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:09.277585  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:09.277757  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:09.315668  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.194:38749
I20260709 13:00:09.315768  8534 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.194:38749 every 8 connection(s)
I20260709 13:00:09.320349  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:09.327324  8538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:09.329167  8539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:09.332590  8541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:09.332867  7335 server_base.cc:1061] running on GCE node
I20260709 13:00:09.333655  8535 heartbeater.cc:344] Connected to a master server at 127.7.41.254:45431
I20260709 13:00:09.333940  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:09.334072  8535 heartbeater.cc:461] Registering TS with master...
W20260709 13:00:09.334266  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:09.334527  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602009334511 us; error 0 us; skew 500 ppm
I20260709 13:00:09.335001  8535 heartbeater.cc:507] Master 127.7.41.254:45431 requested a full tablet report, sending...
I20260709 13:00:09.335074  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:09.337248  8333 ts_manager.cc:194] Registered new tserver with Master: 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:09.337837  7335 webserver.cc:533] Webserver started at http://127.7.41.195:45149/ using document root <none> and password file <none>
I20260709 13:00:09.338364  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:09.338577  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:09.338836  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:09.338790  8333 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57098
I20260709 13:00:09.340260  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/instance:
uuid: "5ffc86752d264d0c81f68028e6413a91"
format_stamp: "Formatted at 2026-07-09 13:00:09 on dist-test-slave-fh5z"
I20260709 13:00:09.344550  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:09.347681  8546 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:09.348434  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:00:09.348722  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root
uuid: "5ffc86752d264d0c81f68028e6413a91"
format_stamp: "Formatted at 2026-07-09 13:00:09 on dist-test-slave-fh5z"
I20260709 13:00:09.349004  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:09.363456  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:09.364544  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:09.365898  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:09.368012  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:09.368268  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:09.368501  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:09.368676  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:09.406328  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.195:41653
I20260709 13:00:09.406426  8608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.195:41653 every 8 connection(s)
I20260709 13:00:09.419432  8609 heartbeater.cc:344] Connected to a master server at 127.7.41.254:45431
I20260709 13:00:09.419793  8609 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:09.420492  8609 heartbeater.cc:507] Master 127.7.41.254:45431 requested a full tablet report, sending...
I20260709 13:00:09.422312  8333 ts_manager.cc:194] Registered new tserver with Master: 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:09.422668  7335 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013177252s
I20260709 13:00:09.423729  8333 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57104
I20260709 13:00:09.446249  8333 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57114:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:09.452253  8333 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:09.671097  8500 tablet_service.cc:1511] Processing CreateTablet for tablet c0a41ce5cf754ad58e31f5e764daa48f (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:09.672513  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a41ce5cf754ad58e31f5e764daa48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.672636  8423 tablet_service.cc:1511] Processing CreateTablet for tablet 2240cdfdfc6c47f49f2aaea6aa62b675 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:09.673033  8424 tablet_service.cc:1511] Processing CreateTablet for tablet 42b1603f302f4b188a0a19190c49fed2 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:09.674000  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2240cdfdfc6c47f49f2aaea6aa62b675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.675053  8422 tablet_service.cc:1511] Processing CreateTablet for tablet ec1a6df183ea46c0b7b35ceaa22ed236 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:09.675244  8425 tablet_service.cc:1511] Processing CreateTablet for tablet c0a41ce5cf754ad58e31f5e764daa48f (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:09.676226  8424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b1603f302f4b188a0a19190c49fed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.677197  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a41ce5cf754ad58e31f5e764daa48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.679132  8499 tablet_service.cc:1511] Processing CreateTablet for tablet 42b1603f302f4b188a0a19190c49fed2 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:09.680467  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b1603f302f4b188a0a19190c49fed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.683758  8498 tablet_service.cc:1511] Processing CreateTablet for tablet 2240cdfdfc6c47f49f2aaea6aa62b675 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:09.684998  8498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2240cdfdfc6c47f49f2aaea6aa62b675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.686347  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1a6df183ea46c0b7b35ceaa22ed236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.686877  8421 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7ceb457b3b46b096de1a7a57adccde (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:09.688140  8421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7ceb457b3b46b096de1a7a57adccde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.691598  8497 tablet_service.cc:1511] Processing CreateTablet for tablet ec1a6df183ea46c0b7b35ceaa22ed236 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:09.692907  8497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1a6df183ea46c0b7b35ceaa22ed236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.699884  8624 tablet_bootstrap.cc:492] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:09.702996  8574 tablet_service.cc:1511] Processing CreateTablet for tablet c0a41ce5cf754ad58e31f5e764daa48f (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:09.704231  8574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a41ce5cf754ad58e31f5e764daa48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.705566  8496 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7ceb457b3b46b096de1a7a57adccde (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:09.706905  8496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7ceb457b3b46b096de1a7a57adccde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.706583  8570 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7ceb457b3b46b096de1a7a57adccde (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:09.707759  8624 tablet_bootstrap.cc:654] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.707857  8570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7ceb457b3b46b096de1a7a57adccde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.711205  8573 tablet_service.cc:1511] Processing CreateTablet for tablet 42b1603f302f4b188a0a19190c49fed2 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:09.712520  8573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b1603f302f4b188a0a19190c49fed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.713917  8571 tablet_service.cc:1511] Processing CreateTablet for tablet ec1a6df183ea46c0b7b35ceaa22ed236 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:09.715253  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1a6df183ea46c0b7b35ceaa22ed236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.719172  8572 tablet_service.cc:1511] Processing CreateTablet for tablet 2240cdfdfc6c47f49f2aaea6aa62b675 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:09.720417  8572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2240cdfdfc6c47f49f2aaea6aa62b675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.776571  8423 tablet_service.cc:1511] Processing CreateTablet for tablet 057641ab553c4ec08538f2ed159ba000 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:09.777937  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057641ab553c4ec08538f2ed159ba000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.779646  8626 tablet_bootstrap.cc:492] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:09.780725  8624 tablet_bootstrap.cc:492] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:09.781231  8624 ts_tablet_manager.cc:1403] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.082s	user 0.035s	sys 0.043s
I20260709 13:00:09.783277  8495 tablet_service.cc:1511] Processing CreateTablet for tablet 057641ab553c4ec08538f2ed159ba000 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:09.784051  8624 raft_consensus.cc:359] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:09.784529  8495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057641ab553c4ec08538f2ed159ba000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.784775  8624 raft_consensus.cc:385] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.785075  8624 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.785889  8624 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:09.787748  8627 tablet_bootstrap.cc:492] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:09.797809  8626 tablet_bootstrap.cc:654] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.800248  8460 heartbeater.cc:499] Master 127.7.41.254:45431 was elected leader, sending a full tablet report...
I20260709 13:00:09.799057  8624 ts_tablet_manager.cc:1434] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:00:09.803753  8624 tablet_bootstrap.cc:492] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:09.808730  8499 tablet_service.cc:1511] Processing CreateTablet for tablet df86b8c30ce74df593c44831a29d2f9f (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:09.799796  8627 tablet_bootstrap.cc:654] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.810005  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df86b8c30ce74df593c44831a29d2f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.811334  8626 tablet_bootstrap.cc:492] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:09.820292  8626 ts_tablet_manager.cc:1403] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.008s
I20260709 13:00:09.815232  8573 tablet_service.cc:1511] Processing CreateTablet for tablet 0254141f106e4023bb2d8ba99024140c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:09.824656  8573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0254141f106e4023bb2d8ba99024140c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.824368  8570 tablet_service.cc:1511] Processing CreateTablet for tablet df86b8c30ce74df593c44831a29d2f9f (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:09.825536  8570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df86b8c30ce74df593c44831a29d2f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.812898  8500 tablet_service.cc:1511] Processing CreateTablet for tablet 0254141f106e4023bb2d8ba99024140c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:09.826858  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0254141f106e4023bb2d8ba99024140c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.827523  8425 tablet_service.cc:1511] Processing CreateTablet for tablet df86b8c30ce74df593c44831a29d2f9f (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:09.828702  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df86b8c30ce74df593c44831a29d2f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.828930  8421 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8ec20c8aeb4915950772c6add9f352 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:09.830442  8421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8ec20c8aeb4915950772c6add9f352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.823341  8626 raft_consensus.cc:359] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:09.833403  8626 raft_consensus.cc:385] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.842154  8626 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.843127  8626 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:09.847385  8497 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8ec20c8aeb4915950772c6add9f352 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:09.848941  8497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8ec20c8aeb4915950772c6add9f352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.833546  8574 tablet_service.cc:1511] Processing CreateTablet for tablet 057641ab553c4ec08538f2ed159ba000 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:09.823350  8422 tablet_service.cc:1511] Processing CreateTablet for tablet 0254141f106e4023bb2d8ba99024140c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:09.812814  8624 tablet_bootstrap.cc:654] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.864751  8627 tablet_bootstrap.cc:492] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:09.865224  8627 ts_tablet_manager.cc:1403] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.029s
I20260709 13:00:09.865372  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0254141f106e4023bb2d8ba99024140c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.867631  8574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057641ab553c4ec08538f2ed159ba000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.874805  8495 tablet_service.cc:1511] Processing CreateTablet for tablet 77b025d136d04841aa2759be7b816f77 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:09.876325  8495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b025d136d04841aa2759be7b816f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.878672  8572 tablet_service.cc:1511] Processing CreateTablet for tablet 77b025d136d04841aa2759be7b816f77 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:09.880208  8572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b025d136d04841aa2759be7b816f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.880671  8424 tablet_service.cc:1511] Processing CreateTablet for tablet 8e9df238f56e482f9ad6efc0c2bd6014 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:09.880851  8627 raft_consensus.cc:359] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:09.881644  8627 raft_consensus.cc:385] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:09.882045  8627 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:09.874857  8571 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8ec20c8aeb4915950772c6add9f352 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:09.892794  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8ec20c8aeb4915950772c6add9f352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.889477  8423 tablet_service.cc:1511] Processing CreateTablet for tablet 77b025d136d04841aa2759be7b816f77 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:09.889865  8424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e9df238f56e482f9ad6efc0c2bd6014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.894696  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b025d136d04841aa2759be7b816f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.882994  8627 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:09.909972  8609 heartbeater.cc:499] Master 127.7.41.254:45431 was elected leader, sending a full tablet report...
I20260709 13:00:09.915319  8497 tablet_service.cc:1511] Processing CreateTablet for tablet 8e9df238f56e482f9ad6efc0c2bd6014 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:09.917611  8570 tablet_service.cc:1511] Processing CreateTablet for tablet 8e9df238f56e482f9ad6efc0c2bd6014 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:09.918434  8497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e9df238f56e482f9ad6efc0c2bd6014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.920397  8570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e9df238f56e482f9ad6efc0c2bd6014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.920531  8425 tablet_service.cc:1511] Processing CreateTablet for tablet a12a506b127d40b1acc72c04ae2f5a40 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:09.921802  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12a506b127d40b1acc72c04ae2f5a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.909961  8632 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.922428  8632 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:09.937168  8632 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:09.952193  8626 ts_tablet_manager.cc:1434] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.132s	user 0.011s	sys 0.008s
I20260709 13:00:09.953153  8626 tablet_bootstrap.cc:492] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:09.953404  8421 tablet_service.cc:1511] Processing CreateTablet for tablet 8e2febf027be449183830c318fbd6012 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:09.954828  8500 tablet_service.cc:1511] Processing CreateTablet for tablet 8e2febf027be449183830c318fbd6012 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:09.956096  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e2febf027be449183830c318fbd6012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.955859  8420 tablet_service.cc:1511] Processing CreateTablet for tablet f6c83778726d49c5b8622ad284f71aa9 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:09.957070  8420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c83778726d49c5b8622ad284f71aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.958366  8499 tablet_service.cc:1511] Processing CreateTablet for tablet a12a506b127d40b1acc72c04ae2f5a40 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:09.959528  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12a506b127d40b1acc72c04ae2f5a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.960815  8421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e2febf027be449183830c318fbd6012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.963030  8571 tablet_service.cc:1511] Processing CreateTablet for tablet a12a506b127d40b1acc72c04ae2f5a40 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:09.963630  8535 heartbeater.cc:499] Master 127.7.41.254:45431 was elected leader, sending a full tablet report...
I20260709 13:00:09.964257  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12a506b127d40b1acc72c04ae2f5a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.963052  8573 tablet_service.cc:1511] Processing CreateTablet for tablet 8e2febf027be449183830c318fbd6012 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:09.982836  8573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e2febf027be449183830c318fbd6012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:09.990571  8627 ts_tablet_manager.cc:1434] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.125s	user 0.009s	sys 0.006s
I20260709 13:00:09.991632  8627 tablet_bootstrap.cc:492] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:09.992966  8626 tablet_bootstrap.cc:654] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:09.995877  8624 tablet_bootstrap.cc:492] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:09.996362  8624 ts_tablet_manager.cc:1403] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.193s	user 0.040s	sys 0.014s
I20260709 13:00:09.999303  8624 raft_consensus.cc:359] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:09.999995  8624 raft_consensus.cc:385] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.000299  8624 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.000175  8497 tablet_service.cc:1511] Processing CreateTablet for tablet f6c83778726d49c5b8622ad284f71aa9 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:10.002164  8624 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.004285  8624 ts_tablet_manager.cc:1434] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:10.005210  8624 tablet_bootstrap.cc:492] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:10.005251  8571 tablet_service.cc:1511] Processing CreateTablet for tablet f6c83778726d49c5b8622ad284f71aa9 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:10.006675  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c83778726d49c5b8622ad284f71aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.014539  8497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c83778726d49c5b8622ad284f71aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.019838  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:10.020563  8510 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:10.021839  8627 tablet_bootstrap.cc:654] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.024252  8495 tablet_service.cc:1511] Processing CreateTablet for tablet c783a77969844f0b82c1b365e456c651 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:10.042263  8423 tablet_service.cc:1511] Processing CreateTablet for tablet 7c808e5ae17447f4a32fc1b5624cc91a (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:10.021885  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:10.043768  8495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c783a77969844f0b82c1b365e456c651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.043572  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:10.044248  8631 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.044318  8435 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:10.044739  8631 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.045099  8631 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.045655  8626 tablet_bootstrap.cc:492] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:10.046134  8626 ts_tablet_manager.cc:1403] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.003s
I20260709 13:00:10.047011  8624 tablet_bootstrap.cc:654] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.048332  8574 tablet_service.cc:1511] Processing CreateTablet for tablet c783a77969844f0b82c1b365e456c651 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:10.023550  8420 tablet_service.cc:1511] Processing CreateTablet for tablet c783a77969844f0b82c1b365e456c651 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:10.049588  8574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c783a77969844f0b82c1b365e456c651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.052614  8498 tablet_service.cc:1511] Processing CreateTablet for tablet 7c808e5ae17447f4a32fc1b5624cc91a (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:10.053047  8631 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.054989  8421 tablet_service.cc:1511] Processing CreateTablet for tablet 45dd878477224acc8d0d4dca5d5d4f02 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:10.043495  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c808e5ae17447f4a32fc1b5624cc91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.057082  8421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dd878477224acc8d0d4dca5d5d4f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.057001  8572 tablet_service.cc:1511] Processing CreateTablet for tablet 7c808e5ae17447f4a32fc1b5624cc91a (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:10.058290  8572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c808e5ae17447f4a32fc1b5624cc91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.060086  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:10.060631  8435 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.062392  8420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c783a77969844f0b82c1b365e456c651. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:10.063980  8381 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:10.067535  8435 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:10.049029  8626 raft_consensus.cc:359] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.068265  8626 raft_consensus.cc:385] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.068640  8626 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.068857  8550 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:10.069926  8632 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.079284  8498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c808e5ae17447f4a32fc1b5624cc91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.083218  8631 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:10.069727  8626 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.105598  8632 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:10.113922  8500 tablet_service.cc:1511] Processing CreateTablet for tablet 45dd878477224acc8d0d4dca5d5d4f02 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:10.115231  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dd878477224acc8d0d4dca5d5d4f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.115341  8627 tablet_bootstrap.cc:492] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:10.115845  8627 ts_tablet_manager.cc:1403] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.124s	user 0.025s	sys 0.022s
I20260709 13:00:10.118633  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:10.118755  8627 raft_consensus.cc:359] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.119385  8510 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.119621  8627 raft_consensus.cc:385] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.120096  8627 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.149175  8425 tablet_service.cc:1511] Processing CreateTablet for tablet f86829baeb70423ab45311ca8cb560c8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:10.150121  8624 tablet_bootstrap.cc:492] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:10.150470  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86829baeb70423ab45311ca8cb560c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.150619  8624 ts_tablet_manager.cc:1403] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.008s
I20260709 13:00:10.153600  8499 tablet_service.cc:1511] Processing CreateTablet for tablet bc7e6e656d324c0bad9eee744f6f1886 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:10.153477  8624 raft_consensus.cc:359] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.154512  8624 raft_consensus.cc:385] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.154856  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7e6e656d324c0bad9eee744f6f1886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.154820  8624 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.155927  8632 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.155997  8624 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.156543  8628 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.158504  8628 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.159034  8495 tablet_service.cc:1511] Processing CreateTablet for tablet f86829baeb70423ab45311ca8cb560c8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:10.161002  8627 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.165776  8627 ts_tablet_manager.cc:1434] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:00:10.172654  8496 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd9d456ec5e4a83be19a678fcfc50f1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:10.167572  8628 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:10.188926  8627 tablet_bootstrap.cc:492] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:10.205588  8496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd9d456ec5e4a83be19a678fcfc50f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.209124  8510 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:10.211122  8495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86829baeb70423ab45311ca8cb560c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.212687  8572 tablet_service.cc:1511] Processing CreateTablet for tablet 45dd878477224acc8d0d4dca5d5d4f02 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:10.214346  8494 tablet_service.cc:1511] Processing CreateTablet for tablet 44116e7a54d141108511e22185400ffe (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:10.223747  8572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dd878477224acc8d0d4dca5d5d4f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.223793  8574 tablet_service.cc:1511] Processing CreateTablet for tablet f86829baeb70423ab45311ca8cb560c8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:10.225067  8574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86829baeb70423ab45311ca8cb560c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.224932  8573 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd9d456ec5e4a83be19a678fcfc50f1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:10.226735  8494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44116e7a54d141108511e22185400ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.227494  8571 tablet_service.cc:1511] Processing CreateTablet for tablet bc7e6e656d324c0bad9eee744f6f1886 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:10.227847  8570 tablet_service.cc:1511] Processing CreateTablet for tablet 44116e7a54d141108511e22185400ffe (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:10.228709  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7e6e656d324c0bad9eee744f6f1886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.229517  8570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44116e7a54d141108511e22185400ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.231963  8573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd9d456ec5e4a83be19a678fcfc50f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.235256  8420 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd9d456ec5e4a83be19a678fcfc50f1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:10.235519  8421 tablet_service.cc:1511] Processing CreateTablet for tablet 44116e7a54d141108511e22185400ffe (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:10.236621  8420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd9d456ec5e4a83be19a678fcfc50f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.240216  8421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44116e7a54d141108511e22185400ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.239962  8423 tablet_service.cc:1511] Processing CreateTablet for tablet b34810c9636748309cee2bf3d1eb6bdb (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:10.241155  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34810c9636748309cee2bf3d1eb6bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.252975  8498 tablet_service.cc:1511] Processing CreateTablet for tablet b34810c9636748309cee2bf3d1eb6bdb (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:10.254524  8626 ts_tablet_manager.cc:1434] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.208s	user 0.007s	sys 0.001s
I20260709 13:00:10.255563  8626 tablet_bootstrap.cc:492] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:10.258431  8498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34810c9636748309cee2bf3d1eb6bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.268924  8424 tablet_service.cc:1511] Processing CreateTablet for tablet 9b195ca1ba0c4d7e993f9dc2d1a12629 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:10.270193  8424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b195ca1ba0c4d7e993f9dc2d1a12629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.270458  8627 tablet_bootstrap.cc:654] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.271203  8571 tablet_service.cc:1511] Processing CreateTablet for tablet 9b195ca1ba0c4d7e993f9dc2d1a12629 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:10.272436  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b195ca1ba0c4d7e993f9dc2d1a12629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.275892  8497 tablet_service.cc:1511] Processing CreateTablet for tablet 9b195ca1ba0c4d7e993f9dc2d1a12629 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:10.277176  8497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b195ca1ba0c4d7e993f9dc2d1a12629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.278923  8425 tablet_service.cc:1511] Processing CreateTablet for tablet bc7e6e656d324c0bad9eee744f6f1886 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:10.284694  8422 tablet_service.cc:1511] Processing CreateTablet for tablet 652dfe8b7bb64be896563cb525d678d1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:10.286208  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652dfe8b7bb64be896563cb525d678d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.291972  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:10.293682  8400 leader_election.cc:343] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.294404  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7e6e656d324c0bad9eee744f6f1886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.302616  8626 tablet_bootstrap.cc:654] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.307356  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:10.314607  8500 tablet_service.cc:1511] Processing CreateTablet for tablet 652dfe8b7bb64be896563cb525d678d1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:10.316560  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652dfe8b7bb64be896563cb525d678d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.317929  8624 ts_tablet_manager.cc:1434] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.167s	user 0.015s	sys 0.042s
I20260709 13:00:10.323091  8333 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.327279  8624 tablet_bootstrap.cc:492] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
W20260709 13:00:10.334232  8398 leader_election.cc:343] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.334887  8398 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:10.336521  8641 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:10.343701  8627 tablet_bootstrap.cc:492] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:10.344478  8627 ts_tablet_manager.cc:1403] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.156s	user 0.013s	sys 0.000s
I20260709 13:00:10.361752  8420 tablet_service.cc:1511] Processing CreateTablet for tablet 435c81d2d1f346bea90c20030455900c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:10.348587  8571 tablet_service.cc:1511] Processing CreateTablet for tablet 652dfe8b7bb64be896563cb525d678d1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:10.364675  8420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435c81d2d1f346bea90c20030455900c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.370393  8627 raft_consensus.cc:359] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.371229  8627 raft_consensus.cc:385] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.371572  8627 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.372442  8627 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.374912  8627 ts_tablet_manager.cc:1434] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:00:10.363061  8574 tablet_service.cc:1511] Processing CreateTablet for tablet b34810c9636748309cee2bf3d1eb6bdb (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:10.375871  8627 tablet_bootstrap.cc:492] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:10.380141  8626 tablet_bootstrap.cc:492] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:10.380636  8626 ts_tablet_manager.cc:1403] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.125s	user 0.026s	sys 0.043s
I20260709 13:00:10.383424  8624 tablet_bootstrap.cc:654] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.383436  8626 raft_consensus.cc:359] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
I20260709 13:00:10.384306  8626 raft_consensus.cc:385] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.384548  8626 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.385185  8626 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
I20260709 13:00:10.387108  8626 ts_tablet_manager.cc:1434] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:10.391430  8627 tablet_bootstrap.cc:654] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.395598  8498 tablet_service.cc:1511] Processing CreateTablet for tablet 435c81d2d1f346bea90c20030455900c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:10.398799  8498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435c81d2d1f346bea90c20030455900c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.397854  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652dfe8b7bb64be896563cb525d678d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.401376  8574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34810c9636748309cee2bf3d1eb6bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.402802  8570 tablet_service.cc:1511] Processing CreateTablet for tablet 435c81d2d1f346bea90c20030455900c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:10.404006  8570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435c81d2d1f346bea90c20030455900c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.408394  8626 tablet_bootstrap.cc:492] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:10.414527  8626 tablet_bootstrap.cc:654] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.415515  8494 tablet_service.cc:1511] Processing CreateTablet for tablet 956b0163855b4f329c033879d86cd33b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:10.418936  8420 tablet_service.cc:1511] Processing CreateTablet for tablet b9e03855c7c944d6a2bd32561a407196 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:10.420279  8420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e03855c7c944d6a2bd32561a407196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.420079  8573 tablet_service.cc:1511] Processing CreateTablet for tablet b9e03855c7c944d6a2bd32561a407196 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:10.421271  8573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e03855c7c944d6a2bd32561a407196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.416491  8572 tablet_service.cc:1511] Processing CreateTablet for tablet 956b0163855b4f329c033879d86cd33b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:10.440097  8624 tablet_bootstrap.cc:492] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:10.442920  8632 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.443329  8632 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.444957  8632 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:10.445683  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:10.446923  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:10.447528  8510 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:10.447813  8496 tablet_service.cc:1511] Processing CreateTablet for tablet b9e03855c7c944d6a2bd32561a407196 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:10.448935  8547 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:10.449541  8496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e03855c7c944d6a2bd32561a407196. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:10.450318  8550 leader_election.cc:343] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.451404  8632 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.451771  8632 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.452069  8632 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.454737  8421 tablet_service.cc:1511] Processing CreateTablet for tablet 956b0163855b4f329c033879d86cd33b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:10.456033  8421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956b0163855b4f329c033879d86cd33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.458014  8494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956b0163855b4f329c033879d86cd33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.459085  8632 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.459843  8624 ts_tablet_manager.cc:1403] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.133s	user 0.019s	sys 0.002s
I20260709 13:00:10.462083  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:00:10.463614  8550 leader_election.cc:343] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.465595  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:10.466151  8510 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.439832  8422 tablet_service.cc:1511] Processing CreateTablet for tablet b7dfd08eb514418f81f0ba7777a079e8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:10.470868  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dfd08eb514418f81f0ba7777a079e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.472013  8627 tablet_bootstrap.cc:492] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:10.472573  8510 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:10.473827  8547 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:10.474738  8631 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.474823  8632 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:10.475450  8631 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:10.472594  8627 ts_tablet_manager.cc:1403] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.011s
I20260709 13:00:10.476601  8631 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.481082  8569 tablet_service.cc:1511] Processing CreateTablet for tablet b7dfd08eb514418f81f0ba7777a079e8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:10.482497  8569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dfd08eb514418f81f0ba7777a079e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.481997  8423 tablet_service.cc:1511] Processing CreateTablet for tablet 8fff54c32b2248dca5e70dc82b71155d (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:10.481940  8499 tablet_service.cc:1511] Processing CreateTablet for tablet b7dfd08eb514418f81f0ba7777a079e8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:10.483323  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fff54c32b2248dca5e70dc82b71155d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.483744  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dfd08eb514418f81f0ba7777a079e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.496131  8568 tablet_service.cc:1511] Processing CreateTablet for tablet 8fff54c32b2248dca5e70dc82b71155d (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:10.496342  8624 raft_consensus.cc:359] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
I20260709 13:00:10.497115  8624 raft_consensus.cc:385] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.497474  8568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fff54c32b2248dca5e70dc82b71155d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.497423  8624 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.503708  8425 tablet_service.cc:1511] Processing CreateTablet for tablet cf4548803154450a8b2b2d3ee14dd41a (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:10.504941  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4548803154450a8b2b2d3ee14dd41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.504803  8567 tablet_service.cc:1511] Processing CreateTablet for tablet cf4548803154450a8b2b2d3ee14dd41a (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:10.506738  8572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956b0163855b4f329c033879d86cd33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.504962  8497 tablet_service.cc:1511] Processing CreateTablet for tablet cf4548803154450a8b2b2d3ee14dd41a (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:10.508314  8497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4548803154450a8b2b2d3ee14dd41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.509909  8567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4548803154450a8b2b2d3ee14dd41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.510349  8498 tablet_service.cc:1511] Processing CreateTablet for tablet 8fff54c32b2248dca5e70dc82b71155d (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:10.511525  8498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fff54c32b2248dca5e70dc82b71155d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.514322  8641 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.514786  8641 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.514895  8627 raft_consensus.cc:359] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.515647  8627 raft_consensus.cc:385] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.515964  8627 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.516953  8641 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:10.516700  8627 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.518914  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:10.520761  8400 leader_election.cc:343] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.521605  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:10.522205  8510 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:10.523442  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:10.526273  8641 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.528462  8420 tablet_service.cc:1511] Processing CreateTablet for tablet a4e89695d22445b4b40c4e3c0d792325 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:10.529677  8420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e89695d22445b4b40c4e3c0d792325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.526813  8641 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.529953  8500 tablet_service.cc:1511] Processing CreateTablet for tablet a4e89695d22445b4b40c4e3c0d792325 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:10.530457  8641 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.531239  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e89695d22445b4b40c4e3c0d792325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.534204  8624 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
I20260709 13:00:10.550607  8627 ts_tablet_manager.cc:1434] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.001s
I20260709 13:00:10.551847  8626 tablet_bootstrap.cc:492] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:10.557730  8626 ts_tablet_manager.cc:1403] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.150s	user 0.035s	sys 0.047s
I20260709 13:00:10.558593  8424 tablet_service.cc:1511] Processing CreateTablet for tablet f25688d717bb4dae964fead4a15af269 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:10.559839  8424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f25688d717bb4dae964fead4a15af269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.551692  8627 tablet_bootstrap.cc:492] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:10.566121  8568 tablet_service.cc:1511] Processing CreateTablet for tablet a4e89695d22445b4b40c4e3c0d792325 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:10.567480  8568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e89695d22445b4b40c4e3c0d792325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.567373  8419 tablet_service.cc:1511] Processing CreateTablet for tablet adc232408fec446f9379aa9fb2c04164 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:10.568638  8419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc232408fec446f9379aa9fb2c04164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.579027  8574 tablet_service.cc:1511] Processing CreateTablet for tablet f25688d717bb4dae964fead4a15af269 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:10.581670  8574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f25688d717bb4dae964fead4a15af269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.561863  8626 raft_consensus.cc:359] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.580440  8496 tablet_service.cc:1511] Processing CreateTablet for tablet f25688d717bb4dae964fead4a15af269 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:10.586584  8626 raft_consensus.cc:385] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.586936  8626 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.587412  8496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f25688d717bb4dae964fead4a15af269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.587777  8626 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.592101  8624 ts_tablet_manager.cc:1434] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.132s	user 0.007s	sys 0.002s
I20260709 13:00:10.593107  8624 tablet_bootstrap.cc:492] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:10.600600  8494 tablet_service.cc:1511] Processing CreateTablet for tablet adc232408fec446f9379aa9fb2c04164 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:10.601840  8494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc232408fec446f9379aa9fb2c04164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.604192  8418 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1186d8dca7484f8fd5714b4489ce99 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:10.605738  8418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1186d8dca7484f8fd5714b4489ce99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.607626  8627 tablet_bootstrap.cc:654] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.608953  8499 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1186d8dca7484f8fd5714b4489ce99 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:10.612744  8568 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1186d8dca7484f8fd5714b4489ce99 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:10.613101  8631 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.616997  8639 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.617468  8639 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.618976  8641 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.619498  8639 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:10.619935  8495 tablet_service.cc:1511] Processing CreateTablet for tablet bd1c8798b6794858b96202fe8f7264d6 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:10.620968  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:10.621575  8510 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:10.621770  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:10.622376  8509 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.622987  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:10.623278  8547 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:10.624637  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:10.624855  8639 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.625207  8639 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.625237  8435 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:10.625674  8639 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.626888  8568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1186d8dca7484f8fd5714b4489ce99. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:10.627110  8400 leader_election.cc:343] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.628857  8425 tablet_service.cc:1511] Processing CreateTablet for tablet bd1c8798b6794858b96202fe8f7264d6 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:10.629722  8509 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:10.630056  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1c8798b6794858b96202fe8f7264d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.630841  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:10.631675  8628 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.636240  8626 ts_tablet_manager.cc:1434] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:00:10.637214  8626 tablet_bootstrap.cc:492] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:10.637506  8571 tablet_service.cc:1511] Processing CreateTablet for tablet adc232408fec446f9379aa9fb2c04164 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:10.638752  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc232408fec446f9379aa9fb2c04164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.642095  8641 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:10.646045  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1186d8dca7484f8fd5714b4489ce99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.652812  8639 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.654326  8495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1c8798b6794858b96202fe8f7264d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.677031  8572 tablet_service.cc:1511] Processing CreateTablet for tablet bd1c8798b6794858b96202fe8f7264d6 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:10.678638  8572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1c8798b6794858b96202fe8f7264d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.683033  8626 tablet_bootstrap.cc:654] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.686883  8628 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:10.690609  8628 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.693240  8632 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:10.693486  8420 tablet_service.cc:1511] Processing CreateTablet for tablet 09de6eee9632412ebe0a904f65cd2a3c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:10.694720  8420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09de6eee9632412ebe0a904f65cd2a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.697012  8498 tablet_service.cc:1511] Processing CreateTablet for tablet d9ee2138cf46471e96358439600aaa0c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:10.698261  8498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ee2138cf46471e96358439600aaa0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.699851  8627 tablet_bootstrap.cc:492] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:10.700322  8627 ts_tablet_manager.cc:1403] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.149s	user 0.007s	sys 0.004s
I20260709 13:00:10.700474  8423 tablet_service.cc:1511] Processing CreateTablet for tablet d9ee2138cf46471e96358439600aaa0c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:10.701807  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ee2138cf46471e96358439600aaa0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.709349  8624 tablet_bootstrap.cc:654] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:10.717597  8569 tablet_service.cc:1511] Processing CreateTablet for tablet 09de6eee9632412ebe0a904f65cd2a3c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:10.718863  8569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09de6eee9632412ebe0a904f65cd2a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.720093  8570 tablet_service.cc:1511] Processing CreateTablet for tablet d9ee2138cf46471e96358439600aaa0c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:10.722443  8333 catalog_manager.cc:5697] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:10.727890  8422 tablet_service.cc:1511] Processing CreateTablet for tablet 37072d40853c44b1b312489112c9250e (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:10.729235  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37072d40853c44b1b312489112c9250e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.738312  8570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ee2138cf46471e96358439600aaa0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.749922  8654 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.753176  8631 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.753692  8631 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
I20260709 13:00:10.755885  8631 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:10.756579  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:10.761987  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:10.762691  8434 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.750416  8654 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
W20260709 13:00:10.766789  8547 leader_election.cc:343] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.768762  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:10.769377  8584 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:10.771265  8654 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:10.773213  8333 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.771706  8626 tablet_bootstrap.cc:492] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:10.821183  8626 ts_tablet_manager.cc:1403] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.184s	user 0.009s	sys 0.007s
I20260709 13:00:10.778234  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:10.781114  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:10.778291  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:10.816812  8568 tablet_service.cc:1511] Processing CreateTablet for tablet d9390750b3d3442e888055fd39566ef1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:10.826598  8433 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:10.826577  8499 tablet_service.cc:1511] Processing CreateTablet for tablet 09de6eee9632412ebe0a904f65cd2a3c (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:10.828049  8654 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:10.827957  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49811.5us
I20260709 13:00:10.828413  8550 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:10.828929  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09de6eee9632412ebe0a904f65cd2a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.829162  8568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9390750b3d3442e888055fd39566ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.829592  8631 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:10.830072  8631 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.830483  8631 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.830783  8627 raft_consensus.cc:359] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
I20260709 13:00:10.831635  8627 raft_consensus.cc:385] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.831959  8627 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.832806  8627 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
W20260709 13:00:10.827907  8398 leader_election.cc:343] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:10.834196  8639 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:10.834100  8418 tablet_service.cc:1511] Processing CreateTablet for tablet d9390750b3d3442e888055fd39566ef1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:10.835291  8418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9390750b3d3442e888055fd39566ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.819995  8569 tablet_service.cc:1511] Processing CreateTablet for tablet 37072d40853c44b1b312489112c9250e (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:10.824985  8495 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2b7b0063404db89eb6c3acc48e3abf (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:10.828589  8654 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.839413  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:10.841535  8420 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2b7b0063404db89eb6c3acc48e3abf (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:10.780143  8496 tablet_service.cc:1511] Processing CreateTablet for tablet d9390750b3d3442e888055fd39566ef1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:10.846346  8420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2b7b0063404db89eb6c3acc48e3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.842837  8654 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.854929  8495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2b7b0063404db89eb6c3acc48e3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.858161  8509 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.860308  8631 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
I20260709 13:00:10.863324  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:10.863221  8654 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
I20260709 13:00:10.863943  8508 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:10.864430  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:10.865175  8433 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:10.866407  8631 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:10.868048  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:10.871011  8508 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:10.871899  8434 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:10.872223  8547 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:10.873085  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:10.873505  8631 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.872943  8654 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:10.873980  8639 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:10.780087  8497 tablet_service.cc:1511] Processing CreateTablet for tablet 37072d40853c44b1b312489112c9250e (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:10.886662  8497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37072d40853c44b1b312489112c9250e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.887770  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:10.903033  8496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9390750b3d3442e888055fd39566ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.906868  8570 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2b7b0063404db89eb6c3acc48e3abf (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:10.825084  8626 raft_consensus.cc:359] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.909474  8569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37072d40853c44b1b312489112c9250e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.920620  8571 tablet_service.cc:1511] Processing CreateTablet for tablet 18349b8506fc4ede84bfb527fb6e8a68 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:10.921265  8509 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:10.921741  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18349b8506fc4ede84bfb527fb6e8a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.922916  8570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2b7b0063404db89eb6c3acc48e3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.927628  8624 tablet_bootstrap.cc:492] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:10.928133  8624 ts_tablet_manager.cc:1403] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.335s	user 0.009s	sys 0.010s
I20260709 13:00:10.931298  8494 tablet_service.cc:1511] Processing CreateTablet for tablet 18349b8506fc4ede84bfb527fb6e8a68 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:10.932612  8494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18349b8506fc4ede84bfb527fb6e8a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.914448  8626 raft_consensus.cc:385] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.914178  8639 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:10.913727  8631 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:10.943940  8627 ts_tablet_manager.cc:1434] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.243s	user 0.008s	sys 0.002s
I20260709 13:00:10.945025  8627 tablet_bootstrap.cc:492] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:10.944890  8420 tablet_service.cc:1511] Processing CreateTablet for tablet cbe0cd8e445e4958b026f85c697843e8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:10.945992  8420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe0cd8e445e4958b026f85c697843e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.947299  8639 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.941244  8626 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.955147  8626 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.957340  8626 ts_tablet_manager.cc:1434] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.136s	user 0.000s	sys 0.008s
I20260709 13:00:10.958495  8423 tablet_service.cc:1511] Processing CreateTablet for tablet 18349b8506fc4ede84bfb527fb6e8a68 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:10.959782  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18349b8506fc4ede84bfb527fb6e8a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.959738  8500 tablet_service.cc:1511] Processing CreateTablet for tablet cbe0cd8e445e4958b026f85c697843e8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:10.961103  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe0cd8e445e4958b026f85c697843e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.967185  8424 tablet_service.cc:1511] Processing CreateTablet for tablet 0318f5ccc3c5462784199f043fe82842 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:10.968509  8424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0318f5ccc3c5462784199f043fe82842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.967268  8569 tablet_service.cc:1511] Processing CreateTablet for tablet cbe0cd8e445e4958b026f85c697843e8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:10.970899  8624 raft_consensus.cc:359] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.971326  8569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe0cd8e445e4958b026f85c697843e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.971670  8624 raft_consensus.cc:385] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:10.979832  8631 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } }
I20260709 13:00:10.983796  8568 tablet_service.cc:1511] Processing CreateTablet for tablet 0318f5ccc3c5462784199f043fe82842 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:10.984248  8496 tablet_service.cc:1511] Processing CreateTablet for tablet 0318f5ccc3c5462784199f043fe82842 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:10.985250  8568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0318f5ccc3c5462784199f043fe82842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.985414  8496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0318f5ccc3c5462784199f043fe82842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.980265  8624 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:10.987778  8624 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:10.973214  8626 tablet_bootstrap.cc:492] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:10.995915  8421 tablet_service.cc:1511] Processing CreateTablet for tablet f518d1b1d4c2478b9d4fc2483806952e (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:10.997326  8421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f518d1b1d4c2478b9d4fc2483806952e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.998236  8665 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.005323  8624 ts_tablet_manager.cc:1434] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.000s
I20260709 13:00:11.015746  8627 tablet_bootstrap.cc:654] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.022476  8624 tablet_bootstrap.cc:492] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:11.035921  8422 tablet_service.cc:1511] Processing CreateTablet for tablet 20fa0c62ae854ede982769f8be4f5421 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:11.037262  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fa0c62ae854ede982769f8be4f5421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.037186  8571 tablet_service.cc:1511] Processing CreateTablet for tablet f518d1b1d4c2478b9d4fc2483806952e (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:11.038560  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f518d1b1d4c2478b9d4fc2483806952e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.040092  8626 tablet_bootstrap.cc:654] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.043040  8496 tablet_service.cc:1511] Processing CreateTablet for tablet f518d1b1d4c2478b9d4fc2483806952e (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:11.053114  8654 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.055794  8654 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.055970  8572 tablet_service.cc:1511] Processing CreateTablet for tablet 20fa0c62ae854ede982769f8be4f5421 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:11.057250  8572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fa0c62ae854ede982769f8be4f5421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.057999  8639 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.058501  8639 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.059069  8496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f518d1b1d4c2478b9d4fc2483806952e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.060608  8639 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:11.061369  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:11.062577  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:11.063442  8425 tablet_service.cc:1511] Processing CreateTablet for tablet d56fc8bb927a4cdd8b35293e875e2856 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:11.064675  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56fc8bb927a4cdd8b35293e875e2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.066921  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:00:11.067517  8381 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:11.067683  8510 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:11.070344  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:11.070853  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:11.071687  8628 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.072914  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:11.073057  8333 catalog_manager.cc:5697] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.057893  8654 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.077842  8654 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.081877  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:11.086097  8500 tablet_service.cc:1511] Processing CreateTablet for tablet 20fa0c62ae854ede982769f8be4f5421 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:11.086645  8665 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.089143  8422 tablet_service.cc:1511] Processing CreateTablet for tablet 094f99cd1bce4f88ab569c64b32b03b1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:11.090653  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094f99cd1bce4f88ab569c64b32b03b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.093552  8494 tablet_service.cc:1511] Processing CreateTablet for tablet 094f99cd1bce4f88ab569c64b32b03b1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:11.094610  8570 tablet_service.cc:1511] Processing CreateTablet for tablet 094f99cd1bce4f88ab569c64b32b03b1 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:11.094674  8499 tablet_service.cc:1511] Processing CreateTablet for tablet d56fc8bb927a4cdd8b35293e875e2856 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:11.089296  8568 tablet_service.cc:1511] Processing CreateTablet for tablet d56fc8bb927a4cdd8b35293e875e2856 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:11.100407  8570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094f99cd1bce4f88ab569c64b32b03b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.101984  8435 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.102342  8624 tablet_bootstrap.cc:654] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.102792  8627 tablet_bootstrap.cc:492] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:11.103334  8627 ts_tablet_manager.cc:1403] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.158s	user 0.010s	sys 0.017s
I20260709 13:00:11.106130  8494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094f99cd1bce4f88ab569c64b32b03b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:11.105983  8669 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:00:11.110041  8497 tablet_service.cc:1511] Processing CreateTablet for tablet 6230ca5c82634f7abb78b594dab8da24 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:11.110100  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56fc8bb927a4cdd8b35293e875e2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.113183  8497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6230ca5c82634f7abb78b594dab8da24. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:11.114807  8666 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:11.116238  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fa0c62ae854ede982769f8be4f5421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.122565  8568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56fc8bb927a4cdd8b35293e875e2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.123800  8423 tablet_service.cc:1511] Processing CreateTablet for tablet 6230ca5c82634f7abb78b594dab8da24 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:11.125003  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6230ca5c82634f7abb78b594dab8da24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.123389  8627 raft_consensus.cc:359] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.127303  8627 raft_consensus.cc:385] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.127604  8627 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.128355  8627 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.130692  8627 ts_tablet_manager.cc:1434] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:00:11.131668  8627 tablet_bootstrap.cc:492] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:11.135918  8571 tablet_service.cc:1511] Processing CreateTablet for tablet 6230ca5c82634f7abb78b594dab8da24 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:11.144433  8495 tablet_service.cc:1511] Processing CreateTablet for tablet 337d7e57df5f492daf49939f167561a0 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:11.146746  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6230ca5c82634f7abb78b594dab8da24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.146724  8423 tablet_service.cc:1511] Processing CreateTablet for tablet 337d7e57df5f492daf49939f167561a0 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:11.147814  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337d7e57df5f492daf49939f167561a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.151134  8495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337d7e57df5f492daf49939f167561a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.154385  8631 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:11.166147  8665 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.173388  8654 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:00:11.187603  8626 tablet_bootstrap.cc:492] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:11.193347  8627 tablet_bootstrap.cc:654] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.195185  8569 tablet_service.cc:1511] Processing CreateTablet for tablet 337d7e57df5f492daf49939f167561a0 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:11.214318  8626 ts_tablet_manager.cc:1403] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.242s	user 0.004s	sys 0.014s
I20260709 13:00:11.214855  8569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337d7e57df5f492daf49939f167561a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.216620  8572 tablet_service.cc:1511] Processing CreateTablet for tablet 18f59320c7be4aea96b523f7f5083650 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:11.217219  8626 raft_consensus.cc:359] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.217780  8626 raft_consensus.cc:385] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.217803  8572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f59320c7be4aea96b523f7f5083650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.218009  8626 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.205590  8499 tablet_service.cc:1511] Processing CreateTablet for tablet 7c79fc54c7a44921afa731a1720c6b3b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:11.207463  8425 tablet_service.cc:1511] Processing CreateTablet for tablet 18f59320c7be4aea96b523f7f5083650 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:11.219290  8333 catalog_manager.cc:5697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.222350  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f59320c7be4aea96b523f7f5083650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.222738  8626 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.225191  8624 tablet_bootstrap.cc:492] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:11.225633  8624 ts_tablet_manager.cc:1403] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.203s	user 0.016s	sys 0.014s
I20260709 13:00:11.210836  8571 tablet_service.cc:1511] Processing CreateTablet for tablet 7c79fc54c7a44921afa731a1720c6b3b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:11.226325  8626 ts_tablet_manager.cc:1434] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:00:11.211637  8423 tablet_service.cc:1511] Processing CreateTablet for tablet 7c79fc54c7a44921afa731a1720c6b3b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:11.210836  8500 tablet_service.cc:1511] Processing CreateTablet for tablet 18f59320c7be4aea96b523f7f5083650 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:11.227283  8626 tablet_bootstrap.cc:492] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:11.227461  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c79fc54c7a44921afa731a1720c6b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.227684  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f59320c7be4aea96b523f7f5083650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.230458  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c79fc54c7a44921afa731a1720c6b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.233263  8626 tablet_bootstrap.cc:654] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.239616  8624 raft_consensus.cc:359] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.240679  8624 raft_consensus.cc:385] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.241052  8624 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.250748  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c79fc54c7a44921afa731a1720c6b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.258551  8624 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.259876  8422 tablet_service.cc:1511] Processing CreateTablet for tablet 6a195e69bd9b4a1a80805249b3c0c304 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:11.261178  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a195e69bd9b4a1a80805249b3c0c304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.262398  8624 ts_tablet_manager.cc:1434] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.003s
I20260709 13:00:11.263336  8624 tablet_bootstrap.cc:492] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:11.263973  8628 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:11.290663  8624 tablet_bootstrap.cc:654] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.288769  8626 tablet_bootstrap.cc:492] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:11.298915  8500 tablet_service.cc:1511] Processing CreateTablet for tablet f2a5011db54b4e9f85a54c19ade01aa8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:11.299422  8495 tablet_service.cc:1511] Processing CreateTablet for tablet 6a195e69bd9b4a1a80805249b3c0c304 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:11.300230  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a5011db54b4e9f85a54c19ade01aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.300805  8665 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.301266  8665 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.303478  8665 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:11.308445  8495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a195e69bd9b4a1a80805249b3c0c304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.308152  8425 tablet_service.cc:1511] Processing CreateTablet for tablet f2a5011db54b4e9f85a54c19ade01aa8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:11.309342  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a5011db54b4e9f85a54c19ade01aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.313149  8497 tablet_service.cc:1511] Processing CreateTablet for tablet 1e038af5e5154b3e8ae9503fdedbb44b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:11.314409  8497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e038af5e5154b3e8ae9503fdedbb44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.314276  8572 tablet_service.cc:1511] Processing CreateTablet for tablet f2a5011db54b4e9f85a54c19ade01aa8 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:11.304958  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:11.317678  8550 leader_election.cc:343] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.307060  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:11.304008  8626 ts_tablet_manager.cc:1403] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.010s
W20260709 13:00:11.320699  8547 leader_election.cc:343] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.321167  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:11.316514  8572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a5011db54b4e9f85a54c19ade01aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.322561  8627 tablet_bootstrap.cc:492] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:11.323043  8627 ts_tablet_manager.cc:1403] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.192s	user 0.009s	sys 0.017s
I20260709 13:00:11.317548  8571 tablet_service.cc:1511] Processing CreateTablet for tablet 6a195e69bd9b4a1a80805249b3c0c304 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:11.322584  8631 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.327490  8424 tablet_service.cc:1511] Processing CreateTablet for tablet 141901f3b86847429c9dead6a62a4b04 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:11.328869  8422 tablet_service.cc:1511] Processing CreateTablet for tablet 1e038af5e5154b3e8ae9503fdedbb44b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:11.329380  8424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141901f3b86847429c9dead6a62a4b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.329998  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e038af5e5154b3e8ae9503fdedbb44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.333653  8571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a195e69bd9b4a1a80805249b3c0c304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.325716  8627 raft_consensus.cc:359] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.346280  8627 raft_consensus.cc:385] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.339342  8569 tablet_service.cc:1511] Processing CreateTablet for tablet 1e038af5e5154b3e8ae9503fdedbb44b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:11.346606  8627 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.347574  8569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e038af5e5154b3e8ae9503fdedbb44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.347358  8627 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.348989  8499 tablet_service.cc:1511] Processing CreateTablet for tablet 141901f3b86847429c9dead6a62a4b04 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:11.354604  8499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141901f3b86847429c9dead6a62a4b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.340183  8626 raft_consensus.cc:359] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.356671  8626 raft_consensus.cc:385] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.356978  8626 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.344671  8654 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.349627  8627 ts_tablet_manager.cc:1434] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:00:11.358572  8654 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.359251  8627 tablet_bootstrap.cc:492] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:11.360590  8654 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.361950  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:11.340030  8624 tablet_bootstrap.cc:492] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:11.362592  8425 tablet_service.cc:1511] Processing CreateTablet for tablet c4156673eede4435930a1d9fd63f78a3 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:11.363160  8624 ts_tablet_manager.cc:1403] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.004s
I20260709 13:00:11.363749  8425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4156673eede4435930a1d9fd63f78a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.365636  8568 tablet_service.cc:1511] Processing CreateTablet for tablet 141901f3b86847429c9dead6a62a4b04 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:11.366818  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:11.367074  8568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141901f3b86847429c9dead6a62a4b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.367408  8509 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:11.368614  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:11.365955  8624 raft_consensus.cc:359] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:00:11.369818  8400 leader_election.cc:343] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.357669  8626 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.370193  8624 raft_consensus.cc:385] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.370501  8624 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.369370  8654 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.371012  8654 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.371408  8654 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.371191  8624 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.371879  8626 ts_tablet_manager.cc:1434] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.001s
I20260709 13:00:11.376034  8627 tablet_bootstrap.cc:654] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.376765  8626 tablet_bootstrap.cc:492] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:11.380913  8495 tablet_service.cc:1511] Processing CreateTablet for tablet c4156673eede4435930a1d9fd63f78a3 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:11.382037  8495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4156673eede4435930a1d9fd63f78a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.382318  8570 tablet_service.cc:1511] Processing CreateTablet for tablet c4156673eede4435930a1d9fd63f78a3 (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:11.383183  8624 ts_tablet_manager.cc:1434] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:00:11.384115  8624 tablet_bootstrap.cc:492] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:11.385936  8570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4156673eede4435930a1d9fd63f78a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.394227  8624 tablet_bootstrap.cc:654] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.400913  8497 tablet_service.cc:1511] Processing CreateTablet for tablet 64f4890aeba446ef8cf170616e61d6ab (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:11.402098  8497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f4890aeba446ef8cf170616e61d6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.402962  8626 tablet_bootstrap.cc:654] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.413223  8574 tablet_service.cc:1511] Processing CreateTablet for tablet 64f4890aeba446ef8cf170616e61d6ab (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:11.414600  8574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f4890aeba446ef8cf170616e61d6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.420535  8627 tablet_bootstrap.cc:492] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:11.420984  8627 ts_tablet_manager.cc:1403] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.010s
I20260709 13:00:11.423060  8665 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:11.423206  8422 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4b315396764044bd73a9cb7f985b2b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:11.424300  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4b315396764044bd73a9cb7f985b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.424379  8500 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4b315396764044bd73a9cb7f985b2b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:11.425395  8500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4b315396764044bd73a9cb7f985b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.428848  8631 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:11.411458  8424 tablet_service.cc:1511] Processing CreateTablet for tablet 64f4890aeba446ef8cf170616e61d6ab (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:11.439191  8424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f4890aeba446ef8cf170616e61d6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.439518  8567 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4b315396764044bd73a9cb7f985b2b (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:11.439630  8654 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.443029  8423 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9ecda5b5b04bbebb108bfcee54439e (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:11.456235  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9ecda5b5b04bbebb108bfcee54439e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.447186  8495 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9ecda5b5b04bbebb108bfcee54439e (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:11.457280  8495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9ecda5b5b04bbebb108bfcee54439e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.459100  8627 raft_consensus.cc:359] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.459743  8627 raft_consensus.cc:385] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.459987  8627 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.463649  8654 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.465055  8567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4b315396764044bd73a9cb7f985b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.475044  8627 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.476421  8627 ts_tablet_manager.cc:1434] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.001s
I20260709 13:00:11.471761  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:11.478438  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:00:11.481518  8400 leader_election.cc:343] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.482132  8510 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.480891  8631 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:00:11.484777  8570 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9ecda5b5b04bbebb108bfcee54439e (DEFAULT_TABLE table=test-workload [id=20aadca15e7e4aa88cb723030736de51]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:11.485955  8570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9ecda5b5b04bbebb108bfcee54439e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.487246  8624 tablet_bootstrap.cc:492] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:11.487709  8624 ts_tablet_manager.cc:1403] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.009s
I20260709 13:00:11.494931  8510 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:11.495769  8626 tablet_bootstrap.cc:492] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:11.496194  8626 ts_tablet_manager.cc:1403] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.002s
I20260709 13:00:11.496047  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:11.497123  8654 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.497550  8654 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:11.498315  8654 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.498689  8626 raft_consensus.cc:359] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.499290  8626 raft_consensus.cc:385] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.499541  8626 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.500133  8626 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.504750  8626 ts_tablet_manager.cc:1434] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:00:11.506664  8627 tablet_bootstrap.cc:492] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:11.508623  8626 tablet_bootstrap.cc:492] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:11.509824  8624 raft_consensus.cc:359] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.510552  8624 raft_consensus.cc:385] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.510857  8624 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.511497  8624 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.519933  8624 ts_tablet_manager.cc:1434] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:00:11.520720  8624 tablet_bootstrap.cc:492] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:11.525935  8624 tablet_bootstrap.cc:654] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.545490  8627 tablet_bootstrap.cc:654] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.548974  8626 tablet_bootstrap.cc:654] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.559656  8333 catalog_manager.cc:5697] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.565073  8626 tablet_bootstrap.cc:492] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:11.566056  8632 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:11.565728  8626 ts_tablet_manager.cc:1403] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.004s
I20260709 13:00:11.573642  8627 tablet_bootstrap.cc:492] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:11.574148  8627 ts_tablet_manager.cc:1403] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.002s
I20260709 13:00:11.574328  8626 raft_consensus.cc:359] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.575127  8626 raft_consensus.cc:385] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.575435  8626 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.576112  8624 tablet_bootstrap.cc:492] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:11.576534  8624 ts_tablet_manager.cc:1403] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.010s
I20260709 13:00:11.576236  8626 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.578567  8626 ts_tablet_manager.cc:1434] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:11.578953  8624 raft_consensus.cc:359] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.579452  8626 tablet_bootstrap.cc:492] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:11.579576  8624 raft_consensus.cc:385] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.579921  8624 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.580636  8624 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.582804  8624 ts_tablet_manager.cc:1434] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:00:11.583725  8624 tablet_bootstrap.cc:492] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:11.586086  8626 tablet_bootstrap.cc:654] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.587004  8627 raft_consensus.cc:359] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.587777  8627 raft_consensus.cc:385] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.588099  8627 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.589267  8624 tablet_bootstrap.cc:654] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.589484  8627 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.591454  8627 ts_tablet_manager.cc:1434] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:00:11.592476  8627 tablet_bootstrap.cc:492] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:11.598237  8627 tablet_bootstrap.cc:654] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.624228  8624 tablet_bootstrap.cc:492] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:11.624400  8626 tablet_bootstrap.cc:492] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:11.624662  8624 ts_tablet_manager.cc:1403] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.016s
I20260709 13:00:11.624723  8627 tablet_bootstrap.cc:492] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:11.624886  8626 ts_tablet_manager.cc:1403] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.022s
I20260709 13:00:11.625241  8627 ts_tablet_manager.cc:1403] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.013s
I20260709 13:00:11.627272  8624 raft_consensus.cc:359] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.627799  8624 raft_consensus.cc:385] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.628036  8624 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.628070  8627 raft_consensus.cc:359] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.628258  8626 raft_consensus.cc:359] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.628654  8624 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.628901  8626 raft_consensus.cc:385] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.628846  8627 raft_consensus.cc:385] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.629350  8626 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.629407  8627 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.630616  8624 ts_tablet_manager.cc:1434] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:00:11.630371  8627 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.630379  8626 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.632726  8626 ts_tablet_manager.cc:1434] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:11.633176  8624 tablet_bootstrap.cc:492] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:11.633723  8626 tablet_bootstrap.cc:492] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:11.635490  8627 ts_tablet_manager.cc:1434] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:00:11.636375  8627 tablet_bootstrap.cc:492] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:11.639184  8624 tablet_bootstrap.cc:654] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.640552  8626 tablet_bootstrap.cc:654] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.641801  8627 tablet_bootstrap.cc:654] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.653368  8654 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.653890  8654 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.654488  8626 tablet_bootstrap.cc:492] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:11.654949  8626 ts_tablet_manager.cc:1403] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:00:11.656234  8654 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.658717  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:11.658475  8626 raft_consensus.cc:359] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.659269  8626 raft_consensus.cc:385] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.659375  8509 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:11.659605  8626 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.660667  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:11.660449  8626 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.661016  8624 tablet_bootstrap.cc:492] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:11.661929  8624 ts_tablet_manager.cc:1403] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.007s
I20260709 13:00:11.662091  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:11.662899  8627 tablet_bootstrap.cc:492] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:11.662865  8584 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:11.663167  8626 ts_tablet_manager.cc:1434] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:00:11.663422  8627 ts_tablet_manager.cc:1403] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.006s
I20260709 13:00:11.664112  8626 tablet_bootstrap.cc:492] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:11.664777  8624 raft_consensus.cc:359] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.665385  8624 raft_consensus.cc:385] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.665632  8624 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.665797  8627 raft_consensus.cc:359] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.666440  8627 raft_consensus.cc:385] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.666706  8627 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.666349  8624 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.667271  8628 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.667654  8628 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.667388  8627 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.667973  8628 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.671026  8626 tablet_bootstrap.cc:654] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.674942  8628 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.676882  8627 ts_tablet_manager.cc:1434] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:00:11.677690  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:11.678498  8509 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.678710  8624 ts_tablet_manager.cc:1434] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:00:11.679593  8628 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.681412  8627 tablet_bootstrap.cc:492] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:11.682205  8626 tablet_bootstrap.cc:492] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:11.682651  8626 ts_tablet_manager.cc:1403] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:00:11.685420  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:11.685364  8626 raft_consensus.cc:359] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.686092  8584 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.686241  8626 raft_consensus.cc:385] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.686545  8626 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.686904  8627 tablet_bootstrap.cc:654] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.687376  8626 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.689843  8626 ts_tablet_manager.cc:1434] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:11.691563  8626 tablet_bootstrap.cc:492] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:11.691643  8627 tablet_bootstrap.cc:492] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:11.692155  8627 ts_tablet_manager.cc:1403] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:00:11.692728  8624 tablet_bootstrap.cc:492] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:11.693945  8584 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:11.695181  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:11.695155  8627 raft_consensus.cc:359] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.695976  8627 raft_consensus.cc:385] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.696182  8654 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.696282  8627 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.696935  8654 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:11.698009  8626 tablet_bootstrap.cc:654] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.701035  8624 tablet_bootstrap.cc:654] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.701866  8627 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.708989  8654 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.710508  8509 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:11.725370  8665 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.725926  8665 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.728179  8665 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:11.728933  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:11.729880  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:11.730537  8627 ts_tablet_manager.cc:1434] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
W20260709 13:00:11.730417  8550 leader_election.cc:343] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.730760  8509 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:11.732379  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:11.733641  8665 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.734061  8665 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.734436  8665 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.744342  8626 tablet_bootstrap.cc:492] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:11.744933  8626 ts_tablet_manager.cc:1403] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.054s	user 0.031s	sys 0.020s
I20260709 13:00:11.747845  8627 tablet_bootstrap.cc:492] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:11.751704  8626 raft_consensus.cc:359] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.752688  8626 raft_consensus.cc:385] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.753098  8626 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.754194  8626 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.758481  8639 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.758968  8639 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.760547  8626 ts_tablet_manager.cc:1434] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:00:11.762984  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:11.763811  8509 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:11.767481  8627 tablet_bootstrap.cc:654] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.767271  8333 catalog_manager.cc:5697] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.749444  8665 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.770535  8665 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:11.771552  8654 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.772094  8654 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.775666  8624 tablet_bootstrap.cc:492] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:11.780834  8626 tablet_bootstrap.cc:492] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:11.765743  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:11.780778  8634 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.761301  8639 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:11.783876  8624 ts_tablet_manager.cc:1403] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.091s	user 0.025s	sys 0.035s
I20260709 13:00:11.783378  8634 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.783829  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:11.785285  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:11.786208  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:00:11.786588  8550 leader_election.cc:343] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:11.786779  8509 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.787631  8639 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.787506  8624 raft_consensus.cc:359] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.788373  8624 raft_consensus.cc:385] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.788709  8624 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.789559  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:11.789413  8624 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.789919  8654 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.790129  8510 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:11.791088  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:11.791651  8584 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:11.793082  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:11.793329  8626 tablet_bootstrap.cc:654] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.795783  8624 ts_tablet_manager.cc:1434] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:00:11.796766  8624 tablet_bootstrap.cc:492] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:11.796567  8654 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.810127  8628 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.812309  8628 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.815634  8628 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.810993  8654 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.824102  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:11.824805  8509 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:11.824885  8510 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:11.828137  8398 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:11.822832  8654 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.830003  8628 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.830446  8628 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.830826  8628 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.818243  8634 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.834518  8627 tablet_bootstrap.cc:492] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:11.835136  8627 ts_tablet_manager.cc:1403] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.087s	user 0.006s	sys 0.009s
I20260709 13:00:11.837755  8665 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.842284  8627 raft_consensus.cc:359] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.843247  8627 raft_consensus.cc:385] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.843498  8627 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.842813  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:11.844419  8627 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.845337  8632 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.845808  8632 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:11.846102  8627 ts_tablet_manager.cc:1434] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:00:11.846621  8632 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.847301  8627 tablet_bootstrap.cc:492] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:11.857975  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:11.842854  8665 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.866222  8584 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:11.866712  8665 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:11.867314  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:11.867776  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:11.868403  8509 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:11.865618  8331 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.869442  8547 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:11.870452  8665 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.870884  8665 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.871313  8665 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.877076  8639 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.888665  8654 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.882444  8628 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.896404  8634 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.897329  8634 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.897900  8434 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:11.899349  8634 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.890394  8665 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.904297  8627 tablet_bootstrap.cc:654] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.905503  8654 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.905663  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:11.906251  8509 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.906891  8628 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.907639  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:11.908138  8706 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.908221  8510 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.908663  8706 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.912953  8624 tablet_bootstrap.cc:654] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:11.913585  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:11.914080  8665 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:11.916389  8706 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.919866  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:11.920750  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:11.921332  8435 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:11.921767  8510 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:11.922014  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:11.922683  8584 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:11.922729  8476 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:11.920943  8434 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:11.924512  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:11.924769  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:11.925138  8583 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:11.925556  8509 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:11.925861  8634 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.926360  8634 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.926792  8634 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.932173  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:11.932984  8507 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:11.934346  8398 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:11.937721  8706 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.938871  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:11.939077  8706 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:11.939790  8708 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:11.940130  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:11.940279  8708 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:11.939942  8706 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.941134  8708 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.942242  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:11.943667  8583 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.944808  8634 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.942994  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:11.943114  8710 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:11.950690  8626 tablet_bootstrap.cc:492] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:11.951124  8626 ts_tablet_manager.cc:1403] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.170s	user 0.013s	sys 0.021s
I20260709 13:00:11.946542  8634 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:11.954489  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:11.955111  8434 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.958279  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:11.949301  8710 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.959605  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:11.959909  8639 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:11.963318  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:11.964130  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:11.968649  8581 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:11.966301  8582 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.967394  8706 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:11.970940  8627 tablet_bootstrap.cc:492] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:11.971554  8627 ts_tablet_manager.cc:1403] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.124s	user 0.007s	sys 0.006s
I20260709 13:00:11.967954  8583 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:11.973779  8584 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 1: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:00:11.977080  8711 raft_consensus.cc:2764] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:00:11.965569  8710 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:11.980633  8582 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:11.983390  8434 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:11.983862  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:11.987882  8626 raft_consensus.cc:359] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.988466  8626 raft_consensus.cc:385] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.988749  8626 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.989370  8626 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.993487  8706 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:11.995738  8627 raft_consensus.cc:359] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:11.996384  8627 raft_consensus.cc:385] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:11.996681  8627 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:11.996747  8626 ts_tablet_manager.cc:1434] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:00:11.997717  8626 tablet_bootstrap.cc:492] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:11.998641  8624 tablet_bootstrap.cc:492] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:11.999058  8624 ts_tablet_manager.cc:1403] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.202s	user 0.018s	sys 0.033s
I20260709 13:00:12.003625  8710 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.005833  8627 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.007886  8627 ts_tablet_manager.cc:1434] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:00:12.008448  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:12.008790  8627 tablet_bootstrap.cc:492] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:12.009002  8626 tablet_bootstrap.cc:654] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.001592  8624 raft_consensus.cc:359] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.009009  8509 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.023787  8626 tablet_bootstrap.cc:492] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:12.024214  8626 ts_tablet_manager.cc:1403] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.004s
I20260709 13:00:12.025017  8634 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.025341  8634 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.010634  8710 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.027740  8634 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.027491  8626 raft_consensus.cc:359] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.027959  8509 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:12.028223  8626 raft_consensus.cc:385] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.017143  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:12.028759  8581 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.028553  8626 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.029074  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:12.029377  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:12.029878  8710 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.029623  8626 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.030046  8582 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:12.030570  8710 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:12.031311  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:12.031374  8710 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.032193  8634 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.032543  8634 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.032876  8634 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.018963  8331 catalog_manager.cc:5697] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.035717  8626 ts_tablet_manager.cc:1434] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:00:12.035681  8331 catalog_manager.cc:5697] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.036975  8626 tablet_bootstrap.cc:492] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:12.019079  8711 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.021019  8624 raft_consensus.cc:385] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.040571  8624 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.041215  8624 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.043126  8624 ts_tablet_manager.cc:1434] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:00:12.043931  8624 tablet_bootstrap.cc:492] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:12.044931  8626 tablet_bootstrap.cc:654] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.014813  8627 tablet_bootstrap.cc:654] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.027969  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:12.049701  8434 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:12.057262  8626 tablet_bootstrap.cc:492] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:12.057212  8634 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.057940  8626 ts_tablet_manager.cc:1403] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:00:12.059350  8634 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.059875  8634 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.060281  8634 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.060767  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:12.061301  8434 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.062516  8626 raft_consensus.cc:359] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.063463  8626 raft_consensus.cc:385] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.063799  8626 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.064973  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:12.064580  8626 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.065538  8582 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.067209  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:12.068572  8476 leader_election.cc:343] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.070886  8626 ts_tablet_manager.cc:1434] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:00:12.072058  8626 tablet_bootstrap.cc:492] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:12.074332  8582 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:12.075677  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:12.079368  8626 tablet_bootstrap.cc:654] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.084149  8581 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:12.088881  8720 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.102303  8624 tablet_bootstrap.cc:654] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.102532  8720 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:12.103468  8720 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.091127  8627 tablet_bootstrap.cc:492] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:12.106050  8627 ts_tablet_manager.cc:1403] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.000s
I20260709 13:00:12.105327  8333 catalog_manager.cc:5697] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.107692  8711 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:12.108497  8711 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.108841  8627 raft_consensus.cc:359] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.109465  8627 raft_consensus.cc:385] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.109733  8627 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.092877  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:12.094172  8634 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.110296  8582 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:12.113235  8627 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.115091  8627 ts_tablet_manager.cc:1434] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:00:12.115113  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:12.115942  8627 tablet_bootstrap.cc:492] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:12.116369  8634 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.116719  8634 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.117022  8634 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.118042  8710 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.120659  8624 tablet_bootstrap.cc:492] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:12.121083  8624 ts_tablet_manager.cc:1403] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.009s
I20260709 13:00:12.095703  8626 tablet_bootstrap.cc:492] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
W20260709 13:00:12.095986  8381 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:12.099814  8434 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:12.122805  8626 ts_tablet_manager.cc:1403] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.008s
I20260709 13:00:12.125928  8624 raft_consensus.cc:359] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.126843  8624 raft_consensus.cc:385] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.127184  8624 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.127895  8626 raft_consensus.cc:359] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.128659  8626 raft_consensus.cc:385] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.127946  8624 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.128937  8626 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.129621  8626 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.130389  8624 ts_tablet_manager.cc:1434] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:00:12.129917  8634 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.131582  8624 tablet_bootstrap.cc:492] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:12.121865  8627 tablet_bootstrap.cc:654] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.131831  8626 ts_tablet_manager.cc:1434] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:00:12.135656  8626 tablet_bootstrap.cc:492] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:12.140378  8634 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.142381  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:12.142962  8581 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.146168  8626 tablet_bootstrap.cc:654] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.148180  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:00:12.149680  8476 leader_election.cc:343] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.150456  8627 tablet_bootstrap.cc:492] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:12.150877  8627 ts_tablet_manager.cc:1403] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:00:12.151747  8581 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:12.153023  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:12.153651  8627 raft_consensus.cc:359] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.154193  8634 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.154369  8627 raft_consensus.cc:385] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.154842  8634 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:12.154745  8627 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.155632  8627 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.155649  8634 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.159183  8624 tablet_bootstrap.cc:654] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.177579  8710 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.201968  8710 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.202623  8710 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.225147  8627 ts_tablet_manager.cc:1434] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.009s
I20260709 13:00:12.226231  8627 tablet_bootstrap.cc:492] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:12.229991  8710 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.233853  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:12.234608  8581 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:12.237816  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:12.239362  8626 tablet_bootstrap.cc:492] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:12.239876  8626 ts_tablet_manager.cc:1403] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.104s	user 0.001s	sys 0.010s
I20260709 13:00:12.247186  8710 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.248900  8710 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.249276  8710 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.249184  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:12.252413  8626 raft_consensus.cc:359] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.252900  8626 raft_consensus.cc:385] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.253134  8626 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.253916  8626 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.240497  8330 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.256075  8626 ts_tablet_manager.cc:1434] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:00:12.252074  8510 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:12.258997  8626 tablet_bootstrap.cc:492] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:12.261063  8627 tablet_bootstrap.cc:654] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.266685  8624 tablet_bootstrap.cc:492] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:12.267135  8624 ts_tablet_manager.cc:1403] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.136s	user 0.030s	sys 0.049s
I20260709 13:00:12.273945  8710 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.274492  8624 raft_consensus.cc:359] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.275197  8626 tablet_bootstrap.cc:654] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.275169  8624 raft_consensus.cc:385] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.275579  8624 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.276796  8710 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.276954  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:12.277549  8509 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.279660  8627 tablet_bootstrap.cc:492] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:12.279253  8330 catalog_manager.cc:5697] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.280089  8627 ts_tablet_manager.cc:1403] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.001s
I20260709 13:00:12.280786  8330 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.282689  8627 raft_consensus.cc:359] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.283105  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:12.283339  8627 raft_consensus.cc:385] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.283617  8627 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.283665  8581 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.284368  8627 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.285110  8624 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.286319  8627 ts_tablet_manager.cc:1434] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:00:12.286972  8624 ts_tablet_manager.cc:1434] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:00:12.284698  8509 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:12.287120  8627 tablet_bootstrap.cc:492] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:12.288096  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:12.289088  8706 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.289525  8706 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:12.290308  8706 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.291954  8624 tablet_bootstrap.cc:492] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:12.298559  8581 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:12.300243  8627 tablet_bootstrap.cc:654] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.301597  8624 tablet_bootstrap.cc:654] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.307585  8626 tablet_bootstrap.cc:492] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:12.308179  8626 ts_tablet_manager.cc:1403] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.009s
I20260709 13:00:12.311560  8626 raft_consensus.cc:359] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.312539  8626 raft_consensus.cc:385] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.313184  8626 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.313480  8333 catalog_manager.cc:5697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.316988  8627 tablet_bootstrap.cc:492] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:12.317575  8627 ts_tablet_manager.cc:1403] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.003s
I20260709 13:00:12.320917  8627 raft_consensus.cc:359] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.321781  8627 raft_consensus.cc:385] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.322261  8626 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.323653  8627 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.324903  8626 ts_tablet_manager.cc:1434] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:00:12.325766  8626 tablet_bootstrap.cc:492] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:12.326725  8627 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.327481  8624 tablet_bootstrap.cc:492] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:12.327911  8624 ts_tablet_manager.cc:1403] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.022s
I20260709 13:00:12.328794  8627 ts_tablet_manager.cc:1434] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:00:12.329672  8627 tablet_bootstrap.cc:492] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:12.330389  8624 raft_consensus.cc:359] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.330996  8624 raft_consensus.cc:385] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.331245  8624 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.331925  8624 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.334422  8626 tablet_bootstrap.cc:654] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.339484  8627 tablet_bootstrap.cc:654] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.340595  8706 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.348719  8624 ts_tablet_manager.cc:1434] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:00:12.349789  8624 tablet_bootstrap.cc:492] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:12.352187  8627 tablet_bootstrap.cc:492] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:12.352625  8627 ts_tablet_manager.cc:1403] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 13:00:12.355607  8627 raft_consensus.cc:359] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.356276  8627 raft_consensus.cc:385] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.356536  8627 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.357113  8627 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.360533  8627 ts_tablet_manager.cc:1434] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:00:12.366852  8624 tablet_bootstrap.cc:654] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.370836  8627 tablet_bootstrap.cc:492] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:12.376268  8706 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.376798  8627 tablet_bootstrap.cc:654] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.377693  8624 tablet_bootstrap.cc:492] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:12.378173  8624 ts_tablet_manager.cc:1403] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:00:12.388484  8627 tablet_bootstrap.cc:492] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:12.388917  8627 ts_tablet_manager.cc:1403] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:00:12.388664  8624 raft_consensus.cc:359] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.389299  8624 raft_consensus.cc:385] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.389593  8624 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.390352  8624 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.391544  8627 raft_consensus.cc:359] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.392170  8627 raft_consensus.cc:385] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.392416  8627 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.392563  8624 ts_tablet_manager.cc:1434] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:00:12.393256  8627 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.393404  8624 tablet_bootstrap.cc:492] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:12.399503  8627 ts_tablet_manager.cc:1434] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:00:12.400117  8624 tablet_bootstrap.cc:654] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.400403  8627 tablet_bootstrap.cc:492] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:12.405637  8627 tablet_bootstrap.cc:654] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.415423  8626 tablet_bootstrap.cc:492] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:12.415455  8624 tablet_bootstrap.cc:492] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:12.416162  8624 ts_tablet_manager.cc:1403] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:00:12.416152  8626 ts_tablet_manager.cc:1403] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.091s	user 0.030s	sys 0.025s
I20260709 13:00:12.419838  8632 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.420259  8632 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.420606  8626 raft_consensus.cc:359] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.421475  8626 raft_consensus.cc:385] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.421831  8626 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.422302  8632 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:12.422585  8626 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.424207  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:12.424893  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:12.426011  8547 leader_election.cc:343] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:12.426827  8550 leader_election.cc:343] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.427374  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:12.428727  8639 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.428895  8624 raft_consensus.cc:359] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.429574  8624 raft_consensus.cc:385] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.429872  8624 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.430634  8624 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.431488  8626 ts_tablet_manager.cc:1434] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:00:12.431444  8434 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.432889  8626 tablet_bootstrap.cc:492] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:12.435806  8624 ts_tablet_manager.cc:1434] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:00:12.437960  8624 tablet_bootstrap.cc:492] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:12.438781  8626 tablet_bootstrap.cc:654] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.443231  8624 tablet_bootstrap.cc:654] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.442888  8639 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.448352  8639 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.448890  8639 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.449182  8634 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.449664  8634 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.452458  8634 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.452414  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:12.453073  8433 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:12.453459  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:12.453723  8624 tablet_bootstrap.cc:492] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:12.454139  8624 ts_tablet_manager.cc:1403] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 13:00:12.454059  8581 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:12.454473  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:12.456667  8624 raft_consensus.cc:359] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.457432  8624 raft_consensus.cc:385] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.457399  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:12.457856  8624 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.458458  8624 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.458869  8665 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.459982  8639 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:12.450101  8626 tablet_bootstrap.cc:492] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:12.460383  8634 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.460726  8624 ts_tablet_manager.cc:1434] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:12.460714  8634 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.461727  8624 tablet_bootstrap.cc:492] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:12.462082  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:12.462777  8509 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
W20260709 13:00:12.463616  8550 leader_election.cc:343] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.464749  8547 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:12.465741  8639 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.466109  8639 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.466467  8639 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.467475  8624 tablet_bootstrap.cc:654] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.460785  8626 ts_tablet_manager.cc:1403] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.007s
I20260709 13:00:12.469825  8706 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.466110  8634 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.472431  8626 raft_consensus.cc:359] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.473054  8626 raft_consensus.cc:385] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.473377  8626 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.474011  8626 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.475948  8626 ts_tablet_manager.cc:1434] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:12.476744  8626 tablet_bootstrap.cc:492] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:12.482702  8626 tablet_bootstrap.cc:654] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.485198  8627 tablet_bootstrap.cc:492] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:12.485749  8627 ts_tablet_manager.cc:1403] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.086s	user 0.018s	sys 0.013s
I20260709 13:00:12.488324  8665 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.488157  8634 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.488770  8665 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.489140  8627 raft_consensus.cc:359] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.491084  8627 raft_consensus.cc:385] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.491406  8627 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.491649  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:12.492300  8434 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:12.492257  8627 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.494266  8550 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:12.495105  8632 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.495508  8632 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.495885  8632 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.499399  8665 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:12.501741  8711 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.502225  8711 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.505609  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:12.506237  8509 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:12.509308  8711 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.510687  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:12.512241  8475 leader_election.cc:343] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.514309  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:12.514920  8434 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:12.516767  8634 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.513540  8632 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.519475  8639 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.521765  8632 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:12.522289  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:12.526575  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:12.527619  8434 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:12.528740  8550 leader_election.cc:343] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.531127  8627 ts_tablet_manager.cc:1434] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:00:12.531652  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:12.531767  8706 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.532245  8582 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.533221  8627 tablet_bootstrap.cc:492] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:12.538837  8708 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.539499  8708 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.542017  8708 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.544900  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:12.545564  8583 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:12.548307  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:12.548914  8509 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:12.552560  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:12.553320  8435 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.553023  8706 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.522310  8639 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:12.550675  8400 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:12.561415  8706 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.563824  8624 tablet_bootstrap.cc:492] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:12.564550  8624 ts_tablet_manager.cc:1403] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.018s
I20260709 13:00:12.563772  8706 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.566442  8706 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.569290  8624 raft_consensus.cc:359] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.569937  8624 raft_consensus.cc:385] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.570225  8624 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.570850  8624 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.571668  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:12.572242  8509 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.572448  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:12.545648  8708 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:00:12.573858  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:12.574457  8510 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.575326  8634 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.575702  8634 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.575949  8434 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:12.579337  8550 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:12.580755  8665 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.581238  8665 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:12.581444  8509 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:12.576035  8634 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.588063  8634 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.588147  8665 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.596418  8634 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.602094  8510 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:12.603606  8547 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:12.603894  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:12.603981  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:12.604663  8434 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.604962  8639 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.607031  8706 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.605466  8639 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:12.610158  8708 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.610611  8708 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.609910  8626 tablet_bootstrap.cc:492] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:12.611675  8626 ts_tablet_manager.cc:1403] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.135s	user 0.028s	sys 0.040s
I20260709 13:00:12.609609  8639 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.611617  8435 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:12.615757  8708 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.615971  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:00:12.613121  8475 leader_election.cc:343] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.617825  8711 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.621304  8624 ts_tablet_manager.cc:1434] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.001s
I20260709 13:00:12.613408  8582 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:12.625126  8624 tablet_bootstrap.cc:492] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:12.630976  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:12.633775  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:12.635239  8398 leader_election.cc:343] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:12.635833  8400 leader_election.cc:343] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.636353  8400 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:12.626272  8711 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:12.644682  8710 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.696492  8756 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.700419  8756 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.694113  8711 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.702489  8627 tablet_bootstrap.cc:654] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:12.706912  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 71416.4us
I20260709 13:00:12.703639  8626 raft_consensus.cc:359] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.708473  8626 raft_consensus.cc:385] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.708901  8626 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.709414  8706 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.705569  8434 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:12.710675  8626 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.713248  8626 ts_tablet_manager.cc:1434] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.101s	user 0.000s	sys 0.006s
I20260709 13:00:12.714394  8626 tablet_bootstrap.cc:492] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:12.702642  8756 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.717101  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:12.704617  8330 catalog_manager.cc:5697] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.727594  8330 catalog_manager.cc:5697] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.728780  8634 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.729416  8634 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:12.722041  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:12.730352  8507 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.730685  8634 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.721196  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:12.741230  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:12.742445  8582 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 1: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:00:12.745371  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:12.747318  8582 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.747562  8435 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.764457  8765 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.771512  8627 tablet_bootstrap.cc:492] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:12.773190  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:12.774803  8627 ts_tablet_manager.cc:1403] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.242s	user 0.018s	sys 0.014s
I20260709 13:00:12.777127  8626 tablet_bootstrap.cc:654] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.777844  8708 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.777940  8711 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.785975  8624 tablet_bootstrap.cc:654] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.788326  8507 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:12.789641  8765 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.790337  8398 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:12.800491  8761 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.804930  8761 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:12.830616  8634 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:00:12.784165  8766 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.064s
I20260709 13:00:12.837970  8639 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.806094  8761 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.845973  8639 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.848098  8639 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:12.848743  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:12.850194  8550 leader_election.cc:343] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.853433  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:12.853472  8768 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:12.857511  8547 leader_election.cc:343] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:12.857937  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:12.868849  8632 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:12.873926  8627 raft_consensus.cc:359] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.874660  8627 raft_consensus.cc:385] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.874945  8627 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.894541  8627 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.895329  8333 catalog_manager.cc:5697] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.896732  8333 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.906217  8624 tablet_bootstrap.cc:492] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:12.906847  8624 ts_tablet_manager.cc:1403] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.285s	user 0.011s	sys 0.016s
I20260709 13:00:12.911648  8624 raft_consensus.cc:359] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.912555  8624 raft_consensus.cc:385] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:12.912889  8624 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:12.913667  8624 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.914286  8711 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.916790  8627 ts_tablet_manager.cc:1434] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.000s
I20260709 13:00:12.917920  8627 tablet_bootstrap.cc:492] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:12.919750  8711 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.922281  8711 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.925457  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:12.926112  8583 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:12.927237  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:12.927860  8435 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:12.929561  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:12.930393  8711 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:12.930757  8711 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.931100  8711 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.930938  8761 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:12.934674  8624 ts_tablet_manager.cc:1434] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:00:12.936209  8624 tablet_bootstrap.cc:492] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:12.936933  8755 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:12.946535  8333 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.969156  8711 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:12.972168  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:12.972715  8435 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.972867  8582 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:12.980386  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:12.980985  8581 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:12.988027  8435 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:12.988615  8581 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:12.992969  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:12.989048  8711 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:12.994163  8711 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:12.995878  8627 tablet_bootstrap.cc:654] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:12.994629  8711 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:13.010841  8711 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.013130  8624 tablet_bootstrap.cc:654] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.016098  8626 tablet_bootstrap.cc:492] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:13.019323  8626 ts_tablet_manager.cc:1403] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.305s	user 0.010s	sys 0.025s
I20260709 13:00:13.020493  8639 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.022042  8626 raft_consensus.cc:359] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.022764  8626 raft_consensus.cc:385] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.023111  8626 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.024277  8626 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.028777  8626 ts_tablet_manager.cc:1434] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:00:13.031829  8626 tablet_bootstrap.cc:492] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:13.032305  8665 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.034053  8627 tablet_bootstrap.cc:492] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.034111  8624 tablet_bootstrap.cc:492] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:13.034574  8627 ts_tablet_manager.cc:1403] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.004s
I20260709 13:00:13.034734  8624 ts_tablet_manager.cc:1403] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.007s
I20260709 13:00:13.037261  8627 raft_consensus.cc:359] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.037964  8627 raft_consensus.cc:385] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.038261  8627 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.037660  8624 raft_consensus.cc:359] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.042694  8624 raft_consensus.cc:385] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.042992  8624 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.043587  8624 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.046099  8639 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.046610  8639 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.047698  8624 ts_tablet_manager.cc:1434] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 13:00:13.048602  8624 tablet_bootstrap.cc:492] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:13.049564  8639 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:13.053282  8626 tablet_bootstrap.cc:654] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.053227  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.054248  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.058473  8627 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.060148  8627 ts_tablet_manager.cc:1434] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:00:13.061028  8627 tablet_bootstrap.cc:492] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:13.065232  8432 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:00:13.066543  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:13.067257  8639 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.069469  8624 tablet_bootstrap.cc:654] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.079885  8627 tablet_bootstrap.cc:654] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.083360  8634 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.093698  8639 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.100461  8333 catalog_manager.cc:5697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.125672  8639 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.126616  8761 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.127197  8761 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.129743  8761 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.130697  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.132925  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:13.133040  8398 leader_election.cc:343] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:13.135485  8400 leader_election.cc:343] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.136093  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:13.136406  8711 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.139389  8761 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.173175  8627 tablet_bootstrap.cc:492] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.173671  8627 ts_tablet_manager.cc:1403] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.036s
I20260709 13:00:13.176419  8627 raft_consensus.cc:359] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.177294  8627 raft_consensus.cc:385] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.177613  8627 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
W20260709 13:00:13.191636  8550 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:13.199190  8711 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.199694  8711 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.205303  8626 tablet_bootstrap.cc:492] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:13.209491  8626 ts_tablet_manager.cc:1403] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.178s	user 0.035s	sys 0.067s
I20260709 13:00:13.208834  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.206969  8765 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.211287  8432 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:13.213544  8476 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.214344  8634 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.214710  8634 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.215036  8634 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.214907  8626 raft_consensus.cc:359] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.216159  8626 raft_consensus.cc:385] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.216094  8765 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.218567  8626 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.213287  8627 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.219365  8626 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.220712  8627 ts_tablet_manager.cc:1434] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.019s
I20260709 13:00:13.221627  8627 tablet_bootstrap.cc:492] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:13.222343  8626 ts_tablet_manager.cc:1434] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 13:00:13.225129  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.223894  8711 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.226450  8626 tablet_bootstrap.cc:492] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:13.226851  8634 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:00:13.229257  8475 leader_election.cc:343] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.230680  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:13.231330  8435 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.233353  8761 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.233951  8634 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.238535  8626 tablet_bootstrap.cc:654] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.240216  8435 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:13.241427  8476 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.242872  8766 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.243476  8766 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:13.244544  8766 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.245748  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:00:13.247066  8475 leader_election.cc:343] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.239804  8627 tablet_bootstrap.cc:654] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:13.277844  8381 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:13.282591  8761 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.293644  8330 catalog_manager.cc:5697] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.297477  8786 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.298115  8786 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.311107  8624 tablet_bootstrap.cc:492] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:13.311585  8624 ts_tablet_manager.cc:1403] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.263s	user 0.011s	sys 0.047s
I20260709 13:00:13.311441  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:13.314355  8550 leader_election.cc:343] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.316636  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:00:13.318192  8547 leader_election.cc:343] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.318621  8547 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:13.319422  8665 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.320307  8627 tablet_bootstrap.cc:492] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.320753  8627 ts_tablet_manager.cc:1403] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.020s
I20260709 13:00:13.321820  8624 raft_consensus.cc:359] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.322526  8624 raft_consensus.cc:385] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.322835  8624 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.323136  8627 raft_consensus.cc:359] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.323781  8627 raft_consensus.cc:385] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.324093  8786 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:13.323561  8624 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.328699  8626 tablet_bootstrap.cc:492] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:13.329088  8626 ts_tablet_manager.cc:1403] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.032s
I20260709 13:00:13.326710  8624 ts_tablet_manager.cc:1434] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:00:13.331447  8624 tablet_bootstrap.cc:492] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:13.331276  8626 raft_consensus.cc:359] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.331943  8626 raft_consensus.cc:385] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.332234  8626 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.332858  8626 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.333662  8627 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.334380  8627 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.336442  8627 ts_tablet_manager.cc:1434] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:00:13.337284  8627 tablet_bootstrap.cc:492] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:13.337728  8624 tablet_bootstrap.cc:654] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.342335  8627 tablet_bootstrap.cc:654] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.347113  8626 ts_tablet_manager.cc:1434] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:00:13.348474  8626 tablet_bootstrap.cc:492] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:13.353803  8624 tablet_bootstrap.cc:492] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:13.353956  8626 tablet_bootstrap.cc:654] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.354367  8624 ts_tablet_manager.cc:1403] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:00:13.356921  8624 raft_consensus.cc:359] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.357551  8624 raft_consensus.cc:385] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.357805  8624 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.358560  8624 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.361616  8624 ts_tablet_manager.cc:1434] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:00:13.362543  8624 tablet_bootstrap.cc:492] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:13.365237  8766 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.365958  8711 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.366595  8711 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.365684  8766 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.370183  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.370764  8435 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:13.371704  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.370623  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.372275  8432 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:13.373128  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.373776  8581 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:13.376405  8711 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.370671  8766 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.381021  8624 tablet_bootstrap.cc:654] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:13.373721  8475 leader_election.cc:343] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.382444  8665 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.382934  8665 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.384462  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:13.386890  8665 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:13.387106  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.387089  8711 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.388911  8711 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:13.390112  8550 leader_election.cc:343] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.394935  8476 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.395576  8624 tablet_bootstrap.cc:492] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:13.396001  8624 ts_tablet_manager.cc:1403] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.009s
I20260709 13:00:13.396540  8711 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.398301  8627 tablet_bootstrap.cc:492] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.398857  8627 ts_tablet_manager.cc:1403] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.004s
I20260709 13:00:13.399114  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.396560  8766 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.400296  8766 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.401072  8766 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:13.401245  8547 leader_election.cc:343] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.401687  8547 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:13.401858  8627 raft_consensus.cc:359] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.402485  8627 raft_consensus.cc:385] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.402711  8627 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.402777  8665 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.403348  8627 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.406234  8626 tablet_bootstrap.cc:492] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:13.406651  8626 ts_tablet_manager.cc:1403] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.058s	user 0.034s	sys 0.015s
I20260709 13:00:13.406991  8627 ts_tablet_manager.cc:1434] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:13.407737  8627 tablet_bootstrap.cc:492] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:13.411404  8624 raft_consensus.cc:359] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.412045  8624 raft_consensus.cc:385] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.412299  8624 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.412900  8624 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.413609  8711 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.414296  8766 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.414958  8624 ts_tablet_manager.cc:1434] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:00:13.416584  8624 tablet_bootstrap.cc:492] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:13.418606  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:13.419199  8435 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.418678  8626 raft_consensus.cc:359] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.420279  8626 raft_consensus.cc:385] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.420527  8626 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.421152  8626 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.421787  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:13.422343  8434 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.423163  8626 ts_tablet_manager.cc:1434] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:00:13.423195  8624 tablet_bootstrap.cc:654] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.425406  8627 tablet_bootstrap.cc:654] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.426748  8626 tablet_bootstrap.cc:492] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:13.427577  8711 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.434859  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:13.435671  8435 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:13.436652  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.437525  8634 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.440016  8634 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:13.440845  8634 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.439384  8766 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.439196  8434 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
W20260709 13:00:13.444373  8475 leader_election.cc:343] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.444769  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:13.445304  8581 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.445344  8476 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.446223  8768 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.446645  8768 raft_consensus.cc:697] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:13.447371  8768 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.457224  8581 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:13.459695  8627 tablet_bootstrap.cc:492] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.460150  8627 ts_tablet_manager.cc:1403] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.007s
I20260709 13:00:13.462337  8624 tablet_bootstrap.cc:492] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:13.462749  8624 ts_tablet_manager.cc:1403] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.008s
I20260709 13:00:13.462867  8626 tablet_bootstrap.cc:654] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.462874  8627 raft_consensus.cc:359] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.463742  8627 raft_consensus.cc:385] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.464335  8627 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.465047  8627 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.465139  8624 raft_consensus.cc:359] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.465891  8624 raft_consensus.cc:385] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.466187  8624 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.466876  8624 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.468255  8627 ts_tablet_manager.cc:1434] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:13.467724  8330 catalog_manager.cc:5697] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.469619  8627 tablet_bootstrap.cc:492] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:13.469875  8330 catalog_manager.cc:5697] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.477617  8627 tablet_bootstrap.cc:654] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.484555  8626 tablet_bootstrap.cc:492] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:13.485109  8626 ts_tablet_manager.cc:1403] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.009s
I20260709 13:00:13.485495  8624 ts_tablet_manager.cc:1434] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:00:13.488349  8626 raft_consensus.cc:359] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.489262  8626 raft_consensus.cc:385] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.489602  8626 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.489997  8624 tablet_bootstrap.cc:492] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:13.490620  8626 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.495821  8624 tablet_bootstrap.cc:654] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.499394  8626 ts_tablet_manager.cc:1434] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:00:13.500618  8626 tablet_bootstrap.cc:492] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:13.507427  8627 tablet_bootstrap.cc:492] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.508414  8627 ts_tablet_manager.cc:1403] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.016s
I20260709 13:00:13.510825  8626 tablet_bootstrap.cc:654] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.511008  8761 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.511459  8761 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.513237  8627 raft_consensus.cc:359] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.513643  8761 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.513947  8627 raft_consensus.cc:385] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.514262  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.514402  8627 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.515276  8627 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.516170  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.517635  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:13.518388  8710 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.519203  8627 ts_tablet_manager.cc:1434] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:00:13.519580  8624 tablet_bootstrap.cc:492] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:13.519992  8624 ts_tablet_manager.cc:1403] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.006s
I20260709 13:00:13.520077  8627 tablet_bootstrap.cc:492] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:13.521726  8768 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.522444  8624 raft_consensus.cc:359] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.523069  8624 raft_consensus.cc:385] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.523346  8624 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.524088  8624 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.525852  8627 tablet_bootstrap.cc:654] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.526738  8624 ts_tablet_manager.cc:1434] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:13.527570  8624 tablet_bootstrap.cc:492] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:13.536053  8627 tablet_bootstrap.cc:492] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.536514  8627 ts_tablet_manager.cc:1403] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:00:13.536983  8626 tablet_bootstrap.cc:492] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:13.537403  8626 ts_tablet_manager.cc:1403] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.003s
I20260709 13:00:13.537998  8624 tablet_bootstrap.cc:654] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.538921  8627 raft_consensus.cc:359] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.539821  8627 raft_consensus.cc:385] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.539889  8626 raft_consensus.cc:359] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.540256  8627 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.540714  8626 raft_consensus.cc:385] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.541064  8626 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.541352  8627 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.542088  8626 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.543479  8627 ts_tablet_manager.cc:1434] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:13.544486  8627 tablet_bootstrap.cc:492] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:13.550201  8627 tablet_bootstrap.cc:654] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.555583  8626 ts_tablet_manager.cc:1434] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:00:13.562680  8626 tablet_bootstrap.cc:492] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:13.568446  8626 tablet_bootstrap.cc:654] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.574630  8624 tablet_bootstrap.cc:492] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:13.575008  8624 ts_tablet_manager.cc:1403] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.018s
I20260709 13:00:13.577251  8627 tablet_bootstrap.cc:492] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.577169  8624 raft_consensus.cc:359] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.577507  8665 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.577929  8624 raft_consensus.cc:385] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.578286  8624 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.578074  8665 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.578960  8624 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.580195  8665 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:13.577731  8627 ts_tablet_manager.cc:1403] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.014s
I20260709 13:00:13.582759  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.583477  8435 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:00:13.583197  8627 raft_consensus.cc:359] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.583801  8627 raft_consensus.cc:385] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.583932  8768 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.584674  8768 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.584074  8627 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.585701  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.586210  8627 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.588191  8627 ts_tablet_manager.cc:1434] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:00:13.588753  8624 ts_tablet_manager.cc:1434] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:00:13.589614  8624 tablet_bootstrap.cc:492] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:13.589962  8547 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:13.591550  8632 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.595216  8624 tablet_bootstrap.cc:654] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.596666  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.598037  8627 tablet_bootstrap.cc:492] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:13.598675  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:13.600014  8476 leader_election.cc:343] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.602250  8632 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.604401  8627 tablet_bootstrap.cc:654] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:13.604523  8475 leader_election.cc:343] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.605139  8475 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:13.606315  8634 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.610049  8624 tablet_bootstrap.cc:492] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:13.610487  8624 ts_tablet_manager.cc:1403] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:00:13.612977  8624 raft_consensus.cc:359] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.613443  8624 raft_consensus.cc:385] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.613634  8624 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.614230  8624 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.615520  8624 ts_tablet_manager.cc:1434] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:13.616122  8624 tablet_bootstrap.cc:492] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:13.616415  8768 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.618377  8634 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.618889  8634 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.619014  8768 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.620925  8634 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.621627  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.622223  8435 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:13.620693  8624 tablet_bootstrap.cc:654] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.623257  8476 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.625396  8766 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.625841  8766 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.626286  8766 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.635092  8632 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.635815  8632 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.639834  8710 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.640523  8627 tablet_bootstrap.cc:492] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.640296  8710 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.640945  8627 ts_tablet_manager.cc:1403] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.003s
I20260709 13:00:13.643400  8627 raft_consensus.cc:359] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.643666  8767 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.644011  8627 raft_consensus.cc:385] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.644342  8627 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.644345  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.644325  8767 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.643723  8710 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.644783  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.646908  8627 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.647233  8767 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:00:13.647109  8398 leader_election.cc:343] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.648862  8627 ts_tablet_manager.cc:1434] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:00:13.649024  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:13.651110  8476 leader_election.cc:343] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:13.651633  8400 leader_election.cc:343] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.652130  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:13.652720  8665 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.653219  8710 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.653352  8665 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.622678  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.655656  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.657037  8632 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:00:13.659142  8475 leader_election.cc:343] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:13.660168  8475 leader_election.cc:343] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.660596  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:13.657997  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.661612  8634 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:13.662248  8550 leader_election.cc:343] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.663748  8665 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:13.665225  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.665963  8435 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:00:13.660605  8627 tablet_bootstrap.cc:492] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:13.672569  8434 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.672461  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.675233  8627 tablet_bootstrap.cc:654] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.680198  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.681627  8768 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.682407  8768 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.684206  8665 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.684823  8665 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.689123  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.690121  8581 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:13.690793  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.691565  8435 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:13.691664  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:13.692876  8765 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.692958  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.693477  8765 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.694192  8632 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.694108  8765 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.694749  8632 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.695173  8632 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.702212  8634 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.703037  8634 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.704174  8665 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:13.706642  8634 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.708307  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.709475  8626 tablet_bootstrap.cc:492] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:13.709965  8626 ts_tablet_manager.cc:1403] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.147s	user 0.041s	sys 0.034s
I20260709 13:00:13.712826  8626 raft_consensus.cc:359] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.713599  8626 raft_consensus.cc:385] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.713899  8626 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.714658  8626 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.715664  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.716882  8626 ts_tablet_manager.cc:1434] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:00:13.717849  8626 tablet_bootstrap.cc:492] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
W20260709 13:00:13.717980  8547 leader_election.cc:343] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.718595  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:13.717989  8432 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:13.719455  8639 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.722947  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:13.723811  8639 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.724864  8626 tablet_bootstrap.cc:654] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.714910  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.687817  8768 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.734403  8766 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.711982  8765 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.743032  8627 tablet_bootstrap.cc:492] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.743577  8627 ts_tablet_manager.cc:1403] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.031s
I20260709 13:00:13.735244  8435 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:13.738853  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.751389  8507 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:13.754766  8766 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.740263  8476 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.755733  8639 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.752570  8765 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.769140  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:13.769762  8433 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.758132  8765 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.770227  8765 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.770576  8765 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.771023  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:13.771595  8584 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.773036  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:13.777792  8433 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:13.778684  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:13.779217  8584 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:13.786674  8632 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.783083  8435 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.787952  8581 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 1: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:00:13.783898  8476 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.787760  8766 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:00:13.790325  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:13.790779  8766 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.782995  8765 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.790915  8433 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.792905  8766 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:13.793704  8765 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.794276  8766 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.799126  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:00:13.800748  8475 leader_election.cc:343] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.802500  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:13.802812  8624 tablet_bootstrap.cc:492] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:13.803296  8624 ts_tablet_manager.cc:1403] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.187s	user 0.036s	sys 0.057s
I20260709 13:00:13.803956  8765 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.804405  8765 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:13.805300  8765 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.806342  8624 raft_consensus.cc:359] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.807024  8624 raft_consensus.cc:385] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.807293  8624 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.808028  8624 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.808884  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:13.811122  8581 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 1: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:00:13.811901  8624 ts_tablet_manager.cc:1434] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:13.809832  8627 raft_consensus.cc:359] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.812327  8627 raft_consensus.cc:385] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.812645  8627 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.813280  8433 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:13.813409  8475 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:13.815814  8767 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:13.814141  8632 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:13.816437  8627 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.817981  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:13.818509  8627 ts_tablet_manager.cc:1434] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 13:00:13.818708  8507 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:00:13.816452  8624 tablet_bootstrap.cc:492] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:13.820860  8435 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:13.823185  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:13.824496  8665 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:13.824914  8665 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:13.825650  8665 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.831429  8627 tablet_bootstrap.cc:492] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:13.836220  8331 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.825598  8624 tablet_bootstrap.cc:654] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.837426  8627 tablet_bootstrap.cc:654] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.842944  8626 tablet_bootstrap.cc:492] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:13.850968  8626 ts_tablet_manager.cc:1403] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.133s	user 0.024s	sys 0.014s
I20260709 13:00:13.856690  8626 raft_consensus.cc:359] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.857388  8626 raft_consensus.cc:385] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.859871  8626 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.863555  8766 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.864886  8765 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:13.865183  8626 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.868137  8626 ts_tablet_manager.cc:1434] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:00:13.869064  8626 tablet_bootstrap.cc:492] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:13.874332  8330 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.884931  8626 tablet_bootstrap.cc:654] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.887349  8761 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.887962  8761 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.890336  8761 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.890384  8766 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.892941  8766 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.894074  8626 tablet_bootstrap.cc:492] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:13.894526  8626 ts_tablet_manager.cc:1403] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:00:13.895694  8766 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.896303  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:13.898013  8476 leader_election.cc:343] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.898133  8626 raft_consensus.cc:359] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.898846  8626 raft_consensus.cc:385] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.899077  8626 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.899727  8626 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.901049  8626 ts_tablet_manager.cc:1434] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:00:13.901724  8626 tablet_bootstrap.cc:492] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:13.903228  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.904085  8507 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:13.905669  8398 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.906643  8626 tablet_bootstrap.cc:654] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:13.906740  8710 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.907362  8710 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.907768  8710 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.910364  8632 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.911056  8632 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.914187  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.914932  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:13.915656  8435 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:13.916778  8550 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:13.917744  8639 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.918202  8639 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.918576  8639 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.919870  8711 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:13.921947  8400 leader_election.cc:343] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.924396  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:13.925303  8583 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:13.929893  8632 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:13.938490  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:13.939404  8507 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:13.942145  8710 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.945813  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:13.946174  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:13.946764  8507 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:13.947311  8400 leader_election.cc:343] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:13.951117  8639 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.953217  8639 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:13.955407  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:13.956307  8508 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.958292  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:13.959224  8768 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:13.959601  8768 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.959781  8710 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.959980  8768 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.963220  8765 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.964176  8767 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:13.969563  8768 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.971800  8768 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:13.973330  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:13.975972  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:13.976593  8432 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:13.978638  8627 tablet_bootstrap.cc:492] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:13.979126  8627 ts_tablet_manager.cc:1403] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.148s	user 0.015s	sys 0.030s
I20260709 13:00:13.981896  8627 raft_consensus.cc:359] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.982708  8627 raft_consensus.cc:385] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:13.982998  8627 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:13.983692  8627 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:13.987717  8331 catalog_manager.cc:5697] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.990660  8627 ts_tablet_manager.cc:1434] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
W20260709 13:00:13.992254  8476 leader_election.cc:343] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.001116  8632 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.001767  8632 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.005033  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:14.005844  8583 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.004406  8632 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:14.013280  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:14.014379  8434 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:00:14.019001  8627 tablet_bootstrap.cc:492] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:14.042325  8624 tablet_bootstrap.cc:492] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:14.042977  8624 ts_tablet_manager.cc:1403] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.227s	user 0.021s	sys 0.028s
I20260709 13:00:14.046875  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.043877  8432 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:14.049790  8583 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:14.062538  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:14.065635  8550 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:14.065899  8639 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.066476  8632 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.067567  8508 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:14.069867  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:14.070674  8766 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.071130  8766 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:14.071213  8786 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.071950  8766 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.086187  8626 tablet_bootstrap.cc:492] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:14.071642  8786 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.086679  8626 ts_tablet_manager.cc:1403] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.185s	user 0.049s	sys 0.075s
I20260709 13:00:14.087481  8632 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:14.092178  8632 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.102479  8624 raft_consensus.cc:359] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.107292  8624 raft_consensus.cc:385] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.107744  8624 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.108728  8624 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.117028  8639 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.118531  8786 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:14.127902  8507 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:14.127014  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.128159  8626 raft_consensus.cc:359] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.128645  8509 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:14.128873  8626 raft_consensus.cc:385] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.129202  8626 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.129307  8398 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:14.129899  8547 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:14.130765  8665 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.131088  8665 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.131608  8626 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.135039  8624 ts_tablet_manager.cc:1434] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.092s	user 0.003s	sys 0.006s
I20260709 13:00:14.135394  8626 ts_tablet_manager.cc:1434] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:00:14.132911  8710 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.140223  8626 tablet_bootstrap.cc:492] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:14.131992  8665 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.141088  8624 tablet_bootstrap.cc:492] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:14.150949  8710 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:14.160044  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:14.157052  8332 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.161419  8627 tablet_bootstrap.cc:654] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:14.161803  8550 leader_election.cc:343] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.163112  8331 catalog_manager.cc:5697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.163602  8710 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.171550  8626 tablet_bootstrap.cc:654] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.174000  8665 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.180225  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:14.181072  8508 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.190160  8665 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:14.195880  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:14.196146  8624 tablet_bootstrap.cc:654] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:14.198743  8550 leader_election.cc:343] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.211825  8766 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:14.213910  8639 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.214457  8639 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.215554  8627 tablet_bootstrap.cc:492] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:14.216017  8627 ts_tablet_manager.cc:1403] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.197s	user 0.017s	sys 0.015s
I20260709 13:00:14.216830  8639 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:14.217396  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:14.218741  8627 raft_consensus.cc:359] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.219487  8627 raft_consensus.cc:385] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.219774  8627 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.220587  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.220422  8627 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.221346  8509 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:14.221413  8624 tablet_bootstrap.cc:492] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:14.221911  8624 ts_tablet_manager.cc:1403] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.007s
I20260709 13:00:14.223686  8547 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:14.225139  8837 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.224895  8330 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.228503  8624 raft_consensus.cc:359] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.229210  8624 raft_consensus.cc:385] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.229502  8624 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.230194  8624 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.235208  8627 ts_tablet_manager.cc:1434] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:00:14.237136  8624 ts_tablet_manager.cc:1434] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:00:14.238119  8624 tablet_bootstrap.cc:492] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:14.240195  8508 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:14.242121  8627 tablet_bootstrap.cc:492] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:14.243639  8634 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:14.244407  8547 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:14.246409  8839 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.246984  8839 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:14.247905  8839 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.249234  8627 tablet_bootstrap.cc:654] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.249455  8634 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.254410  8624 tablet_bootstrap.cc:654] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.254262  8765 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:14.249944  8634 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.261292  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:14.262045  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:14.262959  8475 leader_election.cc:343] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:14.263391  8476 leader_election.cc:343] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.263574  8634 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.263799  8476 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:14.264614  8634 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.267794  8627 tablet_bootstrap.cc:492] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:14.268276  8627 ts_tablet_manager.cc:1403] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.003s
I20260709 13:00:14.271263  8626 tablet_bootstrap.cc:492] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:14.271011  8627 raft_consensus.cc:359] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.271692  8626 ts_tablet_manager.cc:1403] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.004s
I20260709 13:00:14.271921  8627 raft_consensus.cc:385] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.272392  8627 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.273298  8627 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.276468  8627 ts_tablet_manager.cc:1434] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:14.277397  8627 tablet_bootstrap.cc:492] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:14.277922  8837 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.288834  8639 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:14.293926  8626 raft_consensus.cc:359] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.293867  8331 catalog_manager.cc:5697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.294831  8626 raft_consensus.cc:385] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.295122  8626 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.302174  8626 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.308990  8626 ts_tablet_manager.cc:1434] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:00:14.309127  8624 tablet_bootstrap.cc:492] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:14.309172  8765 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.309712  8624 ts_tablet_manager.cc:1403] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.001s
I20260709 13:00:14.309872  8626 tablet_bootstrap.cc:492] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:14.312388  8624 raft_consensus.cc:359] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.313051  8624 raft_consensus.cc:385] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.313310  8624 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.317008  8624 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.334784  8627 tablet_bootstrap.cc:654] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.335186  8624 ts_tablet_manager.cc:1434] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:00:14.335927  8624 tablet_bootstrap.cc:492] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:14.339540  8710 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.340408  8710 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.346412  8710 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.347892  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:14.350744  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.351471  8507 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 1: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:00:14.354336  8398 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:14.356540  8761 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.370586  8634 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.371131  8634 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.388160  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:14.390172  8475 leader_election.cc:343] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.390882  8624 tablet_bootstrap.cc:654] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.390769  8634 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.394208  8639 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.400054  8626 tablet_bootstrap.cc:654] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.400278  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:14.401747  8476 leader_election.cc:343] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.402248  8476 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:14.406193  8634 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.407248  8761 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:14.411293  8381 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:14.450255  8627 tablet_bootstrap.cc:492] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:14.450821  8627 ts_tablet_manager.cc:1403] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.174s	user 0.024s	sys 0.020s
I20260709 13:00:14.453212  8626 tablet_bootstrap.cc:492] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:14.453833  8626 ts_tablet_manager.cc:1403] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.144s	user 0.026s	sys 0.020s
I20260709 13:00:14.453259  8627 raft_consensus.cc:359] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.454335  8627 raft_consensus.cc:385] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.454641  8627 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.455250  8627 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.456807  8626 raft_consensus.cc:359] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.457480  8626 raft_consensus.cc:385] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.457590  8627 ts_tablet_manager.cc:1434] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:00:14.457721  8626 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.458628  8626 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.458627  8627 tablet_bootstrap.cc:492] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:14.460574  8624 tablet_bootstrap.cc:492] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:14.461010  8624 ts_tablet_manager.cc:1403] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.016s
I20260709 13:00:14.463529  8624 raft_consensus.cc:359] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.464044  8624 raft_consensus.cc:385] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.464293  8624 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.464937  8627 tablet_bootstrap.cc:654] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.464896  8624 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.469316  8624 ts_tablet_manager.cc:1434] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:00:14.472543  8624 tablet_bootstrap.cc:492] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:14.473291  8710 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.473783  8710 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.476002  8710 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.477568  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.478191  8508 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:14.478602  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:14.479213  8584 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:14.479699  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:14.479935  8626 ts_tablet_manager.cc:1434] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 13:00:14.480782  8626 tablet_bootstrap.cc:492] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:14.480868  8710 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.481405  8710 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.481814  8710 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.485762  8624 tablet_bootstrap.cc:654] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.486874  8626 tablet_bootstrap.cc:654] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.490943  8627 tablet_bootstrap.cc:492] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:14.491355  8627 ts_tablet_manager.cc:1403] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.003s
I20260709 13:00:14.493765  8627 raft_consensus.cc:359] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.494393  8627 raft_consensus.cc:385] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.494660  8627 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.495278  8627 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.497709  8627 ts_tablet_manager.cc:1434] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:14.501561  8627 tablet_bootstrap.cc:492] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:14.502300  8710 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.506970  8627 tablet_bootstrap.cc:654] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.508039  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:14.508617  8508 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.509910  8710 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.512611  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:14.515751  8584 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.515309  8624 tablet_bootstrap.cc:492] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:14.518503  8624 ts_tablet_manager.cc:1403] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.009s
I20260709 13:00:14.521325  8584 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:14.521286  8624 raft_consensus.cc:359] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.522255  8624 raft_consensus.cc:385] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.522531  8624 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.522868  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:14.523178  8624 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.523825  8710 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:14.524587  8710 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:14.525720  8624 ts_tablet_manager.cc:1434] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:14.525501  8710 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.526696  8624 tablet_bootstrap.cc:492] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:14.532881  8508 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:14.534089  8624 tablet_bootstrap.cc:654] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.544256  8761 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.545413  8626 tablet_bootstrap.cc:492] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:14.544962  8761 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.545861  8626 ts_tablet_manager.cc:1403] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.015s
I20260709 13:00:14.549052  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.552995  8627 tablet_bootstrap.cc:492] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:14.553423  8627 ts_tablet_manager.cc:1403] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.013s
I20260709 13:00:14.553817  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:14.556236  8584 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 1: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:00:14.556890  8627 raft_consensus.cc:359] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.556643  8761 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.557548  8627 raft_consensus.cc:385] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.557868  8627 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.558586  8627 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.559156  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:14.560668  8627 ts_tablet_manager.cc:1434] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:00:14.561165  8761 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.561561  8627 tablet_bootstrap.cc:492] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:14.554673  8626 raft_consensus.cc:359] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.566170  8626 raft_consensus.cc:385] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.566653  8626 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.567866  8627 tablet_bootstrap.cc:654] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.572435  8626 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.575536  8626 ts_tablet_manager.cc:1434] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:00:14.577888  8626 tablet_bootstrap.cc:492] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:14.586900  8626 tablet_bootstrap.cc:654] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.586971  8761 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.591388  8624 tablet_bootstrap.cc:492] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:14.591861  8624 ts_tablet_manager.cc:1403] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.065s	user 0.022s	sys 0.040s
I20260709 13:00:14.592974  8331 catalog_manager.cc:5697] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.595029  8624 raft_consensus.cc:359] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.595918  8624 raft_consensus.cc:385] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.596237  8624 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.596873  8624 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.598451  8627 tablet_bootstrap.cc:492] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:14.598906  8624 ts_tablet_manager.cc:1434] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:00:14.599027  8627 ts_tablet_manager.cc:1403] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.008s
I20260709 13:00:14.599747  8624 tablet_bootstrap.cc:492] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:14.602319  8627 raft_consensus.cc:359] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.603008  8627 raft_consensus.cc:385] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.603299  8627 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.603956  8627 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.606055  8624 tablet_bootstrap.cc:654] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.610550  8624 tablet_bootstrap.cc:492] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:14.611106  8624 ts_tablet_manager.cc:1403] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:00:14.611642  8627 ts_tablet_manager.cc:1434] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:14.612593  8627 tablet_bootstrap.cc:492] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:14.613632  8624 raft_consensus.cc:359] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.614104  8768 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:14.614363  8624 raft_consensus.cc:385] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.614711  8624 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.615401  8624 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.616969  8639 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:14.617719  8624 ts_tablet_manager.cc:1434] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:14.618840  8624 tablet_bootstrap.cc:492] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:14.619598  8627 tablet_bootstrap.cc:654] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.621825  8768 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:14.625253  8624 tablet_bootstrap.cc:654] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:14.627384  8761 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.639981  8634 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.640722  8634 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.644331  8634 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.646986  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:14.647039  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:14.649488  8475 leader_election.cc:343] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.610575  8626 tablet_bootstrap.cc:492] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
W20260709 13:00:14.651427  8476 leader_election.cc:343] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.652122  8476 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:14.651297  8626 ts_tablet_manager.cc:1403] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.002s
I20260709 13:00:14.655490  8765 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:14.670145  8626 raft_consensus.cc:359] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.675971  8761 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:14.687839  8840 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.718348  8626 raft_consensus.cc:385] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.718852  8626 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.727152  8626 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.749745  8786 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.753120  8786 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.761080  8786 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:14.765591  8837 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.762008  8626 ts_tablet_manager.cc:1434] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.000s
I20260709 13:00:14.770648  8626 tablet_bootstrap.cc:492] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:14.768443  8837 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.783931  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.784888  8508 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:14.788111  8837 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:14.802878  8761 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.803628  8761 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.807301  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:14.807952  8434 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:14.808909  8761 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.813930  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.819868  8509 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:14.823104  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:14.824074  8433 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:14.826987  8550 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:14.828266  8766 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.828960  8766 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.831094  8547 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:14.834213  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:14.836051  8766 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.768690  8842 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.846071  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:14.860714  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:14.841367  8842 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.853364  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:14.863495  8475 leader_election.cc:343] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.865041  8842 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.870097  8786 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.870808  8665 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.871978  8837 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:14.870110  8710 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.876398  8761 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.883241  8639 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.892208  8639 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.893924  8639 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:00:14.883955  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49882.7us
I20260709 13:00:14.884989  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:14.894167  8761 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.894929  8584 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:14.896633  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.898435  8761 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:14.886608  8786 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.889932  8710 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.909562  8786 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.909765  8710 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.886621  8665 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.916863  8665 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:14.913944  8400 leader_election.cc:343] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:14.913089  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.947686  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:14.948428  8431 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:14.951602  8624 tablet_bootstrap.cc:492] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:14.952246  8624 ts_tablet_manager.cc:1403] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.334s	user 0.118s	sys 0.135s
I20260709 13:00:14.952554  8509 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:14.980095  8627 tablet_bootstrap.cc:492] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
W20260709 13:00:14.979909  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 65993.7us
I20260709 13:00:14.980530  8627 ts_tablet_manager.cc:1403] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.368s	user 0.087s	sys 0.144s
I20260709 13:00:14.981160  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:14.983848  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:14.984539  8505 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:14.986474  8877 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:14.986874  8877 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.987200  8877 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:14.992502  8624 raft_consensus.cc:359] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.992620  8786 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.993220  8624 raft_consensus.cc:385] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.993531  8624 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.993414  8627 raft_consensus.cc:359] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.994088  8627 raft_consensus.cc:385] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:14.994427  8627 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:14.995007  8627 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:14.994854  8624 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.000675  8627 ts_tablet_manager.cc:1434] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:00:15.009114  8624 ts_tablet_manager.cc:1434] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.003s
I20260709 13:00:15.010206  8624 tablet_bootstrap.cc:492] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
W20260709 13:00:15.006835  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 83407.6us
W20260709 13:00:15.018168  8476 leader_election.cc:343] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.018697  8627 tablet_bootstrap.cc:492] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:15.021520  8626 tablet_bootstrap.cc:654] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.014478  8665 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.025106  8786 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:15.024713  8665 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:00:15.027496  8398 leader_election.cc:343] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.039418  8626 tablet_bootstrap.cc:492] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:15.027387  8877 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.031553  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.041358  8584 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:15.043102  8400 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.031077  8710 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.043833  8842 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.044610  8842 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.045019  8842 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.041011  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:15.045542  8710 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.045572  8507 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:15.052600  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:15.053261  8583 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.055419  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:15.056305  8435 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.057246  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:15.057827  8434 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.060752  8878 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.046430  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:15.022938  8476 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:15.061962  8583 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:15.049937  8627 tablet_bootstrap.cc:654] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.065874  8766 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:15.065996  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47866.6us
I20260709 13:00:15.040426  8626 ts_tablet_manager.cc:1403] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.270s	user 0.015s	sys 0.000s
I20260709 13:00:15.051468  8624 tablet_bootstrap.cc:654] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.051620  8877 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.063985  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.068769  8507 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.069466  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.067830  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.048293  8550 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.070713  8626 raft_consensus.cc:359] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.073084  8626 raft_consensus.cc:385] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.071632  8837 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.074210  8837 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.074549  8837 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.075297  8879 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.075762  8879 raft_consensus.cc:697] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:15.076431  8507 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:15.076519  8879 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.079054  8435 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:15.081140  8837 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.082168  8626 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.084796  8665 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.052621  8842 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.088063  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.088629  8506 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.090129  8842 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.093133  8626 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:00:15.094848  8400 leader_election.cc:343] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.095106  8626 ts_tablet_manager.cc:1434] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:00:15.095254  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.095818  8509 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.096498  8878 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.100608  8550 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:00:15.101382  8398 leader_election.cc:343] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.101629  8786 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.102380  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:15.102574  8786 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:15.109377  8786 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.111668  8506 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:15.102913  8837 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:15.103287  8509 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:15.103374  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:15.113826  8435 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:15.105587  8434 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:15.106249  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.114776  8505 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.115948  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:15.106838  8626 tablet_bootstrap.cc:492] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:15.116708  8583 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 1: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:00:15.121312  8877 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.121860  8877 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:15.122751  8877 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.130728  8624 tablet_bootstrap.cc:492] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:15.137049  8330 catalog_manager.cc:5697] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.141415  8624 ts_tablet_manager.cc:1403] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.131s	user 0.009s	sys 0.015s
I20260709 13:00:15.142262  8550 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.143858  8837 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.144337  8837 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:15.145227  8837 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.142941  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.148727  8509 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 1: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:00:15.148859  8547 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:15.149791  8786 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.150563  8786 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:15.151374  8786 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.153255  8626 tablet_bootstrap.cc:654] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.164852  8398 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:15.165373  8624 raft_consensus.cc:359] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.166047  8624 raft_consensus.cc:385] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.166095  8877 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.173442  8766 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.173918  8766 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.164173  8505 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:15.166401  8624 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.204272  8624 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.206377  8766 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.208559  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.208858  8624 ts_tablet_manager.cc:1434] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 13:00:15.209918  8624 tablet_bootstrap.cc:492] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:15.212107  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:15.214320  8476 leader_election.cc:343] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.215758  8626 tablet_bootstrap.cc:492] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:15.216138  8626 ts_tablet_manager.cc:1403] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.109s	user 0.021s	sys 0.028s
I20260709 13:00:15.218472  8332 catalog_manager.cc:5697] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.220065  8332 catalog_manager.cc:5697] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.224278  8877 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.224740  8877 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.225734  8626 raft_consensus.cc:359] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.226778  8877 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:00:15.232120  8475 leader_election.cc:343] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.226614  8626 raft_consensus.cc:385] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.230670  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:15.235587  8626 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
W20260709 13:00:15.236526  8398 leader_election.cc:343] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.236326  8626 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.232769  8624 tablet_bootstrap.cc:654] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.234513  8475 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:15.233255  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.237843  8767 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:15.238101  8400 leader_election.cc:343] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.238512  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:15.233296  8627 tablet_bootstrap.cc:492] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:15.239166  8627 ts_tablet_manager.cc:1403] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.221s	user 0.016s	sys 0.006s
I20260709 13:00:15.239392  8877 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.241794  8627 raft_consensus.cc:359] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.242417  8627 raft_consensus.cc:385] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.242682  8627 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.243332  8627 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.243876  8626 ts_tablet_manager.cc:1434] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:00:15.246968  8626 tablet_bootstrap.cc:492] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:15.245291  8627 ts_tablet_manager.cc:1434] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:00:15.247911  8627 tablet_bootstrap.cc:492] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:15.261777  8330 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.263356  8330 catalog_manager.cc:5697] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.269747  8627 tablet_bootstrap.cc:654] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.275484  8626 tablet_bootstrap.cc:654] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.276336  8624 tablet_bootstrap.cc:492] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:15.276804  8624 ts_tablet_manager.cc:1403] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.011s
I20260709 13:00:15.279232  8624 raft_consensus.cc:359] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.281775  8624 raft_consensus.cc:385] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.282130  8624 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.281494  8627 tablet_bootstrap.cc:492] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:15.283008  8627 ts_tablet_manager.cc:1403] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.001s
I20260709 13:00:15.283428  8624 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.292687  8624 ts_tablet_manager.cc:1434] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:00:15.295096  8624 tablet_bootstrap.cc:492] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:15.293835  8627 raft_consensus.cc:359] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.297118  8627 raft_consensus.cc:385] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.297495  8627 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.298509  8627 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.300434  8627 ts_tablet_manager.cc:1434] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:00:15.301530  8627 tablet_bootstrap.cc:492] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:15.302124  8624 tablet_bootstrap.cc:654] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.303567  8767 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.304009  8767 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.305938  8767 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.307950  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.308696  8582 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:15.308990  8627 tablet_bootstrap.cc:654] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.309544  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:15.312355  8476 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:15.313313  8767 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.322677  8624 tablet_bootstrap.cc:492] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:15.323133  8624 ts_tablet_manager.cc:1403] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.028s	user 0.002s	sys 0.011s
I20260709 13:00:15.325096  8626 tablet_bootstrap.cc:492] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:15.325508  8626 ts_tablet_manager.cc:1403] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.020s
I20260709 13:00:15.326179  8624 raft_consensus.cc:359] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.326893  8624 raft_consensus.cc:385] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.327137  8624 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.327732  8624 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.328634  8626 raft_consensus.cc:359] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.329500  8626 raft_consensus.cc:385] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.329828  8626 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.330626  8767 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.330788  8626 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.333873  8624 ts_tablet_manager.cc:1434] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:00:15.334740  8624 tablet_bootstrap.cc:492] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:15.340163  8624 tablet_bootstrap.cc:654] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.340878  8837 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.341395  8837 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.345369  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:15.346746  8837 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:15.348798  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:15.349624  8505 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:15.353219  8626 ts_tablet_manager.cc:1434] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 13:00:15.354117  8626 tablet_bootstrap.cc:492] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:15.354853  8627 tablet_bootstrap.cc:492] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:15.355263  8627 ts_tablet_manager.cc:1403] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.032s
I20260709 13:00:15.357071  8786 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.358214  8786 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.358631  8627 raft_consensus.cc:359] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.359274  8627 raft_consensus.cc:385] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.359668  8626 tablet_bootstrap.cc:654] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.359539  8627 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.360432  8627 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.360880  8786 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:15.362744  8627 ts_tablet_manager.cc:1434] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:15.366425  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:15.366914  8766 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.367509  8766 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:00:15.368301  8550 leader_election.cc:343] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.351792  8432 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:15.370012  8766 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.371491  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.374636  8547 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:15.375648  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:15.381729  8506 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
W20260709 13:00:15.383275  8475 leader_election.cc:343] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.383726  8624 tablet_bootstrap.cc:492] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:15.383829  8837 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.384027  8626 tablet_bootstrap.cc:492] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:15.384212  8624 ts_tablet_manager.cc:1403] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.050s	user 0.036s	sys 0.009s
I20260709 13:00:15.384245  8837 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.384783  8837 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.385020  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:15.386863  8624 raft_consensus.cc:359] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.387488  8624 raft_consensus.cc:385] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:15.387669  8476 leader_election.cc:343] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.376092  8627 tablet_bootstrap.cc:492] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:15.387749  8624 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.388159  8476 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:15.388773  8766 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.388712  8624 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.391156  8624 ts_tablet_manager.cc:1434] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:15.392184  8624 tablet_bootstrap.cc:492] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:15.393507  8547 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:15.394299  8786 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.394641  8786 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.394910  8627 tablet_bootstrap.cc:654] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.395004  8786 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.398159  8624 tablet_bootstrap.cc:654] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.400655  8842 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.401283  8842 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.404300  8842 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.407970  8786 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.409510  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.410671  8837 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.412569  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.413118  8506 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.419337  8877 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.419796  8877 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:00:15.420678  8400 leader_election.cc:343] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.421993  8877 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.429504  8624 tablet_bootstrap.cc:492] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:15.429947  8624 ts_tablet_manager.cc:1403] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.009s
I20260709 13:00:15.424387  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:15.430828  8509 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:15.432394  8624 raft_consensus.cc:359] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.433048  8624 raft_consensus.cc:385] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.433295  8624 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.433866  8624 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.435830  8624 ts_tablet_manager.cc:1434] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:15.427357  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:15.424805  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:15.436681  8624 tablet_bootstrap.cc:492] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:15.436806  8398 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.427492  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.438103  8877 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.438452  8877 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:15.438365  8400 leader_election.cc:343] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.438969  8877 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.384460  8626 ts_tablet_manager.cc:1403] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.005s
I20260709 13:00:15.438839  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:15.439913  8434 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:15.440611  8550 leader_election.cc:343] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.443665  8786 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:15.444654  8506 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:15.436161  8837 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:15.445863  8626 raft_consensus.cc:359] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.446590  8626 raft_consensus.cc:385] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.446838  8626 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.448228  8626 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.449153  8624 tablet_bootstrap.cc:654] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.452092  8626 ts_tablet_manager.cc:1434] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:15.452682  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.452939  8626 tablet_bootstrap.cc:492] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:15.453215  8509 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:15.454197  8398 leader_election.cc:343] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.454288  8547 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:15.455969  8627 tablet_bootstrap.cc:492] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:15.456573  8627 ts_tablet_manager.cc:1403] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.006s
I20260709 13:00:15.456758  8837 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.456454  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:15.457247  8837 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:15.457573  8761 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.457983  8761 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.458304  8837 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.460032  8761 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.460496  8761 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.462608  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:15.463985  8400 leader_election.cc:343] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.468880  8509 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:15.469815  8547 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:15.469749  8627 raft_consensus.cc:359] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.470736  8627 raft_consensus.cc:385] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.470706  8786 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.471132  8627 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.471319  8786 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:15.471830  8627 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.472157  8786 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.472519  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:15.473901  8627 ts_tablet_manager.cc:1434] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
W20260709 13:00:15.473807  8398 leader_election.cc:343] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.474488  8398 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:15.474833  8627 tablet_bootstrap.cc:492] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:15.475387  8842 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:15.477967  8434 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:15.477795  8877 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.481420  8877 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.482002  8626 tablet_bootstrap.cc:654] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.482193  8842 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.482108  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:15.483465  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.483834  8582 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.484371  8509 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.483621  8842 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.489636  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:15.490393  8506 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:15.489645  8842 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.493225  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.494565  8581 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:15.495880  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.497622  8842 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.498106  8842 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.498545  8842 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.495998  8509 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:15.509836  8398 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.512188  8582 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:15.511911  8877 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.513697  8627 tablet_bootstrap.cc:654] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.517771  8877 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:15.520588  8877 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.524984  8626 tablet_bootstrap.cc:492] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:15.525449  8626 ts_tablet_manager.cc:1403] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.013s
W20260709 13:00:15.532198  8381 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:15.534071  8626 raft_consensus.cc:359] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.534739  8626 raft_consensus.cc:385] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.535012  8626 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.535650  8626 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.537290  8842 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.538458  8330 catalog_manager.cc:5697] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.539971  8626 ts_tablet_manager.cc:1434] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:00:15.540832  8626 tablet_bootstrap.cc:492] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:15.541431  8624 tablet_bootstrap.cc:492] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:15.541867  8624 ts_tablet_manager.cc:1403] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.105s	user 0.007s	sys 0.020s
I20260709 13:00:15.542892  8842 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.543453  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.543896  8509 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.545490  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:15.546047  8581 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.549798  8509 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:15.554162  8398 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.554919  8842 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.555047  8626 tablet_bootstrap.cc:654] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.555474  8842 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:15.556301  8842 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.559077  8581 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:15.560058  8786 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.563386  8627 tablet_bootstrap.cc:492] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:15.563810  8627 ts_tablet_manager.cc:1403] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.013s
I20260709 13:00:15.568387  8331 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.574446  8624 raft_consensus.cc:359] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.575112  8624 raft_consensus.cc:385] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.575369  8624 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.576052  8624 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.566670  8627 raft_consensus.cc:359] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.580669  8627 raft_consensus.cc:385] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.580945  8627 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.581671  8627 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.583352  8627 ts_tablet_manager.cc:1434] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:00:15.584168  8627 tablet_bootstrap.cc:492] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:15.584256  8837 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.589629  8627 tablet_bootstrap.cc:654] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.599999  8330 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.603157  8627 tablet_bootstrap.cc:492] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:15.603582  8627 ts_tablet_manager.cc:1403] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 13:00:15.604709  8665 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.605464  8624 ts_tablet_manager.cc:1434] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.000s
I20260709 13:00:15.606364  8624 tablet_bootstrap.cc:492] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:15.605944  8627 raft_consensus.cc:359] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.606798  8627 raft_consensus.cc:385] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.607048  8627 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.607726  8627 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.609455  8627 ts_tablet_manager.cc:1434] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:15.612490  8627 tablet_bootstrap.cc:492] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:15.618989  8627 tablet_bootstrap.cc:654] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.643682  8877 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.653705  8624 tablet_bootstrap.cc:654] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.658349  8626 tablet_bootstrap.cc:492] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:15.658982  8626 ts_tablet_manager.cc:1403] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.118s	user 0.010s	sys 0.001s
I20260709 13:00:15.661957  8877 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.664431  8581 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.666389  8766 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.666878  8766 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.668876  8766 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.671502  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.672196  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:15.672760  8435 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
W20260709 13:00:15.672823  8475 leader_election.cc:343] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.674995  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:15.674993  8842 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.676461  8765 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.676942  8765 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.677364  8765 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.686064  8626 raft_consensus.cc:359] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.686797  8626 raft_consensus.cc:385] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.687098  8626 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.688454  8626 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.694527  8624 tablet_bootstrap.cc:492] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:15.694954  8624 ts_tablet_manager.cc:1403] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.000s
I20260709 13:00:15.693670  8842 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:15.697261  8837 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.697434  8624 raft_consensus.cc:359] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.698041  8624 raft_consensus.cc:385] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.698316  8624 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.699409  8624 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.701395  8624 ts_tablet_manager.cc:1434] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:15.703485  8627 tablet_bootstrap.cc:492] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:15.703923  8627 ts_tablet_manager.cc:1403] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.035s
I20260709 13:00:15.707209  8627 raft_consensus.cc:359] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.707877  8627 raft_consensus.cc:385] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.708225  8627 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.708964  8627 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.711505  8627 ts_tablet_manager.cc:1434] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:15.712672  8627 tablet_bootstrap.cc:492] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:15.713030  8626 ts_tablet_manager.cc:1434] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:00:15.715493  8626 tablet_bootstrap.cc:492] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:15.720628  8627 tablet_bootstrap.cc:654] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.713867  8624 tablet_bootstrap.cc:492] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:15.726764  8665 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.689795  8765 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.731078  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:15.731739  8434 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.740806  8434 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:15.740808  8665 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.741834  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.744767  8766 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.745486  8766 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:15.749511  8765 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.746845  8766 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.751758  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:00:15.753916  8475 leader_election.cc:343] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.755865  8330 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.811071  8877 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.812240  8877 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.815204  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.815913  8581 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:15.817096  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.817978  8883 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.819209  8883 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.819972  8883 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.821480  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:15.822145  8506 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:15.827239  8877 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.831835  8627 tablet_bootstrap.cc:492] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:15.832300  8627 ts_tablet_manager.cc:1403] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.120s	user 0.032s	sys 0.053s
I20260709 13:00:15.834851  8330 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.844564  8627 raft_consensus.cc:359] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.845297  8627 raft_consensus.cc:385] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.846354  8627 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.847491  8627 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.849761  8627 ts_tablet_manager.cc:1434] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:00:15.850638  8627 tablet_bootstrap.cc:492] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:15.855445  8624 tablet_bootstrap.cc:654] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.856688  8627 tablet_bootstrap.cc:654] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.859510  8626 tablet_bootstrap.cc:654] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:15.874715  8766 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.875242  8766 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.877099  8766 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.878341  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:15.878974  8434 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:15.880452  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.880702  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.881909  8634 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.882289  8634 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.882615  8634 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:15.887738  8475 leader_election.cc:343] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.890713  8883 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.895821  8634 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.898221  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:15.898907  8434 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.902544  8766 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.903024  8766 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.905352  8626 tablet_bootstrap.cc:492] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:15.905526  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:15.905776  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:15.905905  8626 ts_tablet_manager.cc:1403] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.191s	user 0.013s	sys 0.001s
I20260709 13:00:15.906278  8506 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.898221  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:15.909129  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:15.906201  8432 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
W20260709 13:00:15.910739  8475 leader_election.cc:343] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:15.911827  8476 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:15.912271  8883 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.912642  8767 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:15.913009  8767 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.913338  8767 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.913281  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:15.915139  8584 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.915899  8626 raft_consensus.cc:359] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.916769  8626 raft_consensus.cc:385] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.917109  8626 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.917909  8626 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.924326  8767 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.929342  8584 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:15.929445  8665 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:15.921679  8634 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.905198  8434 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:15.935845  8506 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:15.942526  8432 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.944240  8398 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.911935  8624 tablet_bootstrap.cc:492] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:15.951122  8624 ts_tablet_manager.cc:1403] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.237s	user 0.015s	sys 0.000s
I20260709 13:00:15.930375  8766 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:15.952616  8883 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.956377  8626 ts_tablet_manager.cc:1434] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:00:15.957158  8883 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:15.959985  8761 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:15.960924  8883 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.965040  8626 tablet_bootstrap.cc:492] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:15.963693  8761 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:15.983717  8581 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:15.983894  8624 raft_consensus.cc:359] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.984886  8624 raft_consensus.cc:385] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:15.985241  8624 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:15.976342  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:15.987679  8624 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:15.994282  8766 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:15.994601  8767 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.002168  8624 ts_tablet_manager.cc:1434] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 13:00:16.003224  8624 tablet_bootstrap.cc:492] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:16.005353  8627 tablet_bootstrap.cc:492] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:16.005705  8627 ts_tablet_manager.cc:1403] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.155s	user 0.049s	sys 0.056s
I20260709 13:00:16.006592  8634 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.007050  8634 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.008651  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:16.009124  8435 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.012190  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:16.013970  8634 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.018173  8626 tablet_bootstrap.cc:654] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.021206  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:16.013209  8766 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:00:16.028973  8935 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:00:16.030567  8765 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.031046  8765 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.032940  8765 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.034433  8766 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.040416  8665 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.041806  8435 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:16.051075  8761 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.054819  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:16.055989  8435 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
W20260709 13:00:16.058228  8476 leader_election.cc:343] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.056097  8627 raft_consensus.cc:359] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.060094  8627 raft_consensus.cc:385] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.060427  8627 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.044000  8765 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.061362  8765 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.061409  8627 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.065174  8626 tablet_bootstrap.cc:492] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:16.065505  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:16.065727  8626 ts_tablet_manager.cc:1403] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.005s
W20260709 13:00:16.067885  8475 leader_election.cc:343] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.068323  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:16.076612  8476 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:16.079418  8627 ts_tablet_manager.cc:1434] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.006s
I20260709 13:00:16.081316  8627 tablet_bootstrap.cc:492] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:16.087015  8933 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.092941  8933 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:16.093746  8933 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.094774  8765 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.104651  8333 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.110630  8624 tablet_bootstrap.cc:654] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:16.126493  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 57905us
W20260709 13:00:16.127435  8475 leader_election.cc:343] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.127925  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:16.136096  8934 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:16.136049  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:16.141920  8475 leader_election.cc:343] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.144080  8581 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
W20260709 13:00:16.146332  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67450.1us
I20260709 13:00:16.146976  8476 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:16.147357  8626 raft_consensus.cc:359] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.147699  8933 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.148030  8626 raft_consensus.cc:385] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.148348  8933 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.153687  8627 tablet_bootstrap.cc:654] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:16.153818  8475 leader_election.cc:343] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.149748  8626 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.155963  8626 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.162957  8665 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.149411  8933 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.149055  8883 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:00:16.170287  8626 ts_tablet_manager.cc:1434] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.002s
I20260709 13:00:16.171450  8626 tablet_bootstrap.cc:492] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:16.164973  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:16.169097  8840 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 13:00:16.185855  8476 leader_election.cc:343] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.186298  8476 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:16.186070  8333 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.201581  8945 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:16.281993  8933 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.289870  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:16.290657  8432 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.295311  8944 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:16.306715  8583 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.289881  8626 tablet_bootstrap.cc:654] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.310925  8627 tablet_bootstrap.cc:492] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:16.311367  8627 ts_tablet_manager.cc:1403] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.230s	user 0.018s	sys 0.005s
I20260709 13:00:16.313777  8627 raft_consensus.cc:359] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.314785  8627 raft_consensus.cc:385] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.315081  8627 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.315735  8627 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.317879  8627 ts_tablet_manager.cc:1434] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:00:16.318868  8627 tablet_bootstrap.cc:492] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:16.322052  8624 tablet_bootstrap.cc:492] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:16.322652  8624 ts_tablet_manager.cc:1403] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.320s	user 0.020s	sys 0.012s
I20260709 13:00:16.325004  8627 tablet_bootstrap.cc:654] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.325299  8624 raft_consensus.cc:359] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.328366  8624 raft_consensus.cc:385] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.328667  8624 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.330067  8934 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.339033  8624 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.341085  8624 ts_tablet_manager.cc:1434] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:00:16.345382  8432 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:16.346648  8933 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.345191  8331 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.347932  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:16.341940  8624 tablet_bootstrap.cc:492] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
W20260709 13:00:16.350888  8475 leader_election.cc:343] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.352903  8626 tablet_bootstrap.cc:492] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:16.353364  8626 ts_tablet_manager.cc:1403] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.182s	user 0.008s	sys 0.006s
I20260709 13:00:16.353397  8476 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:16.355785  8944 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.356395  8944 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:16.361413  8626 raft_consensus.cc:359] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.362145  8626 raft_consensus.cc:385] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.362764  8626 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.363415  8626 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.357427  8944 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.363907  8883 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:16.366149  8626 ts_tablet_manager.cc:1434] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:00:16.367003  8626 tablet_bootstrap.cc:492] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:16.371011  8624 tablet_bootstrap.cc:654] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.376698  8627 tablet_bootstrap.cc:492] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:16.377518  8627 ts_tablet_manager.cc:1403] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.059s	user 0.004s	sys 0.034s
I20260709 13:00:16.443202  8627 raft_consensus.cc:359] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.445024  8627 raft_consensus.cc:385] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.445395  8627 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.446492  8627 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.433931  8842 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.467759  8626 tablet_bootstrap.cc:654] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.462420  8842 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.476523  8842 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.480995  8627 ts_tablet_manager.cc:1434] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.103s	user 0.004s	sys 0.008s
I20260709 13:00:16.492089  8627 tablet_bootstrap.cc:492] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:16.493343  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:16.500486  8624 tablet_bootstrap.cc:492] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:16.501287  8624 ts_tablet_manager.cc:1403] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.160s	user 0.031s	sys 0.027s
I20260709 13:00:16.505406  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:16.506408  8505 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:16.505796  8624 raft_consensus.cc:359] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.508359  8624 raft_consensus.cc:385] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.508685  8624 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.509435  8624 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.511323  8624 ts_tablet_manager.cc:1434] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:00:16.513159  8940 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.520792  8398 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:16.514474  8940 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.522949  8842 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.523471  8624 tablet_bootstrap.cc:492] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:16.523406  8842 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.524677  8940 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.525017  8842 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.528555  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:16.539726  8960 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:00:16.541145  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:16.529266  8430 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 0.
I20260709 13:00:16.548305  8842 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.549649  8476 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:16.554132  8944 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:16.554615  8944 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.555042  8944 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.561836  8627 tablet_bootstrap.cc:654] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:16.566272  8475 leader_election.cc:343] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.567821  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:16.568615  8510 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:16.571807  8400 leader_election.cc:343] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.588373  8510 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:16.589840  8398 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:16.590531  8842 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.593454  8960 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.594347  8960 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:16.594959  8626 tablet_bootstrap.cc:492] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:16.596534  8626 ts_tablet_manager.cc:1403] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.230s	user 0.011s	sys 0.010s
I20260709 13:00:16.703159  8624 tablet_bootstrap.cc:654] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.628721  8331 catalog_manager.cc:5697] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:16.599609  8381 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:16.627154  8786 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.613760  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:16.711447  8786 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.716790  8786 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:16.722529  8933 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:16.730358  8944 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.732658  8626 raft_consensus.cc:359] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.733490  8626 raft_consensus.cc:385] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.733754  8626 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.597043  8960 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.734385  8626 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.739166  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:16.739784  8430 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:16.745390  8400 leader_election.cc:343] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.747078  8933 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.747253  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:16.747967  8509 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:16.738015  8627 tablet_bootstrap.cc:492] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:16.748929  8627 ts_tablet_manager.cc:1403] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.257s	user 0.015s	sys 0.022s
I20260709 13:00:16.751401  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:16.757787  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:16.759459  8624 tablet_bootstrap.cc:492] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:16.761108  8626 ts_tablet_manager.cc:1434] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.164s	user 0.013s	sys 0.005s
I20260709 13:00:16.761891  8624 ts_tablet_manager.cc:1403] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.239s	user 0.009s	sys 0.005s
I20260709 13:00:16.762801  8627 raft_consensus.cc:359] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.732684  8944 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.767684  8627 raft_consensus.cc:385] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.768421  8627 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.771752  8940 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.772423  8940 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.775501  8940 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.775785  8547 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:16.777115  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:16.777318  8837 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:16.777325  8550 leader_election.cc:343] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.777742  8837 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.778127  8837 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:16.781659  8476 leader_election.cc:343] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.790093  8627 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.786429  8933 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.794358  8933 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:00:16.793401  8475 consensus_peers.cc:597] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:16.798408  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:16.799635  8475 leader_election.cc:343] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.801203  8626 tablet_bootstrap.cc:492] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:16.802982  8945 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:16.811022  8627 ts_tablet_manager.cc:1434] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 13:00:16.848433  8627 tablet_bootstrap.cc:492] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:16.849174  8933 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:16.858589  8430 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:16.862618  8476 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:00:16.864387  8475 leader_election.cc:343] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:16.863909  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 51234us
I20260709 13:00:16.869431  8624 raft_consensus.cc:359] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.871025  8624 raft_consensus.cc:385] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.871344  8624 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.872628  8624 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.865545  8475 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:16.864655  8933 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.889027  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:16.894181  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:16.877362  8944 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:16.884768  8933 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:16.899070  8627 tablet_bootstrap.cc:654] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.901472  8624 ts_tablet_manager.cc:1434] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.139s	user 0.005s	sys 0.003s
W20260709 13:00:16.918560  8475 leader_election.cc:343] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:16.919885  8475 consensus_peers.cc:597] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:16.925312  8476 leader_election.cc:343] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:16.925700  8476 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:16.927989  8944 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:16.929004  8933 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.934618  8970 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:16.947805  8624 tablet_bootstrap.cc:492] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:16.915931  8837 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.964053  8331 catalog_manager.cc:5697] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.969328  8945 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.969875  8945 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:16.999500  8837 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:17.004033  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:17.004767  8426 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.007838  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:17.008741  8507 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.014555  8626 tablet_bootstrap.cc:654] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.019116  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:17.032541  8945 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.032663  8426 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:17.050305  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:17.053295  8476 leader_election.cc:343] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:17.064465  8475 leader_election.cc:343] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.068859  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:17.070711  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:17.071851  8944 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.073530  8974 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.079195  8974 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:17.080160  8974 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.086069  8627 tablet_bootstrap.cc:492] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:17.086596  8627 ts_tablet_manager.cc:1403] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.238s	user 0.013s	sys 0.005s
I20260709 13:00:17.086737  8624 tablet_bootstrap.cc:654] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.088650  8626 tablet_bootstrap.cc:492] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:17.089136  8626 ts_tablet_manager.cc:1403] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.288s	user 0.024s	sys 0.021s
I20260709 13:00:17.090478  8627 raft_consensus.cc:359] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.092307  8627 raft_consensus.cc:385] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.092620  8627 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.098783  8665 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.099078  8507 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:17.099233  8665 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.100409  8626 raft_consensus.cc:359] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.101200  8626 raft_consensus.cc:385] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.101588  8626 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.103052  8626 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.101320  8665 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:17.104490  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:17.104669  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:17.107559  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:17.108013  8627 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.108880  8665 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.115578  8626 ts_tablet_manager.cc:1434] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:00:17.117013  8626 tablet_bootstrap.cc:492] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:17.117962  8627 ts_tablet_manager.cc:1434] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:00:17.119019  8627 tablet_bootstrap.cc:492] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:17.120959  8624 tablet_bootstrap.cc:492] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:17.121649  8624 ts_tablet_manager.cc:1403] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.001s
I20260709 13:00:17.121187  8333 catalog_manager.cc:5697] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.116873  8330 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.124172  8626 tablet_bootstrap.cc:654] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.125470  8627 tablet_bootstrap.cc:654] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.124331  8624 raft_consensus.cc:359] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.129040  8624 raft_consensus.cc:385] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.129333  8624 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.129966  8624 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.133884  8624 ts_tablet_manager.cc:1434] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:00:17.134848  8624 tablet_bootstrap.cc:492] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:17.141834  8974 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.142403  8974 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.143884  8624 tablet_bootstrap.cc:654] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.144637  8974 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:17.146377  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:17.148849  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:17.154510  8550 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:17.155256  8974 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.156364  8624 tablet_bootstrap.cc:492] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:17.156770  8624 ts_tablet_manager.cc:1403] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 13:00:17.160492  8624 raft_consensus.cc:359] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.161199  8624 raft_consensus.cc:385] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.161468  8624 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.164727  8624 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.167102  8624 ts_tablet_manager.cc:1434] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:00:17.168110  8624 tablet_bootstrap.cc:492] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:17.172144  8626 tablet_bootstrap.cc:492] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:17.172706  8626 ts_tablet_manager.cc:1403] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.005s
I20260709 13:00:17.174100  8624 tablet_bootstrap.cc:654] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.177109  8626 raft_consensus.cc:359] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.178193  8626 raft_consensus.cc:385] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.178650  8626 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.179630  8626 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.184926  8933 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.185520  8933 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.192639  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:17.193255  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:17.193938  8476 leader_election.cc:343] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:17.194463  8475 leader_election.cc:343] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.194981  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:17.195911  8944 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.196964  8933 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.197446  8626 ts_tablet_manager.cc:1434] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:00:17.198689  8626 tablet_bootstrap.cc:492] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:17.208240  8626 tablet_bootstrap.cc:654] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.224929  8580 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.231544  8627 tablet_bootstrap.cc:492] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:17.232208  8627 ts_tablet_manager.cc:1403] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.113s	user 0.020s	sys 0.062s
I20260709 13:00:17.236589  8627 raft_consensus.cc:359] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.237537  8627 raft_consensus.cc:385] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.237905  8627 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.238848  8627 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.239760  8883 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:17.241171  8627 ts_tablet_manager.cc:1434] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:00:17.242520  8627 tablet_bootstrap.cc:492] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:17.254613  8627 tablet_bootstrap.cc:654] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.258507  8584 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.269644  8626 tablet_bootstrap.cc:492] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:17.278656  8626 ts_tablet_manager.cc:1403] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.012s
I20260709 13:00:17.287422  8583 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.296663  8960 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.297222  8960 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.299705  8960 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.307508  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:17.309017  8400 leader_election.cc:343] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.309074  8960 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:17.313665  8944 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.314409  8944 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.317806  8944 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.318816  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:17.320015  8507 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:17.319159  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:17.321645  8398 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:17.323235  8960 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:17.323282  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:17.324154  8960 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:17.321794  8476 leader_election.cc:343] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.324684  8960 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.333930  8624 tablet_bootstrap.cc:492] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:17.334419  8624 ts_tablet_manager.cc:1403] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.167s	user 0.037s	sys 0.063s
W20260709 13:00:17.329458  8475 leader_election.cc:343] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.348059  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:17.352979  8933 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.371635  8624 raft_consensus.cc:359] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.372371  8624 raft_consensus.cc:385] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.372646  8624 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.373248  8624 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.374630  8624 ts_tablet_manager.cc:1434] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.007s
I20260709 13:00:17.386452  8624 tablet_bootstrap.cc:492] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:17.410458  8960 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.414906  8624 tablet_bootstrap.cc:654] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:17.417280  8988 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:00:17.415700  8626 raft_consensus.cc:359] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.423055  8626 raft_consensus.cc:385] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.423347  8626 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.425109  8626 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.433276  8626 ts_tablet_manager.cc:1434] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.151s	user 0.004s	sys 0.003s
I20260709 13:00:17.434242  8626 tablet_bootstrap.cc:492] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:17.439901  8624 tablet_bootstrap.cc:492] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:17.440388  8624 ts_tablet_manager.cc:1403] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.004s
I20260709 13:00:17.442843  8624 raft_consensus.cc:359] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.443502  8624 raft_consensus.cc:385] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.443774  8624 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.447328  8626 tablet_bootstrap.cc:654] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.449970  8624 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.452430  8624 ts_tablet_manager.cc:1434] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:17.456017  8624 tablet_bootstrap.cc:492] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:17.462533  8974 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.463033  8974 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.465091  8974 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:17.467573  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:17.467501  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:17.469139  8507 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:17.470451  8433 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:17.471508  8547 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:17.472290  8974 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:17.472623  8974 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.472963  8974 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.474937  8627 tablet_bootstrap.cc:492] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:17.474921  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:17.475152  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:17.475587  8627 ts_tablet_manager.cc:1403] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.233s	user 0.073s	sys 0.127s
I20260709 13:00:17.475661  8507 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.478978  8960 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.479816  8627 raft_consensus.cc:359] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.480535  8627 raft_consensus.cc:385] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.480808  8627 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.481503  8627 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.483059  8974 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.483790  8627 ts_tablet_manager.cc:1434] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:17.484450  8584 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 1: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:00:17.485615  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:17.486433  8433 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:17.484833  8627 tablet_bootstrap.cc:492] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:17.489945  8626 tablet_bootstrap.cc:492] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:17.490461  8626 ts_tablet_manager.cc:1403] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.003s
I20260709 13:00:17.486783  8624 tablet_bootstrap.cc:654] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.494693  8627 tablet_bootstrap.cc:654] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.495471  8974 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:17.497076  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:17.498391  8547 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:17.499158  8626 raft_consensus.cc:359] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.499223  8962 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:17.499931  8626 raft_consensus.cc:385] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.500326  8626 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.501010  8626 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.501672  8974 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.503363  8626 ts_tablet_manager.cc:1434] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:00:17.504415  8626 tablet_bootstrap.cc:492] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:17.512189  8626 tablet_bootstrap.cc:654] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.523274  8945 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:17.531705  8627 tablet_bootstrap.cc:492] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:17.532224  8627 ts_tablet_manager.cc:1403] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.006s
I20260709 13:00:17.526990  8624 tablet_bootstrap.cc:492] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:17.538481  8624 ts_tablet_manager.cc:1403] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.002s
I20260709 13:00:17.544786  8626 tablet_bootstrap.cc:492] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:17.545326  8626 ts_tablet_manager.cc:1403] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.004s
I20260709 13:00:17.549760  8626 raft_consensus.cc:359] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.550750  8626 raft_consensus.cc:385] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.551055  8626 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.549868  8837 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:00:17.555799  8624 raft_consensus.cc:359] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.556473  8624 raft_consensus.cc:385] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.556814  8624 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.551819  8626 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.593849  8627 raft_consensus.cc:359] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.605564  8584 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.600997  8624 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.608675  8624 ts_tablet_manager.cc:1434] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.001s
I20260709 13:00:17.609648  8624 tablet_bootstrap.cc:492] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:17.556710  8507 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:17.613374  8398 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:17.605792  8627 raft_consensus.cc:385] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.614174  8960 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.614418  8627 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.615113  8960 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:17.616050  8933 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:17.616865  8960 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.617966  8627 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.619351  8626 ts_tablet_manager.cc:1434] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.074s	user 0.015s	sys 0.012s
I20260709 13:00:17.620692  8627 ts_tablet_manager.cc:1434] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.001s
I20260709 13:00:17.621766  8627 tablet_bootstrap.cc:492] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:17.622704  8626 tablet_bootstrap.cc:492] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:17.633261  8883 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.634724  8883 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.642515  8883 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.643913  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:17.645419  8510 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:17.647272  8624 tablet_bootstrap.cc:654] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.648638  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:17.650815  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:17.651221  8877 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:17.651643  8877 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.651995  8877 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.658241  8945 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.658700  8945 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:00:17.654770  8400 leader_election.cc:343] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.660748  8945 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.663425  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:17.663856  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:17.664683  8475 leader_election.cc:343] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:17.665748  8476 leader_election.cc:343] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.666209  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:17.667696  8945 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.665764  8877 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.682447  8627 tablet_bootstrap.cc:654] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.679100  8330 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.686375  8877 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.686982  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:17.687316  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:17.687667  8507 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:17.689137  8400 leader_election.cc:343] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.701313  8626 tablet_bootstrap.cc:654] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.702219  8624 tablet_bootstrap.cc:492] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:17.702782  8624 ts_tablet_manager.cc:1403] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.093s	user 0.018s	sys 0.008s
I20260709 13:00:17.704596  8507 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:17.704941  8624 raft_consensus.cc:359] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.705657  8624 raft_consensus.cc:385] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.705950  8624 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.706259  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:17.706748  8624 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.708012  8960 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.709097  8624 ts_tablet_manager.cc:1434] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:17.708595  8960 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:17.710704  8960 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.716122  8624 tablet_bootstrap.cc:492] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:17.720326  8627 tablet_bootstrap.cc:492] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:17.720746  8627 ts_tablet_manager.cc:1403] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.099s	user 0.007s	sys 0.011s
I20260709 13:00:17.720796  8626 tablet_bootstrap.cc:492] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:17.721349  8626 ts_tablet_manager.cc:1403] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.099s	user 0.006s	sys 0.013s
I20260709 13:00:17.723436  8627 raft_consensus.cc:359] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.724148  8627 raft_consensus.cc:385] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.724491  8627 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.724193  8626 raft_consensus.cc:359] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.724893  8626 raft_consensus.cc:385] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.725150  8626 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.725255  8627 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.726524  8626 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.738193  8974 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.738454  8627 ts_tablet_manager.cc:1434] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:00:17.738680  8974 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.739888  8627 tablet_bootstrap.cc:492] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:17.740761  8974 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:17.743643  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:17.744302  8509 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:17.745565  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:17.744001  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:17.747319  8433 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:17.749357  8837 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:17.749779  8837 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.750759  8626 ts_tablet_manager.cc:1434] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:00:17.751679  8624 tablet_bootstrap.cc:654] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.754505  8626 tablet_bootstrap.cc:492] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:17.750171  8837 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.764599  8627 tablet_bootstrap.cc:654] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.767463  8626 tablet_bootstrap.cc:654] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.773684  8837 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.775895  8837 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:17.778306  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:17.778932  8433 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.781572  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:17.782231  8510 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.796836  8883 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.797441  8883 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.800661  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:17.801373  8507 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:17.801818  8626 tablet_bootstrap.cc:492] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:17.804352  8624 tablet_bootstrap.cc:492] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:17.804840  8624 ts_tablet_manager.cc:1403] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.002s
I20260709 13:00:17.800634  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:17.804404  8626 ts_tablet_manager.cc:1403] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.050s	user 0.005s	sys 0.008s
I20260709 13:00:17.802510  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:17.807348  8624 raft_consensus.cc:359] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.809425  8624 raft_consensus.cc:385] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.809713  8624 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.803947  8627 tablet_bootstrap.cc:492] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:17.810300  8761 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:17.810616  8627 ts_tablet_manager.cc:1403] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.071s	user 0.002s	sys 0.012s
I20260709 13:00:17.810705  8761 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.811115  8761 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.811245  8626 raft_consensus.cc:359] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.812011  8626 raft_consensus.cc:385] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.812711  8626 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.813822  8626 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.816289  8626 ts_tablet_manager.cc:1434] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:17.817364  8626 tablet_bootstrap.cc:492] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
W20260709 13:00:17.818362  8400 leader_election.cc:343] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.810319  8624 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.821935  8624 ts_tablet_manager.cc:1434] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:00:17.822971  8624 tablet_bootstrap.cc:492] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:17.823751  8510 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:17.824637  8626 tablet_bootstrap.cc:654] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.825299  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:17.813060  8627 raft_consensus.cc:359] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.826122  8974 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.825888  8627 raft_consensus.cc:385] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.826414  8883 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.826694  8974 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:17.827337  8627 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.827625  8974 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.829021  8433 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:17.824594  8960 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.830365  8960 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.832481  8960 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.834219  8627 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.835026  8944 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.835444  8944 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.835518  8761 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.836133  8626 tablet_bootstrap.cc:492] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:17.836663  8626 ts_tablet_manager.cc:1403] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:00:17.837441  8761 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.835042  8837 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.841202  8837 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.843240  8837 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:17.844691  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:17.845395  8507 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:17.847054  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:17.847675  8430 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:17.848238  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:17.849083  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:17.850386  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:17.851326  8583 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:17.851971  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:17.854480  8330 catalog_manager.cc:5697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.853797  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:00:17.856498  8400 leader_election.cc:343] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.857121  8960 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:17.857738  8960 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.858210  8960 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.863876  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:00:17.840576  8381 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:17.843261  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:17.839948  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:17.865332  8505 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 0.
I20260709 13:00:17.855752  8837 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:17.866292  8510 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.866580  8837 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.866990  8837 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:17.869208  8475 leader_election.cc:343] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.839649  8944 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.839289  8626 raft_consensus.cc:359] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.871850  8626 raft_consensus.cc:385] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:17.872161  8626 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:17.873106  8626 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.878139  8945 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.875699  8476 leader_election.cc:343] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.878610  8945 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.878705  8960 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.879078  8476 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:17.880358  8933 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.876240  8510 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:17.881573  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:17.882375  8960 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:00:17.883102  8475 leader_election.cc:343] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.883612  8945 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:17.884321  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:17.884855  8580 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.885970  8627 ts_tablet_manager.cc:1434] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.000s
I20260709 13:00:17.886518  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:17.887090  8510 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.887032  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:17.888535  8476 leader_election.cc:343] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:17.888923  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:17.889549  8933 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:17.878176  8626 ts_tablet_manager.cc:1434] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.004s
I20260709 13:00:17.873353  8837 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.910609  8626 tablet_bootstrap.cc:492] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:17.912818  8627 tablet_bootstrap.cc:492] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Bootstrap starting.
I20260709 13:00:17.913740  8510 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:17.914429  8580 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:17.915908  8837 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:17.917905  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:17.918619  8761 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.919296  8761 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:17.920382  8761 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.929296  8624 tablet_bootstrap.cc:654] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.941504  8627 tablet_bootstrap.cc:654] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.943485  8626 tablet_bootstrap.cc:654] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.954640  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:17.955197  8510 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.962112  8510 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:17.967298  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:17.967904  8433 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:17.972548  8330 catalog_manager.cc:5697] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.974716  8627 tablet_bootstrap.cc:492] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: No bootstrap required, opened a new log
I20260709 13:00:17.975236  8627 ts_tablet_manager.cc:1403] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.004s
I20260709 13:00:17.976241  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:17.977814  8837 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.978338  8837 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:17.979331  8837 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.979733  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:17.980558  8761 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:17.980947  8761 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:17.981595  8761 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.984058  8624 tablet_bootstrap.cc:492] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:17.984515  8624 ts_tablet_manager.cc:1403] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.162s	user 0.015s	sys 0.004s
I20260709 13:00:18.000871  8626 tablet_bootstrap.cc:492] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:18.000801  8627 raft_consensus.cc:359] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:17.999876  8333 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.001470  8626 ts_tablet_manager.cc:1403] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.091s	user 0.006s	sys 0.005s
I20260709 13:00:18.003834  8624 raft_consensus.cc:359] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.014886  8624 raft_consensus.cc:385] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.015214  8624 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.015705  8433 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:18.018592  8626 raft_consensus.cc:359] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.019263  8626 raft_consensus.cc:385] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.019516  8626 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.020190  8626 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.022210  8626 ts_tablet_manager.cc:1434] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:18.023154  8626 tablet_bootstrap.cc:492] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:18.015795  8624 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.024762  8624 ts_tablet_manager.cc:1434] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:00:18.025697  8624 tablet_bootstrap.cc:492] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:18.020642  8837 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.001569  8627 raft_consensus.cc:385] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.025729  8333 catalog_manager.cc:5697] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.026595  8837 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.026638  8627 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.029343  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:18.029732  8627 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.038393  8624 tablet_bootstrap.cc:654] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.040076  8330 catalog_manager.cc:5697] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.040956  8837 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:18.042724  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:18.043691  8510 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:18.045032  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:18.045928  8665 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.051067  8960 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:18.053047  8627 ts_tablet_manager.cc:1434] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:00:18.062934  8624 tablet_bootstrap.cc:492] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:18.063381  8624 ts_tablet_manager.cc:1403] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.017s
I20260709 13:00:18.063905  8626 tablet_bootstrap.cc:654] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.065919  8624 raft_consensus.cc:359] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.066716  8624 raft_consensus.cc:385] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.067054  8624 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.069172  8665 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.078066  8960 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.074251  8624 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.090225  8624 ts_tablet_manager.cc:1434] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:00:18.091527  8624 tablet_bootstrap.cc:492] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Bootstrap starting.
I20260709 13:00:18.097262  8883 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.097786  8883 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.100016  8883 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:18.101750  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:18.102360  8509 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:18.103358  8398 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:18.103649  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:18.104071  8883 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.104441  8883 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.104487  8583 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:18.104820  8883 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.107100  8960 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.107551  8960 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.109516  8960 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:18.112311  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:00:18.113515  8400 leader_election.cc:343] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.115686  8624 tablet_bootstrap.cc:654] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.115645  8883 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.117730  8883 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:18.118304  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:18.118665  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:18.119239  8580 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.119685  8626 tablet_bootstrap.cc:492] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:18.120203  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:18.118820  8510 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.120208  8626 ts_tablet_manager.cc:1403] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.018s
I20260709 13:00:18.120752  8509 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:18.122473  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:18.126761  8960 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.127159  8960 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.127609  8960 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.135618  8960 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.137542  8960 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:18.138703  8510 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:18.138873  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:18.139470  8505 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.139730  8398 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:18.140652  8960 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.141250  8960 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:18.141964  8626 raft_consensus.cc:359] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.145025  8626 raft_consensus.cc:385] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.145337  8626 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.157114  8624 tablet_bootstrap.cc:492] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: No bootstrap required, opened a new log
I20260709 13:00:18.157657  8624 ts_tablet_manager.cc:1403] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.004s
I20260709 13:00:18.160377  8624 raft_consensus.cc:359] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.161419  8624 raft_consensus.cc:385] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.144227  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:18.144574  8580 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:18.161969  8624 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.161290  8505 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
W20260709 13:00:18.162976  8400 leader_election.cc:343] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.142123  8960 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.164522  8624 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.165633  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:18.168603  8761 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.168587  8883 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.168583  8624 ts_tablet_manager.cc:1434] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:00:18.169747  8883 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:18.161329  8626 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.171687  8626 ts_tablet_manager.cc:1434] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 13:00:18.172909  8626 tablet_bootstrap.cc:492] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:18.175194  8883 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.178723  8626 tablet_bootstrap.cc:654] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.184283  8331 catalog_manager.cc:5697] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.187534  8761 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.187937  8761 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.189678  8761 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:18.191210  8626 tablet_bootstrap.cc:492] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:18.191772  8626 ts_tablet_manager.cc:1403] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:00:18.193607  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:18.194214  8505 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:18.195281  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:18.195188  8626 raft_consensus.cc:359] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.196158  8626 raft_consensus.cc:385] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.196491  8626 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.196818  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:18.197363  8580 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:18.197499  8626 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.199527  8761 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.199851  8761 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.200124  8761 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.200320  8626 ts_tablet_manager.cc:1434] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:18.206837  8761 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.207342  8960 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.208340  8626 tablet_bootstrap.cc:492] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:18.208554  8761 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:18.213975  8626 tablet_bootstrap.cc:654] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.215018  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:18.215551  8505 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.250572  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:18.251245  8583 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.262260  8583 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:18.263403  8400 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:18.264128  8960 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.264561  8960 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:18.264701  8330 catalog_manager.cc:5697] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.270095  8960 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.281107  8505 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:18.289255  8626 tablet_bootstrap.cc:492] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:18.289680  8626 ts_tablet_manager.cc:1403] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.003s
I20260709 13:00:18.290289  8962 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.292142  8626 raft_consensus.cc:359] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.292773  8626 raft_consensus.cc:385] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.293030  8626 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.293732  8626 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.295687  8626 ts_tablet_manager.cc:1434] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:18.296604  8626 tablet_bootstrap.cc:492] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Bootstrap starting.
I20260709 13:00:18.316256  8626 tablet_bootstrap.cc:654] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.320922  8330 catalog_manager.cc:5697] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.331271  8974 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:18.358276  8626 tablet_bootstrap.cc:492] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: No bootstrap required, opened a new log
I20260709 13:00:18.358786  8626 ts_tablet_manager.cc:1403] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.022s
I20260709 13:00:18.361183  8626 raft_consensus.cc:359] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.361806  8626 raft_consensus.cc:385] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.362090  8626 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.365267  8626 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.371081  8626 ts_tablet_manager.cc:1434] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:18.386191  8761 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.396157  8761 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.414849  8974 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.415288  8974 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.417223  8974 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:18.418116  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:18.418870  8507 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 1: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:00:18.418640  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:18.420192  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:18.420742  8974 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.426363  8974 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.505076  8761 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.505530  8761 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.507081  8974 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.507437  8761 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:18.507845  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:18.507977  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:18.508558  8507 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:18.508697  8583 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 0.
I20260709 13:00:18.509650  8398 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:18.510396  8761 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.510715  8761 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.510985  8761 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.519114  8761 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.519951  8962 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.521749  8761 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:18.522537  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:18.525635  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:18.526434  8580 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.523105  8507 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.533090  8580 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:18.534171  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:18.534874  8761 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.535485  8761 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:18.536187  8761 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:18.538559  8507 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:00:18.550041  8333 catalog_manager.cc:5697] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 0 to 1, leader changed from <none> to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.555480  8761 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.568799  8877 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.590955  8583 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.601204  8960 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.614208  9033 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.632439  9033 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.648654  8877 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.680902  8877 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.684639  8877 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.925767  8883 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.935940  8761 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:19.641811  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:19.669656  9057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:19.672019  9056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:19.672948  9059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:19.681375  7335 server_base.cc:1061] running on GCE node
I20260709 13:00:19.682730  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:19.683058  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:19.683311  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602019683291 us; error 0 us; skew 500 ppm
I20260709 13:00:19.684122  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:19.688321  7335 webserver.cc:533] Webserver started at http://127.7.41.196:39167/ using document root <none> and password file <none>
I20260709 13:00:19.689078  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:19.689383  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:19.689877  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:19.691627  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-3-root/instance:
uuid: "6930e07cbba2484ca2bf800a58acdbb0"
format_stamp: "Formatted at 2026-07-09 13:00:19 on dist-test-slave-fh5z"
I20260709 13:00:19.700584  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:00:19.705574  9064 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:19.706431  7335 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:00:19.706730  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-3-root
uuid: "6930e07cbba2484ca2bf800a58acdbb0"
format_stamp: "Formatted at 2026-07-09 13:00:19 on dist-test-slave-fh5z"
I20260709 13:00:19.707001  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:19.720057  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:19.721336  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:19.722805  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:19.724962  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:19.725164  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:19.725420  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:19.725586  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:19.776793  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.196:40061
I20260709 13:00:19.777050  9126 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.196:40061 every 8 connection(s)
I20260709 13:00:19.781981  7335 auto_leader_rebalancer-test.cc:384] add a tserver: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:19.796690  9127 heartbeater.cc:344] Connected to a master server at 127.7.41.254:45431
I20260709 13:00:19.797211  9127 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:19.798156  9127 heartbeater.cc:507] Master 127.7.41.254:45431 requested a full tablet report, sending...
I20260709 13:00:19.800179  8333 ts_manager.cc:194] Registered new tserver with Master: 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:19.801630  8333 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32800
I20260709 13:00:20.001657  8580 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.007091  8430 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:20.009321  8837 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.012041  8510 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:20.013398  8837 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.019659  8837 raft_consensus.cc:2955] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.021324  8433 raft_consensus.cc:2955] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.024600  8510 raft_consensus.cc:2955] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
W20260709 13:00:20.027591  8549 consensus_peers.cc:597] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77b025d136d04841aa2759be7b816f77. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.040813  8333 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.063689  8430 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.080938  8582 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:20.083081  8507 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:20.083700  8883 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.087589  8761 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:20.094970  8400 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6c83778726d49c5b8622ad284f71aa9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.098721  8883 raft_consensus.cc:2955] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.099720  8582 raft_consensus.cc:2955] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.100788  8507 raft_consensus.cc:2955] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.119294  8330 catalog_manager.cc:5697] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.129403  8430 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
W20260709 13:00:20.140057  8400 consensus_peers.cc:597] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64f4890aeba446ef8cf170616e61d6ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.143404  8510 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:20.143720  8582 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:20.145946  8883 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.146677  8761 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.156610  9148 raft_consensus.cc:2955] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.158267  8580 raft_consensus.cc:2955] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.165894  8507 raft_consensus.cc:2955] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.182546  8330 catalog_manager.cc:5697] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.202515  8507 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.212512  8582 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:20.215169  8430 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:20.216863  9049 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.224560  9155 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:20.226459  8475 consensus_peers.cc:597] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e9df238f56e482f9ad6efc0c2bd6014. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:20.229526  9054 raft_consensus.cc:2955] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.232558  8427 raft_consensus.cc:2955] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.253494  8330 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.256960  8580 raft_consensus.cc:2955] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:20.389261  9160 ts_tablet_manager.cc:933] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:20.390985  9160 tablet_copy_client.cc:323] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:20.400868  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet 77b025d136d04841aa2759be7b816f77 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:20.401489  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet 77b025d136d04841aa2759be7b816f77 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-77b025d136d04841aa2759be7b816f77
I20260709 13:00:20.409422  8594 tablet_copy_source_session.cc:215] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:20.412735  9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b025d136d04841aa2759be7b816f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:20.425292  9160 tablet_copy_client.cc:806] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:20.425909  9160 tablet_copy_client.cc:670] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:20.431008  9160 tablet_copy_client.cc:538] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:20.438268  9160 tablet_bootstrap.cc:492] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:20.496680  9160 tablet_bootstrap.cc:492] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:20.497674  9160 tablet_bootstrap.cc:492] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:20.498328  9160 ts_tablet_manager.cc:1403] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.032s
I20260709 13:00:20.501314  9160 raft_consensus.cc:359] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.502151  9160 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:20.502763  9160 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.505606  9127 heartbeater.cc:499] Master 127.7.41.254:45431 was elected leader, sending a full tablet report...
I20260709 13:00:20.506202  9160 ts_tablet_manager.cc:1434] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:00:20.508343  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-77b025d136d04841aa2759be7b816f77 received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:20.508807  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-77b025d136d04841aa2759be7b816f77 on tablet 77b025d136d04841aa2759be7b816f77 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:20.580061  9160 ts_tablet_manager.cc:933] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:20.581867  9160 tablet_copy_client.cc:323] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:20.592213  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet f6c83778726d49c5b8622ad284f71aa9 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:20.592768  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet f6c83778726d49c5b8622ad284f71aa9 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-f6c83778726d49c5b8622ad284f71aa9
I20260709 13:00:20.597548  8445 tablet_copy_source_session.cc:215] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:20.601531  9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c83778726d49c5b8622ad284f71aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:20.612782  9160 tablet_copy_client.cc:806] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:20.613323  9160 tablet_copy_client.cc:670] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:20.616753  9160 tablet_copy_client.cc:538] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:20.622254  9160 tablet_bootstrap.cc:492] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:20.638618  9160 tablet_bootstrap.cc:492] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:20.639339  9160 tablet_bootstrap.cc:492] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:20.639848  9160 ts_tablet_manager.cc:1403] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:00:20.642794  9160 raft_consensus.cc:359] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.643605  9160 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:20.645051  9160 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.648494  9160 ts_tablet_manager.cc:1434] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:00:20.650660  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-f6c83778726d49c5b8622ad284f71aa9 received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:20.651073  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-f6c83778726d49c5b8622ad284f71aa9 on tablet f6c83778726d49c5b8622ad284f71aa9 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:20.717586  9160 ts_tablet_manager.cc:933] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:20.719527  9160 tablet_copy_client.cc:323] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:20.720964  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet 64f4890aeba446ef8cf170616e61d6ab from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:20.721546  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet 64f4890aeba446ef8cf170616e61d6ab from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-64f4890aeba446ef8cf170616e61d6ab
I20260709 13:00:20.729224  8445 tablet_copy_source_session.cc:215] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:20.732151  9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f4890aeba446ef8cf170616e61d6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:20.751832  9160 tablet_copy_client.cc:806] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:20.752352  9160 tablet_copy_client.cc:670] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:20.765280  9160 tablet_copy_client.cc:538] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:20.772665  9160 tablet_bootstrap.cc:492] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:20.782918  9169 ts_tablet_manager.cc:933] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:20.786298  9169 tablet_copy_client.cc:323] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:20.802855  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet 8e9df238f56e482f9ad6efc0c2bd6014 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:20.803447  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet 8e9df238f56e482f9ad6efc0c2bd6014 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-8e9df238f56e482f9ad6efc0c2bd6014
I20260709 13:00:20.805698  9160 tablet_bootstrap.cc:492] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:20.806548  9160 tablet_bootstrap.cc:492] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:20.807117  9160 ts_tablet_manager.cc:1403] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.002s
I20260709 13:00:20.809404  8520 tablet_copy_source_session.cc:215] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:20.809767  9160 raft_consensus.cc:359] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.810549  9160 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:20.811079  9160 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.813076  9169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e9df238f56e482f9ad6efc0c2bd6014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:20.813530  9160 ts_tablet_manager.cc:1434] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:20.815124  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-64f4890aeba446ef8cf170616e61d6ab received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:20.815557  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-64f4890aeba446ef8cf170616e61d6ab on tablet 64f4890aeba446ef8cf170616e61d6ab with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:20.834659  9169 tablet_copy_client.cc:806] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:20.835318  9169 tablet_copy_client.cc:670] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:20.839417  9169 tablet_copy_client.cc:538] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:20.847566  9169 tablet_bootstrap.cc:492] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:20.868341  9169 tablet_bootstrap.cc:492] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:20.869024  9169 tablet_bootstrap.cc:492] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:20.869561  9169 ts_tablet_manager.cc:1403] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:00:20.871876  9169 raft_consensus.cc:359] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.872654  9169 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:20.873320  9169 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:20.875211  9169 ts_tablet_manager.cc:1434] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:00:20.876856  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-8e9df238f56e482f9ad6efc0c2bd6014 received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:20.877302  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-8e9df238f56e482f9ad6efc0c2bd6014 on tablet 8e9df238f56e482f9ad6efc0c2bd6014 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:20.946183  9102 raft_consensus.cc:1217] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:21.117424  9102 raft_consensus.cc:1217] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:21.277649  9102 raft_consensus.cc:1217] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:21.290359  9102 raft_consensus.cc:1217] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:21.526304  8883 raft_consensus.cc:1064] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:21.529737  8883 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:21.538826  9102 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.540580  9149 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:21.544562  8507 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.546959  8582 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.546272  9177 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:21.550621  8761 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:21.569159  9178 raft_consensus.cc:1064] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:21.574386  9178 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:21.591418  8507 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.593012  9055 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:21.615365  9101 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.617005  9178 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:21.620784  9177 raft_consensus.cc:2955] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.622560  8507 raft_consensus.cc:2955] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.633273  9102 raft_consensus.cc:2955] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:00:21.638799  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 82106.3us
I20260709 13:00:21.641997  8333 catalog_manager.cc:5697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:21.645687  8427 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.658182  9184 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:21.664173  9184 raft_consensus.cc:2955] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.666052  9101 raft_consensus.cc:2955] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.684062  8508 raft_consensus.cc:2955] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.697974  8331 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:21.698693  8427 raft_consensus.cc:2955] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.721093  8582 raft_consensus.cc:2955] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.732944  8580 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:21.732808  8427 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:21.755635  9175 raft_consensus.cc:1064] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:21.761507  9054 raft_consensus.cc:1064] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:21.763213  9175 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:21.764884  9054 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:21.777421  9101 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:21.777923  8507 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:21.779043  9184 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:21.779927  9179 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:21.783164  8507 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.784889  9102 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.786900  9149 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:21.788648  8580 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.794296  9102 raft_consensus.cc:2955] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.801036  8508 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:21.788825  8761 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:21.789187  8962 raft_consensus.cc:2955] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.802685  8508 raft_consensus.cc:2955] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.810429  9149 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:21.814631  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77b025d136d04841aa2759be7b816f77 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:21.821429  9177 raft_consensus.cc:2955] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.824648  8331 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.829381  8580 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.830575  9101 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.835305  8507 raft_consensus.cc:2955] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.836602  9195 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:21.840091  9101 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:21.845378  9049 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:21.840234  9149 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:21.873313  8761 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:21.879189  8320 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6c83778726d49c5b8622ad284f71aa9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:21.882045  8427 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:21.883227  8333 catalog_manager.cc:5697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:21.897635  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet 77b025d136d04841aa2759be7b816f77 with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:21.887907  9199 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:21.887815  9100 raft_consensus.cc:2955] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:00:21.935938  9204 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:00:21.936184  8761 raft_consensus.cc:2955] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.937849  9205 tablet_replica.cc:333] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:21.938966  9205 raft_consensus.cc:2243] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:21.939760  9205 raft_consensus.cc:2272] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:21.941179  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet f6c83778726d49c5b8622ad284f71aa9 with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:21.942816  9102 raft_consensus.cc:2955] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.948431  9205 ts_tablet_manager.cc:1916] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:21.947638  8580 raft_consensus.cc:2955] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.955842  8582 raft_consensus.cc:2955] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.960915  8331 catalog_manager.cc:5697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.972818  8333 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.978169  9199 raft_consensus.cc:2955] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.984216  8510 raft_consensus.cc:2955] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:21.986677  9205 ts_tablet_manager.cc:1929] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:21.994369  9205 log.cc:1199] T 77b025d136d04841aa2759be7b816f77 P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/77b025d136d04841aa2759be7b816f77
I20260709 13:00:21.999861  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet 77b025d136d04841aa2759be7b816f77 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:22.003299  9207 tablet_replica.cc:333] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:22.006270  8433 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:22.015316  9207 raft_consensus.cc:2243] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:22.017382  9207 raft_consensus.cc:2272] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:22.018199  9102 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:22.018724  8582 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:22.023406  9149 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:22.024677  8883 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:22.032665  9207 ts_tablet_manager.cc:1916] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:22.037966  8427 raft_consensus.cc:2955] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:22.038986  9177 raft_consensus.cc:2955] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:22.039254  9102 raft_consensus.cc:2955] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:22.045411  8580 raft_consensus.cc:2955] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:22.046360  9101 raft_consensus.cc:2955] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:22.069675  8331 catalog_manager.cc:5697] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:22.072752  8320 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64f4890aeba446ef8cf170616e61d6ab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:22.070454  9207 ts_tablet_manager.cc:1929] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:22.075902  9207 log.cc:1199] T f6c83778726d49c5b8622ad284f71aa9 P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/f6c83778726d49c5b8622ad284f71aa9
I20260709 13:00:22.077450  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet f6c83778726d49c5b8622ad284f71aa9 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:22.091967  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet 64f4890aeba446ef8cf170616e61d6ab with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:22.099185  9208 tablet_replica.cc:333] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:22.100376  9208 raft_consensus.cc:2243] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:22.102169  9208 raft_consensus.cc:2272] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:22.106654  9208 ts_tablet_manager.cc:1916] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:22.119120  8507 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:22.126688  9208 ts_tablet_manager.cc:1929] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:22.127161  9208 log.cc:1199] T 64f4890aeba446ef8cf170616e61d6ab P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/64f4890aeba446ef8cf170616e61d6ab
I20260709 13:00:22.129019  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet 64f4890aeba446ef8cf170616e61d6ab (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:22.130525  9101 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:22.130702  8580 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:22.132963  9199 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:22.134867  9199 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:22.141995  9049 raft_consensus.cc:2955] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:22.143869  9101 raft_consensus.cc:2955] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:22.145052  8580 raft_consensus.cc:2955] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:22.150844  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e9df238f56e482f9ad6efc0c2bd6014 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:22.160229  8330 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:22.181097  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e9df238f56e482f9ad6efc0c2bd6014 with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:22.182070  9205 tablet_replica.cc:333] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:22.196086  9205 raft_consensus.cc:2243] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:22.196736  9205 raft_consensus.cc:2272] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:22.199532  9205 ts_tablet_manager.cc:1916] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:22.212421  9205 ts_tablet_manager.cc:1929] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:22.212827  9205 log.cc:1199] T 8e9df238f56e482f9ad6efc0c2bd6014 P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/8e9df238f56e482f9ad6efc0c2bd6014
I20260709 13:00:22.214313  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet 8e9df238f56e482f9ad6efc0c2bd6014 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:23.241365  8510 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:23.247217  8580 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:23.249152  9199 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.249615  8426 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:23.250216  8475 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f518d1b1d4c2478b9d4fc2483806952e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:23.251190  9199 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.257191  9049 raft_consensus.cc:2955] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.260221  8580 raft_consensus.cc:2955] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.271652  8582 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:23.283053  8333 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.306892  8510 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:23.306538  8426 raft_consensus.cc:2955] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
W20260709 13:00:23.310178  8549 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2240cdfdfc6c47f49f2aaea6aa62b675. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:23.311659  8433 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:23.314239  9179 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.326079  9179 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:23.337782  9217 raft_consensus.cc:2955] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.339855  8426 raft_consensus.cc:2955] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.342101  8507 raft_consensus.cc:2955] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.357409  8510 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:23.360764  8330 catalog_manager.cc:5697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.368450  8426 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:23.368968  8582 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:23.370206  9213 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:23.371178  8475 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c783a77969844f0b82c1b365e456c651. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:23.371662  9049 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.389216  9199 raft_consensus.cc:2955] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.390537  8582 raft_consensus.cc:2955] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.390671  8433 raft_consensus.cc:2955] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.413158  8583 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:23.416975  8330 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:23.423275  8549 consensus_peers.cc:597] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9ee2138cf46471e96358439600aaa0c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:23.424695  8507 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:23.426380  9219 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.430239  8426 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:23.431983  9219 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:23.451817  9217 raft_consensus.cc:2955] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.453328  8507 raft_consensus.cc:2955] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.455120  8426 raft_consensus.cc:2955] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.469655  8331 catalog_manager.cc:5697] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:23.657951  9232 ts_tablet_manager.cc:933] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:23.660192  9232 tablet_copy_client.cc:323] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:23.661868  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet f518d1b1d4c2478b9d4fc2483806952e from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:23.662465  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet f518d1b1d4c2478b9d4fc2483806952e from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-f518d1b1d4c2478b9d4fc2483806952e
I20260709 13:00:23.669773  8520 tablet_copy_source_session.cc:215] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:23.672894  9232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f518d1b1d4c2478b9d4fc2483806952e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:23.684172  9232 tablet_copy_client.cc:806] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:23.684685  9232 tablet_copy_client.cc:670] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:23.690438  9232 tablet_copy_client.cc:538] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:23.696915  9232 tablet_bootstrap.cc:492] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:23.713186  9232 tablet_bootstrap.cc:492] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:23.714066  9232 tablet_bootstrap.cc:492] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:23.714751  9232 ts_tablet_manager.cc:1403] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.004s
I20260709 13:00:23.717372  9232 raft_consensus.cc:359] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:23.717923  9232 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:23.718467  9232 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:23.721532  9232 ts_tablet_manager.cc:1434] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:23.723902  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-f518d1b1d4c2478b9d4fc2483806952e received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:23.724371  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-f518d1b1d4c2478b9d4fc2483806952e on tablet f518d1b1d4c2478b9d4fc2483806952e with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:23.907089  9232 ts_tablet_manager.cc:933] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:23.909032  9232 tablet_copy_client.cc:323] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:23.910588  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet 2240cdfdfc6c47f49f2aaea6aa62b675 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:23.911108  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet 2240cdfdfc6c47f49f2aaea6aa62b675 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-2240cdfdfc6c47f49f2aaea6aa62b675
I20260709 13:00:23.918241  8594 tablet_copy_source_session.cc:215] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:23.920742  9232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2240cdfdfc6c47f49f2aaea6aa62b675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:23.931845  9232 tablet_copy_client.cc:806] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:23.932548  9232 tablet_copy_client.cc:670] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:23.936640  9232 tablet_copy_client.cc:538] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:23.943763  9232 tablet_bootstrap.cc:492] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:23.948199  9237 ts_tablet_manager.cc:933] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:23.955099  9237 tablet_copy_client.cc:323] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:23.956718  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet c783a77969844f0b82c1b365e456c651 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:23.957288  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet c783a77969844f0b82c1b365e456c651 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-c783a77969844f0b82c1b365e456c651
I20260709 13:00:23.968032  8520 tablet_copy_source_session.cc:215] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:23.971410  9237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c783a77969844f0b82c1b365e456c651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:23.975030  9232 tablet_bootstrap.cc:492] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:23.976989  9232 tablet_bootstrap.cc:492] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:23.977689  9232 ts_tablet_manager.cc:1403] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.009s
I20260709 13:00:23.980572  9232 raft_consensus.cc:359] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:23.981446  9232 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:23.982141  9232 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:23.984651  9232 ts_tablet_manager.cc:1434] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:23.986603  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-2240cdfdfc6c47f49f2aaea6aa62b675 received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:23.986986  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-2240cdfdfc6c47f49f2aaea6aa62b675 on tablet 2240cdfdfc6c47f49f2aaea6aa62b675 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:23.987166  9237 tablet_copy_client.cc:806] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:23.987674  9237 tablet_copy_client.cc:670] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:23.992445  9237 tablet_copy_client.cc:538] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:23.999887  9237 tablet_bootstrap.cc:492] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:24.015100  9232 ts_tablet_manager.cc:933] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:24.023741  9232 tablet_copy_client.cc:323] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:24.025362  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet d9ee2138cf46471e96358439600aaa0c from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:24.025940  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet d9ee2138cf46471e96358439600aaa0c from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-d9ee2138cf46471e96358439600aaa0c
I20260709 13:00:24.026782  9237 tablet_bootstrap.cc:492] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:24.027702  9237 tablet_bootstrap.cc:492] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:24.028594  9237 ts_tablet_manager.cc:1403] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.007s
I20260709 13:00:24.031190  9237 raft_consensus.cc:359] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:24.031962  9237 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:24.032541  9237 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:24.033923  8594 tablet_copy_source_session.cc:215] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:24.037084  9237 ts_tablet_manager.cc:1434] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:00:24.040618  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-c783a77969844f0b82c1b365e456c651 received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:24.041010  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-c783a77969844f0b82c1b365e456c651 on tablet c783a77969844f0b82c1b365e456c651 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:24.048797  9232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ee2138cf46471e96358439600aaa0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:24.066900  9232 tablet_copy_client.cc:806] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:24.067430  9232 tablet_copy_client.cc:670] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:24.070789  9232 tablet_copy_client.cc:538] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:24.076876  9232 tablet_bootstrap.cc:492] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:24.091693  9232 tablet_bootstrap.cc:492] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:24.092599  9232 tablet_bootstrap.cc:492] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:24.093246  9232 ts_tablet_manager.cc:1403] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.004s
I20260709 13:00:24.095570  9232 raft_consensus.cc:359] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:24.096333  9232 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:24.096880  9232 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:24.098869  9232 ts_tablet_manager.cc:1434] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:00:24.100358  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-d9ee2138cf46471e96358439600aaa0c received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:24.100759  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-d9ee2138cf46471e96358439600aaa0c on tablet d9ee2138cf46471e96358439600aaa0c with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:24.266928  9101 raft_consensus.cc:1217] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:24.444303  9101 raft_consensus.cc:1217] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:24.504880  9101 raft_consensus.cc:1217] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:24.522980  9101 raft_consensus.cc:1217] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:24.694442  9199 raft_consensus.cc:1064] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:24.696661  9199 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:24.702939  8426 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.702939  9101 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.703136  8583 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.705044  9214 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.705885  9243 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.715126  9245 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.732069  9245 raft_consensus.cc:2955] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.733791  8426 raft_consensus.cc:2955] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.740479  9101 raft_consensus.cc:2955] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.752590  8330 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:24.758327  8583 raft_consensus.cc:2955] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.793639  8507 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:24.804726  9101 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:24.806159  8426 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:24.806217  9245 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:24.807732  9199 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:24.814241  9245 raft_consensus.cc:2955] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.815927  9101 raft_consensus.cc:2955] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.819543  8426 raft_consensus.cc:2955] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.832159  8331 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.837508  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f518d1b1d4c2478b9d4fc2483806952e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:24.845682  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet f518d1b1d4c2478b9d4fc2483806952e with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:24.859658  9253 tablet_replica.cc:333] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:24.860556  9253 raft_consensus.cc:2243] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.861238  9253 raft_consensus.cc:2272] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.864470  9253 ts_tablet_manager.cc:1916] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:24.874914  9253 ts_tablet_manager.cc:1929] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:24.875272  9253 log.cc:1199] T f518d1b1d4c2478b9d4fc2483806952e P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/f518d1b1d4c2478b9d4fc2483806952e
I20260709 13:00:24.876592  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet f518d1b1d4c2478b9d4fc2483806952e (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:24.883798  9219 raft_consensus.cc:1064] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:24.886108  9219 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:24.893370  9102 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.893370  8507 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.895196  9255 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.895977  8426 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.896955  9184 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.899159  9255 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:24.955598  9219 raft_consensus.cc:2955] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.958696  9102 raft_consensus.cc:2955] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.966715  8426 raft_consensus.cc:2955] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.975724  8333 catalog_manager.cc:5697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:24.974879  8510 raft_consensus.cc:2955] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:24.997361  8583 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:25.004480  9102 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:25.006057  9179 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:25.014173  9219 raft_consensus.cc:1064] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:25.016451  9219 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:25.018409  8430 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:25.021049  9102 raft_consensus.cc:2955] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.022579  9255 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:25.027235  8433 raft_consensus.cc:2955] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.019863  9179 raft_consensus.cc:2955] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.042743  8330 catalog_manager.cc:5697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.049897  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2240cdfdfc6c47f49f2aaea6aa62b675 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:25.056231  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet 2240cdfdfc6c47f49f2aaea6aa62b675 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:25.066977  8510 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:25.071887  9102 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:25.073668  9179 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:25.074582  9255 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:25.077872  9261 tablet_replica.cc:333] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:25.078967  9261 raft_consensus.cc:2243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.079592  9261 raft_consensus.cc:2272] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.082785  9261 ts_tablet_manager.cc:1916] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:25.084594  8433 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:25.086076  9184 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:25.107229  9261 ts_tablet_manager.cc:1929] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:25.107702  9261 log.cc:1199] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/2240cdfdfc6c47f49f2aaea6aa62b675
I20260709 13:00:25.109200  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet 2240cdfdfc6c47f49f2aaea6aa62b675 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:25.108266  9101 raft_consensus.cc:2955] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.114288  9259 raft_consensus.cc:2955] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.139252  9245 raft_consensus.cc:1064] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:25.139688  8433 raft_consensus.cc:2955] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.147568  9245 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:25.149878  8330 catalog_manager.cc:5697] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.153271  8510 raft_consensus.cc:2955] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.174836  8582 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:25.180447  8580 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:25.184751  9102 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:25.185582  8510 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:25.187605  9199 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:25.187605  9179 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:25.197993  9199 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:25.207250  9184 raft_consensus.cc:2955] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.209867  8510 raft_consensus.cc:2955] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.216674  9101 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:25.223349  9179 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:25.231058  8330 catalog_manager.cc:5697] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.236892  9101 raft_consensus.cc:2955] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.245275  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet d9ee2138cf46471e96358439600aaa0c with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:25.248899  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d9ee2138cf46471e96358439600aaa0c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:25.257695  8426 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:25.259167  9214 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:25.258617  9199 raft_consensus.cc:2955] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.273586  8580 raft_consensus.cc:2955] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.279219  8426 raft_consensus.cc:2955] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.285044  9101 raft_consensus.cc:2955] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.288334  9269 tablet_replica.cc:333] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:25.288897  8330 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:25.290375  9269 raft_consensus.cc:2243] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.291121  9269 raft_consensus.cc:2272] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.303746  9269 ts_tablet_manager.cc:1916] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:25.323611  9269 ts_tablet_manager.cc:1929] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:25.323968  9269 log.cc:1199] T d9ee2138cf46471e96358439600aaa0c P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/d9ee2138cf46471e96358439600aaa0c
I20260709 13:00:25.325359  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet d9ee2138cf46471e96358439600aaa0c (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:25.857131  8508 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:25.861901  9101 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:25.862069  8426 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:25.863380  9214 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:25.864101  9266 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:25.870528  9214 raft_consensus.cc:2955] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.872093  9102 raft_consensus.cc:2955] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.882290  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c783a77969844f0b82c1b365e456c651 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:25.892609  8332 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.893617  8426 raft_consensus.cc:2955] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:25.929648  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet c783a77969844f0b82c1b365e456c651 with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:25.931905  9275 tablet_replica.cc:333] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:25.932857  9275 raft_consensus.cc:2243] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:25.933557  9275 raft_consensus.cc:2272] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:25.936563  9275 ts_tablet_manager.cc:1916] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:25.948882  9275 ts_tablet_manager.cc:1929] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:25.949229  9275 log.cc:1199] T c783a77969844f0b82c1b365e456c651 P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/c783a77969844f0b82c1b365e456c651
I20260709 13:00:25.951104  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet c783a77969844f0b82c1b365e456c651 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:27.004920  8580 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.013753  8426 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:27.013931  8510 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:27.016002  8549 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18349b8506fc4ede84bfb527fb6e8a68. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:27.016377  9184 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:27.018249  9184 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.049479  9184 raft_consensus.cc:2955] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.051417  8508 raft_consensus.cc:2955] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.065820  8426 raft_consensus.cc:2955] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.068338  8331 catalog_manager.cc:5697] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.073035  8508 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.089991  8582 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:27.090015  8430 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:27.090756  8475 consensus_peers.cc:597] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20fa0c62ae854ede982769f8be4f5421. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:27.091709  9245 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.093679  9214 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:27.117647  9288 raft_consensus.cc:2955] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.136309  8584 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.145910  8433 raft_consensus.cc:2955] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.149495  8582 raft_consensus.cc:2955] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
W20260709 13:00:27.159610  8549 consensus_peers.cc:597] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f86829baeb70423ab45311ca8cb560c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:27.160473  8505 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:27.162700  8430 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:27.164021  9282 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:27.166203  9184 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.169085  8332 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.188761  9184 raft_consensus.cc:2955] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.193266  8505 raft_consensus.cc:2955] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.193686  8430 raft_consensus.cc:2955] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.222254  8332 catalog_manager.cc:5697] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.223832  8426 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
W20260709 13:00:27.238389  8400 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a2b7b0063404db89eb6c3acc48e3abf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:27.241113  8505 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:27.242947  9175 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:27.243707  8582 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:27.245146  9175 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.256649  9280 raft_consensus.cc:2955] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.258530  8505 raft_consensus.cc:2955] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.265821  8582 raft_consensus.cc:2955] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:27.276440  8332 catalog_manager.cc:5697] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.408708  9301 ts_tablet_manager.cc:933] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:27.410912  9301 tablet_copy_client.cc:323] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:27.412909  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet 18349b8506fc4ede84bfb527fb6e8a68 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:27.413507  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet 18349b8506fc4ede84bfb527fb6e8a68 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-18349b8506fc4ede84bfb527fb6e8a68
I20260709 13:00:27.420830  8594 tablet_copy_source_session.cc:215] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:27.424644  9301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18349b8506fc4ede84bfb527fb6e8a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.443454  9301 tablet_copy_client.cc:806] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:27.444116  9301 tablet_copy_client.cc:670] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:27.448321  9301 tablet_copy_client.cc:538] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:27.454890  9301 tablet_bootstrap.cc:492] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:27.472235  9301 tablet_bootstrap.cc:492] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:27.473140  9301 tablet_bootstrap.cc:492] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:27.473779  9301 ts_tablet_manager.cc:1403] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 13:00:27.476020  9301 raft_consensus.cc:359] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.476751  9301 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:27.477291  9301 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.480361  9301 ts_tablet_manager.cc:1434] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:27.483600  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-18349b8506fc4ede84bfb527fb6e8a68 received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:27.484031  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-18349b8506fc4ede84bfb527fb6e8a68 on tablet 18349b8506fc4ede84bfb527fb6e8a68 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:27.499073  9301 ts_tablet_manager.cc:933] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:27.500703  9301 tablet_copy_client.cc:323] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:27.502547  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet 20fa0c62ae854ede982769f8be4f5421 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:27.503050  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet 20fa0c62ae854ede982769f8be4f5421 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-20fa0c62ae854ede982769f8be4f5421
I20260709 13:00:27.512231  8520 tablet_copy_source_session.cc:215] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:27.515865  9301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fa0c62ae854ede982769f8be4f5421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.532936  9301 tablet_copy_client.cc:806] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:27.533547  9301 tablet_copy_client.cc:670] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:27.537932  9301 tablet_copy_client.cc:538] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:27.546602  9301 tablet_bootstrap.cc:492] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:27.566323  9301 tablet_bootstrap.cc:492] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:27.567167  9301 tablet_bootstrap.cc:492] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:27.567791  9301 ts_tablet_manager.cc:1403] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:00:27.571146  9301 raft_consensus.cc:359] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.572489  9301 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:27.573177  9301 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.577205  9301 ts_tablet_manager.cc:1434] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:00:27.579756  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-20fa0c62ae854ede982769f8be4f5421 received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:27.580173  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-20fa0c62ae854ede982769f8be4f5421 on tablet 20fa0c62ae854ede982769f8be4f5421 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:27.601114  9301 ts_tablet_manager.cc:933] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:27.604060  9301 tablet_copy_client.cc:323] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:27.605729  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet f86829baeb70423ab45311ca8cb560c8 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:27.606274  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet f86829baeb70423ab45311ca8cb560c8 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-f86829baeb70423ab45311ca8cb560c8
I20260709 13:00:27.612004  8594 tablet_copy_source_session.cc:215] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:27.614635  9301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86829baeb70423ab45311ca8cb560c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.630223  9301 tablet_copy_client.cc:806] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:27.630765  9301 tablet_copy_client.cc:670] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:27.634253  9301 tablet_copy_client.cc:538] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:27.642558  9301 tablet_bootstrap.cc:492] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:27.659322  9301 tablet_bootstrap.cc:492] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:27.660172  9301 tablet_bootstrap.cc:492] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:27.660739  9301 ts_tablet_manager.cc:1403] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:00:27.663333  9301 raft_consensus.cc:359] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.664052  9301 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:27.664616  9301 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.669184  9301 ts_tablet_manager.cc:1434] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:27.671483  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-f86829baeb70423ab45311ca8cb560c8 received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:27.671900  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-f86829baeb70423ab45311ca8cb560c8 on tablet f86829baeb70423ab45311ca8cb560c8 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:27.684820  9301 ts_tablet_manager.cc:933] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:27.694836  9301 tablet_copy_client.cc:323] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:27.697443  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet 0a2b7b0063404db89eb6c3acc48e3abf from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:27.697975  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet 0a2b7b0063404db89eb6c3acc48e3abf from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-0a2b7b0063404db89eb6c3acc48e3abf
I20260709 13:00:27.705965  8445 tablet_copy_source_session.cc:215] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:27.708971  9301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2b7b0063404db89eb6c3acc48e3abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.721453  9301 tablet_copy_client.cc:806] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:27.721990  9301 tablet_copy_client.cc:670] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:27.725507  9301 tablet_copy_client.cc:538] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:27.733071  9301 tablet_bootstrap.cc:492] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:27.747880  9301 tablet_bootstrap.cc:492] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:27.748713  9301 tablet_bootstrap.cc:492] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:27.749308  9301 ts_tablet_manager.cc:1403] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 13:00:27.751948  9301 raft_consensus.cc:359] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.752700  9301 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:27.753201  9301 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:27.754912  9301 ts_tablet_manager.cc:1434] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.005s	user 0.009s	sys 0.000s
I20260709 13:00:27.756635  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-0a2b7b0063404db89eb6c3acc48e3abf received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:27.757062  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-0a2b7b0063404db89eb6c3acc48e3abf on tablet 0a2b7b0063404db89eb6c3acc48e3abf with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:27.980624  9101 raft_consensus.cc:1217] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:28.017730  9101 raft_consensus.cc:1217] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:28.121047  9101 raft_consensus.cc:1217] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:28.304306  9101 raft_consensus.cc:1217] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:28.525421  9184 raft_consensus.cc:1064] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:28.527767  9184 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:28.534793  8508 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.535255  9101 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.536074  8433 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.536566  9283 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:28.541870  9313 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:28.543355  9184 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:28.557785  8505 raft_consensus.cc:2955] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.556149  9184 raft_consensus.cc:2955] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.570060  9101 raft_consensus.cc:2955] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.576112  8331 catalog_manager.cc:5697] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.578271  8433 raft_consensus.cc:2955] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.580725  9314 raft_consensus.cc:1064] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:28.586928  9314 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:28.597975  9288 raft_consensus.cc:1064] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:28.616611  9101 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.618055  9283 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:28.622124  9288 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:28.627086  8505 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.629784  8430 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.632313  9283 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:28.635071  8433 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.637651  9313 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:28.647598  8584 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.649679  9288 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:28.653312  9288 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:28.668394  9313 raft_consensus.cc:2955] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.670200  9102 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.671991  9294 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:28.681744  8433 raft_consensus.cc:2955] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.693025  9294 raft_consensus.cc:2955] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.698487  9101 raft_consensus.cc:2955] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.711463  8584 raft_consensus.cc:2955] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.716425  8330 catalog_manager.cc:5697] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.718888  9100 raft_consensus.cc:2955] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.724959  8433 raft_consensus.cc:2955] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.729799  8333 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:28.732080  8508 raft_consensus.cc:2955] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.732798  8582 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:28.763217  8580 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:28.769644  8426 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:28.771476  8505 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:28.770668  9100 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:28.775460  9313 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:28.782812  9314 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:28.791914  9100 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:28.794548  9331 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:28.801671  9279 raft_consensus.cc:1064] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:28.804294  8430 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:28.804064  9279 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:28.815060  8582 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:28.814828  9294 raft_consensus.cc:2955] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.818132  9288 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:28.820952  9100 raft_consensus.cc:2955] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.826663  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 20fa0c62ae854ede982769f8be4f5421 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:28.830554  9332 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:28.836453  9102 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:28.845645  9313 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:28.849778  8426 raft_consensus.cc:2955] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.850785  9313 raft_consensus.cc:2955] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.851068  8580 raft_consensus.cc:2955] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.861070  9336 raft_consensus.cc:2955] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.869580  9102 raft_consensus.cc:2955] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.875895  8333 catalog_manager.cc:5697] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.882953  8331 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:28.885068  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 79533.8us
I20260709 13:00:28.889683  8426 raft_consensus.cc:2955] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.902660  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet 18349b8506fc4ede84bfb527fb6e8a68 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:28.933955  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet 20fa0c62ae854ede982769f8be4f5421 with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:28.941442  9102 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.942786  9335 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:28.950436  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f86829baeb70423ab45311ca8cb560c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:28.955320  8505 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.956110  9339 tablet_replica.cc:333] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:28.957500  9335 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:28.961225  9339 raft_consensus.cc:2243] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:28.958268  8330 catalog_manager.cc:5697] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.967236  9100 raft_consensus.cc:2955] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:28.972054  9339 raft_consensus.cc:2272] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.979561  8580 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.986644  9339 ts_tablet_manager.cc:1916] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:28.990706  9340 tablet_replica.cc:333] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:29.004715  9340 raft_consensus.cc:2243] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:29.014137  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18349b8506fc4ede84bfb527fb6e8a68 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:29.020977  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet f86829baeb70423ab45311ca8cb560c8 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:29.021976  9339 ts_tablet_manager.cc:1929] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:29.022409  9340 raft_consensus.cc:2272] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:29.022475  9339 log.cc:1199] T 18349b8506fc4ede84bfb527fb6e8a68 P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/18349b8506fc4ede84bfb527fb6e8a68
I20260709 13:00:29.026427  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet 18349b8506fc4ede84bfb527fb6e8a68 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:29.027361  9339 tablet_replica.cc:333] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:29.028661  9339 raft_consensus.cc:2243] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:29.029330  9339 raft_consensus.cc:2272] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:29.037313  9340 ts_tablet_manager.cc:1916] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:29.040882  9339 ts_tablet_manager.cc:1916] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:00:29.040714  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46432.7us
I20260709 13:00:29.055387  9339 ts_tablet_manager.cc:1929] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:29.055892  9339 log.cc:1199] T f86829baeb70423ab45311ca8cb560c8 P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/f86829baeb70423ab45311ca8cb560c8
I20260709 13:00:29.055672  9340 ts_tablet_manager.cc:1929] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:29.057895  9340 log.cc:1199] T 20fa0c62ae854ede982769f8be4f5421 P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/20fa0c62ae854ede982769f8be4f5421
I20260709 13:00:29.057484  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet f86829baeb70423ab45311ca8cb560c8 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:29.059795  9343 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:29.062781  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet 20fa0c62ae854ede982769f8be4f5421 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:29.069595  9227 raft_consensus.cc:2955] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:29.074179  9102 raft_consensus.cc:2955] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:29.080833  8510 raft_consensus.cc:2955] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:29.086989  8330 catalog_manager.cc:5697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:29.092653  8580 raft_consensus.cc:2955] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:29.104380  8430 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:29.111559  9102 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:29.112409  8510 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:29.113535  9227 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:29.114475  9311 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:29.121188  9334 raft_consensus.cc:2955] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:29.123541  8510 raft_consensus.cc:2955] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:29.126567  9102 raft_consensus.cc:2955] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:29.136878  8320 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a2b7b0063404db89eb6c3acc48e3abf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:29.141222  8331 catalog_manager.cc:5697] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:29.157636  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a2b7b0063404db89eb6c3acc48e3abf with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:29.160064  9345 tablet_replica.cc:333] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:29.161720  9345 raft_consensus.cc:2243] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:29.162464  9345 raft_consensus.cc:2272] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:29.167752  9345 ts_tablet_manager.cc:1916] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:29.182864  9345 ts_tablet_manager.cc:1929] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:29.183267  9345 log.cc:1199] T 0a2b7b0063404db89eb6c3acc48e3abf P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/0a2b7b0063404db89eb6c3acc48e3abf
I20260709 13:00:29.184818  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet 0a2b7b0063404db89eb6c3acc48e3abf (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:30.225869  8510 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:30.232793  8580 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:30.232969  8430 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:30.233881  8475 consensus_peers.cc:597] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 337d7e57df5f492daf49939f167561a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:30.234751  9294 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:30.235502  9347 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:30.247102  9294 raft_consensus.cc:2955] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.248620  8430 raft_consensus.cc:2955] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.251243  8580 raft_consensus.cc:2955] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.269074  8332 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.273351  8430 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
W20260709 13:00:30.285461  8400 consensus_peers.cc:597] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d56fc8bb927a4cdd8b35293e875e2856. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:30.288149  8505 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:30.289193  8584 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:30.290122  9334 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:30.291778  9335 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:30.299700  9357 raft_consensus.cc:2955] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.301319  8505 raft_consensus.cc:2955] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.318385  8582 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:30.323830  8580 raft_consensus.cc:2955] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.325572  8331 catalog_manager.cc:5697] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.330372  8505 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:30.332561  8549 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd1c8798b6794858b96202fe8f7264d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:30.332597  9348 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:30.340629  8433 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:30.342353  9332 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:30.348649  9346 raft_consensus.cc:2955] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.355749  8505 raft_consensus.cc:2955] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.363286  8430 raft_consensus.cc:2955] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.372725  8580 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:30.374572  8330 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.410836  8510 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:30.412730  8430 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:30.413388  9332 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:30.416839  9332 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:30.417676  8549 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c7ceb457b3b46b096de1a7a57adccde. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:30.422191  9346 raft_consensus.cc:2955] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.427366  8505 raft_consensus.cc:2955] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.438119  8430 raft_consensus.cc:2955] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:30.439502  8332 catalog_manager.cc:5697] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.614991  9369 ts_tablet_manager.cc:933] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:30.616878  9369 tablet_copy_client.cc:323] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:30.618579  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet 337d7e57df5f492daf49939f167561a0 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:30.619105  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet 337d7e57df5f492daf49939f167561a0 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-337d7e57df5f492daf49939f167561a0
I20260709 13:00:30.625577  8520 tablet_copy_source_session.cc:215] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:30.628418  9369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337d7e57df5f492daf49939f167561a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:30.640512  9369 tablet_copy_client.cc:806] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:30.641562  9369 tablet_copy_client.cc:670] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:30.644889  9369 tablet_copy_client.cc:538] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:30.655040  9369 tablet_bootstrap.cc:492] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:30.684480  9369 tablet_bootstrap.cc:492] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:30.685431  9369 tablet_bootstrap.cc:492] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:30.686164  9369 ts_tablet_manager.cc:1403] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.009s
I20260709 13:00:30.688964  9369 raft_consensus.cc:359] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:30.689843  9369 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:30.691411  9369 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:30.701200  9369 ts_tablet_manager.cc:1434] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 13:00:30.703835  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-337d7e57df5f492daf49939f167561a0 received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:30.704208  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-337d7e57df5f492daf49939f167561a0 on tablet 337d7e57df5f492daf49939f167561a0 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:30.835448  9369 ts_tablet_manager.cc:933] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:30.838917  9373 ts_tablet_manager.cc:933] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:30.839393  9369 tablet_copy_client.cc:323] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:30.840864  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet d56fc8bb927a4cdd8b35293e875e2856 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:30.841017  9373 tablet_copy_client.cc:323] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:30.841307  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet d56fc8bb927a4cdd8b35293e875e2856 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-d56fc8bb927a4cdd8b35293e875e2856
I20260709 13:00:30.842623  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet bd1c8798b6794858b96202fe8f7264d6 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:30.843152  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet bd1c8798b6794858b96202fe8f7264d6 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-bd1c8798b6794858b96202fe8f7264d6
I20260709 13:00:30.848536  8445 tablet_copy_source_session.cc:215] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:30.852953  8594 tablet_copy_source_session.cc:215] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:30.853194  9369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56fc8bb927a4cdd8b35293e875e2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:30.856171  9373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1c8798b6794858b96202fe8f7264d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:30.871011  9373 tablet_copy_client.cc:806] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:30.871603  9373 tablet_copy_client.cc:670] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:30.873281  9369 tablet_copy_client.cc:806] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:30.875006  9369 tablet_copy_client.cc:670] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:30.875463  9373 tablet_copy_client.cc:538] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:30.878862  9369 tablet_copy_client.cc:538] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:30.887617  9373 tablet_bootstrap.cc:492] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:30.888211  9369 tablet_bootstrap.cc:492] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:30.928996  9376 ts_tablet_manager.cc:933] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:30.957422  9369 tablet_bootstrap.cc:492] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:30.965144  9376 tablet_copy_client.cc:323] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:30.965785  9373 tablet_bootstrap.cc:492] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:30.966495  9369 tablet_bootstrap.cc:492] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:30.966748  9373 tablet_bootstrap.cc:492] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:30.967435  9369 ts_tablet_manager.cc:1403] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.009s
I20260709 13:00:30.967312  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet 4c7ceb457b3b46b096de1a7a57adccde from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:30.968051  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet 4c7ceb457b3b46b096de1a7a57adccde from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-4c7ceb457b3b46b096de1a7a57adccde
I20260709 13:00:30.968416  9373 ts_tablet_manager.cc:1403] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.081s	user 0.042s	sys 0.029s
I20260709 13:00:30.976282  8594 tablet_copy_source_session.cc:215] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:30.974946  9373 raft_consensus.cc:359] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:30.979571  9373 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:30.982836  9376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7ceb457b3b46b096de1a7a57adccde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:30.982420  9369 raft_consensus.cc:359] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:30.983408  9369 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:30.984131  9369 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:30.986405  9373 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:30.988463  9373 ts_tablet_manager.cc:1434] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 13:00:30.990522  9369 ts_tablet_manager.cc:1434] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.006s
I20260709 13:00:30.990734  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-bd1c8798b6794858b96202fe8f7264d6 received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:30.991199  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-bd1c8798b6794858b96202fe8f7264d6 on tablet bd1c8798b6794858b96202fe8f7264d6 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:30.992233  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-d56fc8bb927a4cdd8b35293e875e2856 received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:30.992672  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-d56fc8bb927a4cdd8b35293e875e2856 on tablet d56fc8bb927a4cdd8b35293e875e2856 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:30.994604  9102 raft_consensus.cc:1217] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:31.003726  9376 tablet_copy_client.cc:806] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:31.004366  9376 tablet_copy_client.cc:670] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:31.022938  9376 tablet_copy_client.cc:538] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:31.029351  9376 tablet_bootstrap.cc:492] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:31.045413  9376 tablet_bootstrap.cc:492] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:31.046193  9376 tablet_bootstrap.cc:492] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:31.046730  9376 ts_tablet_manager.cc:1403] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.012s
I20260709 13:00:31.048821  9376 raft_consensus.cc:359] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:31.049620  9376 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:31.050216  9376 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:31.052673  9376 ts_tablet_manager.cc:1434] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:31.054289  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-4c7ceb457b3b46b096de1a7a57adccde received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:31.054731  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-4c7ceb457b3b46b096de1a7a57adccde on tablet 4c7ceb457b3b46b096de1a7a57adccde with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:31.216732  9102 raft_consensus.cc:1217] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:31.391791  9382 raft_consensus.cc:1064] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:31.395579  9102 raft_consensus.cc:1217] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:31.398813  9382 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:31.405900  8584 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:31.406093  9102 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:31.407100  8430 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:31.407864  9294 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:31.408715  9383 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:31.409524  9382 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:31.443559  9383 raft_consensus.cc:2955] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.445465  8580 raft_consensus.cc:2955] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.451505  9100 raft_consensus.cc:2955] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.458689  8430 raft_consensus.cc:2955] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.468050  8332 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.490281  9100 raft_consensus.cc:1217] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:31.520891  8510 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:31.538760  9100 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:31.539201  8584 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:31.541275  9383 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:31.542179  9347 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:31.549640  9382 raft_consensus.cc:2955] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.551169  9100 raft_consensus.cc:2955] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.558707  8584 raft_consensus.cc:2955] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.560225  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 337d7e57df5f492daf49939f167561a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:31.564297  8331 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.590274  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet 337d7e57df5f492daf49939f167561a0 with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:31.591825  9392 tablet_replica.cc:333] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:31.601398  9380 raft_consensus.cc:1064] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:31.603991  9380 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:31.606582  9392 raft_consensus.cc:2243] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:31.607455  9392 raft_consensus.cc:2272] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:31.610849  9392 ts_tablet_manager.cc:1916] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:31.612308  9100 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:31.612622  8510 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:31.614892  9332 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:31.616945  9332 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:31.626399  8426 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:31.628829  9346 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:31.629036  9392 ts_tablet_manager.cc:1929] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:31.629686  9392 log.cc:1199] T 337d7e57df5f492daf49939f167561a0 P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/337d7e57df5f492daf49939f167561a0
I20260709 13:00:31.631650  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet 337d7e57df5f492daf49939f167561a0 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:31.638293  9380 raft_consensus.cc:2955] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.640671  8426 raft_consensus.cc:2955] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.647054  8510 raft_consensus.cc:2955] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.650514  9100 raft_consensus.cc:2955] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.662034  8332 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.678536  8580 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:31.686510  8426 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:31.687783  9100 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:31.687824  9380 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:31.689952  9332 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:31.696146  9346 raft_consensus.cc:2955] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.697535  8426 raft_consensus.cc:2955] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.699894  9102 raft_consensus.cc:2955] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.706646  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd1c8798b6794858b96202fe8f7264d6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:31.716847  8331 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.732637  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet bd1c8798b6794858b96202fe8f7264d6 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:31.734513  9399 tablet_replica.cc:333] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:31.735575  9399 raft_consensus.cc:2243] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:31.736347  9399 raft_consensus.cc:2272] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:31.747017  9399 ts_tablet_manager.cc:1916] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:31.774667  9399 ts_tablet_manager.cc:1929] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:31.775053  9399 log.cc:1199] T bd1c8798b6794858b96202fe8f7264d6 P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/bd1c8798b6794858b96202fe8f7264d6
I20260709 13:00:31.777215  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet bd1c8798b6794858b96202fe8f7264d6 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:31.802079  9366 raft_consensus.cc:1064] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:31.804028  9366 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:31.810212  9102 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:31.811494  8510 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:31.811977  8584 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:31.813433  9335 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:31.818838  9357 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:31.822825  9335 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:31.884125  9395 raft_consensus.cc:1064] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:31.886704  9395 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:31.905036  9357 raft_consensus.cc:2955] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.911638  8584 raft_consensus.cc:2955] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.914601  8508 raft_consensus.cc:2955] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.940799  8331 catalog_manager.cc:5697] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.942957  9102 raft_consensus.cc:2955] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.959018  8426 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:31.966943  8508 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:31.974095  9335 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:31.985667  9101 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:31.987852  9401 raft_consensus.cc:2955] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:31.992570  8508 raft_consensus.cc:2955] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:32.013437  9335 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:32.021037  8508 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:32.023890  9332 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.036355  9102 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:32.037804  9346 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.034230  8330 catalog_manager.cc:5697] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:32.043658  8430 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:32.046392  9346 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.057693  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet d56fc8bb927a4cdd8b35293e875e2856 with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:32.058717  8320 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d56fc8bb927a4cdd8b35293e875e2856 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:32.061314  9102 raft_consensus.cc:2955] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:32.081197  9395 raft_consensus.cc:2955] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:32.089401  8426 raft_consensus.cc:2955] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:32.098973  8508 raft_consensus.cc:2955] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:32.109036  8331 catalog_manager.cc:5697] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.106703  9408 tablet_replica.cc:333] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:32.113922  9408 raft_consensus.cc:2243] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:32.116250  9101 raft_consensus.cc:2955] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:32.132632  9408 raft_consensus.cc:2272] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:32.135843  8584 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:32.139947  9408 ts_tablet_manager.cc:1916] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:32.143851  8426 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:32.144941  9101 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:32.145454  9395 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:32.147010  9346 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:32.154160  9395 raft_consensus.cc:2955] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:32.160167  8426 raft_consensus.cc:2955] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:32.165787  9408 ts_tablet_manager.cc:1929] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:32.166324  9408 log.cc:1199] T d56fc8bb927a4cdd8b35293e875e2856 P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/d56fc8bb927a4cdd8b35293e875e2856
I20260709 13:00:32.168409  9101 raft_consensus.cc:2955] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:32.170845  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet d56fc8bb927a4cdd8b35293e875e2856 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:32.171551  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4c7ceb457b3b46b096de1a7a57adccde with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:32.180115  8331 catalog_manager.cc:5697] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:32.193670  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c7ceb457b3b46b096de1a7a57adccde with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:32.194628  9399 tablet_replica.cc:333] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:32.195669  9399 raft_consensus.cc:2243] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:32.196434  9399 raft_consensus.cc:2272] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:32.200700  9399 ts_tablet_manager.cc:1916] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:32.213210  9399 ts_tablet_manager.cc:1929] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:32.213505  9399 log.cc:1199] T 4c7ceb457b3b46b096de1a7a57adccde P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/4c7ceb457b3b46b096de1a7a57adccde
I20260709 13:00:32.214872  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet 4c7ceb457b3b46b096de1a7a57adccde (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:33.257594  8426 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:33.265188  8580 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:33.265259  8400 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d9ecda5b5b04bbebb108bfcee54439e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:33.265658  8508 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:33.266887  9401 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.268025  9412 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.274775  9401 raft_consensus.cc:2955] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.277436  8580 raft_consensus.cc:2955] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.278335  8510 raft_consensus.cc:2955] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.286921  8584 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:33.290588  8330 catalog_manager.cc:5697] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:33.301121  8426 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:33.301388  8549 consensus_peers.cc:597] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e1186d8dca7484f8fd5714b4489ce99. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:33.302392  8510 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:33.302508  9395 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:33.303947  9346 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.323017  9418 raft_consensus.cc:2955] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.325011  8426 raft_consensus.cc:2955] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.327224  8510 raft_consensus.cc:2955] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.341914  8510 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:33.341815  8331 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.366708  8580 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:33.367054  8475 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbe0cd8e445e4958b026f85c697843e8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:33.369446  8426 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:33.370798  9382 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.372066  9410 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.380805  9382 raft_consensus.cc:2955] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.382387  8433 raft_consensus.cc:2955] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.385728  8580 raft_consensus.cc:2955] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.397300  8426 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:33.399955  8330 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:33.408178  8584 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:33.409179  8510 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:33.410495  9401 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.413369  9401 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:33.414382  8400 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9390750b3d3442e888055fd39566ef1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:33.435312  9357 raft_consensus.cc:2955] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.436971  8508 raft_consensus.cc:2955] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.437247  8584 raft_consensus.cc:2955] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.453685  8330 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:33.734903  9430 ts_tablet_manager.cc:933] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:33.737068  9430 tablet_copy_client.cc:323] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:33.738711  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet 1d9ecda5b5b04bbebb108bfcee54439e from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:33.739260  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet 1d9ecda5b5b04bbebb108bfcee54439e from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-1d9ecda5b5b04bbebb108bfcee54439e
I20260709 13:00:33.746830  8445 tablet_copy_source_session.cc:215] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:33.749962  9430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9ecda5b5b04bbebb108bfcee54439e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:33.766765  9430 tablet_copy_client.cc:806] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:33.767343  9430 tablet_copy_client.cc:670] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:33.771725  9430 tablet_copy_client.cc:538] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:33.779580  9430 tablet_bootstrap.cc:492] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:33.795740  9430 tablet_bootstrap.cc:492] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:33.796579  9430 tablet_bootstrap.cc:492] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:33.797209  9430 ts_tablet_manager.cc:1403] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:00:33.800616  9430 raft_consensus.cc:359] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:33.801827  9430 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:33.802827  9430 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:33.803424  9433 ts_tablet_manager.cc:933] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:33.808343  9430 ts_tablet_manager.cc:1434] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:00:33.812997  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-1d9ecda5b5b04bbebb108bfcee54439e received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:33.813421  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-1d9ecda5b5b04bbebb108bfcee54439e on tablet 1d9ecda5b5b04bbebb108bfcee54439e with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:33.823429  9435 ts_tablet_manager.cc:933] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:33.827787  9433 tablet_copy_client.cc:323] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:33.828132  9435 tablet_copy_client.cc:323] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:33.829999  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet d9390750b3d3442e888055fd39566ef1 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:33.830360  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet cbe0cd8e445e4958b026f85c697843e8 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:33.830545  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet d9390750b3d3442e888055fd39566ef1 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-d9390750b3d3442e888055fd39566ef1
I20260709 13:00:33.830955  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet cbe0cd8e445e4958b026f85c697843e8 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-cbe0cd8e445e4958b026f85c697843e8
I20260709 13:00:33.838104  8445 tablet_copy_source_session.cc:215] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:33.838990  8520 tablet_copy_source_session.cc:215] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:33.841130  9435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9390750b3d3442e888055fd39566ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:33.842602  9433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe0cd8e445e4958b026f85c697843e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:33.856994  9435 tablet_copy_client.cc:806] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:33.857584  9435 tablet_copy_client.cc:670] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:33.860931  9433 tablet_copy_client.cc:806] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:33.861058  9435 tablet_copy_client.cc:538] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:33.861689  9433 tablet_copy_client.cc:670] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:33.865283  9433 tablet_copy_client.cc:538] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:33.869845  9435 tablet_bootstrap.cc:492] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:33.873663  9433 tablet_bootstrap.cc:492] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:33.928958  9430 ts_tablet_manager.cc:933] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:33.946851  9430 tablet_copy_client.cc:323] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:33.949047  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet 8e1186d8dca7484f8fd5714b4489ce99 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:33.949555  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet 8e1186d8dca7484f8fd5714b4489ce99 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-8e1186d8dca7484f8fd5714b4489ce99
I20260709 13:00:33.958783  9435 tablet_bootstrap.cc:492] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:33.959812  9435 tablet_bootstrap.cc:492] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:33.960541  9435 ts_tablet_manager.cc:1403] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.091s	user 0.036s	sys 0.033s
I20260709 13:00:33.962991  8594 tablet_copy_source_session.cc:215] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:33.963984  9435 raft_consensus.cc:359] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:33.964919  9435 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:33.965734  9435 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:33.968044  9435 ts_tablet_manager.cc:1434] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:33.970086  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-d9390750b3d3442e888055fd39566ef1 received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:33.970471  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-d9390750b3d3442e888055fd39566ef1 on tablet d9390750b3d3442e888055fd39566ef1 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:33.970851  9430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1186d8dca7484f8fd5714b4489ce99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:33.989190  9430 tablet_copy_client.cc:806] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:33.989831  9430 tablet_copy_client.cc:670] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:33.992180  9433 tablet_bootstrap.cc:492] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:33.993119  9433 tablet_bootstrap.cc:492] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:33.993697  9433 ts_tablet_manager.cc:1403] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.120s	user 0.020s	sys 0.031s
I20260709 13:00:33.995309  9430 tablet_copy_client.cc:538] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:33.996538  9433 raft_consensus.cc:359] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:33.997365  9433 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:33.997895  9433 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:34.000221  9433 ts_tablet_manager.cc:1434] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:00:34.007622  9430 tablet_bootstrap.cc:492] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:34.013274  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-cbe0cd8e445e4958b026f85c697843e8 received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:34.013810  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-cbe0cd8e445e4958b026f85c697843e8 on tablet cbe0cd8e445e4958b026f85c697843e8 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:34.028976  9430 tablet_bootstrap.cc:492] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:34.029855  9430 tablet_bootstrap.cc:492] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:34.030959  9430 ts_tablet_manager.cc:1403] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.011s
I20260709 13:00:34.033643  9430 raft_consensus.cc:359] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:34.034546  9430 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:34.035204  9430 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:34.037635  9430 ts_tablet_manager.cc:1434] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:00:34.039731  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-8e1186d8dca7484f8fd5714b4489ce99 received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:34.040223  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-8e1186d8dca7484f8fd5714b4489ce99 on tablet 8e1186d8dca7484f8fd5714b4489ce99 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:34.210904  9102 raft_consensus.cc:1217] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:34.244215  9102 raft_consensus.cc:1217] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:34.315635  9102 raft_consensus.cc:1217] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:34.408169  9102 raft_consensus.cc:1217] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:34.687959  9412 raft_consensus.cc:1064] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:34.689911  9412 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:34.697984  8584 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:34.698776  9102 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:34.699932  9429 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:34.700762  9401 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:34.707743  8505 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:34.710728  9429 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:34.738862  9429 raft_consensus.cc:2955] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.739936  8505 raft_consensus.cc:2955] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.751928  9412 raft_consensus.cc:1064] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:34.754707  9102 raft_consensus.cc:2955] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.767940  9412 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:34.765512  8584 raft_consensus.cc:2955] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.810503  8331 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.819329  9102 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:34.820727  9401 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:34.826696  8584 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:34.830219  9401 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:34.832413  8505 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:34.842610  9357 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:34.844866  9418 raft_consensus.cc:1064] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:34.847297  9418 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:34.866953  9401 raft_consensus.cc:2955] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.875070  8505 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:34.876307  9102 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:34.877544  9101 raft_consensus.cc:2955] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.878353  9395 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:34.890745  9418 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:34.894572  8505 raft_consensus.cc:2955] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.899039  8584 raft_consensus.cc:2955] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.906958  8433 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:34.908390  9418 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:34.925213  9418 raft_consensus.cc:2955] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.933056  8426 raft_consensus.cc:2955] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.951637  9101 raft_consensus.cc:2955] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.973881  8330 catalog_manager.cc:5697] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:34.978191  8505 raft_consensus.cc:2955] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.977094  8330 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:34.997834  8426 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:35.001406  8433 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:35.018926  9102 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:35.020926  9401 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.024494  8580 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:35.025130  8505 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:35.025350  9101 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:35.026624  9357 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.033361  9401 raft_consensus.cc:2955] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.034937  8505 raft_consensus.cc:2955] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.036754  9429 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.038060  9383 raft_consensus.cc:1064] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:35.038581  9449 raft_consensus.cc:2955] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.041271  9383 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:35.034072  8580 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:35.051201  8332 catalog_manager.cc:5697] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.058182  9102 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:35.060233  9395 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.066035  8508 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:35.067600  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d9ecda5b5b04bbebb108bfcee54439e with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:35.068122  9418 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.074292  9455 raft_consensus.cc:2955] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.075238  9101 raft_consensus.cc:2955] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.087169  9465 tablet_replica.cc:333] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:35.090983  9465 raft_consensus.cc:2243] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.091778  9465 raft_consensus.cc:2272] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.095857  9465 ts_tablet_manager.cc:1916] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:00:35.100803  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 65129.6us
I20260709 13:00:35.103032  9412 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.106886  8332 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:00:35.106565  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 60036.1us
I20260709 13:00:35.108765  8320 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d9ecda5b5b04bbebb108bfcee54439e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:35.107522  9101 raft_consensus.cc:2955] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.115142  9102 raft_consensus.cc:2955] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.119697  8320 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d9390750b3d3442e888055fd39566ef1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:35.119424  8505 raft_consensus.cc:2955] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.126811  8580 raft_consensus.cc:2955] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.139235  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e1186d8dca7484f8fd5714b4489ce99 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:35.142002  8332 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.153294  8584 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:35.154073  9100 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:35.155692  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet d9390750b3d3442e888055fd39566ef1 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:35.155722  8433 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:35.165978  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e1186d8dca7484f8fd5714b4489ce99 with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:35.171622  9467 tablet_replica.cc:333] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:35.172775  9467 raft_consensus.cc:2243] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.173525  9467 raft_consensus.cc:2272] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.161115  9383 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:00:35.175833  9382 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:35.176616  9467 ts_tablet_manager.cc:1916] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:35.180807  9466 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:35.241953  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 49787.6us
I20260709 13:00:35.270740  9468 tablet_replica.cc:333] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:35.250559  9465 ts_tablet_manager.cc:1929] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:35.285454  9465 log.cc:1199] T 1d9ecda5b5b04bbebb108bfcee54439e P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/1d9ecda5b5b04bbebb108bfcee54439e
I20260709 13:00:35.301659  9468 raft_consensus.cc:2243] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.302536  9468 raft_consensus.cc:2272] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.320107  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet 1d9ecda5b5b04bbebb108bfcee54439e (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:35.359956  9468 ts_tablet_manager.cc:1916] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:00:35.370265  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 65634.2us
I20260709 13:00:35.394560  8433 raft_consensus.cc:2955] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.399384  9477 raft_consensus.cc:2955] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.411708  8330 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.421160  8582 raft_consensus.cc:2955] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:00:35.441141  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 85680.3us
W20260709 13:00:35.449120  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 65763.4us
I20260709 13:00:35.474561  9467 ts_tablet_manager.cc:1929] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:35.476130  9467 log.cc:1199] T d9390750b3d3442e888055fd39566ef1 P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/d9390750b3d3442e888055fd39566ef1
I20260709 13:00:35.481658  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet d9390750b3d3442e888055fd39566ef1 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:35.482514  9102 raft_consensus.cc:2955] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.475086  9468 ts_tablet_manager.cc:1929] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:35.484385  9468 log.cc:1199] T 8e1186d8dca7484f8fd5714b4489ce99 P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/8e1186d8dca7484f8fd5714b4489ce99
I20260709 13:00:35.485898  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet 8e1186d8dca7484f8fd5714b4489ce99 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:35.514159  8505 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:35.522058  9101 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:35.522702  8433 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:35.524523  9476 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.526381  9476 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.534965  9477 raft_consensus.cc:2955] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.537540  9101 raft_consensus.cc:2955] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.541950  8433 raft_consensus.cc:2955] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:35.552285  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbe0cd8e445e4958b026f85c697843e8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:35.561204  8332 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:35.572830  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet cbe0cd8e445e4958b026f85c697843e8 with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:35.573741  9465 tablet_replica.cc:333] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:35.574792  9465 raft_consensus.cc:2243] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:35.575409  9465 raft_consensus.cc:2272] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:35.581810  9465 ts_tablet_manager.cc:1916] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:35.593874  9465 ts_tablet_manager.cc:1929] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:35.594245  9465 log.cc:1199] T cbe0cd8e445e4958b026f85c697843e8 P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/cbe0cd8e445e4958b026f85c697843e8
I20260709 13:00:35.595681  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet cbe0cd8e445e4958b026f85c697843e8 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:36.705117  8505 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:36.713444  8433 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:36.714143  8475 consensus_peers.cc:597] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b34810c9636748309cee2bf3d1eb6bdb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.714349  8583 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:36.715323  9477 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:36.716526  9476 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:36.725209  9477 raft_consensus.cc:2955] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.726729  8583 raft_consensus.cc:2955] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.727744  8433 raft_consensus.cc:2955] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.741870  8584 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:36.746762  8332 catalog_manager.cc:5697] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.760047  8505 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:36.760629  8549 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 435c81d2d1f346bea90c20030455900c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.761404  8433 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:36.761847  9395 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:36.763360  9480 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:36.774154  9482 raft_consensus.cc:2955] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.778395  8505 raft_consensus.cc:2955] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.790166  8508 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:36.798997  8333 catalog_manager.cc:5697] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.806641  8435 raft_consensus.cc:2955] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.813935  8426 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:36.819223  9477 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:36.839252  8475 consensus_peers.cc:597] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e2febf027be449183830c318fbd6012. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.842497  8583 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:36.845211  9496 raft_consensus.cc:2955] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.846776  9485 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:36.849058  8435 raft_consensus.cc:2955] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.864671  8583 raft_consensus.cc:2955] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.867838  8333 catalog_manager.cc:5697] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.875481  8435 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:36.896636  8583 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:36.897248  8400 consensus_peers.cc:597] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37072d40853c44b1b312489112c9250e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:36.898541  9497 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:36.901532  8508 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:36.903095  9429 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:36.918035  9497 raft_consensus.cc:2955] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.922991  8583 raft_consensus.cc:2955] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:36.937958  8330 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:36.939766  8508 raft_consensus.cc:2955] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:37.157244  9505 ts_tablet_manager.cc:933] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:37.159337  9505 tablet_copy_client.cc:323] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:37.161003  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet b34810c9636748309cee2bf3d1eb6bdb from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:37.161476  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet b34810c9636748309cee2bf3d1eb6bdb from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-b34810c9636748309cee2bf3d1eb6bdb
I20260709 13:00:37.169178  8520 tablet_copy_source_session.cc:215] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:37.174316  9505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34810c9636748309cee2bf3d1eb6bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.194972  9505 tablet_copy_client.cc:806] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:37.195699  9505 tablet_copy_client.cc:670] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:37.199707  9505 tablet_copy_client.cc:538] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:37.206903  9505 tablet_bootstrap.cc:492] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:37.225678  9505 tablet_bootstrap.cc:492] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:37.226665  9505 tablet_bootstrap.cc:492] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:37.227310  9505 ts_tablet_manager.cc:1403] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:00:37.230358  9505 raft_consensus.cc:359] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:37.231208  9505 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:37.231868  9505 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:37.256657  9505 ts_tablet_manager.cc:1434] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.015s
I20260709 13:00:37.258733  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-b34810c9636748309cee2bf3d1eb6bdb received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:37.259291  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-b34810c9636748309cee2bf3d1eb6bdb on tablet b34810c9636748309cee2bf3d1eb6bdb with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:37.297150  9505 ts_tablet_manager.cc:933] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:37.298918  9505 tablet_copy_client.cc:323] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:37.300616  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet 8e2febf027be449183830c318fbd6012 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:37.301118  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet 8e2febf027be449183830c318fbd6012 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-8e2febf027be449183830c318fbd6012
I20260709 13:00:37.308701  8520 tablet_copy_source_session.cc:215] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:37.312013  9505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e2febf027be449183830c318fbd6012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.324529  9510 ts_tablet_manager.cc:933] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:37.326421  9510 tablet_copy_client.cc:323] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:37.328456  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet 435c81d2d1f346bea90c20030455900c from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:37.329000  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet 435c81d2d1f346bea90c20030455900c from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-435c81d2d1f346bea90c20030455900c
I20260709 13:00:37.332597  9505 tablet_copy_client.cc:806] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:37.333199  9505 tablet_copy_client.cc:670] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:37.336954  9505 tablet_copy_client.cc:538] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:37.338384  8594 tablet_copy_source_session.cc:215] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:37.341581  9510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435c81d2d1f346bea90c20030455900c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.346550  9505 tablet_bootstrap.cc:492] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:37.356052  9510 tablet_copy_client.cc:806] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:37.356666  9510 tablet_copy_client.cc:670] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:37.360322  9510 tablet_copy_client.cc:538] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:37.366969  9505 tablet_bootstrap.cc:492] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:37.367498  9510 tablet_bootstrap.cc:492] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:37.368103  9505 tablet_bootstrap.cc:492] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:37.368821  9505 ts_tablet_manager.cc:1403] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.012s
I20260709 13:00:37.371798  9505 raft_consensus.cc:359] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:37.372684  9505 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:37.373597  9505 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:37.375936  9505 ts_tablet_manager.cc:1434] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:37.378154  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-8e2febf027be449183830c318fbd6012 received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:37.378552  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-8e2febf027be449183830c318fbd6012 on tablet 8e2febf027be449183830c318fbd6012 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:37.407321  9510 tablet_bootstrap.cc:492] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:37.408332  9510 tablet_bootstrap.cc:492] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:37.410079  9510 ts_tablet_manager.cc:1403] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.014s
I20260709 13:00:37.412794  9510 raft_consensus.cc:359] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:37.413676  9510 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:37.414394  9510 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:37.418326  9510 ts_tablet_manager.cc:1434] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:00:37.418617  9505 ts_tablet_manager.cc:933] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:37.420737  9505 tablet_copy_client.cc:323] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:37.423312  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet 37072d40853c44b1b312489112c9250e from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:37.423872  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet 37072d40853c44b1b312489112c9250e from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-37072d40853c44b1b312489112c9250e
I20260709 13:00:37.427309  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-435c81d2d1f346bea90c20030455900c received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:37.427804  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-435c81d2d1f346bea90c20030455900c on tablet 435c81d2d1f346bea90c20030455900c with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:37.432087  8445 tablet_copy_source_session.cc:215] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:37.439059  9505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37072d40853c44b1b312489112c9250e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:37.475301  9505 tablet_copy_client.cc:806] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:37.475835  9505 tablet_copy_client.cc:670] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:37.479550  9505 tablet_copy_client.cc:538] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:37.487470  9505 tablet_bootstrap.cc:492] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:37.506675  9505 tablet_bootstrap.cc:492] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:37.507472  9505 tablet_bootstrap.cc:492] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:37.508076  9505 ts_tablet_manager.cc:1403] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:00:37.511001  9505 raft_consensus.cc:359] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:37.511721  9505 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:37.512595  9505 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:37.514711  9505 ts_tablet_manager.cc:1434] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:37.518720  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-37072d40853c44b1b312489112c9250e received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:37.519153  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-37072d40853c44b1b312489112c9250e on tablet 37072d40853c44b1b312489112c9250e with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:37.691675  9100 raft_consensus.cc:1217] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:37.710541  9100 raft_consensus.cc:1217] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:37.862129  9101 raft_consensus.cc:1217] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:37.978646  9101 raft_consensus.cc:1217] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:38.192140  9476 raft_consensus.cc:1064] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:38.194685  9476 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:38.201576  8426 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.202945  9101 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.201576  8582 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.203578  9516 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:38.206298  9517 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.207150  9516 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.223826  9517 raft_consensus.cc:2955] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.227516  8426 raft_consensus.cc:2955] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.259318  8333 catalog_manager.cc:5697] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:00:38.292793  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 61209.5us
I20260709 13:00:38.295794  8582 raft_consensus.cc:2955] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.296960  9100 raft_consensus.cc:2955] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.318006  9476 raft_consensus.cc:1064] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:38.329586  9476 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:38.336515  8582 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.337641  9100 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.337859  9527 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.340351  9516 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.342649  8433 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.344025  9527 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.364598  8508 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:38.374591  9101 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:38.379278  8584 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:38.382087  9476 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:38.383102  9516 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:38.385433  9526 raft_consensus.cc:2955] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.387007  8584 raft_consensus.cc:2955] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.394802  9518 raft_consensus.cc:1064] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:38.398058  9102 raft_consensus.cc:2955] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.398706  9101 raft_consensus.cc:2955] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.394809  9525 raft_consensus.cc:2955] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.403556  8332 catalog_manager.cc:5697] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.397351  9518 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:38.423183  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b34810c9636748309cee2bf3d1eb6bdb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:38.426165  8433 raft_consensus.cc:2955] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.427289  8505 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:38.441206  8584 raft_consensus.cc:2955] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.447726  9102 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:38.449211  8331 catalog_manager.cc:5697] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.453476  9526 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:38.460633  9102 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.461895  8583 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:38.462004  9429 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.463151  8582 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.464490  9429 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.466527  8505 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.467336  9476 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:38.468685  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet b34810c9636748309cee2bf3d1eb6bdb with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:38.469501  9525 raft_consensus.cc:2955] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.470748  9519 raft_consensus.cc:1064] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:38.470634  9429 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.482847  9519 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:38.484797  8584 raft_consensus.cc:2955] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.495854  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e2febf027be449183830c318fbd6012 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:38.506080  8331 catalog_manager.cc:5697] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.504554  9101 raft_consensus.cc:2955] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.520027  8423 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e2febf027be449183830c318fbd6012 with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:38.527621  9540 tablet_replica.cc:333] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:38.529851  8505 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.532831  8426 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.529914  9504 raft_consensus.cc:2955] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.539083  9537 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:38.539667  9100 raft_consensus.cc:2955] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.541144  8505 raft_consensus.cc:2955] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.546949  9099 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.541640  9537 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.550518  9537 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.559739  8583 raft_consensus.cc:2955] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.592023  8332 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.603475  9540 raft_consensus.cc:2243] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.604986  9540 raft_consensus.cc:2272] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.608886  9540 ts_tablet_manager.cc:1916] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:38.629088  9483 raft_consensus.cc:2955] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.630379  8433 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:38.637854  8510 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:38.639287  9518 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:38.637441  8508 raft_consensus.cc:2955] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.656486  9099 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:38.637681  8433 raft_consensus.cc:2955] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.658834  9503 raft_consensus.cc:2955] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.665783  8510 raft_consensus.cc:2955] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.668870  8332 catalog_manager.cc:5697] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.666714  9518 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:00:38.678747  9099 raft_consensus.cc:2955] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.696669  8330 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.698803  8320 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 37072d40853c44b1b312489112c9250e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:38.706578  9099 raft_consensus.cc:2955] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.709410  9540 ts_tablet_manager.cc:1929] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:38.709949  9540 log.cc:1199] T b34810c9636748309cee2bf3d1eb6bdb P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/b34810c9636748309cee2bf3d1eb6bdb
I20260709 13:00:38.711488  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet 37072d40853c44b1b312489112c9250e with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:38.713861  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet b34810c9636748309cee2bf3d1eb6bdb (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:38.714268  9540 tablet_replica.cc:333] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:38.715663  9540 raft_consensus.cc:2243] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.716338  9540 raft_consensus.cc:2272] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.720468  9540 ts_tablet_manager.cc:1916] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:38.734339  9549 tablet_replica.cc:333] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:38.735532  9549 raft_consensus.cc:2243] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.736339  9549 raft_consensus.cc:2272] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.739940  9549 ts_tablet_manager.cc:1916] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:38.740084  8583 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:38.749917  9540 ts_tablet_manager.cc:1929] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:38.750461  9540 log.cc:1199] T 8e2febf027be449183830c318fbd6012 P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/8e2febf027be449183830c318fbd6012
I20260709 13:00:38.752259  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet 8e2febf027be449183830c318fbd6012 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:38.752653  9099 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:38.754511  9547 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:38.754858  8433 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:38.756263  9547 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:38.763669  9483 raft_consensus.cc:2955] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.768713  9549 ts_tablet_manager.cc:1929] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:38.769222  9549 log.cc:1199] T 37072d40853c44b1b312489112c9250e P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/37072d40853c44b1b312489112c9250e
I20260709 13:00:38.771148  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet 37072d40853c44b1b312489112c9250e (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:38.772221  9102 raft_consensus.cc:2955] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.785140  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 435c81d2d1f346bea90c20030455900c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:38.788103  8331 catalog_manager.cc:5697] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.790818  8426 raft_consensus.cc:2955] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:38.799808  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet 435c81d2d1f346bea90c20030455900c with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:38.811429  9550 tablet_replica.cc:333] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:38.812707  9550 raft_consensus.cc:2243] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.813436  9550 raft_consensus.cc:2272] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.816444  9550 ts_tablet_manager.cc:1916] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:38.826444  9550 ts_tablet_manager.cc:1929] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:38.826814  9550 log.cc:1199] T 435c81d2d1f346bea90c20030455900c P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/435c81d2d1f346bea90c20030455900c
I20260709 13:00:38.828233  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet 435c81d2d1f346bea90c20030455900c (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:39.783316  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:39.848371  8583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "435c81d2d1f346bea90c20030455900c"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:39.848928  8583 raft_consensus.cc:606] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:39.851426  8583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:39.853157  8583 raft_consensus.cc:606] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:39.857077  8583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:39.857647  8583 raft_consensus.cc:606] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:39.875240  8508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:39.875725  8508 raft_consensus.cc:606] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:39.890767  8583 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:39.893671  8426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:39.894318  8426 raft_consensus.cc:606] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:39.897315  8508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:39.897818  8508 raft_consensus.cc:606] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:39.899181  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:39.899525  9551 raft_consensus.cc:993] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:39.900444  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:39.900358  9551 raft_consensus.cc:1081] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:39.902526  9102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "435c81d2d1f346bea90c20030455900c"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:00:39.903066  9102 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:39.903481  9102 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.908659  9102 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:39.910970  9102 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:39.911907  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:39.912366  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:39.912545  8426 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.912904  8582 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:39.913184  8582 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:39.914709  8508 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:39.913834  8582 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:39.916071  9558 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:39.916927  8549 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7dfd08eb514418f81f0ba7777a079e8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:39.916975  8582 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.918422  8433 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:39.918751  8426 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:39.920433  9558 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:39.921749  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:39.922935  9551 raft_consensus.cc:993] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:39.923373  9551 raft_consensus.cc:1081] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:39.929126  8508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59098
I20260709 13:00:39.929661  8508 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:39.929991  8508 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.937132  8508 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:39.939605  8508 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:39.940860  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:39.941326  8426 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.942381  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:39.942955  8583 raft_consensus.cc:3055] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:39.943332  8583 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:39.944209  8583 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:39.947422  8583 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.952507  8582 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:39.952669  8426 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:39.959246  8476 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:39.960129  9516 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:39.960624  9516 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:39.961771  9559 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:39.961527  9516 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:39.956665  8583 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:39.965255  9547 raft_consensus.cc:2955] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:39.972021  8510 raft_consensus.cc:2955] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:39.972358  8433 raft_consensus.cc:2955] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:39.986977  8331 catalog_manager.cc:5697] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.997295  8332 catalog_manager.cc:5697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.998437  9558 raft_consensus.cc:993] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:39.998924  9558 raft_consensus.cc:1081] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:39.993371  8426 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.001794  9102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:00:40.002308  9102 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:40.002615  9102 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.011632  9102 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:00:40.013360  8400 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2a5011db54b4e9f85a54c19ade01aa8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:40.016037  8510 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:40.015642  9559 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:40.017308  9504 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.018409  8582 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:40.020562  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:40.021138  8510 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.022357  9559 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:40.022783  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:40.023533  8582 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:40.023880  8582 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:40.024606  8582 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:40.020452  9518 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.025863  8582 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.030308  8510 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:40.033464  9065 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:00:40.034435  9562 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:40.040198  8582 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:40.042382  9102 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:40.045871  8333 catalog_manager.cc:5697] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.052631  9562 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:40.053664  9562 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:40.066756  9518 raft_consensus.cc:2955] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:40.072505  8510 raft_consensus.cc:2955] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:40.075645  8582 raft_consensus.cc:2955] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:40.104805  8510 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.111740  8330 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.114200  8333 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.124548  8582 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:40.124564  8475 consensus_peers.cc:597] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44116e7a54d141108511e22185400ffe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:40.125201  8426 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:40.126106  9564 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.127544  9516 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.140887  9516 raft_consensus.cc:2955] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:40.142482  8583 raft_consensus.cc:2955] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:40.162811  8583 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.160053  8426 raft_consensus.cc:2955] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:40.168056  8333 catalog_manager.cc:5697] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.186676  9476 raft_consensus.cc:993] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:40.187100  9476 raft_consensus.cc:1081] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:40.188644  9101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:40.189118  9101 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:40.189462  9101 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.192690  8508 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:40.193373  8433 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:40.194599  8549 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c0a41ce5cf754ad58e31f5e764daa48f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:40.195844  9557 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.196660  9547 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.198284  9101 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:40.210891  9101 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:40.212677  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:40.215361  8510 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:40.215652  8510 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:40.216398  8510 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:40.217351  8510 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.217661  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:40.218446  8426 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.219480  9518 raft_consensus.cc:993] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:40.220492  9518 raft_consensus.cc:1081] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:40.224468  8583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:00:40.224963  8583 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:40.225296  8583 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.228252  8510 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:40.229305  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:00:40.230116  9562 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:40.230602  9562 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:40.231369  9562 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:40.232911  8583 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:40.240015  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:40.240485  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:40.240525  8435 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:40.241074  8510 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.241148  8435 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:40.243104  8583 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:40.242221  8435 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:40.241024  8426 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:40.245898  8435 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.247455  9558 raft_consensus.cc:2955] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:40.253484  8508 raft_consensus.cc:2955] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:40.255610  8510 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:40.258898  8435 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:40.261703  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:40.262584  9516 raft_consensus.cc:993] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:40.263015  9516 raft_consensus.cc:1081] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:40.264572  9101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:40.265074  9101 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:40.263763  9551 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:40.265412  9101 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.275079  9101 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:40.282279  8332 catalog_manager.cc:5697] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:40.284066  9101 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:40.284969  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:40.285724  8510 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:40.286113  8510 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:40.286450  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:40.287388  8433 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.287083  8510 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:40.288604  8510 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.299418  8426 raft_consensus.cc:2955] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:40.304839  9551 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:40.308601  9551 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:40.295682  8433 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:40.310611  8510 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:40.312207  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:00:40.317066  9562 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:40.317507  9562 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:40.318375  9562 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:40.322959  8332 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.335999  8330 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.342514  8426 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:40.344048  9564 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.366863  8583 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:40.368292  9476 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.368878  8330 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:40.440478  9595 ts_tablet_manager.cc:933] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:40.452836  9595 tablet_copy_client.cc:323] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:40.454557  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet f2a5011db54b4e9f85a54c19ade01aa8 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:40.455092  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet f2a5011db54b4e9f85a54c19ade01aa8 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-f2a5011db54b4e9f85a54c19ade01aa8
I20260709 13:00:40.458281  9597 ts_tablet_manager.cc:933] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:40.461683  8445 tablet_copy_source_session.cc:215] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:40.464202  9597 tablet_copy_client.cc:323] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:40.464823  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a5011db54b4e9f85a54c19ade01aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.465868  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet b7dfd08eb514418f81f0ba7777a079e8 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:40.466456  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet b7dfd08eb514418f81f0ba7777a079e8 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-b7dfd08eb514418f81f0ba7777a079e8
I20260709 13:00:40.473546  8594 tablet_copy_source_session.cc:215] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:40.477432  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dfd08eb514418f81f0ba7777a079e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.477742  8508 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:40.479310  9562 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:40.480820  9595 tablet_copy_client.cc:806] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:40.481431  9595 tablet_copy_client.cc:670] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:40.490743  9595 tablet_copy_client.cc:538] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:40.495062  9597 tablet_copy_client.cc:806] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:40.495651  9597 tablet_copy_client.cc:670] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:40.497298  8582 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:40.498976  9559 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:40.503021  9597 tablet_copy_client.cc:538] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:40.511935  9595 tablet_bootstrap.cc:492] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:40.513321  9597 tablet_bootstrap.cc:492] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:40.543272  9597 tablet_bootstrap.cc:492] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:40.544986  9597 tablet_bootstrap.cc:492] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:40.547482  9597 ts_tablet_manager.cc:1403] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.008s
I20260709 13:00:40.554086  9597 raft_consensus.cc:359] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.555009  9597 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:40.555770  9597 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.562966  9597 ts_tablet_manager.cc:1434] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:00:40.566869  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-b7dfd08eb514418f81f0ba7777a079e8 received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:40.567284  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-b7dfd08eb514418f81f0ba7777a079e8 on tablet b7dfd08eb514418f81f0ba7777a079e8 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:40.571462  8435 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:40.576205  9595 tablet_bootstrap.cc:492] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:40.577131  9595 tablet_bootstrap.cc:492] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:40.577793  9595 ts_tablet_manager.cc:1403] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.008s
I20260709 13:00:40.580729  9595 raft_consensus.cc:359] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.581559  9595 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:40.582199  9595 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.584057  9559 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:40.585362  9595 ts_tablet_manager.cc:1434] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:40.587188  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-f2a5011db54b4e9f85a54c19ade01aa8 received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:40.587648  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-f2a5011db54b4e9f85a54c19ade01aa8 on tablet f2a5011db54b4e9f85a54c19ade01aa8 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:40.594074  9595 ts_tablet_manager.cc:933] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:40.601569  8582 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:40.603991  9572 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:40.638634  9597 ts_tablet_manager.cc:933] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:40.643003  9597 tablet_copy_client.cc:323] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:40.644846  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet 44116e7a54d141108511e22185400ffe from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:40.645367  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet 44116e7a54d141108511e22185400ffe from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-44116e7a54d141108511e22185400ffe
I20260709 13:00:40.653199  8520 tablet_copy_source_session.cc:215] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:40.656467  9597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44116e7a54d141108511e22185400ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.665051  8508 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:40.667342  9595 tablet_copy_client.cc:323] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:40.668648  9562 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:40.668896  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet c0a41ce5cf754ad58e31f5e764daa48f from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:40.669464  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet c0a41ce5cf754ad58e31f5e764daa48f from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-c0a41ce5cf754ad58e31f5e764daa48f
I20260709 13:00:40.678342  8594 tablet_copy_source_session.cc:215] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:40.681005  9597 tablet_copy_client.cc:806] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:40.681666  9597 tablet_copy_client.cc:670] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:40.682551  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a41ce5cf754ad58e31f5e764daa48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.704104  9595 tablet_copy_client.cc:806] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:40.704888  9595 tablet_copy_client.cc:670] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:40.709630  9595 tablet_copy_client.cc:538] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:40.712826  8435 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:40.715386  9562 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:40.717053  9597 tablet_copy_client.cc:538] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:40.718740  9595 tablet_bootstrap.cc:492] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:40.736325  8433 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:40.738077  9551 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.794718  9597 tablet_bootstrap.cc:492] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:40.823910  8510 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:40.835626  8426 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:40.837469  9562 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:40.865195  8510 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:40.867623  9572 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:40.870138  9595 tablet_bootstrap.cc:492] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:40.875228  9595 tablet_bootstrap.cc:492] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:40.862455  9551 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:00:40.876812  9595 ts_tablet_manager.cc:1403] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.158s	user 0.054s	sys 0.042s
I20260709 13:00:40.886873  9597 tablet_bootstrap.cc:492] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:40.892792  9595 raft_consensus.cc:359] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.893812  9595 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:40.894642  9595 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.901105  9595 ts_tablet_manager.cc:1434] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:00:40.903115  9597 tablet_bootstrap.cc:492] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:40.904704  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-c0a41ce5cf754ad58e31f5e764daa48f received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:40.904717  9597 ts_tablet_manager.cc:1403] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.110s	user 0.024s	sys 0.005s
I20260709 13:00:40.905236  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-c0a41ce5cf754ad58e31f5e764daa48f on tablet c0a41ce5cf754ad58e31f5e764daa48f with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:40.908439  9597 raft_consensus.cc:359] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.909358  9597 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:40.910487  9597 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:40.911130  9102 raft_consensus.cc:1217] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:40.913424  9597 ts_tablet_manager.cc:1434] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:40.915107  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-44116e7a54d141108511e22185400ffe received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:40.915520  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-44116e7a54d141108511e22185400ffe on tablet 44116e7a54d141108511e22185400ffe with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:40.901633  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:40.987643  9102 raft_consensus.cc:1217] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:40.992753  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:41.039938  9102 raft_consensus.cc:1217] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:41.045889  8426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:41.046465  8426 raft_consensus.cc:606] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:41.049212  8426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37072d40853c44b1b312489112c9250e"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:41.049724  8426 raft_consensus.cc:606] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:41.051990  8579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:41.052438  8579 raft_consensus.cc:606] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:41.058220  8510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c783a77969844f0b82c1b365e456c651"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:41.058671  8510 raft_consensus.cc:606] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:41.068404  8433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:41.068938  8433 raft_consensus.cc:606] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:41.070644  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:41.072172  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:41.092123  9575 raft_consensus.cc:993] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:41.092597  9504 raft_consensus.cc:1081] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:41.093997  9102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37072d40853c44b1b312489112c9250e"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33884
I20260709 13:00:41.094534  9102 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.094825  9102 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.099210  9102 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.101154  9102 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:41.101302  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:41.101977  8426 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:41.101682  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:41.102403  8426 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:41.102712  8510 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.103193  8426 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.112011  8426 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.115669  8510 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:41.116868  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:00:41.117621  9559 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:41.118115  9559 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:41.118877  9559 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.120762  8426 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:41.128588  8330 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.165328  9504 raft_consensus.cc:993] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:41.165771  9504 raft_consensus.cc:1081] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:41.167073  8579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:00:41.167600  8579 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.167964  8579 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.174842  8579 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:41.176810  8579 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:41.177408  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:41.177731  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:41.178040  8426 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:41.178333  8426 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:41.178308  8510 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.179149  8426 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:41.180256  8426 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.185864  8510 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:41.187084  8547 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:41.187206  8426 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:41.187929  9584 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:41.188393  9584 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:41.189206  9584 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:41.200090  8330 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.234619  9102 raft_consensus.cc:1217] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:41.419569  9476 raft_consensus.cc:993] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:41.420086  9607 raft_consensus.cc:1081] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:41.422295  9102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c783a77969844f0b82c1b365e456c651"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:41.422808  9102 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.423084  9102 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.429700  9102 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.432821  9102 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:41.434893  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:41.435449  8426 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.437844  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:41.438659  8510 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:41.438952  8510 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:41.440079  8510 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.441237  8510 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.444974  9586 raft_consensus.cc:1064] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:41.447436  8426 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:41.447438  9586 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.449182  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:41.450140  9559 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:41.450605  9559 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:41.451404  9559 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.459765  8510 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:41.478531  8330 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.497900  9518 raft_consensus.cc:993] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:41.498492  9518 raft_consensus.cc:1081] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:41.502640  8510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:00:41.503222  8510 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.503618  8510 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.508889  8508 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:41.513132  9559 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:41.516898  9551 raft_consensus.cc:993] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:41.517828  9624 raft_consensus.cc:1081] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:41.518492  9102 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:41.519398  9101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:00:41.519918  9101 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.519805  9551 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:41.520308  9101 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.520588  8435 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:41.522936  9551 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:41.525480  8508 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:41.527261  9551 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:41.530380  9101 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.537731  8510 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:41.543135  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:41.543817  8426 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:41.543706  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:41.544282  8426 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:41.544548  8579 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.545286  8426 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:41.556679  9551 raft_consensus.cc:1064] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:41.559134  8426 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.559581  9551 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.555024  8579 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:41.563150  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:41.563943  8510 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:41.565253  9608 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:41.567266  9608 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:41.568900  9608 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:41.575822  9099 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:41.578598  9626 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:41.585585  8433 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:41.587738  8505 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:41.590878  9626 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:41.592494  8433 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:41.595768  8426 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:41.600924  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:41.598289  9623 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:00:41.625838  8430 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.602218  9559 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:00:41.610392  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:41.630056  8579 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:41.630401  8579 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:41.631349  8579 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.635847  8579 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.634136  8430 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:41.636930  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:41.637902  9559 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:41.638402  9559 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:41.639230  9559 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.640808  9626 raft_consensus.cc:2955] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:41.597486  9101 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:41.678290  9627 raft_consensus.cc:2955] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:41.683007  8507 raft_consensus.cc:2955] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:41.689198  9101 raft_consensus.cc:2955] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:41.693378  9102 raft_consensus.cc:2955] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:41.716277  8330 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.738621  8505 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:41.753863  9586 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:00:41.802512  8426 raft_consensus.cc:2955] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:41.825022  8332 catalog_manager.cc:5697] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:00:41.842344  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 57453.9us
I20260709 13:00:41.834430  8330 catalog_manager.cc:5697] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:41.871410  8333 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:41.892282  9638 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:00:41.909758  8426 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:41.919013  9637 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:00:41.904297  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 77652.1us
I20260709 13:00:41.933763  9648 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:00:41.938196  9476 raft_consensus.cc:1064] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:41.943106  9476 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.945334  8510 raft_consensus.cc:2955] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:41.938125  8579 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:41.953130  8433 raft_consensus.cc:2955] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:41.964300  8430 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:41.966259  9562 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:41.974068  8579 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:41.981155  9102 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:41.982738  9649 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:41.990664  9649 raft_consensus.cc:2955] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:41.998739  9102 raft_consensus.cc:2955] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.012650  8426 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:42.017706  9101 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:42.019949  9101 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Advancing to term 2
I20260709 13:00:42.023522  9642 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:42.029604  8584 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:42.037662  9101 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:42.046823  8333 catalog_manager.cc:5697] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.049978  8435 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.094614  9644 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:42.054780  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c0a41ce5cf754ad58e31f5e764daa48f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:42.103731  9623 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:42.116694  9608 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:42.115784  8579 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.144567  8428 raft_consensus.cc:2955] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.066483  8504 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.074267  8430 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:42.083397  8584 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:42.052817  9607 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:00:42.088019  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:42.189970  9101 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:42.191390  9562 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:42.173132  9559 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:00:42.204689  9476 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:42.221685  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 50338.2us
I20260709 13:00:42.222891  9626 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:00:42.225131  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 90996.5us
W20260709 13:00:42.231501  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 62954.3us
I20260709 13:00:42.234603  8583 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:42.248019  9476 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:42.250475  9567 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:42.271337  8427 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:42.272224  8430 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:42.288741  9608 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:42.290434  9643 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:00:42.304730  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet c0a41ce5cf754ad58e31f5e764daa48f with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:42.315418  9648 raft_consensus.cc:2955] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.316865  9608 raft_consensus.cc:1064] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:42.318945  9100 raft_consensus.cc:2955] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.349145  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7dfd08eb514418f81f0ba7777a079e8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:42.368824  9665 tablet_replica.cc:333] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:42.369906  9665 raft_consensus.cc:2243] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:42.370692  9665 raft_consensus.cc:2272] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:42.376639  9665 ts_tablet_manager.cc:1916] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:00:42.378162  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 70587.9us
I20260709 13:00:42.398598  9608 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:42.411136  8329 catalog_manager.cc:5697] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.416846  9662 raft_consensus.cc:2955] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.434316  8427 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:42.434787  8579 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:42.437001  9608 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:42.439059  8430 raft_consensus.cc:2955] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.445422  9100 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:42.449154  8427 raft_consensus.cc:2955] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.450680  8582 raft_consensus.cc:2955] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.455272  9476 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:42.455960  9608 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:42.461282  9665 ts_tablet_manager.cc:1929] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:42.461813  9665 log.cc:1199] T c0a41ce5cf754ad58e31f5e764daa48f P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/c0a41ce5cf754ad58e31f5e764daa48f
I20260709 13:00:42.463963  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet c0a41ce5cf754ad58e31f5e764daa48f (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:42.470156  9100 raft_consensus.cc:2955] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.486274  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet b7dfd08eb514418f81f0ba7777a079e8 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:42.487365  9665 tablet_replica.cc:333] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:42.500200  9642 raft_consensus.cc:2955] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.501591  8329 catalog_manager.cc:5697] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.515782  8427 raft_consensus.cc:2955] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.524981  9100 raft_consensus.cc:2955] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.546238  9665 raft_consensus.cc:2243] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:42.547114  9665 raft_consensus.cc:2272] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:42.548189  8333 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.555231  8582 raft_consensus.cc:2955] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.558225  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:42.557329  9665 ts_tablet_manager.cc:1916] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:42.575050  8504 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:42.581219  8510 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:42.587121  8582 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:42.587911  9102 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.591202  9100 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:42.588610  8427 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.596196  9476 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:42.598635  9665 ts_tablet_manager.cc:1929] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:42.599124  9665 log.cc:1199] T b7dfd08eb514418f81f0ba7777a079e8 P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/b7dfd08eb514418f81f0ba7777a079e8
I20260709 13:00:42.600924  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet b7dfd08eb514418f81f0ba7777a079e8 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:42.603045  9476 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:42.605144  9608 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:42.604780  9662 raft_consensus.cc:2955] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.606395  8427 raft_consensus.cc:2955] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.608209  9608 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:42.617617  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2a5011db54b4e9f85a54c19ade01aa8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:42.624224  9642 raft_consensus.cc:2955] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.627398  9100 raft_consensus.cc:2955] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.635581  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44116e7a54d141108511e22185400ffe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:42.641407  8332 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 4 to 5, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.650137  8584 raft_consensus.cc:2955] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.658736  9102 raft_consensus.cc:2955] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:42.662688  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet f2a5011db54b4e9f85a54c19ade01aa8 with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:42.682922  8333 catalog_manager.cc:5697] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.685281  9671 tablet_replica.cc:333] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:42.688824  9671 raft_consensus.cc:2243] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:42.689549  9671 raft_consensus.cc:2272] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:42.693619  9671 ts_tablet_manager.cc:1916] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:42.700803  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet 44116e7a54d141108511e22185400ffe with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:42.702520  9672 tablet_replica.cc:333] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:42.703274  9672 raft_consensus.cc:2243] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:42.703903  9672 raft_consensus.cc:2272] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:42.708729  9672 ts_tablet_manager.cc:1916] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:42.717103  9671 ts_tablet_manager.cc:1929] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:42.717553  9671 log.cc:1199] T f2a5011db54b4e9f85a54c19ade01aa8 P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/f2a5011db54b4e9f85a54c19ade01aa8
I20260709 13:00:42.718559  8427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:42.719154  8427 raft_consensus.cc:606] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:42.719916  9672 ts_tablet_manager.cc:1929] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:42.720219  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet f2a5011db54b4e9f85a54c19ade01aa8 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:42.720394  9672 log.cc:1199] T 44116e7a54d141108511e22185400ffe P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/44116e7a54d141108511e22185400ffe
I20260709 13:00:42.723656  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet 44116e7a54d141108511e22185400ffe (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:42.726318  8430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:42.726866  8430 raft_consensus.cc:606] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:42.730229  8504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:42.730830  8504 raft_consensus.cc:606] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:42.733017  8584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:42.733429  8584 raft_consensus.cc:606] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:42.735599  8430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:42.736140  8430 raft_consensus.cc:606] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:42.737089  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:42.738538  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:42.838004  9642 raft_consensus.cc:993] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:42.838583  9662 raft_consensus.cc:1081] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:42.840080  9100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:42.840569  9100 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:42.840837  9100 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:42.844632  9100 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:42.845904  9100 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:42.846570  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:42.846717  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:42.847090  8504 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:42.847222  8584 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:42.847637  8504 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:42.848384  8504 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:42.849292  8504 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:42.851796  8584 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:42.852785  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:00:42.853526  9559 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:42.853973  9559 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:42.855234  8504 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:42.854887  9559 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:42.865061  8329 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.895237  9648 raft_consensus.cc:993] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:42.895741  9551 raft_consensus.cc:1081] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:42.897325  8504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59098
I20260709 13:00:42.897810  8504 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:42.898151  8504 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:42.903131  8504 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:42.904682  8504 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:42.905319  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:42.905926  8430 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:42.906697  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:42.908597  8584 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:42.908947  8584 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:42.909857  8584 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:42.910971  8584 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:42.912189  8430 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:42.913318  8476 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:42.914089  9662 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:42.914531  9662 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:42.915584  8584 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:42.915338  9662 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:42.928489  8329 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.009657  9548 raft_consensus.cc:993] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:43.010206  9548 raft_consensus.cc:1081] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:43.011603  8579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:00:43.012148  8579 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:43.012558  8579 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.018683  8579 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:43.021625  8579 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:43.022804  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:43.022939  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:43.023448  8510 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.023576  8430 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:43.023994  8430 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:43.024770  8430 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:43.025540  8430 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.028831  8510 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:43.029726  8504 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:43.029917  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:43.030781  9551 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:43.031615  9551 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:43.031668  8430 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:43.032781  9551 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:43.045065  8329 catalog_manager.cc:5697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.096781  9548 raft_consensus.cc:993] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:43.097208  9673 raft_consensus.cc:1081] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:43.098522  9102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33884
I20260709 13:00:43.098943  9102 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:43.099205  9102 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.103597  9102 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:43.105352  9102 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:43.105783  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:43.105783  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:43.106514  8504 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.106594  8430 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:43.107038  8430 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:43.107717  8430 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:43.108619  8430 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.111670  8504 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:43.112592  9065 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:00:43.113092  8430 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:43.113375  9559 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:43.113863  9559 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:43.114703  9559 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:43.121693  8329 catalog_manager.cc:5697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.252374  9548 raft_consensus.cc:993] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:43.252839  9673 raft_consensus.cc:1081] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:43.254529  8579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:00:43.255143  8579 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:43.255517  8579 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.260294  8579 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:43.262426  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:43.262621  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:43.262967  8430 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:43.263221  8504 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.264427  8579 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:43.264617  8430 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:43.265892  8430 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:43.266809  8430 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.269164  8504 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:43.270251  8547 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:43.270849  9648 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:43.271297  9648 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:43.271849  8430 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:43.272706  9648 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:43.283080  8329 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:43.384167  8510 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:43.385456  9559 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:43.394596  8579 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:43.396950  8430 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:43.397593  9562 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:43.399520  9662 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.406235  8582 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:43.407749  9662 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.452836  8430 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:43.454160  9551 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.467460  8510 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:43.468839  9551 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.524183  8430 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:43.525285  9559 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:43.533811  8510 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:43.536729  9559 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:43.695915  8430 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:43.696990  9648 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.710908  8510 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:43.722093  9551 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.739369  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:43.791172  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:43.794463  8504 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:43.800628  8579 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:43.800885  8427 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:43.802265  8475 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9e03855c7c944d6a2bd32561a407196. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:43.802345  9642 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.803418  9662 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.817705  9662 raft_consensus.cc:2955] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:43.819623  8579 raft_consensus.cc:2955] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:43.834623  8427 raft_consensus.cc:2955] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:43.838857  8582 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:43.849957  8333 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.872159  8504 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:43.873700  9648 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.875198  8426 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:43.876809  8549 consensus_peers.cc:597] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf4548803154450a8b2b2d3ee14dd41a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:43.877400  9696 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.891073  8427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:43.891701  8427 raft_consensus.cc:606] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:43.895463  8510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "337d7e57df5f492daf49939f167561a0"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:43.896255  8510 raft_consensus.cc:606] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:43.898229  9648 raft_consensus.cc:2955] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:43.900488  8582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:43.899887  8426 raft_consensus.cc:2955] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:43.900902  8582 raft_consensus.cc:606] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:43.902064  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:43.903107  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:43.906256  8504 raft_consensus.cc:2955] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:43.916440  8329 catalog_manager.cc:5697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.923923  8504 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:43.935993  9673 raft_consensus.cc:993] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:43.936522  9673 raft_consensus.cc:1081] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:43.937984  8582 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:43.938216  8579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:00:43.938752  8579 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:43.939083  8579 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.940670  8426 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:43.941533  8475 consensus_peers.cc:597] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 956b0163855b4f329c033879d86cd33b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:43.941869  9608 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.942775  9662 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:43.945502  8579 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:43.952087  8579 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:43.952998  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:43.953438  8427 raft_consensus.cc:3055] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:43.953662  8427 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:43.954356  8427 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:43.955236  8427 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.958326  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:43.958849  8510 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:43.962667  9608 raft_consensus.cc:2955] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:43.968865  8510 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:43.969256  8582 raft_consensus.cc:2955] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:43.970104  8547 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:43.970248  8430 raft_consensus.cc:2955] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:43.971575  9648 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:43.972054  9648 raft_consensus.cc:697] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:43.972810  9648 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:43.990788  8427 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:44.011765  8333 catalog_manager.cc:5697] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:44.013315  8333 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:44.015771  8426 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:44.034502  8582 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:44.035631  8504 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:44.036998  9673 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:44.041337  8400 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a12a506b127d40b1acc72c04ae2f5a40. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:44.044049  9548 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:44.055567  9548 raft_consensus.cc:2955] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:44.057281  8579 raft_consensus.cc:2955] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:44.061368  8504 raft_consensus.cc:2955] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:44.071455  8333 catalog_manager.cc:5697] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:44.339323  9715 ts_tablet_manager.cc:933] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:44.340921  9715 tablet_copy_client.cc:323] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:44.342298  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet b9e03855c7c944d6a2bd32561a407196 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:44.342810  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet b9e03855c7c944d6a2bd32561a407196 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-b9e03855c7c944d6a2bd32561a407196
I20260709 13:00:44.350147  8520 tablet_copy_source_session.cc:215] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:44.353199  9715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e03855c7c944d6a2bd32561a407196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:44.366760  9715 tablet_copy_client.cc:806] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:44.367362  9715 tablet_copy_client.cc:670] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:44.371115  9715 tablet_copy_client.cc:538] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:44.382112  9715 tablet_bootstrap.cc:492] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:44.392774  8504 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:44.394884  9648 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:44.395385  9662 raft_consensus.cc:993] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:44.395848  9662 raft_consensus.cc:1081] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:44.398154  9102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "337d7e57df5f492daf49939f167561a0"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:44.398762  9102 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:44.399137  9102 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:44.405622  9102 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:44.411455  9102 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:44.412668  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:44.413228  8504 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:44.413486  8504 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:44.415498  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:44.416432  8579 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:44.416584  8504 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:44.418449  8504 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:44.423491  8579 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:44.424995  9718 ts_tablet_manager.cc:933] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:44.427172  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:00:44.427953  9693 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:44.428418  9693 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:44.429467  9693 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:44.454380  8329 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:44.460886  9715 tablet_bootstrap.cc:492] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.461761  9715 tablet_bootstrap.cc:492] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:44.465641  9715 ts_tablet_manager.cc:1403] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.084s	user 0.025s	sys 0.000s
I20260709 13:00:44.469810  9715 raft_consensus.cc:359] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:44.470631  9715 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:44.472618  9726 ts_tablet_manager.cc:933] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:44.479568  9715 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:44.483786  9726 tablet_copy_client.cc:323] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:44.486533  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet 956b0163855b4f329c033879d86cd33b from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:44.487069  9715 ts_tablet_manager.cc:1434] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:00:44.487102  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet 956b0163855b4f329c033879d86cd33b from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-956b0163855b4f329c033879d86cd33b
I20260709 13:00:44.488879  8519 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-b9e03855c7c944d6a2bd32561a407196 received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:44.489285  8519 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-b9e03855c7c944d6a2bd32561a407196 on tablet b9e03855c7c944d6a2bd32561a407196 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:44.504288  9715 ts_tablet_manager.cc:933] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:44.604192  8426 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:44.607892  8520 tablet_copy_source_session.cc:215] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:44.609548  8504 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
W20260709 13:00:44.610844  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 168167us
I20260709 13:00:44.625275  9724 raft_consensus.cc:993] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:44.625746  9724 raft_consensus.cc:1081] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:44.629724  9648 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:44.649271  9718 tablet_copy_client.cc:323] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:44.651515  8504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59098
I20260709 13:00:44.653385  8504 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:44.653815  8504 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:44.660419  8504 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:44.663645  9726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956b0163855b4f329c033879d86cd33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:44.664287  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:44.664810  8430 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:44.666247  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet cf4548803154450a8b2b2d3ee14dd41a from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:44.666774  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet cf4548803154450a8b2b2d3ee14dd41a from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-cf4548803154450a8b2b2d3ee14dd41a
I20260709 13:00:44.670925  8430 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:44.672217  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:44.673009  9662 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:44.673434  9662 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:44.674261  9662 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:44.678686  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:44.679203  8579 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:44.679471  8579 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:44.680128  8579 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:44.681094  8579 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:44.687397  8579 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:44.688777  8504 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:44.693897  8594 tablet_copy_source_session.cc:215] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:44.696599  9715 tablet_copy_client.cc:323] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:44.699682  9718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4548803154450a8b2b2d3ee14dd41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:44.708668  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet a12a506b127d40b1acc72c04ae2f5a40 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:44.709234  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet a12a506b127d40b1acc72c04ae2f5a40 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-a12a506b127d40b1acc72c04ae2f5a40
I20260709 13:00:44.712571  8329 catalog_manager.cc:5697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:44.717298  9718 tablet_copy_client.cc:806] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:44.718387  8445 tablet_copy_source_session.cc:215] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:44.723784  9718 tablet_copy_client.cc:670] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:44.727837  9718 tablet_copy_client.cc:538] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:44.750650  9715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12a506b127d40b1acc72c04ae2f5a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:44.769104  9718 tablet_bootstrap.cc:492] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:44.778558  9726 tablet_copy_client.cc:806] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:44.779260  9726 tablet_copy_client.cc:670] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:44.795511  9100 raft_consensus.cc:1217] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:44.819331  9718 tablet_bootstrap.cc:492] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:44.818902  9726 tablet_copy_client.cc:538] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:44.820492  9718 tablet_bootstrap.cc:492] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:44.822139  9715 tablet_copy_client.cc:806] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:44.822494  9718 ts_tablet_manager.cc:1403] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.000s
I20260709 13:00:44.822738  9715 tablet_copy_client.cc:670] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:44.827569  9718 raft_consensus.cc:359] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:44.829958  9718 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:44.830753  9718 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:44.833670  9718 ts_tablet_manager.cc:1434] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:00:44.847548  9715 tablet_copy_client.cc:538] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:44.867039  9726 tablet_bootstrap.cc:492] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:44.911229  9715 tablet_bootstrap.cc:492] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:44.906780  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:44.993808  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-cf4548803154450a8b2b2d3ee14dd41a received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:44.994305  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-cf4548803154450a8b2b2d3ee14dd41a on tablet cf4548803154450a8b2b2d3ee14dd41a with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:45.002481  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:45.021873  9726 tablet_bootstrap.cc:492] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:45.024308  9726 tablet_bootstrap.cc:492] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:45.025132  9726 ts_tablet_manager.cc:1403] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.158s	user 0.017s	sys 0.011s
I20260709 13:00:45.034096  9726 raft_consensus.cc:359] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:45.035115  9726 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:45.036103  9726 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:45.039361  9726 ts_tablet_manager.cc:1434] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:00:45.041206  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-956b0163855b4f329c033879d86cd33b received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:45.041607  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-956b0163855b4f329c033879d86cd33b on tablet 956b0163855b4f329c033879d86cd33b with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:45.055718  8505 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:45.120187  8582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:45.120831  8582 raft_consensus.cc:606] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:45.122627  9100 raft_consensus.cc:1217] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:45.127056  9715 tablet_bootstrap.cc:492] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:45.128154  9715 tablet_bootstrap.cc:492] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:45.128914  9715 ts_tablet_manager.cc:1403] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.218s	user 0.025s	sys 0.017s
I20260709 13:00:45.131520  9102 raft_consensus.cc:1217] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:45.133267  9715 raft_consensus.cc:359] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:45.134666  9715 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:45.139439  8584 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:45.142086  8504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:45.135682  9715 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:45.142622  8504 raft_consensus.cc:606] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Received request to transfer leadership to TS dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:45.144381  8426 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:45.145700  9715 ts_tablet_manager.cc:1434] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:00:45.145758  9608 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:45.147522  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-a12a506b127d40b1acc72c04ae2f5a40 received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:45.147939  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-a12a506b127d40b1acc72c04ae2f5a40 on tablet a12a506b127d40b1acc72c04ae2f5a40 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:45.151643  8426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:45.152208  8426 raft_consensus.cc:606] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:45.155411  8584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:45.155941  8584 raft_consensus.cc:606] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:45.157904  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:45.159548  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:45.065742  9559 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:00:45.172859  9741 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:45.193055  8583 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:45.199426  9662 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:45.225469  9662 raft_consensus.cc:993] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:45.226002  9662 raft_consensus.cc:1081] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Signalling peer dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:45.228394  8426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:52372
I20260709 13:00:45.229190  8426 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.229696  8426 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:45.268631  9746 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:45.264771  8426 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:45.296762  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:45.297410  8584 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.297571  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:45.298237  8508 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:45.298503  8508 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:45.299202  8508 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:45.300117  8508 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.305035  8584 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:45.306553  8508 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:45.306788  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:45.307639  9736 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:45.308115  9736 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:45.308979  9736 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:45.335153  8426 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:45.339740  9724 raft_consensus.cc:993] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:45.340226  9724 raft_consensus.cc:1081] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:45.346231  8426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:60094
I20260709 13:00:45.346764  8426 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.347095  8426 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.355530  8426 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:45.358471  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:45.358987  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:00:45.359987  8583 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:45.360035  9102 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.359431  8426 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:45.366777  9102 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:45.360431  8583 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:45.368597  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:45.368993  8583 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:45.369405  9736 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:45.370149  9736 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:45.371035  9736 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:45.370252  8583 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.380012  8583 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:45.385654  8331 catalog_manager.cc:5697] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.400177  9733 raft_consensus.cc:1064] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:45.402076  9733 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:45.415257  8583 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:45.416646  9608 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.418234  8430 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:45.418867  9102 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:45.419488  9608 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:45.420460  9642 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.440181  9662 raft_consensus.cc:2955] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.437067  8330 catalog_manager.cc:5697] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.443219  9100 raft_consensus.cc:1217] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:45.445590  9101 raft_consensus.cc:2955] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.456949  8426 raft_consensus.cc:2955] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.469012  9642 raft_consensus.cc:1064] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:45.468876  8583 raft_consensus.cc:2955] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.471145  9642 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:45.482738  8333 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.490077  9736 raft_consensus.cc:993] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:45.490697  9736 raft_consensus.cc:1081] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:45.492954  8582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:00:45.493598  8582 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.493988  8582 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.498121  8584 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:45.498159  8426 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:45.499739  9662 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.500705  9608 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.500953  9100 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:45.503499  9608 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.508297  8508 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:45.516021  8430 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:45.517899  9608 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:45.519743  9100 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:45.521028  9608 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:45.538540  9733 raft_consensus.cc:2955] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.547972  9100 raft_consensus.cc:2955] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.549568  8430 raft_consensus.cc:2955] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.538543  8582 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:45.554450  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:45.555014  8428 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:45.555311  8428 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:45.556057  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9e03855c7c944d6a2bd32561a407196 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:45.556357  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:45.556902  8508 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.556061  8582 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:45.556084  8428 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:45.563761  8428 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.567387  9738 raft_consensus.cc:2955] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.574142  8508 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:45.575162  8547 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:45.575860  9725 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:45.576321  9725 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:45.577198  9725 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:45.569689  9100 raft_consensus.cc:2955] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.580296  8428 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:45.582679  9648 raft_consensus.cc:1064] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:45.578866  8330 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:45.585002  9648 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:45.589663  9744 raft_consensus.cc:993] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:45.590209  9744 raft_consensus.cc:1081] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:45.590677  8584 raft_consensus.cc:2955] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.591634  8508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59098
I20260709 13:00:45.592128  8508 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:45.592448  8508 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.609747  8508 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:45.611438  8508 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:45.612511  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:45.613168  8584 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:45.613476  8584 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:45.614148  8584 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:45.615274  8584 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.615729  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:45.616350  8427 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.621852  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e03855c7c944d6a2bd32561a407196 with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:45.622133  8584 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:45.623301  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:45.623608  8332 catalog_manager.cc:5697] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.625377  9608 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:45.625984  9608 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:45.626899  9608 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:45.635170  8331 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.640892  9770 tablet_replica.cc:333] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:45.643855  8427 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:45.647768  8504 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:45.650357  9725 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.654606  9100 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:45.655210  9770 raft_consensus.cc:2243] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:45.656374  9696 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.657810  9770 raft_consensus.cc:2272] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:45.661676  9770 ts_tablet_manager.cc:1916] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:45.616799  8428 raft_consensus.cc:2955] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.666165  9696 raft_consensus.cc:2955] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.670951  8435 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:45.677903  9725 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:45.691462  8510 raft_consensus.cc:2955] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.695144  8331 catalog_manager.cc:5697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.718531  8330 catalog_manager.cc:5697] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.719545  8504 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:45.719343  9770 ts_tablet_manager.cc:1929] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:45.723033  9770 log.cc:1199] T b9e03855c7c944d6a2bd32561a407196 P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/b9e03855c7c944d6a2bd32561a407196
I20260709 13:00:45.724337  9101 raft_consensus.cc:2955] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.731196  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet b9e03855c7c944d6a2bd32561a407196 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:45.738907  8582 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:45.738965  9100 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:45.741281  9608 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:45.743381  9733 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:45.755190  9100 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:45.755038  9662 raft_consensus.cc:2955] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.759518  9102 raft_consensus.cc:2955] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.762609  8584 raft_consensus.cc:2955] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.762476  8427 raft_consensus.cc:2955] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.763051  8582 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:45.781922  8504 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:45.782156  9099 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:45.783480  9648 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:45.786293  9648 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:45.791266  9648 raft_consensus.cc:2955] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.793944  9099 raft_consensus.cc:2955] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.794893  8504 raft_consensus.cc:2955] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.801120  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 956b0163855b4f329c033879d86cd33b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:45.812995  9736 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:45.818403  8332 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.822623  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf4548803154450a8b2b2d3ee14dd41a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:45.832912  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet 956b0163855b4f329c033879d86cd33b with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:45.832703  8330 catalog_manager.cc:5697] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 1 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:45.834547  9777 tablet_replica.cc:333] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:45.835423  9777 raft_consensus.cc:2243] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:45.836090  9777 raft_consensus.cc:2272] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:45.838938  8582 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:45.840175  9777 ts_tablet_manager.cc:1916] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:45.842599  9548 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:45.846056  8504 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:45.848728  9548 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:45.853215  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet cf4548803154450a8b2b2d3ee14dd41a with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:45.856986  9777 ts_tablet_manager.cc:1929] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:45.857430  9777 log.cc:1199] T 956b0163855b4f329c033879d86cd33b P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/956b0163855b4f329c033879d86cd33b
I20260709 13:00:45.860010  9777 tablet_replica.cc:333] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:45.861649  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet 956b0163855b4f329c033879d86cd33b (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:45.865334  9777 raft_consensus.cc:2243] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:45.866058  9777 raft_consensus.cc:2272] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:45.876830  9777 ts_tablet_manager.cc:1916] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:45.886301  8583 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:45.888268  9774 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:45.903620  9777 ts_tablet_manager.cc:1929] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:45.904198  9777 log.cc:1199] T cf4548803154450a8b2b2d3ee14dd41a P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/cf4548803154450a8b2b2d3ee14dd41a
I20260709 13:00:45.905766  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet cf4548803154450a8b2b2d3ee14dd41a (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
W20260709 13:00:45.924333  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800039900 after lost signal to thread 7338
W20260709 13:00:45.925470  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800034fe0 after lost signal to thread 8367
W20260709 13:00:45.926674  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4520 after lost signal to thread 8459
W20260709 13:00:45.927745  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800321b60 after lost signal to thread 8534
W20260709 13:00:45.928762  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6b60 after lost signal to thread 8608
W20260709 13:00:45.931787  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800051b60 after lost signal to thread 9126
I20260709 13:00:46.009903  8510 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:46.012873  9725 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:46.041419  9099 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Advancing to term 2
I20260709 13:00:46.043510  8583 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:46.063843  9662 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:46.076938  9099 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:46.080623  9724 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:46.087543  8427 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:46.089212  9696 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:46.137734  8426 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:46.160482  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:46.166087  9642 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:46.177920  9725 raft_consensus.cc:1064] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:46.180246  9725 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:46.192816  9099 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:46.194391  9696 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:46.196154  8427 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:46.196759  8504 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:46.198624  9696 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:46.208942  9724 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:46.237789  9724 raft_consensus.cc:2955] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:46.241289  9099 raft_consensus.cc:2955] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:46.256534  8430 raft_consensus.cc:2955] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:46.278185  8331 catalog_manager.cc:5697] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 2 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:46.291601  8507 raft_consensus.cc:2955] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:46.300365  8582 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:46.320614  8430 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:46.324158  9725 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:46.328058  9101 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:46.331231  9725 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:46.343343  9724 raft_consensus.cc:2955] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:46.354557  9100 raft_consensus.cc:2955] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:46.360638  8430 raft_consensus.cc:2955] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:46.369856  8331 catalog_manager.cc:5697] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 4 to 5, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:46.373442  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a12a506b127d40b1acc72c04ae2f5a40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:46.392560  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet a12a506b127d40b1acc72c04ae2f5a40 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:46.394670  9789 tablet_replica.cc:333] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:46.401753  9789 raft_consensus.cc:2243] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:46.402545  9789 raft_consensus.cc:2272] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:46.404366  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:46.407318  9789 ts_tablet_manager.cc:1916] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:46.428887  9789 ts_tablet_manager.cc:1929] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:46.429276  9789 log.cc:1199] T a12a506b127d40b1acc72c04ae2f5a40 P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/a12a506b127d40b1acc72c04ae2f5a40
I20260709 13:00:46.431030  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet a12a506b127d40b1acc72c04ae2f5a40 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:46.449735  8430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:46.450320  8430 raft_consensus.cc:606] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:46.452858  8430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:46.453274  8430 raft_consensus.cc:606] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:46.455789  8582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77b025d136d04841aa2759be7b816f77"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:46.456210  8582 raft_consensus.cc:606] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:46.458492  8510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:46.459066  8510 raft_consensus.cc:606] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:46.460249  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:46.461400  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:46.469043  9662 raft_consensus.cc:993] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:46.469467  9642 raft_consensus.cc:1081] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:46.471110  9100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:46.471540  9100 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:46.471813  9100 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.478091  9100 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:46.480089  9100 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:46.480683  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:46.481241  8430 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.481755  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:46.482362  8510 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:46.482722  8510 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:46.483549  8510 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:46.484894  8510 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.487257  8430 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:46.488598  9068 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:46.489424  9559 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:46.489835  9559 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:46.490542  9559 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:46.494241  8510 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:46.498595  8331 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.512329  9548 raft_consensus.cc:993] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:46.512739  9735 raft_consensus.cc:1081] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:46.514072  8582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:00:46.514559  8582 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:46.514856  8582 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.547860  9744 raft_consensus.cc:993] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:46.549077  9744 raft_consensus.cc:1081] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:46.550549  8507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77b025d136d04841aa2759be7b816f77"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59098
I20260709 13:00:46.551120  8507 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:46.552116  8507 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.552822  8582 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:46.559507  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:46.559762  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:46.560148  8510 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.560485  8427 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:46.561059  8427 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:46.561882  8427 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:46.566298  8427 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.566569  8582 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:46.567420  8507 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:46.571241  8507 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:46.572415  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:00:46.572947  9100 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.576843  8510 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:00:46.574091  8427 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:00:46.578136  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:46.581769  9100 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:46.581830  9725 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:46.582777  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:46.582803  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:00:46.583452  8582 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:46.583774  8582 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:46.583807  9733 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:46.583989  9725 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:46.584362  9733 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:46.584614  8582 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:46.585088  9725 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:46.585265  9733 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:46.585887  8582 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.593261  8582 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:46.674289  8333 catalog_manager.cc:5697] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 3, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.661851  8331 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.691300  9548 raft_consensus.cc:993] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:46.692173  9735 raft_consensus.cc:1081] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:46.709977  8579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:00:46.710920  8579 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:46.711467  8579 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.729069  8579 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:46.734664  8579 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:46.734798  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:46.735554  8430 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:46.735790  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:46.735929  8430 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:46.736572  8510 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.737063  8430 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:46.746827  8430 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.767208  8510 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:46.768618  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:46.769829  9744 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:46.770339  9744 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:46.771447  9744 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:46.772626  8430 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:46.792439  8333 catalog_manager.cc:5697] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:46.934397  8510 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:46.935999  9559 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:46.959681  8430 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:46.963204  9797 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:47.000510  9101 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:47.002622  9608 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:47.025729  8507 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:47.037400  9648 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:47.047063  8584 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:47.049140  9662 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:47.074875  8430 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:47.078504  9724 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:47.235960  8510 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:47.237362  9648 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:47.252507  8428 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:47.254392  9725 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:47.462448  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:47.476887  8510 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:47.492841  8428 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:47.494473  9733 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:47.498570  8584 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:47.512609  9662 raft_consensus.cc:2955] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.514108  8428 raft_consensus.cc:2955] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
W20260709 13:00:47.519153  8475 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc7e6e656d324c0bad9eee744f6f1886. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:47.543983  9733 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:47.573495  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:47.583051  8426 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:47.586138  8333 catalog_manager.cc:5697] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
W20260709 13:00:47.594952  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 51725.6us
I20260709 13:00:47.621142  8579 raft_consensus.cc:2955] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.634442  8582 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:47.642886  8510 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:47.637243  8400 consensus_peers.cc:597] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f25688d717bb4dae964fead4a15af269. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:47.645583  9548 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:47.646656  9792 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:47.699326  9548 raft_consensus.cc:2955] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.704759  8510 raft_consensus.cc:2955] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.708050  8579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:47.710749  8579 raft_consensus.cc:606] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:47.715533  8504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:47.716147  8504 raft_consensus.cc:606] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Received request to transfer leadership to TS dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:47.718312  8582 raft_consensus.cc:2955] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.719192  8507 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:47.720468  8330 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.727609  8579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:47.728284  8579 raft_consensus.cc:606] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:47.732224  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:47.741298  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:47.749079  8579 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:47.751012  8475 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8fff54c32b2248dca5e70dc82b71155d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:47.752064  9662 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:47.755295  8426 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:47.757050  9733 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:47.759897  9811 raft_consensus.cc:2955] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.765763  8579 raft_consensus.cc:2955] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.777923  8583 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:47.777638  8330 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.782353  8428 raft_consensus.cc:2955] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.805431  8510 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:00:47.806740  8549 consensus_peers.cc:597] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b195ca1ba0c4d7e993f9dc2d1a12629. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:47.806936  9744 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:47.826927  8427 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:47.830526  9725 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:47.828644  9724 raft_consensus.cc:2955] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.830546  8510 raft_consensus.cc:2955] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.856935  9828 raft_consensus.cc:993] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:47.879731  9829 raft_consensus.cc:1081] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:47.855547  8427 raft_consensus.cc:2955] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.898715  8330 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:47.914655  9834 raft_consensus.cc:993] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:47.916374  9832 raft_consensus.cc:1081] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:47.936174  8510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59098
I20260709 13:00:47.936712  8510 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.937080  8510 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:47.943078  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 94343.2us
I20260709 13:00:47.947304  8428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:60094
I20260709 13:00:47.947968  8428 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.948338  8428 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.947337  8510 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:47.955863  8428 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:47.961736  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:47.962384  8426 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.963219  8428 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:47.964335  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:00:47.964942  9101 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.970003  8426 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:47.971576  8476 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:47.974016  9733 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:47.974489  9733 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:47.975348  9733 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:47.986590  8510 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:47.992334  9101 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:48.003803  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:48.004711  9548 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.005149  9548 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:48.005944  9548 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:48.001292  9835 ts_tablet_manager.cc:933] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:48.008250  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:48.008836  8579 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.009111  8579 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:48.009220  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:48.009747  8583 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.010077  8583 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:48.009868  8579 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:48.011138  8579 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.010820  8583 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:48.012008  8583 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.026091  8330 catalog_manager.cc:5697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.032912  9642 raft_consensus.cc:993] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:48.033365  9642 raft_consensus.cc:1081] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Signalling peer dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:48.033301  8579 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:48.038208  8583 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:48.044086  8426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:52372
I20260709 13:00:48.044662  8426 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.045441  8426 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.056461  8426 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:48.059414  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:48.060004  8507 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.060276  8507 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:48.060581  8426 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:48.061057  8507 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:48.057025  8330 catalog_manager.cc:5697] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.062117  8507 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.072105  8507 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:48.076068  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:48.076860  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:48.077302  8579 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.077747  9548 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.078475  9548 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:48.079299  9548 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:48.076846  9835 tablet_copy_client.cc:323] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:48.084336  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet bc7e6e656d324c0bad9eee744f6f1886 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:48.085034  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet bc7e6e656d324c0bad9eee744f6f1886 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-bc7e6e656d324c0bad9eee744f6f1886
I20260709 13:00:48.094430  8520 tablet_copy_source_session.cc:215] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:48.095018  8579 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:48.098680  9835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7e6e656d324c0bad9eee744f6f1886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:48.106140  8330 catalog_manager.cc:5697] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.109763  9840 ts_tablet_manager.cc:933] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:48.134089  9835 tablet_copy_client.cc:806] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:48.134872  9835 tablet_copy_client.cc:670] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:48.139802  9835 tablet_copy_client.cc:538] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:48.147596  9840 tablet_copy_client.cc:323] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:48.149717  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet f25688d717bb4dae964fead4a15af269 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:48.150295  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet f25688d717bb4dae964fead4a15af269 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-f25688d717bb4dae964fead4a15af269
I20260709 13:00:48.150905  9835 tablet_bootstrap.cc:492] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:48.163141  8445 tablet_copy_source_session.cc:215] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:48.166910  9840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f25688d717bb4dae964fead4a15af269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:48.195230  9835 tablet_bootstrap.cc:492] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:48.196216  9835 tablet_bootstrap.cc:492] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:48.196905  9835 ts_tablet_manager.cc:1403] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.010s
I20260709 13:00:48.201426  9840 tablet_copy_client.cc:806] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:48.202175  9840 tablet_copy_client.cc:670] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:48.206845  9835 raft_consensus.cc:359] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:48.209709  9840 tablet_copy_client.cc:538] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:48.210796  9835 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:48.226284  9835 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:48.232120  9843 ts_tablet_manager.cc:933] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:48.234311  9835 ts_tablet_manager.cc:1434] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 13:00:48.240149  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-bc7e6e656d324c0bad9eee744f6f1886 received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:48.240614  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-bc7e6e656d324c0bad9eee744f6f1886 on tablet bc7e6e656d324c0bad9eee744f6f1886 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:48.221444  9840 tablet_bootstrap.cc:492] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:48.258893  9843 tablet_copy_client.cc:323] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:48.261500  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet 8fff54c32b2248dca5e70dc82b71155d from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:48.262035  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet 8fff54c32b2248dca5e70dc82b71155d from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-8fff54c32b2248dca5e70dc82b71155d
I20260709 13:00:48.309453  8520 tablet_copy_source_session.cc:215] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:48.313392  9843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fff54c32b2248dca5e70dc82b71155d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:48.328776  9843 tablet_copy_client.cc:806] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:48.329372  9843 tablet_copy_client.cc:670] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:48.333053  9843 tablet_copy_client.cc:538] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:48.340981  9840 tablet_bootstrap.cc:492] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:48.341920  9840 tablet_bootstrap.cc:492] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:48.342963  9840 ts_tablet_manager.cc:1403] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.122s	user 0.030s	sys 0.037s
I20260709 13:00:48.353431  9840 raft_consensus.cc:359] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:48.354488  9840 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:48.355237  9840 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:48.375445  9840 ts_tablet_manager.cc:1434] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:00:48.386431  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-f25688d717bb4dae964fead4a15af269 received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:48.386883  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-f25688d717bb4dae964fead4a15af269 on tablet f25688d717bb4dae964fead4a15af269 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:48.395996  9843 tablet_bootstrap.cc:492] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:48.396332  8580 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:48.399407  9846 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:48.401736  9840 ts_tablet_manager.cc:933] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:48.419219  9840 tablet_copy_client.cc:323] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:48.421044  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet 9b195ca1ba0c4d7e993f9dc2d1a12629 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:48.421648  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet 9b195ca1ba0c4d7e993f9dc2d1a12629 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-9b195ca1ba0c4d7e993f9dc2d1a12629
I20260709 13:00:48.428968  9843 tablet_bootstrap.cc:492] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:48.429872  9843 tablet_bootstrap.cc:492] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:48.430764  9843 ts_tablet_manager.cc:1403] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.008s
I20260709 13:00:48.434175  9843 raft_consensus.cc:359] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:48.435024  9843 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:48.451079  8594 tablet_copy_source_session.cc:215] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:48.460616  9843 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:48.474453  9840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b195ca1ba0c4d7e993f9dc2d1a12629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:48.475788  9843 ts_tablet_manager.cc:1434] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.004s
I20260709 13:00:48.477463  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-8fff54c32b2248dca5e70dc82b71155d received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:48.477916  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-8fff54c32b2248dca5e70dc82b71155d on tablet 8fff54c32b2248dca5e70dc82b71155d with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:48.481040  9101 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:48.483361  9736 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:48.499020  8507 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.500982  9792 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.507869  9840 tablet_copy_client.cc:806] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:48.511565  9840 tablet_copy_client.cc:670] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:48.515763  9840 tablet_copy_client.cc:538] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:48.529392  9840 tablet_bootstrap.cc:492] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:48.539788  8579 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.542497  9792 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.552006  8426 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.557374  9733 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:48.561759  9101 raft_consensus.cc:1217] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:48.575371  8582 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:48.578706  9733 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:48.596882  9101 raft_consensus.cc:1217] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:48.742429  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:48.826982  9840 tablet_bootstrap.cc:492] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:48.828302  9840 tablet_bootstrap.cc:492] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:48.829066  9840 ts_tablet_manager.cc:1403] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.300s	user 0.028s	sys 0.003s
I20260709 13:00:48.838940  9100 raft_consensus.cc:1217] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:48.832420  9840 raft_consensus.cc:359] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:48.842718  9840 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:48.843401  9840 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:48.846136  9840 ts_tablet_manager.cc:1434] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:00:48.852176  8594 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-9b195ca1ba0c4d7e993f9dc2d1a12629 received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:48.852666  8594 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-9b195ca1ba0c4d7e993f9dc2d1a12629 on tablet 9b195ca1ba0c4d7e993f9dc2d1a12629 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:49.049284  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:49.058604  9811 raft_consensus.cc:1064] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:49.061269  9811 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:49.086923  8582 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:49.088585  9642 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:49.097307  9101 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:49.102373  8427 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:49.104646  9642 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:49.106016  9608 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:49.129797  9608 raft_consensus.cc:2955] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.132457  9101 raft_consensus.cc:2955] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.142055  8426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:49.142635  8426 raft_consensus.cc:606] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:49.145651  8426 raft_consensus.cc:2955] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.153548  8507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:49.154171  8507 raft_consensus.cc:606] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:49.164557  8427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:49.165122  8427 raft_consensus.cc:606] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:49.165637  8331 catalog_manager.cc:5697] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.168488  8579 raft_consensus.cc:2955] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.176939  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:49.189950  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:49.191318  9792 raft_consensus.cc:1064] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:49.200776  9792 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:49.217444  9101 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:49.221154  9846 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:49.230453  8579 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:49.235199  8507 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:49.240643  9548 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:49.271733  9811 raft_consensus.cc:993] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:49.272217  9811 raft_consensus.cc:1081] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:49.274413  8580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:46442
I20260709 13:00:49.274932  8580 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:49.275246  8580 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.276722  9548 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:49.278914  9608 raft_consensus.cc:1064] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:49.281234  9608 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:49.287985  8580 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:49.295315  8580 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:49.295851  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:49.297122  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:49.299818  8508 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.300143  8508 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:49.300957  8508 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:49.302484  8508 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.306238  8426 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.313642  8508 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:00:49.317566  8426 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:00:49.320282  9548 raft_consensus.cc:2955] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.324990  9100 raft_consensus.cc:2955] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.332502  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:49.333312  9828 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:49.333758  9828 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:49.334545  9828 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:49.358780  8579 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:49.361634  9811 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:49.374480  8426 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:49.380988  8508 raft_consensus.cc:2955] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.369150  8580 raft_consensus.cc:2955] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.386622  9846 raft_consensus.cc:993] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:49.391264  9846 raft_consensus.cc:1081] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:49.392784  8582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:00:49.393241  8582 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:49.393540  8582 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.387676  9101 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:49.395630  9608 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:49.409976  8582 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:49.415485  8582 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:00:49.418090  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 77730.4us
I20260709 13:00:49.423887  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:49.424584  8427 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:49.424938  8427 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:49.425776  8427 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:49.428181  8427 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.437305  8427 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:49.442471  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:00:49.443197  9101 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.445115  9100 raft_consensus.cc:1217] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:49.444258  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:49.451956  9101 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:49.454807  9811 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:49.461550  9608 raft_consensus.cc:2955] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.463608  9829 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.471240  8427 raft_consensus.cc:2955] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.593794  8582 raft_consensus.cc:2955] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.576221  9829 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:00:49.586576  9881 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:49.628824  9829 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:49.664567  9877 raft_consensus.cc:993] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:49.665285  9877 raft_consensus.cc:1081] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:49.666337  9101 raft_consensus.cc:2955] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.679193  8507 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:49.689980  8427 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:49.693992  9642 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:49.691691  8332 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.695397  8332 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.701817  9101 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:49.706902  9608 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:49.726127  9733 raft_consensus.cc:2955] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.743988  8508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59114
I20260709 13:00:49.744544  8508 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:49.744884  8508 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.746743  8426 raft_consensus.cc:2955] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.775570  8330 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 3, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.779160  8508 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:49.782946  8330 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.799613  8508 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:49.810416  9100 raft_consensus.cc:2955] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.812058  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:49.812668  8427 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:49.812969  8427 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:49.815198  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:49.815969  8508 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:49.816020  8584 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.823732  9874 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:49.831097  8427 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:49.832244  8427 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.851267  8584 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:49.852377  8433 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:49.855382  9885 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:49.859009  8427 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:49.873330  8331 catalog_manager.cc:5697] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 4 to 5, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.863188  8434 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:49.888609  9101 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:49.890503  9875 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:49.896821  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc7e6e656d324c0bad9eee744f6f1886 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:49.897173  9874 raft_consensus.cc:1064] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:49.899740  9874 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:49.903527  8582 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:49.906260  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:49.913664  9608 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.914124  9608 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:49.916432  9893 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:49.927351  9608 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:49.925865  8584 raft_consensus.cc:2955] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.920224  9891 raft_consensus.cc:2955] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.933833  8504 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:49.943437  9100 raft_consensus.cc:2955] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:49.953613  8426 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:49.965818  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet bc7e6e656d324c0bad9eee744f6f1886 with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:49.972515  9733 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:49.976032  9098 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:49.979596  9811 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:49.998885  8330 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:00:50.000253  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48090.9us
I20260709 13:00:50.008667  8320 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f25688d717bb4dae964fead4a15af269 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:50.012924  9811 raft_consensus.cc:2955] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.033361  8434 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:50.037047  9885 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:50.050668  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet f25688d717bb4dae964fead4a15af269 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:50.052228  8426 raft_consensus.cc:2955] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.056988  9098 raft_consensus.cc:2955] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.066155  9100 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:50.115351  9904 tablet_replica.cc:333] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:50.116576  9904 raft_consensus.cc:2243] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.123095  9905 tablet_replica.cc:333] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:50.124471  9905 raft_consensus.cc:2243] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.125360  9905 raft_consensus.cc:2272] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.106669  9892 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:00:50.152842  9905 ts_tablet_manager.cc:1916] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:50.162460  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8fff54c32b2248dca5e70dc82b71155d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:50.169225  8331 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.178732  8508 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:50.182013  9904 raft_consensus.cc:2272] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.190003  9905 ts_tablet_manager.cc:1929] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:50.190524  9905 log.cc:1199] T f25688d717bb4dae964fead4a15af269 P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/f25688d717bb4dae964fead4a15af269
I20260709 13:00:50.191461  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:50.192548  9904 ts_tablet_manager.cc:1916] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:50.200604  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fff54c32b2248dca5e70dc82b71155d with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:50.186609  9892 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:00:50.199626  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet f25688d717bb4dae964fead4a15af269 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:50.222767  8330 catalog_manager.cc:5697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:50.236752  9101 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:50.238595  9828 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:50.240648  8428 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:50.242921  9829 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:50.272421  9904 ts_tablet_manager.cc:1929] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:50.272887  9904 log.cc:1199] T bc7e6e656d324c0bad9eee744f6f1886 P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/bc7e6e656d324c0bad9eee744f6f1886
I20260709 13:00:50.281956  9885 raft_consensus.cc:2955] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.302242  8428 raft_consensus.cc:2955] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.305222  9904 tablet_replica.cc:333] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:50.310369  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet bc7e6e656d324c0bad9eee744f6f1886 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:50.319887  9100 raft_consensus.cc:2955] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.327963  9904 raft_consensus.cc:2243] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.329763  9904 raft_consensus.cc:2272] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.338135  8508 raft_consensus.cc:2955] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.346151  9904 ts_tablet_manager.cc:1916] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:50.359212  8428 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:50.359496  8582 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:50.361161  9811 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:50.362175  9733 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:50.385928  8332 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.393869  9904 ts_tablet_manager.cc:1929] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:50.395586  9904 log.cc:1199] T 8fff54c32b2248dca5e70dc82b71155d P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/8fff54c32b2248dca5e70dc82b71155d
I20260709 13:00:50.397178  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet 8fff54c32b2248dca5e70dc82b71155d (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:50.480643  8584 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:50.497097  9098 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:50.498502  9828 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:50.508652  9100 raft_consensus.cc:2955] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.506361  9828 raft_consensus.cc:2955] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.517222  8508 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:50.521656  9885 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:50.529210  8508 raft_consensus.cc:2955] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.529883  8330 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 4 to 5, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:50.542052  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b195ca1ba0c4d7e993f9dc2d1a12629 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:50.549613  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b195ca1ba0c4d7e993f9dc2d1a12629 with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:50.553071  9914 tablet_replica.cc:333] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:50.555738  9914 raft_consensus.cc:2243] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:50.556532  9914 raft_consensus.cc:2272] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:50.563338  9914 ts_tablet_manager.cc:1916] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:50.577718  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:50.581017  9914 ts_tablet_manager.cc:1929] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:50.581471  9914 log.cc:1199] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/9b195ca1ba0c4d7e993f9dc2d1a12629
I20260709 13:00:50.584303  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet 9b195ca1ba0c4d7e993f9dc2d1a12629 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:50.645910  8582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:50.646517  8582 raft_consensus.cc:606] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:50.648818  8582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:50.649290  8582 raft_consensus.cc:606] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:00:50.651463  8508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:50.651911  8508 raft_consensus.cc:606] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:50.653030  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:50.654239  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:50.921125  9828 raft_consensus.cc:993] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:50.921686  9885 raft_consensus.cc:1081] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:00:50.923071  8508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59098
I20260709 13:00:50.923523  8508 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:50.923861  8508 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.930011  8508 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:50.932541  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:50.932837  8508 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:50.933109  8428 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.933105  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:50.938634  8582 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:50.938918  8582 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:50.939586  8582 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:50.940078  8428 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:50.940346  8582 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.940829  8426 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:50.947710  8476 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:50.949323  9898 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:50.949777  9898 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:50.951629  9898 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:50.958670  8582 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:50.967900  8330 catalog_manager.cc:5697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.023645  9885 raft_consensus.cc:993] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:51.024156  9828 raft_consensus.cc:1081] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Signalling peer dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:51.025671  8428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:60094
I20260709 13:00:51.026281  8428 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.026566  8428 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.035053  8428 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:51.039608  8428 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:51.039858  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:00:51.040454  9100 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.043387  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:51.044037  8582 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:51.045293  8582 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:51.046007  8582 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:51.047219  8582 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.049429  9100 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:51.051692  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:51.052385  9736 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:51.052863  9736 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:51.054463  8582 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:51.053675  9736 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:51.069867  8330 catalog_manager.cc:5697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.224098  9898 raft_consensus.cc:993] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:51.224643  9898 raft_consensus.cc:1081] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:51.226006  9100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:51.226562  9100 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:51.226819  9100 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.230944  9100 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:51.232350  9100 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:51.233330  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:51.233450  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:51.233816  8508 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:51.234066  8428 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.234223  8508 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:51.234979  8508 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:51.235853  8508 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.240439  8508 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:51.240729  8428 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:51.241673  9065 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:00:51.242441  9886 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:51.242900  9886 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:51.243625  9886 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:51.253863  8330 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:51.480582  8426 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.483798  9811 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:51.520696  8582 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.525960  9642 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:51.528252  8582 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:51.530107  9736 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:51.557854  9100 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:51.561559  9916 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:51.650319  8504 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:51.655146  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:51.664674  8579 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:51.667670  8426 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:51.669870  9642 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:51.670964  8475 consensus_peers.cc:597] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c808e5ae17447f4a32fc1b5624cc91a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.671588  9642 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:51.688447  9642 raft_consensus.cc:2955] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.697592  8579 raft_consensus.cc:2955] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.719827  8428 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:51.724172  9890 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:51.724319  8428 raft_consensus.cc:2955] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.728869  8582 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:51.740585  8333 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.756884  8504 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:51.758589  9828 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:51.770689  8549 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0318f5ccc3c5462784199f043fe82842. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.771411  8504 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:51.778833  9935 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:51.806704  8426 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:00:51.808413  9932 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:51.808457  9828 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:51.830333  9885 raft_consensus.cc:2955] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.838285  8507 raft_consensus.cc:2955] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.844146  8428 raft_consensus.cc:2955] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.852173  8582 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:51.854048  8333 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:51.893534  8507 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:00:51.894796  8549 consensus_peers.cc:597] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 42b1603f302f4b188a0a19190c49fed2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.898172  8428 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:51.900067  9885 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:51.903445  9885 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:51.916482  9938 raft_consensus.cc:2955] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.918175  8428 raft_consensus.cc:2955] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.918622  8504 raft_consensus.cc:2955] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.932821  8434 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:51.945334  8333 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 4, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:51.975220  8582 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:51.976157  8507 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:51.976688  8400 consensus_peers.cc:597] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18f59320c7be4aea96b523f7f5083650. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.977560  9736 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:51.978662  9916 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:52.007318  9916 raft_consensus.cc:2955] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:52.019321  8507 raft_consensus.cc:2955] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:52.034196  8583 raft_consensus.cc:2955] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:52.048324  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:52.051599  8333 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:52.110921  9947 ts_tablet_manager.cc:933] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:52.125209  9947 tablet_copy_client.cc:323] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:52.126857  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet 7c808e5ae17447f4a32fc1b5624cc91a from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:52.127414  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet 7c808e5ae17447f4a32fc1b5624cc91a from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-7c808e5ae17447f4a32fc1b5624cc91a
I20260709 13:00:52.137269  8520 tablet_copy_source_session.cc:215] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:52.140515  9947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c808e5ae17447f4a32fc1b5624cc91a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.144466  8434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:00:52.145115  8434 raft_consensus.cc:606] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:52.148043  8507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:00:52.148578  8507 raft_consensus.cc:606] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:00:52.157186  9947 tablet_copy_client.cc:806] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:52.157789  9947 tablet_copy_client.cc:670] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:52.158380  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:52.160138  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:52.161343  9947 tablet_copy_client.cc:538] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:52.170795  9947 tablet_bootstrap.cc:492] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:52.218685  9947 tablet_bootstrap.cc:492] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:52.219648  9947 tablet_bootstrap.cc:492] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:52.220451  9947 ts_tablet_manager.cc:1403] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.050s	user 0.031s	sys 0.005s
I20260709 13:00:52.222689  9947 raft_consensus.cc:359] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:52.223294  9947 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:52.223878  9947 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:52.226689  9947 ts_tablet_manager.cc:1434] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:00:52.228196  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-7c808e5ae17447f4a32fc1b5624cc91a received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:52.228583  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-7c808e5ae17447f4a32fc1b5624cc91a on tablet 7c808e5ae17447f4a32fc1b5624cc91a with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:52.360445  9893 raft_consensus.cc:993] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:52.360942  9893 raft_consensus.cc:1081] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:00:52.384099  9100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33884
I20260709 13:00:52.384699  9100 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.385061  9100 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.392779  9100 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:52.400092  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:52.400674  8434 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:52.400965  8434 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:52.401250  9947 ts_tablet_manager.cc:933] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:52.404858  8434 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:52.406088  8434 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.418821  9100 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:52.421902  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:52.422518  8579 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.439327  8579 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:52.443181  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:00:52.445271  9934 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:52.445861  9934 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:00:52.446761  9934 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:52.463603  8434 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:00:52.482295  8331 catalog_manager.cc:5697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:52.491822  9951 ts_tablet_manager.cc:933] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:52.497929  9947 tablet_copy_client.cc:323] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:52.502779  9951 tablet_copy_client.cc:323] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:52.505903  8594 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet 0318f5ccc3c5462784199f043fe82842 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:52.506500  8594 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet 0318f5ccc3c5462784199f043fe82842 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-0318f5ccc3c5462784199f043fe82842
I20260709 13:00:52.515344  8593 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet 42b1603f302f4b188a0a19190c49fed2 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:52.515970  8593 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet 42b1603f302f4b188a0a19190c49fed2 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-42b1603f302f4b188a0a19190c49fed2
I20260709 13:00:52.538173  8594 tablet_copy_source_session.cc:215] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:52.547670  8593 tablet_copy_source_session.cc:215] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:52.558169  9953 ts_tablet_manager.cc:933] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:52.560071  9947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0318f5ccc3c5462784199f043fe82842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.560580  9956 raft_consensus.cc:993] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:52.561141  9956 raft_consensus.cc:1081] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:00:52.574100  8579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:46442
I20260709 13:00:52.574800  8579 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.575234  8579 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.578058  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42b1603f302f4b188a0a19190c49fed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.581933  8579 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:52.599048  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:00:52.599638  8434 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.595230  9951 tablet_copy_client.cc:806] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:52.603924  9951 tablet_copy_client.cc:670] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:52.610150  9951 tablet_copy_client.cc:538] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:52.616079  9953 tablet_copy_client.cc:323] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:52.620118  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet 18f59320c7be4aea96b523f7f5083650 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:52.620682  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet 18f59320c7be4aea96b523f7f5083650 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-18f59320c7be4aea96b523f7f5083650
I20260709 13:00:52.622804  8434 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:52.623162  9947 tablet_copy_client.cc:806] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:52.624778  9947 tablet_copy_client.cc:670] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:52.626117  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:52.627441  9828 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:52.628516  8445 tablet_copy_source_session.cc:215] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:52.628598  9828 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:52.630498  9828 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:52.632773  9951 tablet_bootstrap.cc:492] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:52.635476  9953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f59320c7be4aea96b523f7f5083650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:52.639111  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:00:52.639694  8504 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:52.639991  8504 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:00:52.640669  8504 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:52.641747  8504 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.654239  8504 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:52.657881  9947 tablet_copy_client.cc:538] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:52.667598  8579 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:52.671615  8331 catalog_manager.cc:5697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:52.680704  9947 tablet_bootstrap.cc:492] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:52.693148  9953 tablet_copy_client.cc:806] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:52.693807  9953 tablet_copy_client.cc:670] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:52.697923  9953 tablet_copy_client.cc:538] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:52.704991  9951 tablet_bootstrap.cc:492] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:52.705964  9951 tablet_bootstrap.cc:492] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:52.706739  9951 ts_tablet_manager.cc:1403] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.011s
I20260709 13:00:52.717509  9951 raft_consensus.cc:359] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:52.718479  9951 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:52.719185  9951 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:52.723133  9953 tablet_bootstrap.cc:492] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:52.727335  9951 ts_tablet_manager.cc:1434] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:00:52.731335  8593 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-42b1603f302f4b188a0a19190c49fed2 received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:52.731755  8593 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-42b1603f302f4b188a0a19190c49fed2 on tablet 42b1603f302f4b188a0a19190c49fed2 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:52.734913  9101 raft_consensus.cc:1217] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:52.767419  9947 tablet_bootstrap.cc:492] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:52.768347  9947 tablet_bootstrap.cc:492] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:52.769034  9947 ts_tablet_manager.cc:1403] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.013s
I20260709 13:00:52.775465  9947 raft_consensus.cc:359] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:52.776285  9947 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:52.776893  9947 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:52.779278  9947 ts_tablet_manager.cc:1434] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:00:52.785050  8593 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-0318f5ccc3c5462784199f043fe82842 received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:52.785526  8593 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-0318f5ccc3c5462784199f043fe82842 on tablet 0318f5ccc3c5462784199f043fe82842 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:52.791389  9953 tablet_bootstrap.cc:492] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:52.792383  9953 tablet_bootstrap.cc:492] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:52.794704  9953 ts_tablet_manager.cc:1403] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.072s	user 0.038s	sys 0.026s
I20260709 13:00:52.797749  9953 raft_consensus.cc:359] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:52.798743  9953 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:52.799417  9953 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:52.811133  9953 ts_tablet_manager.cc:1434] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:00:52.816125  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-18f59320c7be4aea96b523f7f5083650 received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:52.816582  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-18f59320c7be4aea96b523f7f5083650 on tablet 18f59320c7be4aea96b523f7f5083650 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:52.818840  9101 raft_consensus.cc:1217] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:00:52.871554  8434 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:52.873000  9934 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:52.897013  8579 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:52.899369  9890 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:53.037081  9098 raft_consensus.cc:1217] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:53.075639  8507 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:53.077095  9938 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:53.133502  8426 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:53.135392  9938 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:53.157064  9898 raft_consensus.cc:1064] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:53.159761  9898 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:53.161152  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:53.182394  8428 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:53.183741  8579 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:53.183877  9956 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:53.185387  9642 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:53.190398  9101 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:53.196614  9642 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:53.258181  9642 raft_consensus.cc:2955] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.352339  9101 raft_consensus.cc:1217] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:53.359649  8428 raft_consensus.cc:2955] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:00:53.408128  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 147604us
I20260709 13:00:53.413807  9100 raft_consensus.cc:2955] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.416731  8584 raft_consensus.cc:2955] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.435853  9828 raft_consensus.cc:1064] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:53.436837  8331 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.445035  9828 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:53.566928  8507 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:53.573400  9098 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:53.575017  9976 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:53.575320  8426 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:53.576838  9975 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:53.589470  9898 raft_consensus.cc:2955] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.601930  8317 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c808e5ae17447f4a32fc1b5624cc91a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:53.605732  8507 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:53.608266  8434 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:53.606766  9101 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:53.599907  8426 raft_consensus.cc:2955] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.610725  9098 raft_consensus.cc:2955] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.614202  8333 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:53.612380  9981 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:53.617648  9885 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:53.624377  9828 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:53.628952  9736 raft_consensus.cc:1064] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:53.635533  9736 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:53.646531  9828 raft_consensus.cc:2955] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.655907  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c808e5ae17447f4a32fc1b5624cc91a with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54330
I20260709 13:00:53.656203  9100 raft_consensus.cc:2955] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.685848  9987 tablet_replica.cc:333] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:00:53.688057  9987 raft_consensus.cc:2243] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:53.724509  9987 raft_consensus.cc:2272] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:53.726572  8331 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 4 to 5, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.728914  8584 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:53.756444  8507 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:53.768841  8508 raft_consensus.cc:2955] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.771015  9987 ts_tablet_manager.cc:1916] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:53.730749  9098 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:53.774488  9984 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:00:53.782490  8426 raft_consensus.cc:2955] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.794831  9916 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:53.807965  9736 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:53.799607  8579 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:53.801872  9987 ts_tablet_manager.cc:1929] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:53.830435  9987 log.cc:1199] T 7c808e5ae17447f4a32fc1b5624cc91a P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/7c808e5ae17447f4a32fc1b5624cc91a
I20260709 13:00:53.832975  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet 7c808e5ae17447f4a32fc1b5624cc91a (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:53.839999  9736 raft_consensus.cc:2955] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.845332  9100 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:53.846709  9828 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:53.848505  9098 raft_consensus.cc:2955] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.851903  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:53.856838  8507 raft_consensus.cc:2955] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.877221  9885 raft_consensus.cc:2955] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.884749  8510 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:53.887704  9981 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:53.888348  9098 raft_consensus.cc:2955] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.890981  8330 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.897349  8507 raft_consensus.cc:2955] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.901476  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 42b1603f302f4b188a0a19190c49fed2 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:53.903899  9938 raft_consensus.cc:1064] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:00:53.907302  9938 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:53.939378  8579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:00:53.941797  8583 raft_consensus.cc:2955] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.944794  8579 raft_consensus.cc:606] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Received request to transfer leadership to TS dacb523538a14c7cb335ab9c18f4111b
I20260709 13:00:53.949815  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:53.951395  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:53.951257  8426 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:53.963688  9100 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:53.937567  8330 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 5 to 6, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.965821  9984 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:53.965732  8579 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:53.971908  9984 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:53.984200  9945 raft_consensus.cc:2955] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.985900  9101 raft_consensus.cc:2955] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:53.987205  9102 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:53.991827  9938 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:53.996414  8507 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:53.999933  8426 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:54.002367  9885 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:54.003988  9885 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:54.009151  8579 raft_consensus.cc:2955] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:54.011179  8320 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18f59320c7be4aea96b523f7f5083650 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:54.014796  8424 tablet_service.cc:1558] Processing DeleteTablet for tablet 42b1603f302f4b188a0a19190c49fed2 with delete_type TABLET_DATA_TOMBSTONED (TS dacb523538a14c7cb335ab9c18f4111b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60082
I20260709 13:00:54.024972  9995 tablet_replica.cc:333] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:00:54.024818  9828 raft_consensus.cc:2955] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:54.026105  9995 raft_consensus.cc:2243] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:54.026818  9995 raft_consensus.cc:2272] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:54.030831  8330 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 4, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:54.036831  8507 raft_consensus.cc:2955] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:54.041392  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet 18f59320c7be4aea96b523f7f5083650 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:54.043325  9100 raft_consensus.cc:2955] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:54.046334  8434 raft_consensus.cc:2955] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:54.052812  9995 ts_tablet_manager.cc:1916] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:54.065696  9996 tablet_replica.cc:333] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:54.066879  9996 raft_consensus.cc:2243] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:54.068399  8331 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:54.067586  9996 raft_consensus.cc:2272] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:54.081934  9995 ts_tablet_manager.cc:1929] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:00:54.082533  9995 log.cc:1199] T 42b1603f302f4b188a0a19190c49fed2 P dacb523538a14c7cb335ab9c18f4111b: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/wals/42b1603f302f4b188a0a19190c49fed2
I20260709 13:00:54.085538  8320 catalog_manager.cc:5028] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): tablet 42b1603f302f4b188a0a19190c49fed2 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:54.086973  9996 ts_tablet_manager.cc:1916] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:54.096318  8579 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:54.102080  9100 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:54.105059  8426 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:54.106490  9828 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:54.110155  9938 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:54.113154  9996 ts_tablet_manager.cc:1929] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:54.113579  9996 log.cc:1199] T 18f59320c7be4aea96b523f7f5083650 P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/18f59320c7be4aea96b523f7f5083650
I20260709 13:00:54.113512  9981 raft_consensus.cc:2955] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:54.115630  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet 18f59320c7be4aea96b523f7f5083650 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:54.115278  8426 raft_consensus.cc:2955] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:54.124740  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0318f5ccc3c5462784199f043fe82842 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:54.124051  9100 raft_consensus.cc:2955] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:00:54.132315  8333 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 4 to 5, VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) evicted. New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.144598  8497 tablet_service.cc:1558] Processing DeleteTablet for tablet 0318f5ccc3c5462784199f043fe82842 with delete_type TABLET_DATA_TOMBSTONED (TS 0b9f7467deed4381835a85ffd0e88af6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59086
I20260709 13:00:54.145493  9996 tablet_replica.cc:333] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:00:54.146442  9996 raft_consensus.cc:2243] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:54.147243  9996 raft_consensus.cc:2272] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:54.153505  9996 ts_tablet_manager.cc:1916] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:54.166083  9996 ts_tablet_manager.cc:1929] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:54.166461  9996 log.cc:1199] T 0318f5ccc3c5462784199f043fe82842 P 0b9f7467deed4381835a85ffd0e88af6: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/wals/0318f5ccc3c5462784199f043fe82842
I20260709 13:00:54.167950  8317 catalog_manager.cc:5028] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): tablet 0318f5ccc3c5462784199f043fe82842 (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:00:54.230471  9981 raft_consensus.cc:993] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:54.230968  9938 raft_consensus.cc:1081] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Signalling peer dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:00:54.232331  8426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:60094
I20260709 13:00:54.232846  8426 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.233155  8426 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.240285  8426 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:54.242692  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:00:54.243204  8583 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:54.243494  8583 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:00:54.244045  8426 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:54.244166  8583 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:54.245285  8583 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.248272  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:00:54.248836  9100 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.252839  8583 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:00:54.254190  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:54.255071  9736 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:54.255154  9100 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:00:54.255656  9736 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:00:54.256610  9736 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:54.265838  8330 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 2 to 3, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 3 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.649930  8579 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:54.651139  9893 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:54.662104  9101 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:54.663627  9893 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:54.952416  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:55.215718  8426 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:55.221288  8508 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:55.221376  8583 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:55.222481  9945 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:55.223347  8400 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e038af5e5154b3e8ae9503fdedbb44b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.223373  9893 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.231304  9893 raft_consensus.cc:2955] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.232785  8508 raft_consensus.cc:2955] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.233338  8583 raft_consensus.cc:2955] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.250133  8330 catalog_manager.cc:5697] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.259341  8508 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
W20260709 13:00:55.268980  8475 consensus_peers.cc:597] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adc232408fec446f9379aa9fb2c04164. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.269582  8583 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:55.271463  9975 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:55.278393  8434 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:55.281088  9975 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:55.297217  9975 raft_consensus.cc:2955] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.302668  8428 raft_consensus.cc:2955] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.309406  8583 raft_consensus.cc:2955] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.313860  8579 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:55.312578  8330 catalog_manager.cc:5697] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.331286  8510 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:00:55.331676  8549 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09de6eee9632412ebe0a904f65cd2a3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.332005  8428 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:55.333312  9981 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:55.335096  9938 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:55.346619  9938 raft_consensus.cc:2955] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.351761  8510 raft_consensus.cc:2955] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.353076  8428 raft_consensus.cc:2955] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.360467  8508 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:55.364156  8332 catalog_manager.cc:5697] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index -1 to 3, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.371083  8579 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:55.374289  8475 consensus_peers.cc:597] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Couldn't send request to peer 6930e07cbba2484ca2bf800a58acdbb0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6230ca5c82634f7abb78b594dab8da24. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.373551  8428 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:55.374912  9975 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.376024  9898 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:55.399358  9898 raft_consensus.cc:2955] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.401513  8428 raft_consensus.cc:2955] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.410789  8579 raft_consensus.cc:2955] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } }
I20260709 13:00:55.413230  8333 catalog_manager.cc:5697] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index -1 to 2, NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) added. New cstate: current_term: 1 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.686554 10023 ts_tablet_manager.cc:933] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:55.688948 10023 tablet_copy_client.cc:323] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:55.690456  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet adc232408fec446f9379aa9fb2c04164 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:55.690976  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet adc232408fec446f9379aa9fb2c04164 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-adc232408fec446f9379aa9fb2c04164
I20260709 13:00:55.699645  8520 tablet_copy_source_session.cc:215] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:55.702554 10023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc232408fec446f9379aa9fb2c04164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:55.720613 10023 tablet_copy_client.cc:806] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:55.721239 10023 tablet_copy_client.cc:670] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:55.724654 10023 tablet_copy_client.cc:538] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:55.732551 10023 tablet_bootstrap.cc:492] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:55.752209 10023 tablet_bootstrap.cc:492] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:55.753171 10023 tablet_bootstrap.cc:492] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:55.753762 10023 ts_tablet_manager.cc:1403] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:00:55.756703 10023 raft_consensus.cc:359] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:55.757668 10023 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:55.758354 10023 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:55.762656 10026 ts_tablet_manager.cc:933] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:55.765028 10023 ts_tablet_manager.cc:1434] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:00:55.774497  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-adc232408fec446f9379aa9fb2c04164 received from {username='slave'} at 127.0.0.1:55892
I20260709 13:00:55.775104  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-adc232408fec446f9379aa9fb2c04164 on tablet adc232408fec446f9379aa9fb2c04164 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:55.776718 10026 tablet_copy_client.cc:323] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.195:41653
I20260709 13:00:55.779547  8593 tablet_copy_service.cc:140] P 5ffc86752d264d0c81f68028e6413a91: Received BeginTabletCopySession request for tablet 09de6eee9632412ebe0a904f65cd2a3c from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:46464)
I20260709 13:00:55.780095  8593 tablet_copy_service.cc:161] P 5ffc86752d264d0c81f68028e6413a91: Beginning new tablet copy session on tablet 09de6eee9632412ebe0a904f65cd2a3c from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:46464: session id = 6930e07cbba2484ca2bf800a58acdbb0-09de6eee9632412ebe0a904f65cd2a3c
I20260709 13:00:55.787518  8593 tablet_copy_source_session.cc:215] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:55.790630 10026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09de6eee9632412ebe0a904f65cd2a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:55.812387 10023 ts_tablet_manager.cc:933] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:00:55.815069 10023 tablet_copy_client.cc:323] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.193:41353
I20260709 13:00:55.817296  8445 tablet_copy_service.cc:140] P dacb523538a14c7cb335ab9c18f4111b: Received BeginTabletCopySession request for tablet 1e038af5e5154b3e8ae9503fdedbb44b from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:52386)
I20260709 13:00:55.817811  8445 tablet_copy_service.cc:161] P dacb523538a14c7cb335ab9c18f4111b: Beginning new tablet copy session on tablet 1e038af5e5154b3e8ae9503fdedbb44b from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:52386: session id = 6930e07cbba2484ca2bf800a58acdbb0-1e038af5e5154b3e8ae9503fdedbb44b
I20260709 13:00:55.825141  8445 tablet_copy_source_session.cc:215] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:55.830314 10023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e038af5e5154b3e8ae9503fdedbb44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:55.833185 10026 tablet_copy_client.cc:806] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:55.833784 10026 tablet_copy_client.cc:670] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:55.837205 10026 tablet_copy_client.cc:538] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:55.844648 10026 tablet_bootstrap.cc:492] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:55.847069 10023 tablet_copy_client.cc:806] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:55.847669 10023 tablet_copy_client.cc:670] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:55.851257 10023 tablet_copy_client.cc:538] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:55.860023 10023 tablet_bootstrap.cc:492] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:55.874712 10026 tablet_bootstrap.cc:492] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:55.875706 10026 tablet_bootstrap.cc:492] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:55.876394 10026 ts_tablet_manager.cc:1403] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.009s
I20260709 13:00:55.879673 10026 raft_consensus.cc:359] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:55.880543 10026 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:55.881064 10026 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:55.883361 10026 ts_tablet_manager.cc:1434] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:55.886312  8593 tablet_copy_service.cc:342] P 5ffc86752d264d0c81f68028e6413a91: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-09de6eee9632412ebe0a904f65cd2a3c received from {username='slave'} at 127.0.0.1:46464
I20260709 13:00:55.886716  8593 tablet_copy_service.cc:434] P 5ffc86752d264d0c81f68028e6413a91: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-09de6eee9632412ebe0a904f65cd2a3c on tablet 09de6eee9632412ebe0a904f65cd2a3c with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:55.888803 10023 tablet_bootstrap.cc:492] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:55.889731 10023 tablet_bootstrap.cc:492] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:55.890427 10023 ts_tablet_manager.cc:1403] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.012s
I20260709 13:00:55.893337 10031 ts_tablet_manager.cc:933] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:55.892975 10023 raft_consensus.cc:359] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:55.893842 10023 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:55.894609 10023 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:55.897991 10023 ts_tablet_manager.cc:1434] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:55.899607 10031 tablet_copy_client.cc:323] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Beginning tablet copy session from remote peer at address 127.7.41.194:38749
I20260709 13:00:55.900583  8445 tablet_copy_service.cc:342] P dacb523538a14c7cb335ab9c18f4111b: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-1e038af5e5154b3e8ae9503fdedbb44b received from {username='slave'} at 127.0.0.1:52386
I20260709 13:00:55.901036  8445 tablet_copy_service.cc:434] P dacb523538a14c7cb335ab9c18f4111b: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-1e038af5e5154b3e8ae9503fdedbb44b on tablet 1e038af5e5154b3e8ae9503fdedbb44b with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:00:55.901502  8520 tablet_copy_service.cc:140] P 0b9f7467deed4381835a85ffd0e88af6: Received BeginTabletCopySession request for tablet 6230ca5c82634f7abb78b594dab8da24 from peer 6930e07cbba2484ca2bf800a58acdbb0 ({username='slave'} at 127.0.0.1:55892)
I20260709 13:00:55.901957  8520 tablet_copy_service.cc:161] P 0b9f7467deed4381835a85ffd0e88af6: Beginning new tablet copy session on tablet 6230ca5c82634f7abb78b594dab8da24 from peer 6930e07cbba2484ca2bf800a58acdbb0 at {username='slave'} at 127.0.0.1:55892: session id = 6930e07cbba2484ca2bf800a58acdbb0-6230ca5c82634f7abb78b594dab8da24
I20260709 13:00:55.908629  8520 tablet_copy_source_session.cc:215] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:55.913311 10031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6230ca5c82634f7abb78b594dab8da24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:55.934207 10031 tablet_copy_client.cc:806] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:55.934947 10031 tablet_copy_client.cc:670] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:56.040769 10031 tablet_copy_client.cc:538] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:00:58.774614  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800196660 after lost signal to thread 7338
I20260709 13:00:58.811128 10031 tablet_bootstrap.cc:492] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap starting.
I20260709 13:00:58.939159 10012 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:58.940557 10012 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:58.956065 10012 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:58.982553 10042 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:58.983863 10042 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:58.987140 10036 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.018206 10036 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.022480 10048 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.023816 10040 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.023721 10048 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.027228 10042 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.028031 10042 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.031088 10041 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.031991 10041 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.029076 10042 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:59.036237 10038 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.037345 10038 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.038190 10052 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.040310 10037 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.041414 10037 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.042248 10045 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.043383 10048 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.043187 10045 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:59.044399 10037 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.021857 10036 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.045081 10035 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.039072 10052 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.075958 10041 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.076470 10039 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.079125 10038 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.080940  9938 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.081506 10052 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.081682  9938 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.084756  9938 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.088881 10037 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.089628 10031 tablet_bootstrap.cc:492] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:59.089807 10037 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.091339 10042 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.024808 10040 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.093873 10058 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.094843 10058 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.099175  9898 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.099839  9898 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.100709 10040 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.101771 10058 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.101998  9898 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.102259 10041 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.103219 10041 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.092281 10037 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.105644 10031 tablet_bootstrap.cc:492] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Bootstrap complete.
I20260709 13:00:59.106765 10031 ts_tablet_manager.cc:1403] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent bootstrapping tablet: real 2.361s	user 0.055s	sys 0.028s
I20260709 13:00:59.115655 10036 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.119405 10053 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.120095 10036 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.119241 10042 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.121400 10052 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.126452 10020 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.122251 10052 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:59.122001 10042 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.137037 10043 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.123013  9898 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.119275 10057 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.120244 10053 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.092278 10035 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.130203 10038 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.077832 10039 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.142513 10048 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.150593 10046 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.127308 10020 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.126466 10059 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.123595 10058 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.146144 10045 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.150780 10036 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.146771 10051 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.138576 10037 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.163233 10041 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.163499 10050 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.164871 10048 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.157322 10053 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.169696 10053 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.169410  9898 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.137949 10043 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.164455 10050 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.163292 10046 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.178512 10035 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.166392 10059 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.167018 10058 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.180665 10042 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.154707 10057 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.170529 10038 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.179141 10053 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:59.191587  9898 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.197604 10057 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.197453  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.197921 10059 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.198357  8428 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:59.198645 10020 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.197975 10053 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.200760 10048 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.193601 10037 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.201597 10053 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.202510 10053 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.203154 10037 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.204908 10053 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.206037 10046 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.205711 10061 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.209637 10058 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.189716 10049 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.208189 10020 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.212599 10055 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.196307 10056 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.208804 10052 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.190495 10051 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.214689 10054 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.214483 10050 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.230192 10056 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.236167 10020 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.230785 10038 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.242693  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.234859  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.247129 10063 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.245419  8430 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:59.245780  9938 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.233407 10061 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.247107 10054 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.243767 10055 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.270406  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.276372  9938 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.279212  9938 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.279850 10056 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.280572  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.281257  8430 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:00:59.275650 10012 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.289335 10036 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.289412 10012 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.290140 10036 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.256841 10049 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.296423  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.264322 10062 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.291580 10035 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.291239 10046 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.301141 10043 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.301251 10046 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.301697 10061 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.302380 10060 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.298687  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:59.297534  9898 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.297416 10036 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.291472 10052 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.274474 10063 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.305558  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.307250 10039 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.307885  9898 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.308218 10054 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.299901 10035 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.295583 10056 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.325866  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.323977  9938 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.317143 10062 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.312004 10060 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.322991 10054 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:59.342638 10012 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:00:59.344623  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800354080 after lost signal to thread 8367
I20260709 13:00:59.328766 10020 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.346259 10046 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.347503 10051 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.348301 10055 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.337311 10063 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.350515  9898 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.327440 10052 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.328202 10067 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.352034 10054 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.380973 10060 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.384796  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.385921  8507 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:00:59.386927 10068 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.387706 10068 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.379587  9938 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.334302 10065 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.399822 10059 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.400007 10020 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.400806 10020 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.400678 10059 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:59.402370 10064 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.403438 10020 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.403673 10058 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.403142 10064 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.403960 10020 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.404316 10058 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:59.406533 10073 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.406829 10058 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.407478 10058 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.407377 10073 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.408288 10058 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.412570 10058 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.404569 10020 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.415150  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:59.388675 10054 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:59.358946 10056 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:00:59.396559  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 56260us
I20260709 13:00:59.417279 10067 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.426167  9898 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.426256  8476 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:59.421412 10020 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.427927 10053 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.428077 10049 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.530865  9898 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.579180 10031 raft_consensus.cc:359] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:59.585270 10058 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.587280 10031 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Initialized, Role: LEARNER
I20260709 13:00:59.588222  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.588888  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:59.576655  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 151465us
I20260709 13:00:59.455390  9938 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.596462 10079 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.424178 10064 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.454802 10076 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.588532  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.455581 10059 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.425889 10062 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.459290 10052 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.458050 10035 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.585619 10055 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:59.616906 10055 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.617409 10055 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:59.617797  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.618183 10074 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.427296 10063 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.538726 10056 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.538108 10061 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.452284 10067 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.445209 10073 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.446199 10051 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.613574  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.597558 10079 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.618814  9965 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.602783 10076 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.624040  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.427945 10071 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.587695 10058 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.625051 10063 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.631636  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.537739 10072 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.588258 10031 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:00:59.559850 10066 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.636320  9898 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.622257 10062 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.638540  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:59.645603  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 43574.2us
I20260709 13:00:59.646374  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:00:59.606765 10053 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.618863 10074 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.627964 10059 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.650928  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.652765  9898 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:59.653206  9898 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.653663  9898 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:59.654808 10076 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.629325 10061 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.662753 10075 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.632906 10072 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.663614  8504 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:59.647482 10063 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.642506 10051 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:00:59.668224  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800035720 after lost signal to thread 8459
I20260709 13:00:59.647933  9965 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.673158  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.673516  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:00:59.674326  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800034ec0 after lost signal to thread 8534
I20260709 13:00:59.676014  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.676679  8509 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:59.678262  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.678823  8427 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:59.677889  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.662539 10071 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.445398 10065 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:00:59.685014  8364 debug-util.cc:398] Leaking SignalData structure 0x7b080034cce0 after lost signal to thread 8608
I20260709 13:00:59.687402 10070 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:00:59.666689 10076 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.666743 10020 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:00:59.710399  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800352b20 after lost signal to thread 9126
I20260709 13:00:59.717803  9938 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:00:59.711869  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef380 after lost signal to thread 9893
I20260709 13:00:59.722512 10031 ts_tablet_manager.cc:1434] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent starting tablet: real 0.615s	user 0.018s	sys 0.010s
W20260709 13:00:59.723140 10031 ts_tablet_manager.cc:1467] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Tablet startup took 615ms
I20260709 13:00:59.724614 10089 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.725611 10089 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:00:59.731145  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa100 after lost signal to thread 10005
I20260709 13:00:59.735643  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.676579 10062 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:00:59.737409  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800307860 after lost signal to thread 10018
W20260709 13:00:59.740869  8364 debug-util.cc:398] Leaking SignalData structure 0x7b080034f2c0 after lost signal to thread 10025
I20260709 13:00:59.678046 10059 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.743963  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.744423  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:59.748595  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:00:59.670359 10066 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.760015  9938 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
W20260709 13:00:59.763543  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 90912.5us
I20260709 13:00:59.771641  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.774322  9938 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.747393 10076 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.745359 10020 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.764674 10072 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.779942 10059 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.768882 10078 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.780244  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.780539 10087 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.773176  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.729079 10070 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.766767 10067 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:59.794193  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.711158 10075 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.802568  8435 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:59.843078  8508 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:59.799618 10067 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.845089  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.783452 10083 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.836091 10085 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.829615 10079 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.853255  9938 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.829782 10058 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.792666 10054 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.829916 10088 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:00:59.723680 10031 ts_tablet_manager.cc:1469] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Trace:
0709 13:00:55.891775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.892079 (+   304us) service_pool.cc:224] Handling call
0709 13:00:55.893698 (+  1619us) ts_tablet_manager.cc:934] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Initiating tablet copy from peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
0709 13:00:55.912241 (+ 18543us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:55.923081 (+ 10840us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:55.923187 (+   106us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:55.933327 (+ 10140us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:55.933618 (+   291us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:55.933940 (+   322us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:55.933998 (+    58us) inbound_call.cc:177] Queueing success response
0709 13:00:56.745887 (+811889us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:59.107230 (+2361343us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:59.208254 (+101024us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:59.230553 (+ 22299us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":215,"mutex_wait_us":333151,"raft.queue_time_us":88099,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":168,"tablet-copy.queue_time_us":816,"tablet-download-pool.queue_time_us":195,"tablet-download-pool.run_cpu_time_us":1208,"tablet-download-pool.run_wall_time_us":104889,"thread_start_us":83903,"threads_started":3}
I20260709 13:00:59.846937 10061 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.848533 10067 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.861726 10069 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.866283 10059 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.845319 10078 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.904721 10075 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.905652 10078 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.906188 10066 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:00:59.885910  9938 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.889946 10091 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.866365 10092 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:00:59.915653  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.851904 10087 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.882877 10058 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:00:59.940052  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.940150  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:59.940686  8510 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:59.940752  8579 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:00:59.937459 10070 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.964679 10065 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.970248  9938 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.972455  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:59.893251 10088 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.974181  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.964932  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.908375 10083 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.974757  8510 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:00:59.977762  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.977828  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:59.978060  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.978632  8583 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:00:59.977697 10078 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.980150  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.980657 10066 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:00:59.980772  8503 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:59.981225 10066 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.911834 10085 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.981578 10088 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.982004 10020 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:00:59.931190 10059 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:00:59.945873  9965 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:00:59.989730  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.965900 10058 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.991799  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:00:59.994076  8503 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:00:59.998340  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.001766  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.000200  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.011116 10066 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.012833 10055 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.013219  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.014292  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.015015  8509 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:00.014453 10053 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.005640  9898 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:00:59.968986 10069 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.019838  8505 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:00.020247 10087 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.018335 10071 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.020972  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.038005  8579 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:00.021896  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.980175 10078 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.040136  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.041117 10078 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.041030  8578 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:00.022450 10054 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.024113  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.024405 10051 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.024592  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.027590  9898 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.031863 10083 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.032521  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:00:59.969065 10091 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.032963  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.034336  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.035812  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.036052  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.036769  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:00:59.946002 10092 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.037894 10095 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:00.037218  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.053535  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.055738  8582 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:01:00.055289  8584 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:01:00.054636 10078 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:00.057288  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:00.042244 10059 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.058771  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.061386 10092 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.061450  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.069986 10078 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.070982  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.071549 10058 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:00.071980 10078 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.062435  8520 tablet_copy_service.cc:342] P 0b9f7467deed4381835a85ffd0e88af6: Request end of tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-6230ca5c82634f7abb78b594dab8da24 received from {username='slave'} at 127.0.0.1:55892
I20260709 13:01:00.072569  8520 tablet_copy_service.cc:434] P 0b9f7467deed4381835a85ffd0e88af6: ending tablet copy session 6930e07cbba2484ca2bf800a58acdbb0-6230ca5c82634f7abb78b594dab8da24 on tablet 6230ca5c82634f7abb78b594dab8da24 with peer 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:00.072988  8429 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:00.074038  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.074643  8427 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:00.075202  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.075459  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.075826  8578 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:01:00.076305  8547 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:00.076557  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.077191  9938 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.077523  9938 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.077905  9938 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.078171  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.078446  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.078838  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.060385  8476 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.080111  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.080719  8433 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:00.073954  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.081785 10087 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:00.082183  8429 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:00.082331 10087 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.083107  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.083670  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.062089  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.066113 10095 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.056731 10020 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:00.069335 10055 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.092748 10092 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:00.058493 10091 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.106485 10068 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.084409 10087 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.064153  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.095721  8550 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.109081  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.073011  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.081439  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:00.092506  8476 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.072139  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.094612  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.081530  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.097543  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:00.098979  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.099344 10076 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.091665 10059 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.116496 10059 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.116895 10059 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.117034  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.101034  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.118183  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.119033  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.119259  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.120024  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.120309  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.120898  8504 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:00.121068  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.121695  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.123596  8508 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:00.102862  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.103331 10095 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.085944 10054 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.101660 10069 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:00.103773 10062 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.129889 10054 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:00.130046  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.130412 10054 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.131554 10092 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.132488  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.133095  8431 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:00.104691  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.136359  8505 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.127133  9938 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.100440  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.139866  8503 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:00.139793 10054 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:00.105856 10067 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:00.142760 10089 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.077579  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.107062 10085 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.110822 10068 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.111621  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.111253  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.111905  8433 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:00.145620 10067 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:00.149569 10054 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.149314  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.151145  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.151814  9938 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.114282 10053 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.101621  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.153976 10053 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:00.154455 10053 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.079489  8578 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:00.091125  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.113715  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.156039  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.155045 10020 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:00.161125 10062 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.161643 10062 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.161801 10084 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.162187 10062 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.162309 10084 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.162900 10084 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.165088  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.133764 10092 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.166725  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.168831  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.169309  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.169744  8502 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.171402  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.192441 10083 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:00.193681 10086 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:00.172091  8476 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.174094 10020 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:00.200716  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.175240  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.175868  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.175982  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.176877  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.177161  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.179116  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.182134  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.207067  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.179145  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.211354  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.211478  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.182168 10053 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:00.183132 10066 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:00.214107  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.184919 10059 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.182766 10078 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:00.186182 10091 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:00.163643 10074 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.187879  9965 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:00.188565 10082 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:00.189167 10069 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:00.204771  9938 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.208846  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.219398  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.220242  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.209427 10055 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.213310  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.216470  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.217226  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.194046 10086 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:00.230463  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.218864  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.241839  8547 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.212160 10068 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.205554 10054 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.243474 10098 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:00.235946  8507 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.237375  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.212743 10067 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:00.240662  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 58810.9us
I20260709 13:01:00.242938  8547 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.219499 10078 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.215631  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.243952 10040 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.230126  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:00.248515  9938 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.246536  8502 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.239934 10055 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.233269 10091 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.261977  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.262589  9100 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:01:00.252782  8547 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.253098 10076 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:00.249866 10069 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.244254 10020 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.235543 10066 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.272324  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.272866  9100 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:01:00.273375 10066 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.254894 10062 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.256247  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.251919 10099 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:00.265933 10095 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:00.266047 10096 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:00.248036  8429 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.248273 10068 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.267907  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.247298 10054 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.269735  9938 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:00.270428 10080 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.284988 10068 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.285645 10053 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.260933 10084 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.258198 10040 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.251111  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:00.274968  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.257398 10067 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.277285  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.242867  9965 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.263921 10055 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.280105  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.270758  8577 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:00.263577 10091 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:00.288743  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.309667  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.293200  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.251675 10082 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.291289  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:00.308717  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 48309.9us
I20260709 13:01:00.289580  9938 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:00.315183  9938 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:00.287945 10054 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.252779 10086 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.295029 10040 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.286695 10020 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.328917  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.331954  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.335675  9965 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.336547  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.275678 10058 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:01:00.343393  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.344723  9938 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:00.346055 10086 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.350184  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.352404  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.353724 10091 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.354974 10091 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.355189 10084 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.356007  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.356247  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.357120  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.312136 10067 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.359551  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.362250  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.306494 10095 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.288836 10098 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.286120 10096 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.367010 10095 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:00.329113  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.328621  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.371687  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.371629  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.372638  8584 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.373118  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.374135  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.379742  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.380836  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.379200  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.382387  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.383045  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.383668  9098 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:01:00.385953  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.341778 10068 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.386561  9938 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.368207 10083 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:00.389019  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 64812.2us
I20260709 13:01:00.390975  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.399238  8398 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.400204  8398 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.326915 10099 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.376430 10059 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.403009  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.408423  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.409173 10101 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.409523 10054 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.409878  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.413312  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.420675  8583 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:00.424196  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.391786  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.433228  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.389228  9096 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:00.436529  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.432490  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.413020  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.409572 10101 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:00.426460 10091 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:00.450539 10069 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:01:00.423828 10096 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:00.450999  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.451838  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.452579  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.454592  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.454798  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.466941  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.467585  9100 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:00.468531  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.455366  8429 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:00.428202 10078 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.476892  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.458403  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.458693 10099 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.459007  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.459673  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.456636  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.430274 10054 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.493429  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:00.464013  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.477447  8427 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.477846  8578 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.479171 10068 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.477573  9096 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:01:00.449484 10055 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.443491 10101 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.484915  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:00.495591  8581 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:00.458688  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.489383  9102 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:00.476831 10102 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.498520  8476 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:00.506541  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 75163.2us
I20260709 13:01:00.465912 10098 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:00.509397  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.484664 10059 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:00.510139 10080 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:00.511152 10080 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:00.511274  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.511583 10102 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.497146 10058 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:01:00.509485  9097 raft_consensus.cc:1217] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:00.512969 10058 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:00.511492 10080 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:00.513260  9098 raft_consensus.cc:1217] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:00.512159 10102 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.513330 10058 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:00.506896  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.503804  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:00.519019  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.519272  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.516328  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.511508  8398 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.517590 10053 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:00.521775  8507 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.522781 10082 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.523069 10053 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:00.524346  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.524073 10053 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.525027  8576 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:00.525848  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.525969  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.521919 10076 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:00.528301 10076 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:00.528357 10078 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.530081  9097 raft_consensus.cc:1217] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:00.522228 10083 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:00.532519  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.535830  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.537220  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.534231 10040 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.529597 10076 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:00.541590  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.545174  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.549260  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.555956  8584 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.543558  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.559581  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.538170  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.546438  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:00.667999  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67665us
I20260709 13:01:00.564559  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.585848  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.552116  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.590613  8507 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:00.686375  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 100733us
I20260709 13:01:00.688659  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.517607 10103 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.555661  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:00.689472  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.537386 10104 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.544561  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.699465  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.700330  9898 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:00.700840  9898 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:00.701319  9898 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:00.552577  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.557857 10062 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.547911  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.542142  9094 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:00.694936  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.575340  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.540751  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.672667  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.692538 10052 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:00.546335  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:00.719120  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 207654us
I20260709 13:01:00.724025  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.725060  9102 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:00.578336 10098 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:01:00.705474 10104 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.696249 10103 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.727617  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.728439  9097 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:01:00.730268  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:00.730770 10103 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.534351 10058 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:00.733927 10105 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.734498 10105 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.734943 10105 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.736459  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.737498 10094 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:00.738857  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.739535 10094 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.743218 10105 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.745147 10105 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.747081  8434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:01:00.747785  8434 raft_consensus.cc:606] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:00.749507  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.753087  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:00.753842  8508 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:00.565346 10080 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:00.719841  8400 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 1.528s (SENT) [suppressed 1 similar messages]
I20260709 13:01:00.724035 10052 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:00.732115 10104 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.756518 10100 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.726101 10086 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:00.758862 10052 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:00.790009 10100 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.791289  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:01:00.794711  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:00.793164  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.794896 10100 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:00.808364  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 88591.6us
W20260709 13:01:00.823084  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67354us
I20260709 13:01:00.830430  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.835738  9898 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:01:00.804195 10055 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.848630  9898 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:00.854275  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:00.807219  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.802321 10080 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.842540  9098 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:01:00.858246  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:00.860961  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:00.846220 10040 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.867169  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:00.859021 10076 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:00.882427  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:00.885673  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49715.9us
I20260709 13:01:00.872187  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:00.891726  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:00.886629 10067 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.005s
I20260709 13:01:00.897670 10082 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:00.901501 10082 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:00.910830 10082 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.912132 10082 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.908644  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.914214  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.915858  9099 raft_consensus.cc:1217] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:01:00.916244  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.916419  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.917282  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.917428  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.918341  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.918454  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.918653  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.920883 10100 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.922627 10040 raft_consensus.cc:993] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:01:00.922915 10100 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.924134  8508 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.915371 10052 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.926324 10058 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.927465 10098 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:00.930137 10098 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:00.932793  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:00.932922  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.897523 10067 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.896966 10101 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:00.944250 10100 raft_consensus.cc:1081] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:01:00.912668 10102 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.947268  8428 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:00.947726 10098 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:00.948819 10067 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.949277  8575 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:00.950120  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 398151us
I20260709 13:01:00.958155  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.959625  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.960480 10052 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.960999  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.971982 10098 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.973091  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:00.974866  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:00.976928  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:00.961349  9095 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:00.938356 10099 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:00.967512  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:00.975678 10068 consensus_queue.cc:1059] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:01:00.994392  8427 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.995127  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:00.996834  9898 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.996969  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:00.997185  9898 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:00.997655  9898 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.971495 10102 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:00.993660 10055 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.999374  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.007104  8584 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:01.019730  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:00.999607 10108 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:01.020901  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:01.021198 10108 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:01.021569 10108 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.011550  9898 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.030956  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:01.029752  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:00.976267 10103 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.011989 10078 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:01:01.029538  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 80852.7us
I20260709 13:01:00.976608 10104 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.082177  9898 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.085592  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:01.023564  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.085541  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:01.024302 10051 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:01.090162 10071 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:01.092507 10104 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.094540  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:01.002154 10067 raft_consensus.cc:3055] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:01.106673 10067 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:01.107575 10067 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.108734 10067 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.015432  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:01.014655  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:01.110399  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.111528 10086 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.112116 10101 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:01.113821  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.016669  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.016578  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.016048  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:01.102046  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 64355.9us
I20260709 13:01:01.125883  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.010885 10055 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:01.084843 10078 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:01.026762 10107 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:01.017340  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:01.062701  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:01.015746  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:01.101491 10051 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:01.104147 10071 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:01.127904 10055 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.135587 10051 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.017117  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:01.123116  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:01.123891  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 232778us
I20260709 13:01:01.121731  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.139071  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.012368  8578 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:01.016805 10080 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:01:01.128983  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.136647 10107 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:01.149992 10107 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.142373  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.145903 10094 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.146343 10099 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.146351 10076 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.137454 10071 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.150010 10051 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.137959 10054 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.148022 10111 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.151541  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.125629 10086 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.153137  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.153447  9898 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.147586  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.157128  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.159359 10078 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.163101  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.163915  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.164211  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.164522  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.165412  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.163936 10111 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:01.133915 10108 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.153053 10098 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.223136 10098 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:01.223444 10108 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.224099 10098 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.224454 10098 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:01.225224 10098 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:01.181918  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.225801 10107 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.226850  8510 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:01.169963 10104 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.205572 10083 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.227149 10071 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.228940  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:01.230726  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:01.231527 10098 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.166677 10052 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.168485 10074 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:01.235759 10074 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:01.235636 10104 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:01.235984  8501 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:01.236173 10074 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.170993 10053 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.207428  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.238093  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:01.205973 10120 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.217163  8429 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:01.217677 10078 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.217914 10103 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.218048 10058 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.219537 10111 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.220422  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.220928 10094 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:01.200945  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 134534us
I20260709 13:01:01.228118 10051 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:01.232156 10071 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:01.233361 10055 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.243562 10108 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:01:01.234720  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.215617 10084 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.236646 10104 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:01.258630 10104 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:01.238752 10076 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.259588 10104 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.244210  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.260725  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:01.261023 10101 consensus_queue.cc:1175] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ffc86752d264d0c81f68028e6413a91" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:01:01.245255 10120 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.261775 10102 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.262524 10103 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:01.250437 10111 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.253160  8501 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.263325  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.241653 10052 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:01:01.205118  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.256685  8510 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.258692 10118 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.261031 10104 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.262719 10120 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.261834  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.266183  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.266717  8510 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:01.267568  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.268254 10099 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.268867 10099 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.270316 10099 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:01.270555  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 65532us
I20260709 13:01:01.255074 10055 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.239791  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.271467  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.271581  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.257617 10074 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.273262 10076 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.274061  8400 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.274808 10074 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:01.275590  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:01.276237  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.276441 10115 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.281769 10108 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:01.276609 10121 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:01.282347 10108 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:01.282593 10121 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:01.283030 10121 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.284940  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:01.285154  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.285910  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.290120 10120 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.290295  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:01.290573 10107 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:01.294564  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.293816 10115 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:01.283833 10084 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:01.299039 10100 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.300312  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.283288 10108 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.301491  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.297561  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.302472  8583 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:01.300778  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.303404  8580 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:01.304073  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.305135 10115 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:01.305485 10115 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:01.305936 10067 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.306301 10115 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:01.307615 10117 consensus_queue.cc:1175] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ffc86752d264d0c81f68028e6413a91" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:01:01.307862  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.312270  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.312318  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.308877 10120 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:01.314783 10120 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.315141 10120 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:01.315918 10120 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.317236 10120 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.320072  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.321244  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.322525 10116 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.323203 10100 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.324126  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.323833  8333 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 3, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 3 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.309394 10040 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:01.325323 10040 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:01.326151 10040 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.327548 10040 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.289484 10118 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.332180 10084 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:01.297966 10086 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:01.318328 10082 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.355566  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.289345 10083 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:01:01.333031 10115 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.334730 10078 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.343921 10101 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:01.343437 10086 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:01.365448  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:01.343780 10099 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:01:01.359697 10105 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:01.371881  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.364511 10086 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.364253 10101 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:01.379384  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.380702  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.381506 10116 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:01.382943  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.383829 10084 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.381912 10116 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:01.370689 10103 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:01.371254 10105 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:01.380313 10100 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.393450  8510 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.379668 10102 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:01.395504  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.380959 10101 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.391621 10126 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.409775  8475 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.434726 10082 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.436069 10082 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:01.436923 10082 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.416954  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:01.440308  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:01.431717  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 51084us
I20260709 13:01:01.387398 10083 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:01:01.445819  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.441459  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.453333  8510 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:01.496093  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50354.8us
I20260709 13:01:01.443742  8501 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.498948 10117 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:01.499418 10117 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:01.499776 10117 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.396557 10116 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.500705  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:01.496172  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55945.4us
I20260709 13:01:01.396322 10052 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.434911 10040 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.510906  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.437915 10082 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.406118 10102 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:01.513526  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:01.396904 10103 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:01.500537 10107 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.444108 10078 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.406167 10105 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.444366 10071 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:01.517087  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 75708.3us
I20260709 13:01:01.532024  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.519294  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.520198 10122 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:01.521845 10098 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.515815 10126 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.523301 10102 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.524827 10118 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.442466 10099 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:01:01.525207  8428 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:01.442052 10110 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:01.563426 10110 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:01.555454 10098 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:01.563997 10110 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:01.527457 10123 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:01.533389  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.533355 10040 raft_consensus.cc:2764] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:01.534807  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.536448  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.555951 10083 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.537101  8579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:01:01.526952 10086 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.567171  8579 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:01.567667  8579 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.538200  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.538312  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.538964  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:01.542196  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.582963  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.572952  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:01.584038  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.585084  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.585570 10108 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.537889  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.548290  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.548944  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.549566  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.553122 10074 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.546269 10122 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:01.527973 10103 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.561635 10102 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:01.562135  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50185.6us
I20260709 13:01:01.528812 10078 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:01.563568 10126 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.586308 10108 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:01.514353 10054 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:01.555244  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.587024  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.588937 10084 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.589465 10051 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:01.591085  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 57783us
I20260709 13:01:01.586452 10062 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:01.586285 10114 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:01:01.594851 10122 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.565042 10101 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.564587 10098 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.594377 10086 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:01.627864 10062 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:01.594266 10083 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.611294  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:01.628875 10062 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.629307  9095 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:01.630770  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.632158 10084 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.632984  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.635305 10101 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.635921  8427 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:01.612867  8426 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.603488 10054 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:01.616458  8435 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.599696 10100 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.614058 10074 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.602260 10126 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:01.627267 10128 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:01:01.603506 10108 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:01.638955  8430 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.613781  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.654563  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.655861  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.656998  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.644737 10111 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:01.660521  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.640170  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.640388  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.648831 10114 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.622790  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.602506 10121 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.663915  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.664397  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.664494  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.667949  9898 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.668889  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.669534  8433 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.677191  9898 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.645695 10054 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.678617  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:01.679257  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.679795  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:01.672489  8579 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.659399 10108 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.682408  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.667897 10120 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.633956 10084 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.667686 10068 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.668612 10086 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.659226 10076 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.683532  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.689939  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.690848 10068 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.691032  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:01.680413  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.684183  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:01.686563  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.668157 10114 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:01.685860  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:01.669418 10101 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.692154  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.676597 10098 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.695714  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:01.696269  8579 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:01.686393  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.697023 10080 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.700888 10122 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.686420  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.702243  8510 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:01.702636  9093 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:01.703825 10122 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.682967 10094 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.684840 10067 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.687000 10052 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.712502  9098 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:01.674564 10078 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.714588  8575 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:01.718071  9100 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:01.695372 10111 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.726266  8576 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:01.722904 10078 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.723791 10121 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:01.721809  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.704129 10110 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.706343 10084 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.706174 10068 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.711651 10101 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:01.679702 10126 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.735339 10052 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.735785 10126 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.735903  9097 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:01.734817  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.727038 10117 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.715914 10114 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.741931 10101 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:01.882527  9096 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:01.860173 10108 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.894152 10101 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.894939  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.745921  8428 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:01.895583 10105 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.841820 10103 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.915128  8429 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.916803  8432 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:01.917595 10103 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.849201 10080 raft_consensus.cc:1064] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
W20260709 13:01:01.921535  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 133512us
I20260709 13:01:01.922791  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:01.923199  9099 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:01.908579 10054 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.925028 10104 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:01.925535 10054 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.925644 10104 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:01.911314 10116 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.927975 10116 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.927332 10104 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.746522  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:01.744573 10110 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.840304  9094 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:01.891863  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.906016  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.931305 10052 raft_consensus.cc:1064] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:01:01.931576  8579 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:01.757607  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:01.917745 10105 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:01.930663  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 191485us
I20260709 13:01:01.906750 10082 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:01.897076 10117 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.932752  8508 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:01.935824  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:01.935916 10082 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.937004 10108 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:01.943529 10082 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:01.939045 10052 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.940099  8435 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.948020 10059 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:01.948621 10059 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.952587  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:01.953558 10076 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:01.957087 10076 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.952993 10059 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:01.955610  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.960216  8435 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.957456 10076 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:01.963517 10076 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:01.964884 10076 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.966980  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:01.969204  8435 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 2: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:01.972059  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.972306  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:01.972868  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.974886 10138 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:01:01.977973  9093 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.978969 10083 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.980568  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.983276  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.983857  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.985093  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:01.986392  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.987598  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:01.970722 10059 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.987390  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:01.990716  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:01.995187 10059 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:01.997107 10062 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:01.992654 10107 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.998098  8435 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:01.999668 10058 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:01.986403 10108 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:02.000151 10058 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:02.005997  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:02.006044 10058 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.007501 10058 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.015779  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:02.020793  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:02.027942  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:02.028723  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:02.030349 10140 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.033130  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:02.035066  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:02.012365 10062 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:02.019840  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:02.039829  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:02.042362  9898 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.042786  9898 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:02.036932 10122 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:01:02.034080 10110 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:02.048780 10062 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.057762  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:02.062263 10040 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:02.064097  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:02.065371  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:02.038867 10140 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:02.061741  9898 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.041481 10117 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:02.076545  8508 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:02.078074 10105 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:02.079013 10105 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:02.079334 10105 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:02.084379 10102 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:02.084271 10140 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.085474 10108 raft_consensus.cc:1064] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:01:02.079414 10040 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.061721 10098 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:02.083338  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:02.089752  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.086104 10040 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:02.097322 10108 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.097991 10040 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.085772 10114 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.104593  9101 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:02.106822  8549 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:02.109333  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:02.111985 10118 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:02.113538 10118 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.115978  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:02.101372 10058 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:02.118665 10133 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:02.118781 10058 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.115646 10115 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:02.121327 10058 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:02.105643 10098 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.108242 10144 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:01:02.108670 10121 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:02.123888 10098 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:02.114401 10118 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:02.126111  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:02.126711  8435 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:02.125725  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:02.128149  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:02.131393  8580 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:02.133455  8435 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:02.114333 10059 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:02.137442  8435 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:02.121985 10058 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:02.140107  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 109210us
I20260709 13:01:02.148689  9095 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:02.149396  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:02.084271 10105 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.147644  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:02.168712 10067 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:02.168861  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:02.172055 10107 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:01:02.173920 10145 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:02.174371 10145 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:02.174739 10145 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.146462 10059 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:02.175545 10118 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.184494 10105 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.146361 10058 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.177055 10059 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:02.213766 10059 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.214588 10058 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:02.215070 10059 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.168053 10051 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:01:02.219513 10148 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:01:02.220623  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:02.221518  8432 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:02.228065  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:02.011523 10111 consensus_queue.cc:1175] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dacb523538a14c7cb335ab9c18f4111b" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:02.236941 10058 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:02.248256 10058 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:02.248719 10058 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.175058 10083 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:02.172816 10098 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:01:02.182781 10130 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.185178 10067 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:02.212131  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:02.261662  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 146090us
I20260709 13:01:02.266886 10067 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:02.269016 10067 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.270548 10067 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.242563 10110 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:02.275668  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 63615.4us
I20260709 13:01:02.276480  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:02.277117  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:02.277532  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 111660us
I20260709 13:01:02.278252 10078 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:02.283380 10127 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:02.285015 10094 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.285382 10094 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:02.286312 10094 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.287602 10094 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.294202 10132 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.294714 10132 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:02.295550 10132 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.301383  8430 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:02.304787 10147 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.277232 10130 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:02.312300  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:02.313578  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:02.316431 10118 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.321084  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:02.321791  8508 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:02.321525 10110 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:02.324931  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.332180  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.333734 10054 raft_consensus.cc:1064] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: attempting to promote NON_VOTER 6930e07cbba2484ca2bf800a58acdbb0 to VOTER
I20260709 13:01:02.334543 10145 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.335920 10054 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.337369 10126 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.337728 10126 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:02.338060 10084 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.338487 10084 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:02.338783 10145 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:02.338707 10126 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.339306 10084 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.341151  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:02.345793  8510 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:02.347149 10084 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.339550 10130 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.354835 10082 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.355211 10082 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:02.354169  8435 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:02.358191  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:02.305497 10147 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.363247  8508 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:02.366412  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:02.340152 10126 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.368567  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:02.365307 10059 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:02.371071 10059 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:02.371125  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:02.371443 10082 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.369361  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:02.371994  8502 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:02.372041 10059 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.374272  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:02.387307  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.387897  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:02.375630 10082 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.389247  8583 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:02.376044  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:02.377228 10058 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.378140  8508 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 2: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:02.380049  8426 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:02.380584  8429 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.375485 10147 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:02.394266 10145 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:01:02.397219 10147 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:02.394174 10076 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:01:02.397759 10147 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:02.398357 10076 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:02.398712 10076 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:02.398859 10147 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.399578 10076 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.400445 10147 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.400696 10076 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.390764  8428 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:02.392023  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:02.401338  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:02.401957  8508 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:02.403354  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:02.404353 10058 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:02.405354  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.405589  8429 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:02.406667  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:02.393697  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:02.404872 10058 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:02.409807 10058 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.404850 10080 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.415850 10149 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.415972 10145 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:02.401922 10067 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.410189 10058 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.425865 10145 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.428058  8428 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:02.433230  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:02.436295  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:02.437021  8508 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 2: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:01:02.442848  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 336097us
I20260709 13:01:02.427955 10084 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:01:02.428558 10149 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:02.431607 10145 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.428822 10074 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:01:02.447649  8429 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:02.441293 10094 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:02.454051 10094 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:02.452382 10149 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.482707 10094 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.490438 10154 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:01:02.494012  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:02.496093 10076 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:02.497223 10076 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:02.498337 10076 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:02.502671  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.502302  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 228608us
I20260709 13:01:02.512477  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:02.517560  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.528266  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:02.526090  9099 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:02.532830 10154 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:02.535223  8508 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:02.528695 10108 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:02.539737 10135 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:02.540203 10135 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:02.539330  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:02.544935  8583 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:02.549513  8583 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:02.546185 10108 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:02.538980 10115 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:01:02.566231  9097 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:02.554574 10102 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:01:02.565743 10058 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.578840  9101 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:02.595746  8510 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:02.612217  8501 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:02.612892 10100 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:02.613103 10145 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.613384  8575 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:02.616546 10058 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:02.623601  8580 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:01:02.626945  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.671675  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 90007.1us
I20260709 13:01:02.583431 10135 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:02.649456  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:02.652693  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:02.673758 10067 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:02.687549  8432 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.650584 10100 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:02.720259  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:02.721053  8435 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.691777  8501 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.690879 10133 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:02.734409  8510 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.733661  8583 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:02.737445  8435 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:02.738672  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:02.720005 10108 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:01:02.722482 10067 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.701624 10084 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:01:02.735242 10135 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.719473 10074 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 13:01:02.834209 10162 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:01:02.834591 10160 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:02.766165  8330 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32800 (request call id 241) took 1033 ms. Trace:
I20260709 13:01:02.834988 10158 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.207s
I20260709 13:01:02.748335 10094 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:02.748853 10080 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.837927  8330 rpcz_store.cc:276] 0709 13:01:01.667897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.668297 (+   400us) service_pool.cc:224] Handling call
0709 13:01:02.701104 (+1032807us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4}
W20260709 13:01:02.853325 10165 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:01:02.862488  8502 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:02.867425  8510 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:01:02.891999 10161 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:01:02.849823 10055 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:01:02.850153 10145 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:02.895536  9099 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:02.891083 10080 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.899048 10080 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:02.863359 10160 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.920692  8432 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:02.935935  8501 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:02.937928 10160 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:02.944759 10067 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:02.961365  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:02.971113  8583 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:02.993734  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:02.994061  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:02.995034  8432 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:02.992703 10111 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.001482 10111 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:03.011256 10111 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:03.024731  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:03.037559  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:03.043529  8432 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:01:03.047267  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.034451 10076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.019s	sys 0.026s
I20260709 13:01:03.029881 10067 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:03.033088 10068 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:03.030697 10144 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:03.042949 10126 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.043282 10094 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:03.073434 10126 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.091645  8432 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:03.064658 10068 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.099257  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:03.107156  8583 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:03.051116 10140 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:03.113261  8432 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:03.119083  8428 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:03.046803 10110 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:01:03.127542  8432 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:03.107331 10067 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:01:03.131587  9094 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEARNER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:03.051301 10132 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:01:03.108198 10068 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:03.132629 10094 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:03.146822 10102 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:03.059710 10076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.019s	sys 0.026s
I20260709 13:01:03.118618 10145 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:03.124603 10105 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.123035 10059 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:03.162313  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 412278us
I20260709 13:01:03.154551 10157 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:03.129820 10138 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:03.098433 10126 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.173393  8580 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:03.181847  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:03.170461  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:03.166692 10145 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.167955 10059 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:03.166905 10105 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:03.310992  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 266595us
I20260709 13:01:03.176132 10157 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:01:03.323320  8580 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:03.305500  8429 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:03.335947 10126 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:03.337435  9099 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:03.336427 10182 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:03.340169 10184 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:03.350138 10126 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.360708 10126 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.361972 10184 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:01:03.362718 10182 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.364303 10184 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:03.364763 10144 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:03.364810 10182 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.382382  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:03.378340 10181 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.394310  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:03.389434  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:03.392360 10146 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.398206 10059 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:03.398279 10146 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:03.399619 10144 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:03.400411 10146 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.396764 10181 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.402949 10157 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:03.392843 10159 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:03.403664 10159 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.404161 10181 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.404275 10115 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.404762 10115 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.405689 10159 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.416324  8578 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:03.416177  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.408457  8435 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:03.412639  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.409672  8426 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:03.412389  9094 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:03.406946 10145 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.406438  8429 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:01:03.417644  9095 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:03.414470 10115 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.428155  8508 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:03.431398 10157 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:01:03.441308  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:03.442219 10181 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:03.442703 10181 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.443024 10181 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.443970 10105 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.444622 10110 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.445156 10110 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.432152 10082 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:03.448238 10082 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.450332  8502 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
W20260709 13:01:03.439345 10185 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260709 13:01:03.431020 10101 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.454571 10182 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:03.454960 10101 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.455127 10182 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.457115 10101 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.457170 10182 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:03.447245 10110 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.458170 10126 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:03.458829 10126 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.460472 10184 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:03.460807 10130 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.461107 10126 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.461242 10130 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.461750 10126 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:03.462527 10183 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:01:03.462369 10126 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.463397 10130 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.464149  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.464330  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:03.464891  8510 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:03.464964 10126 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.465724  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:03.466382  8582 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:03.468894  9101 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:03.469218  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:03.470572  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:03.471288  9100 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:03.473644  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.474038  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:03.455464  9094 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:03.469798  8330 catalog_manager.cc:5697] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 3, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 3 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.493781  8330 catalog_manager.cc:5697] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 3, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 3 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.457881 10182 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.512784 10094 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.513130 10182 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.513479  8330 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 3, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 3 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.515961  9097 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:03.516302  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:03.517141 10103 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.517383 10203 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:03.517817  9096 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:03.516579 10182 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.517940 10103 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.518743 10181 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.519443 10132 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.520229 10103 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.519979 10132 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.520910 10181 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.517910 10203 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:03.521724 10203 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:03.523479 10132 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:03.517122  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46643.4us
I20260709 13:01:03.513350 10094 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.519351  8330 catalog_manager.cc:5697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.526139  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.527281 10094 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.527580  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:03.527114  8330 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 3, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 3 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.528352  8508 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.531495 10181 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.532074 10181 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.534477 10181 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:03.538111  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.545151  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.546042  8510 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:03.551175  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:03.552736  8426 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:03.554997  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:03.558722  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46182.2us
I20260709 13:01:03.557614  8582 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:03.485862 10126 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:03.556955  8508 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:03.561406  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:03.497421 10105 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:03.471788 10188 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:03.564917  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.579252  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.579618  8510 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:03.584211  8509 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:03.585083  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.543104 10203 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.564654  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:03.562278 10126 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.471298 10058 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:01:03.582127  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:03.588431  8504 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.585750  8509 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 2: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:03.586467  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.588120 10144 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:03.561046  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:03.562777  9898 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:03.587213  8503 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:03.619690 10178 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:03.621101  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:03.621943 10122 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:03.578583 10105 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.591837  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.616868  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.624675  8507 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:03.625344  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.585645 10135 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:03.616142 10144 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.636296 10144 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.588519 10126 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.624154 10181 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:03.631528 10058 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.631675 10105 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:03.650070  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 162416us
I20260709 13:01:03.652065  9095 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:03.657279  8583 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:03.657611  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:03.659792  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:03.631407  8429 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:03.662086 10186 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:03.663785 10138 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:03.667214  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:03.668803  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45673.6us
I20260709 13:01:03.670869  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:03.671584  8580 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.670360  8582 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:03.631412 10068 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:03.661448 10140 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.587387 10188 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.701290  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:03.642379 10135 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.670742 10138 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.657195 10058 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.693739 10145 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:03.714288  8581 raft_consensus.cc:2368] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3.
I20260709 13:01:03.670485 10071 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:01:03.677201 10107 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:03.704487 10100 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.707616 10138 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:03.712687 10111 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.705139 10140 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:03.748643 10140 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.722704 10177 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:03.706382 10055 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:01:03.754170 10177 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:03.775619 10177 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:03.723286 10145 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.783577 10202 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:03.786237  8504 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:03.790383  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.746716 10100 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.792531  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:03.793357 10145 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.793892  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:03.754501 10111 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.765089 10051 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:01:03.787964 10203 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:03.791420 10082 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:03.756197 10154 raft_consensus.cc:2955] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:03.784173 10202 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.826241 10068 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:03.826665 10188 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.827270 10188 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.819931 10082 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:03.831739 10082 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.835040  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.835994  8504 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:03.840075 10101 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.840243 10111 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.840627 10101 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.830709 10203 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.830467 10135 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.861536 10101 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.862808 10058 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.862912 10100 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:03.827725 10188 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.864069  8580 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:03.926918 10140 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:03.852402 10110 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:01:03.872685 10082 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.938297 10101 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:03.940619 10040 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:03.948233 10111 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.929558 10158 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:03.959254  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:03.966600  8504 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 2: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:04.004508 10133 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:04.005293 10133 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:04.005752  8332 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 2 to 3, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 3 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:03.858949 10203 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.007784  8332 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 2 to 3, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 3 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:04.014982 10100 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.015661 10133 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:04.016263 10116 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:04.016395 10133 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:04.017083 10116 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.018307 10040 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.020601 10116 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.020895 10040 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.015689 10100 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.021602 10111 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.024044 10100 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.024369 10111 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.049567 10203 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:04.052469 10188 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:04.056326 10105 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.982561 10144 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.017149 10133 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:04.067056 10144 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.067307  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.069074  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.085362 10110 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:04.085592  8507 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:04.069628  8506 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:04.069744  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.070276  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.091353  8509 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:04.070672 10138 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:03.956875 10202 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:03.927692 10140 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:04.087435  9065 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:04.090876  8505 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:04.098910  8426 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:04.061117  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:04.102957  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:04.104113  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:04.119381  8432 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:04.108033  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.085935 10110 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.127293 10188 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:04.128091 10203 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:04.129313  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:04.144757  8577 raft_consensus.cc:2368] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:04.145160  8431 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.144989 10203 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.131385  8429 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:04.118800  8426 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:04.057988 10158 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.154733 10188 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.157042 10140 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:04.058930 10126 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.060592 10177 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:04.173450  8578 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:04.095911 10111 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:04.175302 10111 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.100817 10132 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:04.178846 10132 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:01:04.181336 10132 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:04.139158 10202 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:04.182211 10202 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.182636 10202 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.163326 10144 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:04.168098 10126 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:04.171473 10138 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.172737  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:04.191072 10182 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:04.191591 10188 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:04.191673 10182 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:04.192598 10144 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.196609 10144 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.183343 10158 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.197255 10110 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.177834 10111 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.169631 10133 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:04.199851 10177 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:04.200656 10203 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:04.193711 10182 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.221736 10111 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:04.094311 10204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.032s	sys 0.082s
I20260709 13:01:04.227007  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.227353  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.210736  8432 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:04.221704 10105 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.233320  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.237175  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.241230 10111 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:04.241968 10111 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.245770 10111 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.220825  8431 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:04.249802  8398 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:04.238547 10204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.032s	sys 0.082s
W20260709 13:01:04.271582  8510 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.002s	sys 0.045s
W20260709 13:01:04.272255  8510 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.002s	sys 0.045s
I20260709 13:01:04.275772  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:04.265375 10040 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:04.310230  8476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.021s	sys 0.024s
W20260709 13:01:04.310875  8476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.022s	sys 0.024s
W20260709 13:01:04.311317  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 610055us
I20260709 13:01:04.314970  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:04.315289  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:04.278084 10149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.023s	sys 0.069s
I20260709 13:01:04.265707 10111 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:04.270941  8430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.007s	sys 0.038s
I20260709 13:01:04.276604  8398 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:04.340390  8430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.008s	sys 0.038s
W20260709 13:01:04.324214  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.022s	sys 0.012s
I20260709 13:01:04.324795  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:04.344075  8435 raft_consensus.cc:2368] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
W20260709 13:01:04.340813  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 77063.5us
W20260709 13:01:04.342999  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.022s	sys 0.012s
I20260709 13:01:04.350483  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:04.351275  9100 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:04.351729  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:04.352592  9102 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:04.274418 10202 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.361600  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:04.291636 10040 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:04.340188 10149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.023s	sys 0.070s
I20260709 13:01:04.360057 10133 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:04.385002  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:04.325269 10094 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:04.358687 10203 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:04.322763 10138 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:01:04.386003  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:04.439172  9100 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.386957  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:04.443986  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 57132.7us
I20260709 13:01:04.444890  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:04.452472  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:04.453358  9101 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:04.455106  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:04.450554  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:04.465742  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.039s	sys 0.059s
W20260709 13:01:04.466192  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.040s	sys 0.059s
W20260709 13:01:04.470266  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 810062us
I20260709 13:01:04.457226  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:04.474774  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:04.450287  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:04.478319  8433 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:04.478993  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.053s	sys 0.156s
W20260709 13:01:04.479310  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.053s	sys 0.156s
W20260709 13:01:04.362793 10178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.042s	sys 0.074s
W20260709 13:01:04.443435 10195 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:01:04.361003 10111 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.366704 10058 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:04.384802 10133 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.436111 10068 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:04.542537  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:04.506799 10082 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:04.366856 10040 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.547540  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:04.547708  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:04.385151 10181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.019s	sys 0.017s
I20260709 13:01:04.506510 10126 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:04.414829  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:04.556675  9102 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:04.414300 10144 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.156s
I20260709 13:01:04.584555  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.584268  9100 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:04.580713 10068 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:04.559084 10082 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:04.558831 10154 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.624s	user 0.005s	sys 0.006s
W20260709 13:01:04.546902 10178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.047s	sys 0.085s
I20260709 13:01:04.586318  8427 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:04.592190  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.558688 10133 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:04.601735  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:04.624377  8510 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.548192 10094 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:04.548662 10202 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:04.608103  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.610612  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:04.611416 10205 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:04.612125  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.612213 10135 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.600222 10181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.019s	sys 0.025s
I20260709 13:01:04.479236 10203 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.617764  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:04.539923 10188 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:04.556216 10122 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.556171 10058 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:04.624783 10082 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:04.630399  8584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.006s	sys 0.019s
I20260709 13:01:04.632057  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:04.651582  8584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.006s	sys 0.019s
I20260709 13:01:04.634559  9067 leader_election.cc:400] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:04.647472  8510 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:04.715094  9067 leader_election.cc:403] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:04.715767  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.600739  9898 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.607228 10126 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:04.698354  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:04.718088  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 155906us
I20260709 13:01:04.718297  8504 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:04.635522 10181 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:04.632077 10132 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:04.632309  9099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.010s	sys 0.027s
W20260709 13:01:04.639668 10207 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:01:04.652452  8476 leader_election.cc:400] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:04.754382  8476 leader_election.cc:403] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:04.719712  9101 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:04.650738  9097 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:04.736887  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1567) took 1393 ms. Trace:
W20260709 13:01:04.754848  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 103870us
I20260709 13:01:04.746315 10138 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.752256  9066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.029s	sys 0.093s
I20260709 13:01:04.652235 10051 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.717211  9898 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:04.753988  9099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.011s	sys 0.028s
I20260709 13:01:04.650938 10202 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.649602 10058 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:04.652154 10100 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:04.744925  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.014s	sys 0.016s
I20260709 13:01:04.641629 10135 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:04.780783  9066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.030s	sys 0.094s
I20260709 13:01:04.735654 10126 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:04.778761  8430 rpcz_store.cc:276] 0709 13:01:03.323577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.323694 (+   117us) service_pool.cc:224] Handling call
0709 13:01:03.323964 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.324681 (+   717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.324708 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.481728 (+157020us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b2c00055dc8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:01:03.551894 (+ 70166us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.342716 (+790822us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:04.342771 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.342858 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.639482 (+296624us) raft_consensus.cc:1685] finished
0709 13:01:04.639507 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.717183 (+ 77676us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":408,"raft.queue_time_us":747,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":6888,"spinlock_wait_cycles":99244416,"thread_start_us":757606,"threads_started":1,"wal-append.queue_time_us":1065666}
I20260709 13:01:04.650152  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.785148  8510 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:04.652994 10122 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:04.788276  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.015s	sys 0.016s
I20260709 13:01:04.652280 10188 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.791745  8504 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
W20260709 13:01:04.782843 10182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.020s	sys 0.010s
I20260709 13:01:04.777326 10159 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.754453 10215 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:04.754523 10218 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:04.801664  9898 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:04.838855  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1574) took 1365 ms. Trace:
I20260709 13:01:04.820567  8433 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
W20260709 13:01:04.780908  8579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.011s	sys 0.042s
W20260709 13:01:04.842818  8579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.011s	sys 0.042s
I20260709 13:01:04.783725 10178 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:04.837884  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:04.844866  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:04.817934 10103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.033s	sys 0.063s
W20260709 13:01:04.819278  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 891637us
I20260709 13:01:04.776268 10132 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:04.842550  8428 rpcz_store.cc:276] 0709 13:01:03.473459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.474732 (+  1273us) service_pool.cc:224] Handling call
0709 13:01:03.474987 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.486970 (+ 11983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.486997 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.491564 (+  4567us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.784451 (+292887us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b48002f0358. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:01:03.796763 (+ 12312us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:03.796804 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.796867 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.838580 (+1041713us) raft_consensus.cc:1685] finished
0709 13:01:04.838602 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.838795 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99,"raft.queue_time_us":15171,"raft.run_cpu_time_us":2889,"raft.run_wall_time_us":292753,"spinlock_wait_cycles":100339968,"thread_start_us":235771,"threads_started":1,"wal-append.queue_time_us":766371}
I20260709 13:01:04.850792  9100 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
W20260709 13:01:04.839835 10212 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:01:04.833348 10182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.021s	sys 0.010s
W20260709 13:01:04.839401 10210 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:04.799918 10100 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:04.787863 10051 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:04.826607 10219 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:04.835613  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:04.785883 10138 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.811625 10202 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:04.840344 10144 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:04.832190 10184 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.010s	sys 0.014s
I20260709 13:01:04.835326  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:04.957543  8508 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:05.016408  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:05.029489  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:04.954720 10216 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:01:05.017504  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:04.851816  8501 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:04.837822 10159 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:04.856946 10115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.014s	sys 0.017s
W20260709 13:01:04.894973 10103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.033s	sys 0.069s
I20260709 13:01:04.840458 10215 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:04.954291  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:04.893649 10217 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.946770 10182 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:04.928725 10111 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:05.027876 10184 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.015s	sys 0.015s
I20260709 13:01:04.946725  8503 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:04.918111  8583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.209s	user 0.052s	sys 0.058s
W20260709 13:01:05.083483  8583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.375s	user 0.055s	sys 0.058s
I20260709 13:01:05.034602  8428 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
W20260709 13:01:05.044006 10115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.017s	sys 0.020s
I20260709 13:01:04.838245 10218 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.037086  9098 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:05.067940  8427 raft_consensus.cc:2368] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3.
I20260709 13:01:05.084733  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:05.057065  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:04.898617 10116 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 13:01:05.086354  8504 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:05.097187  9065 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:05.089514  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:05.104187  8550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.000s	sys 0.030s
W20260709 13:01:05.104504  8550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.000s	sys 0.030s
W20260709 13:01:05.086171  8547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.016s	sys 0.015s
W20260709 13:01:05.105341  8547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.016s	sys 0.015s
I20260709 13:01:05.104993  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:05.105862  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 720870us
I20260709 13:01:05.032953 10144 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:05.104737  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 659879us
I20260709 13:01:05.132391  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:05.134490  8427 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:05.018286 10219 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.067549 10100 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:04.849675 10181 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:05.137455  8432 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.011s	sys 0.024s
I20260709 13:01:05.064725  9095 raft_consensus.cc:2376] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4. Re-sending same reply.
I20260709 13:01:05.152863 10220 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:05.155577  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:05.189247  8427 raft_consensus.cc:2368] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4.
I20260709 13:01:05.175653  9898 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:05.175848  8432 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.011s	sys 0.024s
W20260709 13:01:05.176579  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.014s	sys 0.025s
I20260709 13:01:05.082887 10203 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:05.193085  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.014s	sys 0.025s
I20260709 13:01:05.089123 10182 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:05.174443  8577 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.060s	sys 0.155s
I20260709 13:01:05.200736  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:05.201772  8427 raft_consensus.cc:2368] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:05.192183  9898 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.139082 10135 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:05.154446 10111 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:05.212917  9898 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:05.213923  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:05.224530  8435 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.014s	sys 0.027s
W20260709 13:01:05.226899  8435 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.014s	sys 0.028s
I20260709 13:01:05.228988  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:05.205498  8577 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.060s	sys 0.155s
I20260709 13:01:05.087242 10217 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.206825 10220 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:05.209753 10122 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:05.263798  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:05.258522 10130 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.120s	user 0.018s	sys 0.051s
I20260709 13:01:05.250985 10188 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:05.298194  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.014s	sys 0.006s
I20260709 13:01:05.298643  8427 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:05.264643 10068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.015s	sys 0.005s
I20260709 13:01:05.257542  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:05.330588  8476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.007s	sys 0.028s
W20260709 13:01:05.332237  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.014s	sys 0.006s
I20260709 13:01:05.333230 10215 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:05.337181  8476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.007s	sys 0.028s
I20260709 13:01:05.265661 10209 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:05.260939 10094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.002s	sys 0.017s
I20260709 13:01:05.226073 10111 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.335299  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:05.332058 10224 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.243s	user 0.002s	sys 0.009s
I20260709 13:01:05.344040  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:05.361776  9102 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
W20260709 13:01:05.337955  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 553416us
W20260709 13:01:05.307703 10130 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.018s	sys 0.051s
I20260709 13:01:05.300956 10138 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:05.332683 10068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.015s	sys 0.005s
W20260709 13:01:05.333770  8426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.023s	sys 0.047s
W20260709 13:01:05.371183  8426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.023s	sys 0.047s
I20260709 13:01:05.367522  8476 leader_election.cc:400] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3.
I20260709 13:01:05.371800  8476 leader_election.cc:403] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:05.335354 10188 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:05.358659 10094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.003s	sys 0.017s
I20260709 13:01:05.338490 10202 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:05.332788 10132 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:05.368172  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:05.361222 10154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.001s	sys 0.023s
W20260709 13:01:05.382202  9066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.014s	sys 0.011s
I20260709 13:01:05.348114 10159 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:05.339867 10238 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:05.348332 10051 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:05.386935  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:05.373481 10068 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:05.379458  8578 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.024s
I20260709 13:01:05.387676  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:05.349411 10205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.020s	sys 0.052s
I20260709 13:01:05.372818 10188 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:05.423662  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.005s	sys 0.022s
I20260709 13:01:05.382273 10215 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3.
I20260709 13:01:05.475128  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 658) took 1018 ms. Trace:
I20260709 13:01:05.298234 10220 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.383948 10138 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:05.353610 10103 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:01:05.386791  8429 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 2: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:01:05.348631 10230 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:01:05.479998  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:05.369778 10231 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:05.382429 10122 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:05.495285  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.005s	sys 0.024s
W20260709 13:01:05.455615  9066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.016s	sys 0.013s
I20260709 13:01:05.379478 10094 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:05.379952  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:05.485181  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 388028us
W20260709 13:01:05.393013 10154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.001s	sys 0.024s
I20260709 13:01:05.500104  9100 rpcz_store.cc:276] 0709 13:01:04.456880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.617505 (+160625us) service_pool.cc:224] Handling call
0709 13:01:05.474904 (+857399us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54006121d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:05.475042 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492302208}
I20260709 13:01:05.498189 10218 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:05.485203 10205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.020s	sys 0.052s
W20260709 13:01:05.546402  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 409253us
I20260709 13:01:05.360157 10209 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.608276 10241 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:05.610275 10209 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:05.488256  8578 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.010s	sys 0.024s
I20260709 13:01:05.562209  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:05.558286  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:05.558585  9898 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.611883  8509 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 2: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:05.612064  9898 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:05.538635  8431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.009s	sys 0.051s
I20260709 13:01:05.614208  9898 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:05.563944  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 459074us
W20260709 13:01:05.614451  8431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.010s	sys 0.051s
I20260709 13:01:05.569425  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 589) took 2086 ms. Trace:
I20260709 13:01:05.615511  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:05.615150  9099 rpcz_store.cc:276] 0709 13:01:03.468384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.471574 (+  3190us) service_pool.cc:224] Handling call
0709 13:01:03.591873 (+120299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.650286 (+ 58413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.651288 (+  1002us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.792327 (+141039us) log.cc:844] Serialized 556 byte log entry
0709 13:01:04.798372 (+1006045us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:04.817813 (+ 19441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.832705 (+ 14892us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.510696 (+677991us) raft_consensus.cc:1685] finished
0709 13:01:05.510724 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.554856 (+ 44132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":993572,"threads_started":1,"wal-append.queue_time_us":1239519}
I20260709 13:01:05.500124 10144 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:05.495970 10232 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:05.567802  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:05.564738 10222 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
I20260709 13:01:05.511399 10138 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.535838 10202 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:05.573772  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:05.546665 10240 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:05.607553 10182 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:05.619319  8427 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:05.619764  9898 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:05.619911  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 61709.7us
I20260709 13:01:05.623682  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1418) took 1177 ms. Trace:
I20260709 13:01:05.625595 10111 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:05.568014 10184 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:05.631196  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:05.700147  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 126465us
I20260709 13:01:05.705080  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:05.719153  8427 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:01:05.705334  8547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.005s	sys 0.027s
I20260709 13:01:05.705443  8432 rpcz_store.cc:276] 0709 13:01:04.446147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.447066 (+   919us) service_pool.cc:224] Handling call
0709 13:01:04.447360 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.447564 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:05.192365 (+744801us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.623379 (+431014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:05.623426 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:05.623470 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.623535 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.623636 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78147,"prepare.queue_time_us":176856,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":81,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":8282,"thread_start_us":1075085,"threads_started":2}
W20260709 13:01:05.631182 10040 consensus_meta.cc:287] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.005s	user 0.005s	sys 0.005s
W20260709 13:01:05.720474  8547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.005s	sys 0.027s
I20260709 13:01:05.722131  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1584) took 1281 ms. Trace:
I20260709 13:01:05.618716 10218 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:05.636219  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:05.554939 10122 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.627043 10232 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.622637 10116 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:05.729110  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:05.730463  8475 leader_election.cc:400] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3.
I20260709 13:01:05.722625  8435 rpcz_store.cc:276] 0709 13:01:04.441027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.448595 (+  7568us) service_pool.cc:224] Handling call
0709 13:01:04.448924 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.449271 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:05.227372 (+778101us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.721649 (+494277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:05.721769 (+   120us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:05.721825 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.721907 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.722069 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99079,"prepare.queue_time_us":266329,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":22425,"thread_start_us":1154131,"threads_started":2}
I20260709 13:01:05.618306 10159 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.149s
I20260709 13:01:05.631314 10144 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:05.496171 10238 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.608868 10241 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:05.554509 10231 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.643450 10068 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.703637 10240 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.732259  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:05.864701 10252 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.788182 10178 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.407472 10252 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:06.386324 10133 consensus_meta.cc:287] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.754s	user 0.004s	sys 0.009s
I20260709 13:01:06.407764 10178 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.408209  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:05.705065 10219 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:06.408398 10133 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.409308 10219 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.409621  8428 raft_consensus.cc:2368] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:05.874402 10243 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:06.411192  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 680804us
I20260709 13:01:06.410861 10243 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.411531 10133 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:05.860968 10094 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:06.412086 10133 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:06.388101 10126 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.556s	user 0.008s	sys 0.004s
I20260709 13:01:05.764573 10202 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:06.356123 10249 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.332s	user 0.000s	sys 0.000s
I20260709 13:01:06.414342 10202 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:05.892303 10227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.008s	sys 0.027s
I20260709 13:01:06.415241  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 647) took 2066 ms. Trace:
W20260709 13:01:06.415550 10227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.019s	sys 0.043s
W20260709 13:01:05.789709 10223 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.531s	user 0.000s	sys 0.001s
I20260709 13:01:06.415669  9093 rpcz_store.cc:276] 0709 13:01:04.348595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.358912 (+ 10317us) service_pool.cc:224] Handling call
0709 13:01:04.523308 (+164396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.602789 (+ 79481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.617030 (+ 14241us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.817628 (+200598us) log.cc:844] Serialized 556 byte log entry
0709 13:01:05.474433 (+656805us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:05.484982 (+ 10549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.503960 (+ 18978us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.415035 (+911075us) raft_consensus.cc:1685] finished
0709 13:01:06.415052 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.415189 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":491557,"threads_started":1,"wal-append.queue_time_us":806424}
I20260709 13:01:06.417378  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1531) took 2761 ms. Trace:
W20260709 13:01:06.356446 10251 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:01:06.071636  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.008s	sys 0.017s
W20260709 13:01:06.418442  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.015s	sys 0.037s
I20260709 13:01:06.417754  8583 rpcz_store.cc:276] 0709 13:01:03.655879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.658166 (+  2287us) service_pool.cc:224] Handling call
0709 13:01:03.658760 (+   594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.667771 (+  9011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.667804 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.669865 (+  2061us) log.cc:844] Serialized 556 byte log entry
0709 13:01:05.083901 (+1414036us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:05.083942 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.084007 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.417196 (+1333189us) raft_consensus.cc:1685] finished
0709 13:01:06.417217 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.417329 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1375241,"threads_started":1,"wal-append.queue_time_us":1497817}
I20260709 13:01:06.418861  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1422) took 1861 ms. Trace:
W20260709 13:01:06.418953  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 1.28255e+06us
I20260709 13:01:06.419615  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.352473 10259 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.420706  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.420500 10259 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.421200 10241 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:06.383284 10260 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:01:06.419305  8430 rpcz_store.cc:276] 0709 13:01:04.557331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.817443 (+260112us) service_pool.cc:224] Handling call
0709 13:01:04.819414 (+  1971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.819784 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.819820 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.851337 (+ 31517us) log.cc:844] Serialized 556 byte log entry
0709 13:01:05.478080 (+626743us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:05.478116 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.478180 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.418676 (+940496us) raft_consensus.cc:1685] finished
0709 13:01:06.418697 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.418812 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":462484,"threads_started":1,"wal-append.queue_time_us":824690}
I20260709 13:01:06.423540  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.424233  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1429) took 1043 ms. Trace:
I20260709 13:01:06.424120 10116 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:06.424584  8430 rpcz_store.cc:276] 0709 13:01:05.381304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.423320 (+1042016us) service_pool.cc:224] Handling call
0709 13:01:06.424181 (+   861us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.425446  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.406845 10144 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:06.426077 10116 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.421744  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.413686 10126 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.427491 10116 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:06.428025 10116 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:05.775252 10253 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.426800  8583 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:06.429282  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:05.644016 10138 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.429828  8583 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:06.430608  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.431110  8583 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:06.426142  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 340) took 1489 ms. Trace:
I20260709 13:01:06.431747  8430 rpcz_store.cc:276] 0709 13:01:04.937238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.425236 (+1487998us) service_pool.cc:224] Handling call
0709 13:01:06.426089 (+   853us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.267558 10220 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.290145 10254 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:06.406818 10240 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:06.276876 10242 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.401s	user 0.000s	sys 0.000s
W20260709 13:01:06.222868 10058 consensus_meta.cc:287] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.402s	user 0.012s	sys 0.000s
I20260709 13:01:06.234352  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1421) took 1684 ms. Trace:
I20260709 13:01:06.419235 10231 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.435235 10058 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.435492  8431 rpcz_store.cc:276] 0709 13:01:04.549934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.581191 (+ 31257us) service_pool.cc:224] Handling call
0709 13:01:04.633897 (+ 52706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.638217 (+  4320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.638276 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.638892 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.615055 (+976163us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:05.615130 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.615235 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.189647 (+574412us) raft_consensus.cc:1685] finished
0709 13:01:06.198300 (+  8653us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.229496 (+ 31196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1692,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":49947,"thread_start_us":975679,"threads_started":1,"wal-append.queue_time_us":1494724}
I20260709 13:01:05.766083 10184 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.410885  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.427516 10144 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:06.439184 10144 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.166903 10215 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.410079 10252 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:06.272632 10256 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.413141 10243 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.440237 10215 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.439621 10144 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:06.440755 10256 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.442142 10232 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:05.729213 10040 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.444398 10122 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:05.765827  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:06.198423  8504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.010s	sys 0.011s
I20260709 13:01:05.788951  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.449518 10227 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.521647  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 601) took 1180 ms. Trace:
I20260709 13:01:06.508713 10144 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:06.525365  8429 raft_consensus.cc:2410] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:06.509550 10116 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.493884 10094 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.526104  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 349) took 1460 ms. Trace:
I20260709 13:01:06.526257 10256 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.524699 10227 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.526508  8429 rpcz_store.cc:276] 0709 13:01:05.065320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.631043 (+565723us) service_pool.cc:224] Handling call
0709 13:01:06.526041 (+894998us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:06.197810 10250 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.485s	user 0.000s	sys 0.001s
I20260709 13:01:06.527812  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.167353  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1441) took 1497 ms. Trace:
I20260709 13:01:06.464349 10058 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.465428 10240 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.207482 10245 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.529196  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.529628 10245 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.530124 10227 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.530290  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1588) took 2073 ms. Trace:
I20260709 13:01:06.530442  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.531237 10240 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.473191 10138 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.531608  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:05.947115 10262 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.532843  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.532593 10262 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.533172 10138 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:06.533754  8504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.014s	sys 0.018s
I20260709 13:01:06.508734 10126 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.534520  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1445) took 1087 ms. Trace:
I20260709 13:01:06.526486 10094 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.534889 10262 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:05.982290 10110 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:06.536162 10110 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:06.537328  8432 raft_consensus.cc:2410] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:06.538205  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 595) took 1198 ms. Trace:
W20260709 13:01:06.166849 10225 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
I20260709 13:01:06.538722  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.089779 10208 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.539369 10040 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.410782 10219 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.539700 10208 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.539839  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.540968  8432 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:06.541400 10219 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.541740  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.542328  8432 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:06.542614 10208 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:06.133930 10226 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.606s	user 0.000s	sys 0.001s
I20260709 13:01:06.543045  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.207140 10246 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.544260  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.544924  8432 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:06.545614  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 592) took 1207 ms. Trace:
I20260709 13:01:06.546602  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1424) took 1939 ms. Trace:
I20260709 13:01:06.546182  8427 raft_consensus.cc:2955] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:06.547650 10094 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.546980  8432 rpcz_store.cc:276] 0709 13:01:04.606924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.545925 (+1939001us) service_pool.cc:224] Handling call
0709 13:01:06.546196 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.546330 (+   134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.546354 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.546392 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:06.546421 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.546472 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.546557 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.530678  8434 rpcz_store.cc:276] 0709 13:01:04.456645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.458016 (+  1371us) service_pool.cc:224] Handling call
0709 13:01:04.458341 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.458689 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.458725 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.459245 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.952848 (+493603us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b18003f04c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:01:05.267497 (+314649us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:05.267558 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.267662 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.335763 (+ 68101us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b48002f0358. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:01:06.530087 (+1194324us) raft_consensus.cc:1685] finished
0709 13:01:06.530108 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.530235 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7166,"raft.queue_time_us":20190,"raft.run_cpu_time_us":8579,"raft.run_wall_time_us":833675,"spinlock_wait_cycles":80880384,"thread_start_us":313350,"threads_started":1,"wal-append.queue_time_us":1008223}
I20260709 13:01:06.548714 10232 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.549837  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1426) took 1901 ms. Trace:
I20260709 13:01:06.550069  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 338) took 1652 ms. Trace:
I20260709 13:01:06.550258  9099 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:06.046937 10132 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.535502  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.550225  8432 rpcz_store.cc:276] 0709 13:01:04.648417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.549172 (+1900755us) service_pool.cc:224] Handling call
0709 13:01:06.549420 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.549569 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.549592 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.549629 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:06.549659 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.549706 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.549791 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.551401 10132 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:06.533978  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.552480  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1427) took 1176 ms. Trace:
W20260709 13:01:06.552896  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 936185us
I20260709 13:01:06.540128  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:06.478659  9066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.009s	sys 0.018s
W20260709 13:01:06.554260  9066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.009s	sys 0.018s
I20260709 13:01:06.554419  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1433) took 1050 ms. Trace:
I20260709 13:01:06.555104  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 593) took 1216 ms. Trace:
I20260709 13:01:06.555475  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1432) took 1068 ms. Trace:
I20260709 13:01:06.555873  8429 rpcz_store.cc:276] 0709 13:01:05.486951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.552994 (+1066043us) service_pool.cc:224] Handling call
0709 13:01:06.553260 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.553537 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.555174 (+  1637us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.555220 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:06.555261 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.555325 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.555423 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.554847  8432 rpcz_store.cc:276] 0709 13:01:05.503670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.553694 (+1050024us) service_pool.cc:224] Handling call
0709 13:01:06.553975 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.554149 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.554172 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.554206 (+    34us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:06.554232 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.554285 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.554375 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.558324  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.559543  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.546015  9095 rpcz_store.cc:276] 0709 13:01:05.338251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.363001 (+ 24750us) service_pool.cc:224] Handling call
0709 13:01:06.544827 (+1181826us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:06.545042 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.545225 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.545257 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.545349 (+    92us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:06.545381 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.545447 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.545556 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14577536}
I20260709 13:01:06.560081  9099 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:01:06.560675  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.560966  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.482903 10178 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.511214  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.509063 10215 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:06.488142  9094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.006s	sys 0.029s
I20260709 13:01:06.562543  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1428) took 1186 ms. Trace:
I20260709 13:01:06.534859  8504 rpcz_store.cc:276] 0709 13:01:05.446824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.475786 (+ 28962us) service_pool.cc:224] Handling call
0709 13:01:05.476382 (+   596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.476722 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.476749 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.539499 (+ 62750us) log.cc:844] Serialized 556 byte log entry
0709 13:01:06.534170 (+994671us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:06.534210 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.534275 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.534316 (+    41us) raft_consensus.cc:1685] finished
0709 13:01:06.534326 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.534448 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":926852,"threads_started":1,"wal-append.queue_time_us":940318}
I20260709 13:01:06.510864  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.538690  9097 rpcz_store.cc:276] 0709 13:01:05.339313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.349152 (+  9839us) service_pool.cc:224] Handling call
0709 13:01:06.537477 (+1188325us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:06.537668 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.537849 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.537876 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.537917 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:06.537968 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.538046 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.538150 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31341312}
W20260709 13:01:06.562821  9094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.008s	sys 0.029s
I20260709 13:01:06.564211  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.564357  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.564653  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 648) took 2215 ms. Trace:
I20260709 13:01:06.564743  8583 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 1.
I20260709 13:01:06.565593  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.510426 10188 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.512390 10184 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.567042  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:06.567727  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.568320  8583 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:06.568711 10178 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.568868  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:06.552814  8426 rpcz_store.cc:276] 0709 13:01:05.375883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.551807 (+1175924us) service_pool.cc:224] Handling call
0709 13:01:06.552061 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.552209 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.552233 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.552272 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:06.552299 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.552345 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.552433 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.569200 10178 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.550491  8434 rpcz_store.cc:276] 0709 13:01:04.897883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.549346 (+1651463us) service_pool.cc:224] Handling call
0709 13:01:06.549595 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.549745 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.549771 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.549810 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:06.549854 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.549904 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.550002 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.571156 10178 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.555492  9098 rpcz_store.cc:276] 0709 13:01:05.338648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.349272 (+ 10624us) service_pool.cc:224] Handling call
0709 13:01:06.554413 (+1205141us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:06.554632 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.554797 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.554822 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.554865 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:06.554895 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.554948 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.555047 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25666432}
I20260709 13:01:06.571789 10178 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.572305 10178 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.572532  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.573163  9098 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:06.525115  9100 rpcz_store.cc:276] 0709 13:01:05.341171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.568516 (+227345us) service_pool.cc:224] Handling call
0709 13:01:05.569038 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.569377 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.569405 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.622695 (+ 53290us) log.cc:844] Serialized 556 byte log entry
0709 13:01:06.406437 (+783742us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:06.406477 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.406552 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.521463 (+114911us) raft_consensus.cc:1685] finished
0709 13:01:06.521481 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.521596 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":424100,"threads_started":1,"wal-append.queue_time_us":895863}
I20260709 13:01:06.574591  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.574795 10178 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.575008  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.575161  9098 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:06.576028  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:06.576088  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.577127  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.553484 10132 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.538312 10110 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.565128  9097 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:06.578006 10094 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:06.578696 10094 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.579211 10094 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.561733  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.577162  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.580158  9095 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:06.580271  9098 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:06.585609  8433 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:06.563000  8430 rpcz_store.cc:276] 0709 13:01:05.376549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.432373 (+1055824us) service_pool.cc:224] Handling call
0709 13:01:06.562490 (+130117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.590507  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.528451  8510 rpcz_store.cc:276] 0709 13:01:04.622858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.715482 (+ 92624us) service_pool.cc:224] Handling call
0709 13:01:06.119745 (+1404263us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b54003a07d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:06.119923 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157718912}
W20260709 13:01:06.593158  8547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.006s	sys 0.009s
W20260709 13:01:06.593580  8547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.006s	sys 0.009s
I20260709 13:01:06.593884  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:06.595197  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.595441  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:05.706383 10234 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.607136 10279 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:06.607569 10279 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:06.607764  8501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1438) took 1985 ms (client timeout 1959 ms). Trace:
I20260709 13:01:06.608078 10279 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.608770  8581 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:06.596215  8433 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:06.611145  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:05.894927  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1530) took 2232 ms. Trace:
I20260709 13:01:06.597597  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:06.412566 10133 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:06.433059 10253 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.591552  8582 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
W20260709 13:01:06.591370  8475 connection.cc:256] RPC call timeout handler was delayed by -1.3269772689999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:01:05.877807 10082 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.163s	user 0.016s	sys 0.013s
I20260709 13:01:05.774632 10218 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.592444 10178 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.603006  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.485018 10259 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:05.877167 10217 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:06.603879  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:06.604632 10283 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:01:06.652089  8578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.010s	sys 0.010s
I20260709 13:01:06.708639  8435 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:06.577838 10184 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:06.115856 10130 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:05.800737  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.639807  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.718518  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:06.608222  8501 rpcz_store.cc:269] 0709 13:01:04.621908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.623634 (+  1726us) service_pool.cc:224] Handling call
0709 13:01:06.607598 (+1983964us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b54001fc054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:06.607702 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34229632}
I20260709 13:01:06.641644  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:06.642920  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:06.727263  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 85694.1us
W20260709 13:01:06.727495  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 84674.3us
I20260709 13:01:06.728258  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:06.729067  8428 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 345) took 1700 ms (client timeout 1541 ms). Trace:
I20260709 13:01:06.729323  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:06.643164  9067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 1.593s (SENT) [suppressed 2 similar messages]
I20260709 13:01:06.521709  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.646819 10240 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.607605 10232 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.649046  8584 rpcz_store.cc:276] 0709 13:01:03.655565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.659120 (+  3555us) service_pool.cc:224] Handling call
0709 13:01:03.673700 (+ 14580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.676497 (+  2797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.676536 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.695673 (+ 19137us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.714944 (+1019271us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:04.714985 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.740549 (+ 25564us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.887690 (+1147141us) raft_consensus.cc:1685] finished
0709 13:01:05.887717 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.887882 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2406,"raft.queue_time_us":2522,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":11685,"thread_start_us":988245,"threads_started":1,"wal-append.queue_time_us":1327686}
I20260709 13:01:06.656692  8475 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:06.671103  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1423) took 2105 ms. Trace:
I20260709 13:01:06.531684 10245 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:06.736528  8580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1537) took 2167 ms (client timeout 1607 ms). Trace:
W20260709 13:01:06.736924  8580 rpcz_store.cc:269] 0709 13:01:04.547295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.547458 (+   163us) service_pool.cc:224] Handling call
0709 13:01:06.714270 (+2166812us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b54000aa5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:06.714411 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4400216320}
I20260709 13:01:06.737411 10071 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.698251  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 100730us
I20260709 13:01:06.638147 10234 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.737960 10071 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:01:06.739372  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:06.739902 10071 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.740270 10234 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.740813  8547 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:06.699669  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 95854.5us
I20260709 13:01:06.700233 10273 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:06.678216 10082 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.742309  9099 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:06.743810  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:06.744331  9099 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:06.579165  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.565124  9094 rpcz_store.cc:276] 0709 13:01:04.348937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.359421 (+ 10484us) service_pool.cc:224] Handling call
0709 13:01:04.852487 (+493066us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:04.929212 (+ 76725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.554343 (+625131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.558384 (+  4041us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.568892 (+ 10508us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.564210 (+995318us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:06.564252 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.564327 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.564369 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:06.564384 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.564572 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":351993,"raft.run_cpu_time_us":9170,"raft.run_wall_time_us":98156,"spinlock_wait_cycles":58469248,"thread_start_us":1492148,"threads_started":2,"wal-append.queue_time_us":945304}
I20260709 13:01:06.745901  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:06.746719  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.747378  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.747923  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:06.748543  9094 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:06.747512 10058 raft_consensus.cc:2955] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:06.750253  9101 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:06.750694  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1431) took 1274 ms. Trace:
I20260709 13:01:06.751039  8435 rpcz_store.cc:276] 0709 13:01:05.476646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.410641 (+933995us) service_pool.cc:224] Handling call
0709 13:01:06.750525 (+339884us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400239454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:06.750643 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620393216}
I20260709 13:01:06.752851  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 596) took 1413 ms. Trace:
I20260709 13:01:06.648489  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.715929  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.754482 10122 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.755122 10122 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.756549  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.757386  8435 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:01:06.732950 10257 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:06.760001 10257 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:06.760216 10218 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
W20260709 13:01:06.708736  8578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.010s	sys 0.010s
I20260709 13:01:06.760514 10257 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.707739 10144 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.733439  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:06.733974  8575 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:06.741873 10253 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:06.744247 10082 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.712066  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.734421  9898 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:06.798581  9898 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:06.734090  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 77503.7us
I20260709 13:01:06.798194  8583 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
W20260709 13:01:06.766471  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.031s	sys 0.043s
I20260709 13:01:06.799005  9898 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:06.729458  8428 rpcz_store.cc:269] 0709 13:01:05.013349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.084470 (+ 71121us) service_pool.cc:224] Handling call
0709 13:01:06.713542 (+1629072us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400125a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:06.713715 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036888448}
I20260709 13:01:06.544225 10246 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.753326  9101 rpcz_store.cc:276] 0709 13:01:05.339652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.342270 (+  2618us) service_pool.cc:224] Handling call
0709 13:01:06.586783 (+1244513us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:06.586959 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.750731 (+163772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.752574 (+  1843us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540017a054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:06.752780 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401764992}
I20260709 13:01:06.734239  8427 rpcz_store.cc:276] 0709 13:01:04.566172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.545632 (+1979460us) service_pool.cc:224] Handling call
0709 13:01:06.545883 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.546079 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:06.583390 (+ 37311us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.670731 (+ 87341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.670791 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:06.670833 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.670896 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.671037 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":397,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":86083,"threads_started":1}
I20260709 13:01:06.761219  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1534) took 2289 ms. Trace:
I20260709 13:01:06.801843  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:06.802527  8583 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:06.735184 10208 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:06.705296 10178 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:06.732785 10094 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.767830 10231 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.769888  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:06.716897 10184 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:06.820763  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50938.9us
I20260709 13:01:06.822176  8400 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:06.732646 10040 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:06.732264 10132 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:06.799724  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.031s	sys 0.044s
I20260709 13:01:06.790305  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:06.734647 10130 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:06.768576 10122 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.768399 10240 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.789844  8547 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:06.789829  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1439) took 2141 ms. Trace:
I20260709 13:01:06.794317  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 1799) took 1062 ms. Trace:
I20260709 13:01:06.849005  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.865984  8584 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
I20260709 13:01:06.742300 10273 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.868067 10273 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:06.879107 10221 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.571s	user 0.002s	sys 0.012s
I20260709 13:01:06.881541  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.883080  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.883920  8580 raft_consensus.cc:2368] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:06.841516 10040 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.797684 10254 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:06.853297  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:06.732827  8576 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:06.806881  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.861174  8582 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 2: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:06.846535 10227 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:06.841151 10184 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.795878 10241 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:01:06.863685  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.905471  8581 raft_consensus.cc:2368] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:06.906478  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.907617  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:06.886503  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 96739.9us
I20260709 13:01:06.911063  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.801206 10110 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:06.897540  9068 connection.cc:256] RPC call timeout handler was delayed by -1.9535090499999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260709 13:01:06.853227 10158 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:06.900048  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46828.2us
I20260709 13:01:06.855417 10082 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:06.885437  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 95180.9us
I20260709 13:01:06.888310  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1529) took 3233 ms. Trace:
I20260709 13:01:06.850226 10231 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:06.899088 10282 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:06.918598  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:06.918157  9068 connection.cc:256] RPC call timeout handler was delayed by -1.882823180999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 13:01:06.770620 10261 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.116s
I20260709 13:01:06.924491  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.897297 10040 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.865216 10271 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:06.917655  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.922389  8579 rpcz_store.cc:276] 0709 13:01:03.655275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.656613 (+  1338us) service_pool.cc:224] Handling call
0709 13:01:03.751082 (+ 94469us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ae9c 00007f1a1621aa5b 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:03.751260 (+   178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.751580 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.751607 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.756502 (+  4895us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.843447 (+1086945us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:04.843502 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.843582 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.878257 (+2034675us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:06.888099 (+  9842us) raft_consensus.cc:1685] finished
0709 13:01:06.888128 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.888261 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":619,"raft.queue_time_us":1379,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":11299,"spinlock_wait_cycles":15251200,"thread_start_us":1078461,"threads_started":1,"wal-append.queue_time_us":1455959}
I20260709 13:01:06.906704 10132 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:06.901511 10138 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:06.914541  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 1806) took 1180 ms. Trace:
I20260709 13:01:06.906090  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1535) took 2428 ms. Trace:
I20260709 13:01:06.939939  8576 rpcz_store.cc:276] 0709 13:01:05.734612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.521267 (+786655us) service_pool.cc:224] Handling call
0709 13:01:06.905515 (+384248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.944483 10238 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:06.945166  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.945608  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.946329  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.946452  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.947445  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.947816  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.948202  8576 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:06.948827  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.948982  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.949520  8582 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:06.949635  8576 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:06.914083 10227 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.950253 10227 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:06.929819  9068 connection.cc:256] RPC call timeout handler was delayed by -1.8797828659999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 13:01:06.951108  9068 connection.cc:256] RPC call timeout handler was delayed by -1.8522174999999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
W20260709 13:01:06.951486  9068 connection.cc:256] RPC call timeout handler was delayed by -1.7015311979999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 13:01:06.951809  9068 connection.cc:256] RPC call timeout handler was delayed by -1.485648140999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 13:01:06.931079  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.952389  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:06.953572  8580 raft_consensus.cc:2368] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:06.930404  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:06.860728  8503 rpcz_store.cc:276] 0709 13:01:04.622276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.623386 (+  1110us) service_pool.cc:224] Handling call
0709 13:01:04.633834 (+ 10448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.083013 (+449179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.711034 (+1628021us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400154854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:06.763718 (+ 52684us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502393600}
W20260709 13:01:06.955770 10297 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:01:06.956284  9096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 594) took 1617 ms (client timeout 1595 ms). Trace:
I20260709 13:01:06.865032  8575 rpcz_store.cc:276] 0709 13:01:05.732205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.785541 (+ 53336us) service_pool.cc:224] Handling call
0709 13:01:06.790510 (+1004969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33536}
I20260709 13:01:06.933713 10158 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:06.946631  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:06.928501 10277 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.936774  8431 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:06.917819 10110 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.959580  9068 leader_election.cc:400] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4.
W20260709 13:01:06.956696  9096 rpcz_store.cc:269] 0709 13:01:05.338986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.349206 (+ 10220us) service_pool.cc:224] Handling call
0709 13:01:06.956063 (+1606857us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400526554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:06.956204 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2403537280}
I20260709 13:01:06.971896  9068 leader_election.cc:403] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:06.974710  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:06.975463  9068 leader_election.cc:400] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:06.936949 10132 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.924082 10254 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:01:06.937814 10282 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:06.928970 10082 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:06.963099 10253 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:06.968993 10280 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:01:06.992035  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:06.950604  8582 raft_consensus.cc:2955] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:06.970263 10133 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:06.801801  8578 rpcz_store.cc:276] 0709 13:01:04.471885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.478922 (+  7037us) service_pool.cc:224] Handling call
0709 13:01:04.834073 (+355151us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:04.834277 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.834483 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:05.611083 (+776600us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.760884 (+1149801us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.760939 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:06.760983 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.761057 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.761166 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":502316,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":464829,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":9554176,"thread_start_us":1865413,"threads_started":3,"wal-append.queue_time_us":905852}
I20260709 13:01:06.961056 10116 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:06.976749  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:06.990324 10217 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4.
I20260709 13:01:07.015651 10218 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:06.974596 10110 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.990869 10132 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.045771  9898 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.020637 10253 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.014967 10158 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:07.061184  8583 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:07.033427 10116 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.065121 10116 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.069288 10217 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:06.943608 10130 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:07.072850  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 96155.8us
I20260709 13:01:07.031203 10259 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:07.078716  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:07.082090  9068 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:07.086274  9068 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:07.083778  9898 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.066207 10158 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:07.038694 10094 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.087608 10158 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.942551  8577 rpcz_store.cc:276] 0709 13:01:04.473477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.480123 (+  6646us) service_pool.cc:224] Handling call
0709 13:01:04.553392 (+ 73269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.558099 (+  4707us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:06.519640 (+1961541us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b18002d6640. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf
0709 13:01:06.519792 (+   152us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.848861 (+329069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.854239 (+  5378us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:06.857000 (+  2761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.863254 (+  6254us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.901816 (+ 38562us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10515,"prepare.queue_time_us":700911,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":29218,"raft.queue_time_us":11585,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5896,"spinlock_wait_cycles":16966400,"thread_start_us":992516,"threads_started":2,"wal-append.queue_time_us":413458}
I20260709 13:01:07.087453 10259 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.089102  8428 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:07.089032  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:07.094265  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:07.066390 10253 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.110869  9068 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:07.112334 10188 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:06.990515 10277 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.070443 10282 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.037701 10218 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.117519  9898 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.088689 10202 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.119946  9898 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:07.106853 10294 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
I20260709 13:01:07.107450 10240 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.109838 10178 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:07.145778  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:07.110756 10217 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.151461  9898 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:07.121399 10287 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.137277  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.115581 10277 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:07.085901 10246 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:07.121507 10071 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.136708 10289 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:01:07.168025 10071 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.143184 10234 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.154881 10287 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.187340 10110 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:07.188463  8431 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:07.190208  9099 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:07.193605  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:07.194067 10071 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.194291  8510 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.202868  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.203686  8504 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:07.204866  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:07.205619  8435 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:07.207330  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:07.208424 10071 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:07.208583 10218 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:07.208907 10071 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.210592 10071 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:07.218732  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 575531us
I20260709 13:01:07.220892 10278 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:07.222880  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.225732  8510 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:07.227617  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:07.228549  9099 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:07.221860 10082 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:07.232082  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.231113  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.233914  8510 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:07.237277  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.237954  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:07.238804  8510 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.232576  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.248908 10116 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.250164  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:07.250762  9094 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.254386 10287 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.227205  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.227480 10218 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:07.266057 10257 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
W20260709 13:01:07.266599 10058 consensus_meta.cc:287] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.004s
I20260709 13:01:07.268556 10231 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:07.273859  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.277815  8504 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:07.274325  8501 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:07.274792 10116 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.279999 10110 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:07.280210  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.275465 10218 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:07.281838  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 429805us
W20260709 13:01:07.292848  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 318174us
I20260709 13:01:07.298189  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:07.274921 10287 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:01:07.296715  9898 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:07.302538 10116 raft_consensus.cc:2764] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:07.310760  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.276968 10259 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:07.314412  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:07.315642  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.318403  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.269546 10184 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.262135 10040 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:07.288162 10234 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:07.391067  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69985.8us
I20260709 13:01:07.391309  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.402076  8580 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:07.273204 10273 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:07.405953  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:07.407308  9898 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:07.407713  9898 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:07.408521  9898 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.409662  9898 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.412392  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:07.277948 10257 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.415032  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:07.416944 10133 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:07.420392  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:07.421363  8428 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:07.320267 10245 raft_consensus.cc:2955] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:07.398777 10272 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:07.462960 10110 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:07.468411 10279 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.001s
I20260709 13:01:07.468919 10279 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:07.472651  8584 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:07.475405 10279 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:07.478957 10257 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.450073  8577 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:07.412905 10234 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.509428 10234 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:07.466004 10272 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.510349 10272 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.422711 10133 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:07.451435 10184 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.445120 10273 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:07.443568 10040 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:07.439764 10218 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:07.470346 10227 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.002s
I20260709 13:01:07.520561 10227 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:07.522081  8427 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:07.524065 10227 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:07.482466 10158 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.526556 10158 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.429989 10071 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.529587 10071 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.449810  9094 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:07.531517  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.532148  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.532425  9097 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:07.534076  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.535368  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:07.536278  9098 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:01:07.537357  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 117056us
I20260709 13:01:07.538829  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.539479  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:07.519025 10133 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.533756  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:07.460817 10144 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.690s	user 0.006s	sys 0.003s
I20260709 13:01:07.545187  9097 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.545490 10144 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.546855  8583 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:07.539604  8504 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:07.501549 10253 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.552443 10253 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:07.561834 10178 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:07.562422 10178 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:07.562887 10158 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.563575 10178 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:07.571224  8330 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57098 (request call id 367) took 4242 ms. Trace:
I20260709 13:01:07.504452 10132 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.579988 10227 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:07.580969 10227 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.581388 10227 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.587452  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:07.589692  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:07.591044  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.535668  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.598368  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:07.611320  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:07.613368 10272 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.609753  8510 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
W20260709 13:01:07.620344  8549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.018s	sys 0.034s
W20260709 13:01:07.621186  8549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.018s	sys 0.034s
W20260709 13:01:07.623538  8550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.019s	sys 0.037s
W20260709 13:01:07.623883  8550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.019s	sys 0.037s
W20260709 13:01:07.624210  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 701243us
I20260709 13:01:07.625949  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:07.635581  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:07.636065  8547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.007s	sys 0.060s
W20260709 13:01:07.636454  8547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.007s	sys 0.060s
I20260709 13:01:07.636586  8428 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
W20260709 13:01:07.638561  8579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.021s	sys 0.026s
W20260709 13:01:07.639076  8579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.021s	sys 0.027s
W20260709 13:01:07.639614  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.014s	sys 0.063s
I20260709 13:01:07.596506 10208 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:07.656385  8582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.008s	sys 0.040s
W20260709 13:01:07.659852  8582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.008s	sys 0.041s
I20260709 13:01:07.660032  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.660755  9100 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:07.571727  8330 rpcz_store.cc:276] 0709 13:01:03.329278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.329435 (+   157us) service_pool.cc:224] Handling call
0709 13:01:07.571119 (+4241684us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:03.545529 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:03.546206 (+   677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:03.546238 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:01:03.546255 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:03.547135 (+   880us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:03.547235 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:03.547277 (+    42us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:01:03.548020 (+   743us) tablet.cc:701] Row locks acquired
0709 13:01:03.548046 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:01:03.548230 (+   184us) write_op.cc:270] Start()
0709 13:01:03.548363 (+   133us) write_op.cc:276] Timestamp: P: 1783602063548175 usec, L: 0
0709 13:01:03.548403 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:01:03.549230 (+   827us) log.cc:844] Serialized 2069 byte log entry
0709 13:01:05.634101 (+2084871us) op_driver.cc:464] REPLICATION: finished
0709 13:01:06.638963 (+1004862us) write_op.cc:301] APPLY: starting
0709 13:01:06.648367 (+  9404us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:06.707894 (+ 59527us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:06.791508 (+ 83614us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:06.952267 (+160759us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:07.007274 (+ 55007us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:01:07.018423 (+ 11149us) write_op.cc:312] APPLY: finished
0709 13:01:07.080394 (+ 61971us) log.cc:844] Serialized 47 byte log entry
0709 13:01:07.092265 (+ 11871us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:07.109205 (+ 16940us) write_op.cc:454] Released schema lock
0709 13:01:07.116908 (+  7703us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:07.165500 (+ 48592us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:07.167539 (+  2039us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":961828,"apply.run_cpu_time_us":4617,"apply.run_wall_time_us":517786,"num_ops":5,"prepare.queue_time_us":13555,"prepare.run_cpu_time_us":115431,"prepare.run_wall_time_us":727126,"raft.queue_time_us":1689419,"raft.run_cpu_time_us":42370,"raft.run_wall_time_us":880856,"replication_time_us":2085463,"thread_start_us":1994777,"threads_started":4,"wal-append.queue_time_us":865227,"wal-append.run_cpu_time_us":81332,"wal-append.run_wall_time_us":2175554}]]}
I20260709 13:01:07.651306  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1816) took 1006 ms. Trace:
W20260709 13:01:07.635860  8429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.025s	sys 0.033s
W20260709 13:01:07.636776  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 724174us
W20260709 13:01:07.658869  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.015s	sys 0.064s
W20260709 13:01:07.604508 10296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.009s	sys 0.042s
W20260709 13:01:07.603312 10232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.032s	sys 0.073s
I20260709 13:01:07.604920 10178 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:07.663923  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 553022us
I20260709 13:01:07.660879  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1543) took 1018 ms. Trace:
I20260709 13:01:07.650777 10116 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.669865  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:07.666846  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:07.648350  8576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.030s	sys 0.044s
I20260709 13:01:07.662142  8579 rpcz_store.cc:276] 0709 13:01:06.645318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.977837 (+332519us) service_pool.cc:224] Handling call
0709 13:01:06.978189 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.978429 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:07.053682 (+ 75253us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.650840 (+597158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.650914 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:07.650975 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.651072 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.651238 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14967,"prepare.queue_time_us":87981,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":83,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":3779,"thread_start_us":585516,"threads_started":1}
I20260709 13:01:07.719986  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:07.720319  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:07.720741  8428 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:07.720947  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 55096us
I20260709 13:01:07.722292  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:07.724210  8432 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:07.725739  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 56559us
I20260709 13:01:07.727139  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:07.665354  8429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.026s	sys 0.034s
W20260709 13:01:07.733265  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 122040us
I20260709 13:01:07.799439  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:07.666805 10296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.010s	sys 0.042s
W20260709 13:01:07.671208 10232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.033s	sys 0.075s
I20260709 13:01:07.801230  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:07.719218  8576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.030s	sys 0.044s
I20260709 13:01:07.814930  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.837918  8428 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:07.839985  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.844286  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.860301  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.848274  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.848896  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.849543  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:07.841825  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 218349us
W20260709 13:01:07.842476  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 115768us
I20260709 13:01:07.869369  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:07.801151 10272 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:07.807368 10116 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:07.871075  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.871865  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:07.810654 10188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.007s	sys 0.019s
W20260709 13:01:07.886277 10188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.008s	sys 0.019s
I20260709 13:01:07.886354  8580 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:07.887099  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:07.887537  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.887821  8508 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.889385  8580 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:07.873093  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:07.865016  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:07.893779 10231 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:07.894363 10231 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:07.894800 10301 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:07.895262 10130 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:07.874115  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53975.6us
I20260709 13:01:07.730463 10071 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:01:07.719316 10159 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.157s
I20260709 13:01:07.800671  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.886569 10188 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:07.663235  9098 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:07.669445 10133 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:07.814625 10208 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:07.908675  8549 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:07.910333  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.917024  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:07.958884  8508 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:07.850191  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.962664  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:07.973238  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 598) took 2633 ms. Trace:
I20260709 13:01:07.868919 10273 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:08.038307  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 129713us
I20260709 13:01:08.080837  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:07.896667  8431 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:07.984257 10282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.054s	sys 0.056s
I20260709 13:01:08.081971  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:08.102685  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:08.045024  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:08.112438  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:07.894845 10231 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.908021  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:07.959882 10241 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.024s	sys 0.055s
W20260709 13:01:08.116508  8426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.059s	sys 0.127s
I20260709 13:01:07.946826  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:08.133533  8426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.059s	sys 0.127s
I20260709 13:01:08.108469  8579 raft_consensus.cc:2376] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4. Re-sending same reply.
I20260709 13:01:08.142204  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:08.143219  8580 raft_consensus.cc:2368] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:08.036908  9102 rpcz_store.cc:276] 0709 13:01:05.340301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.369513 (+ 29212us) service_pool.cc:224] Handling call
0709 13:01:06.584227 (+1214714us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:06.584382 (+   155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.599334 (+ 14952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.599354 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.609860 (+ 10506us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.091074 (+481214us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:07.091111 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.091173 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.895967 (+804794us) raft_consensus.cc:1685] finished
0709 13:01:07.896012 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.973139 (+ 77127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14771,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":25828224,"thread_start_us":386216,"threads_started":1,"wal-append.queue_time_us":1007595}
I20260709 13:01:07.960579 10208 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.147256 10208 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.148427 10309 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:08.148660  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.149118 10309 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:08.149592 10309 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:08.147253  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:08.150885  9102 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:08.151845  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:08.153113 10311 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:08.138857  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.131946  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:07.841485 10313 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.232s
I20260709 13:01:08.154871  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.155099  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:08.155907  9093 raft_consensus.cc:2368] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:08.102118 10279 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:08.156170  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:08.156697  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:08.157011 10309 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.157445  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:08.131289 10282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.054s	sys 0.056s
I20260709 13:01:08.159128 10133 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:08.159746  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:08.153074  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:08.160319  9098 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.160985  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:08.161592  9102 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.078706 10253 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:08.162397 10253 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.167968  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:08.170454  8427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.012s	sys 0.029s
W20260709 13:01:08.172070  8427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.012s	sys 0.029s
W20260709 13:01:08.138545 10241 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.024s	sys 0.056s
W20260709 13:01:08.186859 10058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.025s	sys 0.032s
I20260709 13:01:08.157825  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:08.226295  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:08.249258  8505 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.230669  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.250377  8510 raft_consensus.cc:2368] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4.
I20260709 13:01:08.238807  9098 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:08.166003 10130 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:08.254498  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.259953  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:08.263723  9098 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:08.265255  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 603) took 1029 ms. Trace:
I20260709 13:01:08.265882  9098 rpcz_store.cc:276] 0709 13:01:07.235931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.259674 (+1023743us) service_pool.cc:224] Handling call
0709 13:01:08.265202 (+  5528us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:08.267232 10306 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:01:08.272527  9097 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.000s
I20260709 13:01:08.272827  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.257884  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 605) took 1021 ms. Trace:
W20260709 13:01:08.274000 10305 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.610s	user 0.000s	sys 0.001s
I20260709 13:01:08.274761  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:08.331079  8510 raft_consensus.cc:2410] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:08.275203 10132 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:08.280982  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:08.253305 10058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.026s	sys 0.032s
I20260709 13:01:08.291625  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.292687  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:08.345643  8507 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.294078  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:08.296300  8475 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.061s	sys 0.119s
W20260709 13:01:08.307919  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 496250us
I20260709 13:01:08.311156  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1553) took 1006 ms. Trace:
I20260709 13:01:08.138373 10273 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.258316 10130 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:08.273389  9102 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:08.311882  9097 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:08.261343  9093 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:08.305045 10159 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:08.338434  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.257503 10188 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.346400  8583 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
I20260709 13:01:08.309372  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:08.373843 10315 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:01:08.374161  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:08.374775 10317 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:01:08.374997  9093 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:08.375427  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 606) took 1119 ms. Trace:
I20260709 13:01:08.375730  9093 rpcz_store.cc:276] 0709 13:01:07.256313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.373836 (+1117523us) service_pool.cc:224] Handling call
0709 13:01:08.375372 (+  1536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.376402  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 669) took 1138 ms. Trace:
I20260709 13:01:08.376639  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:08.376825  9097 rpcz_store.cc:276] 0709 13:01:07.235133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.533393 (+298260us) service_pool.cc:224] Handling call
0709 13:01:08.373247 (+839854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.377429  9093 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:08.348995  8475 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.061s	sys 0.119s
W20260709 13:01:08.378440  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.05905e+06us
I20260709 13:01:08.378841  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:08.378217  9097 raft_consensus.cc:2955] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:08.379506  9096 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:08.380036  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 661) took 1157 ms. Trace:
I20260709 13:01:08.310781 10253 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:08.353103  8581 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
W20260709 13:01:08.310851 10245 consensus_meta.cc:287] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.855s	user 0.008s	sys 0.004s
I20260709 13:01:08.383076  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 548) took 1807 ms. Trace:
I20260709 13:01:08.349675  8575 rpcz_store.cc:276] 0709 13:01:07.302136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.302339 (+   203us) service_pool.cc:224] Handling call
0709 13:01:07.302794 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.404829 (+102035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.411710 (+  6881us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:07.462440 (+ 50730us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.082769 (+620329us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:08.116419 (+ 33650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.162162 (+ 45743us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.295243 (+133081us) raft_consensus.cc:1685] finished
0709 13:01:08.298153 (+  2910us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.308635 (+ 10482us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9630,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10014,"thread_start_us":499160,"threads_started":1,"wal-append.queue_time_us":804998}
I20260709 13:01:08.383432  9101 rpcz_store.cc:276] 0709 13:01:06.575824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.800245 (+224421us) service_pool.cc:224] Handling call
0709 13:01:06.803942 (+  3697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.804252 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.804278 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.804698 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.212920 (+408222us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:07.212971 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.214138 (+  1167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.382874 (+1168736us) raft_consensus.cc:1685] finished
0709 13:01:08.382891 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.383025 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":431,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":407830,"threads_started":1,"wal-append.queue_time_us":1072270}
I20260709 13:01:08.314337  9094 rpcz_store.cc:276] 0709 13:01:07.253613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.815219 (+561606us) service_pool.cc:224] Handling call
0709 13:01:08.253534 (+438315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.385538  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 607) took 1129 ms. Trace:
I20260709 13:01:08.386322  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:08.386550  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 549) took 1810 ms. Trace:
I20260709 13:01:08.386914  8501 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.386804  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.386736  9100 raft_consensus.cc:2955] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:08.388322  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:08.389314  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.389256 10208 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.390118  8509 raft_consensus.cc:2368] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4.
I20260709 13:01:08.390887  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.391573 10208 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:08.391233 10130 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.391770  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:08.392932  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.385862  9101 rpcz_store.cc:276] 0709 13:01:07.256571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.384821 (+1128250us) service_pool.cc:224] Handling call
0709 13:01:08.385096 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.385253 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.385275 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.385312 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:08.385340 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.385394 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.385488 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.395702  8505 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:08.396389  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 618) took 1085 ms. Trace:
I20260709 13:01:08.396828  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.397488  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.368566  8510 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
W20260709 13:01:08.313951 10227 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.731s	user 0.012s	sys 0.000s
I20260709 13:01:08.380383  9096 rpcz_store.cc:276] 0709 13:01:07.222853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.227139 (+  4286us) service_pool.cc:224] Handling call
0709 13:01:08.378735 (+1151596us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aeee 0000000000375939 00007f1a1e28e1e0 00007f1a1e3570c4 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:08.379980 (+  1245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72002304}
I20260709 13:01:08.378235 10159 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:08.396739  9101 rpcz_store.cc:276] 0709 13:01:07.310688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.395694 (+1085006us) service_pool.cc:224] Handling call
0709 13:01:08.395964 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.396124 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.396147 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.396183 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:08.396209 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.396254 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.396344 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.405750  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 619) took 1094 ms. Trace:
I20260709 13:01:08.406401  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 621) took 1086 ms. Trace:
I20260709 13:01:08.404032  8505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77b025d136d04841aa2759be7b816f77"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:01:08.377838  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 604) took 1141 ms. Trace:
I20260709 13:01:08.406956  9098 rpcz_store.cc:276] 0709 13:01:07.319837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.308872 (+989035us) service_pool.cc:224] Handling call
0709 13:01:08.406352 (+ 97480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.407308  8505 raft_consensus.cc:606] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:08.395084 10130 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.385761  8578 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:08.406136  9101 rpcz_store.cc:276] 0709 13:01:07.310950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.405008 (+1094058us) service_pool.cc:224] Handling call
0709 13:01:08.405292 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.405463 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.405493 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.405530 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:08.405559 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.405608 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.405704 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.385872  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 609) took 1128 ms. Trace:
I20260709 13:01:08.406975  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.366247  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:08.413123  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 300775us
I20260709 13:01:08.416890  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 622) took 1096 ms. Trace:
I20260709 13:01:08.417238  9102 rpcz_store.cc:276] 0709 13:01:07.320153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.354374 (+1034221us) service_pool.cc:224] Handling call
0709 13:01:08.416835 (+ 62461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.407922  9093 rpcz_store.cc:276] 0709 13:01:07.236209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.376391 (+1140182us) service_pool.cc:224] Handling call
0709 13:01:08.377779 (+  1388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.404111 10227 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.410842 10231 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:08.431702 10159 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:08.361500  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.014s	sys 0.028s
W20260709 13:01:08.518886  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.014s	sys 0.028s
I20260709 13:01:08.519598  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.351768  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:08.523226  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 171378us
I20260709 13:01:08.527632  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1554) took 1222 ms. Trace:
I20260709 13:01:08.528314  8577 rpcz_store.cc:276] 0709 13:01:07.305032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.312583 (+  7551us) service_pool.cc:224] Handling call
0709 13:01:07.418568 (+105985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.506496 (+ 87928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.526877 (+1020381us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b54000659d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:08.527361 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71816448}
I20260709 13:01:08.530541 10158 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:08.531534 10158 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:08.488318  8429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.022s	sys 0.023s
W20260709 13:01:08.535542  8429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.022s	sys 0.023s
I20260709 13:01:08.536909 10105 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:08.495287  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 327232us
I20260709 13:01:08.521920  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.500144  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:08.502271  8506 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:08.543272  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:08.544109  9098 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.545074  8506 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:08.504034  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 421989us
I20260709 13:01:08.416400  9094 rpcz_store.cc:276] 0709 13:01:07.257112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.385072 (+1127960us) service_pool.cc:224] Handling call
0709 13:01:08.385372 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.385562 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.385591 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.385632 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:08.385665 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.385721 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.385820 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.386946  9095 rpcz_store.cc:276] 0709 13:01:06.576095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.801781 (+225686us) service_pool.cc:224] Handling call
0709 13:01:06.802113 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.802444 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.802478 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.803005 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.125906 (+322901us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:07.136453 (+ 10547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.137473 (+  1020us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.386339 (+1248866us) raft_consensus.cc:1685] finished
0709 13:01:08.386357 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.386494 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1996,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":316112,"threads_started":1,"wal-append.queue_time_us":783393}
I20260709 13:01:08.508284  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1817) took 1862 ms. Trace:
I20260709 13:01:08.546730  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:08.511273  9065 leader_election.cc:400] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4.
I20260709 13:01:08.536995  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1596) took 2023 ms. Trace:
I20260709 13:01:08.414799  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:08.548801  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:08.547756  9065 leader_election.cc:403] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.549733 10058 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:08.550846 10058 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.551664  8506 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:08.552032  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1603) took 2036 ms. Trace:
W20260709 13:01:08.555006  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 55347.1us
I20260709 13:01:08.556085  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:08.556484  8575 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:08.547101  8576 rpcz_store.cc:276] 0709 13:01:06.645613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.966566 (+320953us) service_pool.cc:224] Handling call
0709 13:01:06.966949 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.827820 (+860871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.859010 (+ 31190us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.166531 (+307521us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.506983 (+340452us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:08.507137 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.507410 (+   273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.507535 (+   125us) raft_consensus.cc:1685] finished
0709 13:01:08.507554 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.507965 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154735,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":26943,"thread_start_us":1077719,"threads_started":2,"wal-append.queue_time_us":206237}
I20260709 13:01:08.557371  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:08.558053  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:08.558472 10094 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:08.560127  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.552588  8426 rpcz_store.cc:276] 0709 13:01:06.515940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.570114 (+ 54174us) service_pool.cc:224] Handling call
0709 13:01:06.751381 (+181267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.751560 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:07.106126 (+354566us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.141272 (+1035146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.141339 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:08.141397 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.141494 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.536204 (+394710us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400239450. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:08.551831 (+ 15627us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188420,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":18851,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":416271744,"thread_start_us":1388954,"threads_started":2,"wal-append.queue_time_us":1303920}
I20260709 13:01:08.565171  8427 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:07.667778  8582 rpcz_store.cc:276] 0709 13:01:06.642265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.950090 (+307825us) service_pool.cc:224] Handling call
0709 13:01:06.950331 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.950508 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:07.078793 (+128285us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.660578 (+581785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.660627 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:07.660667 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.660725 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.660831 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3295,"raft.queue_time_us":201,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":1744,"thread_start_us":581199,"threads_started":1}
I20260709 13:01:08.567524  8428 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:01:08.533654 10158 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.570953 10132 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.572991  8431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:01:08.549806  8429 rpcz_store.cc:276] 0709 13:01:06.513757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.560918 (+ 47161us) service_pool.cc:224] Handling call
0709 13:01:06.561195 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.561375 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:06.798689 (+237314us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.536176 (+1737487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.536318 (+   142us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:08.536465 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.536612 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.536849 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9010,"prepare.queue_time_us":279891,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":79704,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":92,"thread_start_us":1867039,"threads_started":3,"wal-append.queue_time_us":1346574}
I20260709 13:01:08.577135  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:08.614279  9098 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:08.614497 10319 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4.
I20260709 13:01:08.612092  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:08.614400 10178 consensus_meta.cc:287] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.873s	user 0.013s	sys 0.005s
I20260709 13:01:08.624291 10314 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.625825  8503 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:08.626799  8581 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.630143  8508 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:08.630519  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 73367.6us
I20260709 13:01:08.632944  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:08.634341 10335 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:08.635085  9065 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:08.635257 10334 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:08.636318 10188 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:08.636565 10319 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:08.636792 10188 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:08.625561 10232 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:08.637490 10188 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.637887 10319 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:08.640249  8507 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:08.637840 10232 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:08.641551  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:08.643834 10232 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:08.644009 10231 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:08.645740 10343 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:01:08.623644  8431 raft_consensus.cc:606] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:08.646611  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:08.647253  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:08.648854  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 617) took 1338 ms. Trace:
I20260709 13:01:08.646649  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:08.655227 10188 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.656032 10132 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.656741  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:08.614387 10058 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:08.710507  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 96681.6us
I20260709 13:01:08.875859  8430 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:08.876065  8581 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:08.787741 10215 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:08.876896  9102 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 LEARNER]: Advancing to term 3
I20260709 13:01:08.706691 10094 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:08.877628  9094 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.835985  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:08.875788  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:08.655328  8434 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:08.676673  8427 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:08.711067 10275 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:08.871934  8432 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:08.864665  8504 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
W20260709 13:01:08.880801  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 248039us
I20260709 13:01:08.874549  9100 rpcz_store.cc:276] 0709 13:01:07.310407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.386180 (+1075773us) service_pool.cc:224] Handling call
0709 13:01:08.386443 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.386637 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:08.421694 (+ 35057us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.648194 (+226500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.648284 (+    90us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:08.648400 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.648507 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.648653 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":252,"spinlock_wait_cycles":13782400,"thread_start_us":200501,"threads_started":1,"wal-append.queue_time_us":222709}
I20260709 13:01:08.872912  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:08.789645  8435 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:08.657748 10227 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:08.872577  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:08.640275 10319 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:08.873638 10287 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:08.891811  8431 raft_consensus.cc:614] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:08.889859 10215 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:08.898742 10319 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:08.917086  9098 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.899802 10287 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:08.921819  8508 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:08.900624 10275 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:08.919847  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:08.919355  8433 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.940099  8428 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:08.929018 10058 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:08.970288 10184 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:08.971107  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.971225 10346 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:08.973439  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1456) took 1157 ms. Trace:
W20260709 13:01:08.974227  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 98622.5us
I20260709 13:01:08.978379  8432 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:08.979053 10094 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:08.980439  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 670) took 1744 ms. Trace:
I20260709 13:01:08.980801  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1541) took 2339 ms. Trace:
I20260709 13:01:08.959810  8501 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:08.981381  8584 rpcz_store.cc:276] 0709 13:01:06.641767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.951978 (+310211us) service_pool.cc:224] Handling call
0709 13:01:06.952411 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.473105 (+520694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.980279 (+1507174us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54000163d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:08.980616 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195830656}
I20260709 13:01:08.967706 10132 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:08.970284 10188 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:09.033406  8433 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:09.013554  8508 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:09.021677  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49122.4us
I20260709 13:01:08.973877  8505 rpcz_store.cc:276] 0709 13:01:07.815840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.410078 (+594238us) service_pool.cc:224] Handling call
0709 13:01:08.562991 (+152913us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:08.563432 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.564274 (+   842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.564310 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.565083 (+   773us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.619340 (+ 54257us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:08.910722 (+291382us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.910948 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.911042 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.973000 (+ 61958us) raft_consensus.cc:1685] finished
0709 13:01:08.973100 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.973257 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76119,"raft.queue_time_us":49446,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5646,"spinlock_wait_cycles":66812032,"thread_start_us":200492,"threads_started":2,"wal-append.queue_time_us":298153}
I20260709 13:01:09.040064  9098 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:08.986093 10215 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:08.980903  9097 rpcz_store.cc:276] 0709 13:01:07.235356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.377490 (+1142134us) service_pool.cc:224] Handling call
0709 13:01:08.377869 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.378102 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:08.861957 (+483855us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.949129 (+ 87172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.951017 (+  1888us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:08.968185 (+ 17168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.980023 (+ 11838us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.980210 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2502,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4528,"thread_start_us":47756,"threads_started":1,"wal-append.queue_time_us":70817}
I20260709 13:01:09.046545  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.049506  9102 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEARNER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:09.049896  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.050350  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:09.051700 10275 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:09.053539  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54736.8us
I20260709 13:01:09.051748 10215 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.054518  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.055841 10094 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:09.056437  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 152801us
I20260709 13:01:09.056555 10094 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:09.057104 10094 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:09.057330  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.058218 10188 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:09.058720 10058 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.058961 10188 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.059425  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:09.060410 10058 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:09.059588 10303 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.233s	user 0.000s	sys 0.008s
I20260709 13:01:09.059710 10094 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.050942  8508 raft_consensus.cc:2376] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4. Re-sending same reply.
W20260709 13:01:09.047781 10256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.006s	user 0.003s	sys 0.045s
I20260709 13:01:09.066929  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1458) took 1214 ms. Trace:
I20260709 13:01:09.068102 10287 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:09.067718  8510 rpcz_store.cc:276] 0709 13:01:07.850630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.543462 (+692832us) service_pool.cc:224] Handling call
0709 13:01:08.544151 (+   689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.544884 (+   733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.544943 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.545535 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.711422 (+165887us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:09.045586 (+334164us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.045836 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.045929 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.061857 (+ 15928us) raft_consensus.cc:1685] finished
0709 13:01:09.061893 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.064793 (+  2900us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52038,"prepare.queue_time_us":352489,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":52818,"raft.run_cpu_time_us":501,"raft.run_wall_time_us":18152,"thread_start_us":420317,"threads_started":2,"wal-append.queue_time_us":498056}
I20260709 13:01:09.061064 10058 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:09.081276  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.077859  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:09.082748  8501 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:09.083096 10342 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:09.073553 10058 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.086928 10253 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:09.087476 10253 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.089079  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:09.089790  9065 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:09.090101 10318 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:09.090324 10319 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.090966  9097 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:09.091030 10318 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:09.091877 10318 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:09.076212 10256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.139s	user 0.004s	sys 0.046s
I20260709 13:01:09.092736  9096 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:08.955173  8426 raft_consensus.cc:2955] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:09.094082  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.094131  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.091895 10319 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.093063 10318 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.089802 10253 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:09.095770  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.096086  8432 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:09.105458  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:09.100379  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 68333.6us
I20260709 13:01:09.103556  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.104034  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.098523  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.112447  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.069969 10287 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.098430  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.096151  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.120160  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.099000  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:09.101739 10184 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.101356 10188 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:09.115856  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.121958  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.122332  8434 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:09.131657  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.130781  8432 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
W20260709 13:01:09.132654  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78397us
I20260709 13:01:09.134150  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:09.135198 10333 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:09.135761 10333 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:09.136901 10333 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.138284 10232 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.139072 10232 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:09.141577 10238 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.141789 10254 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.142565  8433 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:09.142323 10238 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:09.143013  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:09.143435 10144 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.144001 10144 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.142618  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:09.144973 10238 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:09.142387 10254 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:09.157196  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:09.145783 10241 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.132297 10184 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.158643  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:09.161194  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:09.164880  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:09.165416  8581 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
I20260709 13:01:09.153074 10231 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:09.146410 10144 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:09.169557  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:09.171272  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 95365.9us
I20260709 13:01:09.170779  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:09.177995  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.179447  8428 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:09.168008 10231 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.169100 10158 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:09.181777 10158 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:09.182366 10158 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.172559 10232 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:09.190304  8432 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:09.189689  8333 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 2 to 3, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 3 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.191162 10254 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:09.191684  8333 catalog_manager.cc:5697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 2 to 3, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 3 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.194227 10245 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:09.187748  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.194972  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:09.194348  8431 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:09.195850  8577 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
W20260709 13:01:09.196817  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 133721us
I20260709 13:01:09.184911 10231 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.198148  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.200017  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.198154  8429 raft_consensus.cc:2368] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:09.201644 10304 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:09.202148 10144 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:09.202217  8502 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:09.202729 10144 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:09.203209 10144 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.204187  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.184338 10253 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:09.206166 10238 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.205956  8501 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:09.185617 10241 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.211416 10238 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.213351 10241 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:09.214669  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.215474  8506 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
I20260709 13:01:09.217216  8431 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:09.217914 10232 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.218477 10312 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.218580 10232 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.219117 10312 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.220813 10232 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:09.221104 10312 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:09.221453  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.221750  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.222329  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.222594  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.222780  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.193266  8333 catalog_manager.cc:5697] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 1 to 2, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 2 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:09.223356  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.223711  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.224242 10238 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:09.224442  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.221884  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:09.225353  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:09.226200  8433 raft_consensus.cc:2368] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
W20260709 13:01:09.226815  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 105500us
I20260709 13:01:09.227397  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.227973  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.228466  9065 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:09.229290  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:09.230162 10253 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:09.234468  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:09.235541  8577 raft_consensus.cc:2410] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:09.223716  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:09.239142  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 92151.6us
I20260709 13:01:09.240658  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:09.226256  8429 raft_consensus.cc:2368] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:09.242786 10273 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:09.243678  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 394) took 1279 ms. Trace:
I20260709 13:01:09.247002  8503 rpcz_store.cc:276] 0709 13:01:07.962582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.549058 (+586476us) service_pool.cc:224] Handling call
0709 13:01:08.549568 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.626460 (+ 76892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.241372 (+614912us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b540008d254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:09.241599 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110054656}
I20260709 13:01:09.244297  8398 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:09.249855 10328 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:09.250416 10328 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:09.251400  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1448) took 1523 ms. Trace:
I20260709 13:01:09.210336 10245 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:09.201937 10287 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:09.244580 10218 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:09.251879  8502 rpcz_store.cc:276] 0709 13:01:07.728106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.730634 (+  2528us) service_pool.cc:224] Handling call
0709 13:01:09.103303 (+1372669us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aeee 0000000000375939 00007f1a1e28e1e0 00007f1a1e3570c4 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:09.251143 (+147840us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b54003732d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:09.251295 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236525824}
I20260709 13:01:09.293617  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:09.294595  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 90527.2us
I20260709 13:01:09.299778 10273 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.300448 10273 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:01:09.302305  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:09.304553  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 70687.9us
W20260709 13:01:09.307269  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.281216 10218 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:09.261754 10330 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:01:09.313539  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 72968.1us
W20260709 13:01:09.315913  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.317499  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:09.305110  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:09.276466 10158 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:09.325465 10318 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:09.326329 10318 consensus_queue.cc:1243] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:09.321276  8429 raft_consensus.cc:2955] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:09.326885 10318 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:09.325742 10316 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:09.327255 10318 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:09.327502 10316 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:09.328013 10316 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.334410  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.251401 10328 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.312023 10218 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.307293 10253 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:09.335925 10367 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:09.338689  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.340258  8434 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:09.342708  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:09.344534 10329 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:09.342748  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.350313 10375 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.350657  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:09.351274  8576 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.351861 10158 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:09.353776  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.354382  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.355199  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:09.355255  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:09.342763 10367 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:09.357370  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.357370  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:09.358563  8506 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:09.358750  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.359153  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.358881  8503 raft_consensus.cc:2955] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:09.367236  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.368760  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.370311  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:09.344944 10329 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.371927 10253 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.375232  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.376636  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.340301 10184 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.378168  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.379468  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.380606  8502 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:09.367779 10367 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.395063 10132 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:09.395526 10159 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.395690  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:09.404348 10329 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.396183 10227 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:09.380272  8577 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:09.408260  8581 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:09.416390  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:09.423066  9098 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:09.344926 10144 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.424834  8430 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:09.335666 10094 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:01:09.346726 10231 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.420414  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:09.425829  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:09.432384  8579 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.415022 10132 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:09.426332  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:09.426486 10159 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:09.445199  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 77351.1us
I20260709 13:01:09.427349  8583 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:09.447877  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:09.427927  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:09.428403  9096 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:09.430084 10184 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:09.328236 10318 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.443123 10316 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:09.443845 10218 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.444675  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.406628  9094 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
W20260709 13:01:09.450456  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 47119.3us
I20260709 13:01:09.449036 10132 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:09.460718  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47436.9us
I20260709 13:01:09.461030 10376 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.458459  8506 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:09.461347  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:09.462371 10159 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:09.458662 10094 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:01:09.462936 10231 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:09.464637 10368 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:09.465581  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:09.467375  8504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1854) took 1880 ms (client timeout 1908 ms). Trace:
I20260709 13:01:09.500311  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:09.469555  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.471028  8576 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:09.471702  8332 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32800 (request call id 242) took 6019 ms. Trace:
I20260709 13:01:09.472056 10144 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:09.422749 10227 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:09.486259 10184 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:01:09.504295  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45315.8us
I20260709 13:01:09.434451 10273 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:09.490976  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:09.509856  8508 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:01:09.510447  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 65863us
I20260709 13:01:09.467608  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:09.499549  8504 rpcz_store.cc:269] 0709 13:01:07.587020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.587162 (+   142us) service_pool.cc:224] Handling call
0709 13:01:09.467210 (+1880048us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001fe854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:09.467323 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2387249408}
I20260709 13:01:09.507014  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1455) took 1697 ms. Trace:
I20260709 13:01:09.508383  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:09.515847  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:09.503839 10375 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.522967  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:09.510054 10287 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:09.451316 10367 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:09.536881  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 71482.8us
I20260709 13:01:09.517149 10253 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:09.539112 10133 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:09.539670 10133 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:09.539875 10367 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:01:09.525202 10374 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:01:09.540665 10133 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.543712 10227 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.545455 10227 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:09.549185 10310 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:01:09.515467  8509 rpcz_store.cc:276] 0709 13:01:07.806313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.404167 (+597854us) service_pool.cc:224] Handling call
0709 13:01:08.515056 (+110889us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:08.515771 (+   715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.516530 (+   759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.516585 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.517645 (+  1060us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.616304 (+ 98659us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:09.396659 (+780355us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b18003e55a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf 00007f1a19359038
0709 13:01:09.492838 (+ 96179us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.502092 (+  9254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.502175 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.502215 (+    40us) raft_consensus.cc:1685] finished
0709 13:01:09.502225 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.503731 (+  1506us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":382906,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":6940,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":7272,"spinlock_wait_cycles":24005888,"thread_start_us":166092,"threads_started":2,"wal-append.queue_time_us":163813}
I20260709 13:01:09.538952  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.528276 10318 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:09.531047 10330 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:09.563941  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:09.578320  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 53484.2us
W20260709 13:01:09.578855 10369 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:01:09.579943  9067 leader_election.cc:400] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:09.580261  9067 leader_election.cc:403] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:09.502657  8332 rpcz_store.cc:276] 0709 13:01:03.452442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.452597 (+   155us) service_pool.cc:224] Handling call
0709 13:01:09.471387 (+6018790us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:04.361929 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:04.562923 (+200994us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:04.580132 (+ 17209us) write_op.cc:435] Acquired schema lock
0709 13:01:04.580148 (+    16us) tablet.cc:662] Decoding operations
0709 13:01:04.629965 (+ 49817us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:04.632999 (+  3034us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:04.634112 (+  1113us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:04.780397 (+146285us) tablet.cc:701] Row locks acquired
0709 13:01:04.780415 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:01:04.798372 (+ 17957us) write_op.cc:270] Start()
0709 13:01:04.826402 (+ 28030us) write_op.cc:276] Timestamp: P: 1783602064795067 usec, L: 0
0709 13:01:04.826456 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 13:01:05.024537 (+198081us) log.cc:844] Serialized 913 byte log entry
0709 13:01:06.522482 (+1497945us) op_driver.cc:464] REPLICATION: finished
0709 13:01:06.903534 (+381052us) write_op.cc:301] APPLY: starting
0709 13:01:06.903665 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:06.903862 (+   197us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:06.913282 (+  9420us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:06.917186 (+  3904us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:06.917401 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:06.917476 (+    75us) write_op.cc:312] APPLY: finished
0709 13:01:06.917712 (+   236us) log.cc:844] Serialized 29 byte log entry
0709 13:01:07.827041 (+909329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:07.859445 (+ 32404us) write_op.cc:454] Released schema lock
0709 13:01:07.871134 (+ 11689us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:08.038649 (+167515us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:08.081882 (+ 43233us) write_op.cc:454] Released schema lock
0709 13:01:09.465190 (+1383308us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b18001d3200. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
Metrics: {"mutex_wait_us":17635,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":375380,"apply.run_cpu_time_us":55397,"apply.run_wall_time_us":1014238,"mutex_wait_us":73512,"num_ops":2,"prepare.queue_time_us":216817,"prepare.run_cpu_time_us":12358,"prepare.run_wall_time_us":683379,"replication_time_us":1689511,"spinlock_wait_cycles":183285504,"thread_start_us":1101745,"threads_started":2,"wal-append.queue_time_us":1044003}]]}
I20260709 13:01:09.586174 10130 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.587071 10380 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.588357 10375 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:09.593443 10218 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:09.564548 10287 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.594164 10130 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.594841  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:09.608078  8502 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.608547 10256 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:09.608994 10256 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:09.609485 10130 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:09.613384  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74565.5us
I20260709 13:01:09.596442  8582 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:09.597764 10159 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:09.616199 10159 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:09.616598 10159 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:09.598635  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 668) took 2363 ms. Trace:
I20260709 13:01:09.599790  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:09.600883 10071 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:09.601728 10245 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:09.604446  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:09.604766  8507 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:09.617448  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:09.593561 10329 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:09.618670  8584 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.617496  9099 rpcz_store.cc:276] 0709 13:01:07.234832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.234949 (+   117us) service_pool.cc:224] Handling call
0709 13:01:09.598295 (+2363346us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54004e1954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:09.598455 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3180868864}
I20260709 13:01:09.619793 10316 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:09.637401  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 119311us
I20260709 13:01:09.620038  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:09.620453  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:09.609920 10256 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.625883  8579 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:09.568322 10367 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:09.638435  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 138213us
I20260709 13:01:09.642323  8398 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:09.646421  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 82547.2us
I20260709 13:01:09.637729 10184 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:09.639245 10215 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:09.649287 10381 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:09.649585 10319 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:09.655445 10215 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:09.655346 10333 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:01:09.657837 10329 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:09.649960 10132 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:09.649796 10159 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.650918  8575 raft_consensus.cc:2410] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:09.651512  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.652221 10256 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.638227 10218 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:09.657958  8398 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:09.663208 10330 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:09.641064 10367 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.666433  8584 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:09.661392  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:09.659430 10329 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:09.658634 10215 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:09.677026 10375 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:09.678471  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.655589 10184 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.682824 10184 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.683030 10071 raft_consensus.cc:2764] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:09.683297 10375 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.684033 10375 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:09.684320 10375 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:09.658080 10319 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.682075  9067 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:09.689738 10387 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:09.690176 10387 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.690255 10329 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:09.690610 10387 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.691398 10329 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.695297 10287 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:09.695585  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 44198.7us
I20260709 13:01:09.699150 10215 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.697403  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:09.701272 10215 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:09.680123 10367 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.703560 10386 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:09.704327 10386 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:09.695708 10287 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:09.705317 10386 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.705937 10287 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:09.710183  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.711727  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.713295  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:09.690192  8502 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:09.714847 10330 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.715976 10132 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:09.716634  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:09.718163  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 60322us
W20260709 13:01:09.687588 10310 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:01:09.688885 10319 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:09.746652  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:09.747895  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:09.747689  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 75303.3us
I20260709 13:01:09.724304 10159 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.726579 10374 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:09.764452  8509 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:09.765172  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:09.748103 10218 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:09.768369  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:09.750743 10227 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:09.771230 10287 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.771966  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:09.773003 10387 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.781095  8581 raft_consensus.cc:2955] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:09.774987 10380 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.775588  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:09.776209 10158 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:09.775367 10132 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:09.776690  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:09.778909  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:09.779989  8576 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:09.782474  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 70832us
I20260709 13:01:09.754696 10188 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:09.685195 10375 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.800904  8584 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:09.804220  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:09.807565  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:09.783511 10374 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:09.816112  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:09.795482 10227 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:09.806506  8475 connection.cc:256] RPC call timeout handler was delayed by -1.6380227940000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:01:09.826922  8475 connection.cc:256] RPC call timeout handler was delayed by -1.3770227940000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
I20260709 13:01:09.817126  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.822484  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.823199  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.823908  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:09.791972 10333 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:01:09.839637  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 83529.9us
I20260709 13:01:09.829315  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.824488  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.830518  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:09.827353  8475 connection.cc:256] RPC call timeout handler was delayed by -1.2879227940000533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 13:01:09.842923  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0113515420000567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
I20260709 13:01:09.805902 10188 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:09.829563  8502 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:09.816207 10178 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.856660  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:09.856232 10178 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.858420 10389 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:09.859825  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:09.860117 10377 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:09.861107 10377 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:09.861546 10377 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:09.845795 10376 raft_consensus.cc:2764] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:01:09.862195 10388 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:09.862599 10388 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:09.863183  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.863459 10388 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.864180 10215 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:09.864526  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.864858 10388 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.848141 10253 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.866796 10377 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.868444  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:09.869801  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 61187.8us
I20260709 13:01:09.867816 10362 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.867816 10227 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:09.865788  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.917534  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.829792 10316 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:09.915617  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 53585.1us
I20260709 13:01:09.916433  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:09.818111 10132 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:09.854403 10188 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:09.946171  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.952476  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:09.954665  8434 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:09.958448  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:09.819401 10380 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.874593  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:09.979396  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 127290us
I20260709 13:01:09.982317  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:09.982453  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 116719us
I20260709 13:01:09.953820 10375 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.951731 10215 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.954912 10218 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:10.020376  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 103991us
I20260709 13:01:09.980638 10133 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.029958  9068 leader_election.cc:400] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
I20260709 13:01:09.980376 10253 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:10.031337  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 191009us
I20260709 13:01:09.986522 10376 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.033234  8510 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.034731  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:10.036783  9068 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.037278  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:10.037439  8510 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:09.974236 10329 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:01:10.074848  9068 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.038983 10389 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.022095 10256 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:01:10.075996  9094 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:10.074826 10218 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:09.983608 10374 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.127625  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:10.126317  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47434us
W20260709 13:01:10.158648  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 83852.1us
I20260709 13:01:10.120671  9101 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:10.245878  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:10.228578  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 246297us
W20260709 13:01:10.109328  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 88338.1us
I20260709 13:01:10.103263 10318 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.235684 10132 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:10.105355 10387 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:10.125654 10380 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:10.246863  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:10.121352 10394 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:01:10.210171  8510 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:10.183935 10393 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:01:10.262315  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:10.111799 10253 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.116046 10178 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:10.113431 10307 raft_consensus.cc:2764] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:10.262934 10132 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.113969 10376 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.293673  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.110167 10362 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:10.289778  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 43965.6us
W20260709 13:01:10.306483  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44224.1us
W20260709 13:01:10.298616 10401 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:01:10.304404  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 267155us
I20260709 13:01:10.308036  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:10.309188 10253 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:10.309619 10253 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:10.310092 10253 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:10.311705 10411 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:01:10.312474 10404 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:01:10.315024 10178 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:10.315201  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 53369.3us
I20260709 13:01:10.316272  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.317353 10178 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:10.317732 10178 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:10.317768  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.318255 10178 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:10.318719 10405 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:01:10.319559  8475 leader_election.cc:400] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:10.319900  8475 leader_election.cc:403] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.320420 10071 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:10.320850  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.321646 10071 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.323010  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:10.309800  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:10.330802  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:10.298897  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:10.305871 10367 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.600s	user 0.003s	sys 0.007s
I20260709 13:01:10.373710  9101 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.331570  8510 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.375453  9068 leader_election.cc:400] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3.
W20260709 13:01:10.377632  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55636.8us
I20260709 13:01:10.330673 10071 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:10.375139 10388 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.002s
I20260709 13:01:10.383549  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:10.318745 10417 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:10.384074  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74385.6us
I20260709 13:01:10.298666 10412 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:10.378558 10407 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:01:10.382671 10184 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.003s
I20260709 13:01:10.378396 10376 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:10.384856 10391 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.444s	user 0.007s	sys 0.000s
I20260709 13:01:10.389365  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:10.327474 10387 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:01:10.344960 10362 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:10.379709 10367 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.386437 10307 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.399019  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.393529 10376 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:10.401430 10399 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:01:10.416206 10159 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.000s
I20260709 13:01:10.431747  8433 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
W20260709 13:01:10.421818 10319 consensus_meta.cc:287] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.667s	user 0.002s	sys 0.005s
I20260709 13:01:10.417057 10188 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.393499 10184 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:10.437479 10416 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:01:10.433422 10376 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:10.448120  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.461624 10318 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.448242 10417 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.469125 10417 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:10.471333 10417 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:10.471966 10218 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:10.473387  8580 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
W20260709 13:01:10.477584  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 82239.7us
W20260709 13:01:10.481042 10287 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.001s
I20260709 13:01:10.466220 10307 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.446960 10415 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.443702 10319 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.471975 10384 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.488704 10384 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:10.489710 10384 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.490682 10231 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:10.490820 10384 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.491096 10231 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:10.491945 10231 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.493095 10231 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.495790 10319 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:10.496650 10133 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:10.497025 10133 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:10.497819 10133 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.482395 10253 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.499006 10133 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.500128 10253 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:10.485110  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 95775.3us
I20260709 13:01:10.501132  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.487118 10184 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:10.511709 10375 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.503s	user 0.005s	sys 0.004s
I20260709 13:01:10.493264 10376 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.521620 10178 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.532624 10178 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:10.533265  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:10.537837  9101 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:10.538550 10376 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:10.539330  8510 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:10.547554 10188 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:10.547789  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:10.550899 10362 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:10.551605  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50516.8us
I20260709 13:01:10.552325  9067 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.553524  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:10.557523 10188 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.558856 10367 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:10.520092 10412 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.559250  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:10.560386  8432 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:01:10.561463  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.563095  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:10.564438  8507 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:10.565289 10307 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.565605  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:10.566186 10362 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:10.567595  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:10.570129  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:10.570516  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.571296  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:10.572791  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:10.573963  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:10.575635  8509 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:01:10.577169  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.581854 10058 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:01:10.583976  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 335543us
I20260709 13:01:10.594515  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:10.596254  9101 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.595166  8510 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:10.604281  8510 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:10.605701  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:10.609944  9101 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.611008  9099 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.606966 10412 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.613511  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:10.614576  8430 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:10.615231  8427 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:10.565768 10307 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:10.629478  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:10.632809  9101 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.627290  8433 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:10.617352  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:10.637151  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:10.608527 10384 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:10.602859 10377 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:10.639648 10395 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.620s	user 0.003s	sys 0.000s
I20260709 13:01:10.648439  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:10.637337  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:10.649458  8580 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:10.654464  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:10.655465  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.653954  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.643503 10275 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:10.641237  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:10.662070  8433 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:10.662118  9101 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:10.660044  8550 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.636778 10408 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:01:10.665289  8550 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.666391  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:10.670156 10184 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.670513  9096 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:10.670814 10184 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.671540 10413 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:10.672098 10413 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:10.651648  8577 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.667168  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:10.674772 10367 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.674746 10413 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:10.636687 10412 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:01:10.644273 10384 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:10.661334 10333 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.681911  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:10.683240  8510 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:10.659099 10275 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:10.696012  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:10.696426 10275 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:10.667877 10417 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:10.688885 10329 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:10.648388 10377 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:10.675658 10133 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:10.661911 10231 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:01:10.702806  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.704860  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:10.708047  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:10.708724  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:10.714990  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:10.700798 10386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.005s	sys 0.017s
I20260709 13:01:10.716544 10188 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.718777 10307 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:10.718849 10376 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:10.719656 10376 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:10.720099 10376 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.713862  9094 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:01:10.720724  9094 pending_rounds.cc:85] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 5
I20260709 13:01:10.721035  9094 pending_rounds.cc:107] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:10.721298  9094 raft_consensus.cc:2889] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:10.700114 10417 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.715773 10377 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:10.680961 10367 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.736510 10367 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:10.702101  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.726894 10417 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.737762  9097 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:10.742059  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:10.742712  8581 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:10.743521  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:10.744182  8575 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:10.744922  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.745337  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.745548  9098 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:10.746066  9102 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:10.746397  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.746785  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.746897  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.747424  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:10.747664  9095 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 2: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:10.747961  9098 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:10.748512  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.748618  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.749186  9095 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:10.749842  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.750631  9093 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 2: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:10.751139 10307 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:10.751353  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.752319  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:10.752492  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:10.753257  9093 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 2: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:10.753520  8577 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:10.753715  9097 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:10.753914 10215 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:10.754416  9093 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:10.755859  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:10.756428  8433 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:10.743521  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:10.699630 10374 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:01:10.689792 10409 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:01:10.757709 10374 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:10.758080 10374 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:10.759313  9100 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:10.716917 10133 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.760950  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 575) took 1052 ms. Trace:
I20260709 13:01:10.756448  9101 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:10.762739 10133 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:10.758926 10374 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.706748 10427 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:01:10.747774  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:10.775440  9102 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:10.723111 10386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.005s	sys 0.017s
W20260709 13:01:10.770638  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 105411us
I20260709 13:01:10.779464  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.773808  9098 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:10.769631  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:10.761339  9099 rpcz_store.cc:276] 0709 13:01:09.708775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.708905 (+   130us) service_pool.cc:224] Handling call
0709 13:01:09.735324 (+ 26419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.613085 (+877761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.760720 (+147635us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54002bc0d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:10.760872 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006510848}
I20260709 13:01:10.781494  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:10.783915  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:10.785745  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:10.755344  9097 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:10.788877  8580 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:10.792920  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:10.795531  9100 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:01:10.795976  9100 pending_rounds.cc:85] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 4
I20260709 13:01:10.796200  9100 pending_rounds.cc:107] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:01:10.796434  9100 raft_consensus.cc:2889] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:10.798235  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.799484  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.790387 10333 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.794432 10133 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:10.802105 10133 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.804100 10133 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:10.804935  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:10.805415 10178 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:10.805876 10178 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.806492  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:10.806716 10178 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.765156  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:10.819003  9102 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:10.817111 10333 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.816949 10184 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:10.821480 10184 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.788998 10256 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.794385 10144 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:10.828872  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:10.827374  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:10.790462 10231 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:10.793399 10257 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.828063 10376 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.797276 10436 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:01:10.834291  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 71008us
I20260709 13:01:10.839391 10435 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.840451 10441 raft_consensus.cc:993] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:01:10.842875 10441 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:10.843880 10435 raft_consensus.cc:1081] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:01:10.817318 10374 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.849136 10436 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:10.855417 10433 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.824071 10184 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.836339  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:10.928279  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 92037.6us
I20260709 13:01:10.931114  9100 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:10.932253  9102 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:10.934213 10444 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:10.934039  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 109285us
I20260709 13:01:10.935145 10444 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.935525 10444 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.941874  9096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77b025d136d04841aa2759be7b816f77"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:01:10.944847  9096 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:10.945338  9096 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:10.926851  9095 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:10.930902 10188 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:10.945152 10436 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:10.948784  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.949542 10432 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260709 13:01:10.959988 10397 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.973s	user 0.004s	sys 0.000s
I20260709 13:01:10.961278  9094 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEARNER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:10.968631  8510 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:10.971323  8509 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:10.961531 10188 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:10.989696  8509 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:11.008313  8579 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:01:11.011550  8579 pending_rounds.cc:85] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 5
I20260709 13:01:11.011893  8579 pending_rounds.cc:107] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:11.012151  8579 raft_consensus.cc:2889] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:11.014204  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:11.014889  8579 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:11.028820 10384 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.032308  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:11.012599 10433 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.013458 10436 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:11.040297  8507 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:11.006142 10319 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:11.017388 10318 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:11.036154 10333 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.048457  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:11.054355  8501 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:11.050640 10386 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:01:11.060945 10245 raft_consensus.cc:3055] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:11.061483 10245 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:11.063016 10376 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:11.062651 10245 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.065774 10446 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.066352 10446 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.068868 10446 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.071918  8575 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:11.073705  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:11.042390 10433 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.074431  8430 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:11.076215 10388 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:11.076694 10388 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:11.032980 10367 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 13:01:11.080379 10442 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:01:11.080626  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:11.083425  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:11.077718 10388 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:11.103674  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 309696us
I20260709 13:01:11.104923  8550 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:11.107172  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.107508 10388 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.975510 10444 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.061627 10417 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.126931  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:11.128077  8550 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:11.129299 10257 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:11.116149 10333 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:01:11.129820 10257 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:11.131810 10257 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.133803  8510 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
W20260709 13:01:11.142992  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 336841us
I20260709 13:01:11.144096  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:11.153159  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:11.154742  8581 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:11.155510  8576 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:11.157127  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:11.157967  8576 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 2: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:11.158512  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:11.153384  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:11.160522  8579 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 2: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:11.161125  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:11.142735  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 110801us
I20260709 13:01:11.159709  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:11.172103  8433 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:01:11.172122  8430 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:11.170481  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:11.175984  8435 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:11.120442 10188 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.175381  8434 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:11.126724 10105 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.114619 10439 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:11.140326 10413 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:11.201038  8505 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:11.279754  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:11.278400 10275 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.001s
W20260709 13:01:11.278625 10408 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.018s	sys 0.025s
I20260709 13:01:11.171820 10273 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.289677  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:11.290639  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 146663us
I20260709 13:01:11.295120  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:11.241068  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:11.261180  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:11.279338 10439 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.251473 10410 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:11.279512 10456 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.291592 10408 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.019s	sys 0.025s
I20260709 13:01:11.286319 10105 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.301813  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:11.302425 10420 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.295277 10287 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:11.291594 10130 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:11.306193 10417 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:11.306829 10256 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:11.286784 10438 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:11.302444 10435 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.305158 10178 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.314492  9101 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:11.323835  9095 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:11.325109  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:11.325975  9094 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:11.327752  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.333276  9100 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:11.309141  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:11.308535 10439 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.292188 10275 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.343720  8507 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:11.296658 10413 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.334196  8506 raft_consensus.cc:2368] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5.
I20260709 13:01:11.317181 10287 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:11.316627 10455 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:11.307577 10273 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.310755 10456 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.343101  8429 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.345608 10444 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.354568 10287 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.349788 10105 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:11.338215 10256 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.311157 10410 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.333802 10449 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:01:11.357401 10457 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.361030 10455 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:11.330343 10420 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.378782  8575 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:11.383960  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 84223.5us
I20260709 13:01:11.408262  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:11.344923 10438 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.411975  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:11.412742  8578 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:11.413686  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:11.414244  8576 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.414707 10410 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.418325 10188 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:11.418692  9100 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:11.418833 10188 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.419996  8431 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:11.420993 10188 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:11.424364 10071 raft_consensus.cc:3055] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:11.424773 10071 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:11.426365 10273 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:11.425586 10071 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.383590 10461 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:01:11.429752  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:11.431056  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:11.457259  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.470929  8579 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:11.460702 10184 consensus_meta.cc:287] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:01:11.400204 10464 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:11.475580  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 314499us
I20260709 13:01:11.475880 10438 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.442628  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:11.457135 10144 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.000s
I20260709 13:01:11.482757  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:11.458060 10275 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:11.447252 10420 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:11.427446 10178 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:11.489888  8429 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:11.491001 10408 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.472298 10184 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.472662 10456 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:11.417646  9096 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.485283 10462 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:11.409221 10413 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:01:11.406625 10457 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:01:11.458772 10455 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.493424 10433 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:11.427707 10257 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.173s
I20260709 13:01:11.600596  8580 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:11.462044  8577 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:11.599136  8581 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:11.494331 10439 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.603413 10410 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:11.605031  8579 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:11.460565  8576 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:11.617714  8547 leader_election.cc:400] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5.
I20260709 13:01:11.606783 10333 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.522739 10412 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.623663  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:11.534271  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:11.631523  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.636930  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:11.618372  8547 leader_election.cc:403] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:11.533746 10188 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.634094  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.623554 10257 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:01:11.631844 10333 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.561151 10256 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:11.484265 10144 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:11.643850  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.618893 10446 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:01:11.646811  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:11.643110 10449 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:11.647796 10438 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:11.648892 10287 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.608253 10408 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.616206 10178 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:01:11.650324  9094 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:11.645794  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:11.656576  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:11.619411 10466 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:01:11.482328 10464 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.657469  9101 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:11.662637  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:11.666990  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:11.669210  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:11.652307 10188 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.670483 10386 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:11.671763 10386 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:11.669925  8580 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:11.674052  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:11.660313  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:11.687759  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:11.663154 10256 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5.
I20260709 13:01:11.672716 10409 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:11.681113 10449 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:11.682328  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:11.663623 10330 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:11.683898 10435 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.685340 10287 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.687289  9096 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.691339  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:11.691977  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:11.672237 10188 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.646107 10412 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.707053 10455 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.714205  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:11.675953 10417 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:11.714854  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:11.715960  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:11.731115  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 64197.2us
I20260709 13:01:11.678342 10178 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:11.725251  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:11.759955  8579 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.764364  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:11.765434 10328 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:11.766116 10328 consensus_queue.cc:1243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:11.709475 10409 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.712651  8577 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:11.764274 10427 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:11.746377  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 108059us
W20260709 13:01:11.779721  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 120297us
I20260709 13:01:11.780093  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:11.781790  9068 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:11.747762 10439 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.766675 10409 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.778997 10386 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:11.803064  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:11.756734 10188 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:01:11.769683 10105 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:11.805296  8582 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:11.805864  8579 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:11.758518 10417 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:11.780277 10178 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:11.773798 10388 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:11.824877  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:11.761499 10455 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.829092 10455 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:11.830667 10468 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:01:11.813385 10386 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:11.783869  9095 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:11.832513 10464 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:11.832015 10386 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.818414 10473 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:11.845597 10474 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:11.846331 10105 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:11.846766 10105 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:11.847604 10474 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:11.847643 10105 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.848889 10188 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.849373 10105 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:11.849427 10188 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.850536 10472 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.851303 10472 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:11.851963 10188 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.848361 10474 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:11.852445 10417 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.853245 10474 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.854009 10417 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:11.856143  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:11.856763  8582 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:11.833707  8576 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:11.786577 10449 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.869154 10412 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.874480  8579 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:11.826537 10420 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.856045  8578 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:11.884905 10178 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:11.887162 10420 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:11.897435 10408 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:11.881695 10386 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.864127 10473 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:11.902751 10420 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:11.936630  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:11.938934  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 251270us
W20260709 13:01:11.942044  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 160278us
W20260709 13:01:11.949792  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 142492us
I20260709 13:01:11.944044 10257 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:12.008049  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 205130us
I20260709 13:01:12.009253  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:11.950623 10488 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.001871 10470 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:11.938457 10457 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:01:11.944335 10440 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:01:11.949398 10461 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:01:11.954370 10477 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:11.944612 10458 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:01:11.963404 10257 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.027626  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:12.006207 10474 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.032241  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 81781us
I20260709 13:01:11.960151 10480 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:12.037863  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 90428.7us
I20260709 13:01:12.017820 10159 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:11.905932 10473 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.044543  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:12.031149 10464 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:12.044256  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.108582  8427 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:12.045500  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:12.109146  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.110298  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.028890 10257 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.113864  8505 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:12.042343  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:12.056267 10435 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:12.118918  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:12.126647  8505 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:12.107869  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:12.107205  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 73185.6us
W20260709 13:01:12.046180 10485 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:01:12.127794  8504 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:12.130646  8504 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:12.108304 10464 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:12.166311  8430 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:12.158238  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:12.040274 10474 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.023116 10488 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.125180  8506 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:12.160059 10461 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:12.121047 10159 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.120628 10481 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:12.190438 10489 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:01:12.191299 10475 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:12.193650  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:12.194540  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48197.2us
I20260709 13:01:12.159092 10388 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:01:12.194268  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.223491  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:12.224270  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.194267 10328 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.031407 10477 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.204872  8582 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:12.206830  8505 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:12.166632 10435 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:12.105991 10484 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:12.129321 10478 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:12.045885 10480 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:12.210958 10490 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:12.212559  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:12.214147  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:12.214224  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:12.182291 10409 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.218195  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:12.242599 10496 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:12.222707  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 179573us
I20260709 13:01:12.227921  8435 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:12.230193  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:12.217442 10257 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.157692 10494 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:01:12.179795  8429 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:12.238107  8503 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:12.238600  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:12.239151 10159 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:12.240420 10435 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:12.241063 10488 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:12.241791 10388 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:12.242012  8575 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:12.243691  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:12.262686  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.271207  8432 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:12.245160  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.219211 10461 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.247575 10496 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.274952  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:12.277737 10408 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:12.278152  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.233006 10464 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:12.254001 10439 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:01:12.251417 10484 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.282195 10456 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:12.284900 10480 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:12.292549  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.293804  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:12.242177 10478 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.233506 10481 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:12.242802 10328 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:12.306833  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.307883  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 75733.6us
I20260709 13:01:12.307797  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:12.276115 10388 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:12.342641  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:12.287149 10488 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:12.343223 10178 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.343508 10488 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.290771 10159 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.346297 10159 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.343269 10388 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.348359 10388 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.348477 10159 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:12.345906 10488 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:12.349627 10488 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:12.350139 10488 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:12.310778  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 283194us
I20260709 13:01:12.291680 10496 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.295181 10482 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:12.356375  8427 raft_consensus.cc:2410] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:01:12.353024  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:12.357457  8476 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:12.358330  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:12.308943 10307 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:12.309052 10408 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:12.366806  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:12.364168 10105 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.369575  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 116141us
I20260709 13:01:12.359315 10464 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.354674 10256 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:12.363152 10494 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.359977 10439 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:01:12.383016  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 154544us
I20260709 13:01:12.368703 10482 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:12.310380 10483 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:01:12.371683 10460 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:12.366557 10505 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:12.368919 10480 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:12.400719  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:12.403190  8505 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:12.369755  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:12.405898  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:12.409976  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:12.412276  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 54901.6us
W20260709 13:01:12.416628  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.428246 10440 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:12.430996 10275 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:12.431612 10275 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:12.432757 10275 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.448205 10058 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:12.450146  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.450524 10413 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:12.463631  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1643) took 1323 ms. Trace:
I20260709 13:01:12.464102  8428 rpcz_store.cc:276] 0709 13:01:11.139957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.140093 (+   136us) service_pool.cc:224] Handling call
0709 13:01:11.171449 (+ 31356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.310363 (+138914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.310396 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:11.315480 (+  5084us) log.cc:844] Serialized 26 byte log entry
0709 13:01:11.439965 (+124485us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:11.440015 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.463175 (+1023160us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54001d38d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:12.463234 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.463284 (+    50us) raft_consensus.cc:1685] finished
0709 13:01:12.463298 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.463556 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":475,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":9850,"spinlock_wait_cycles":318545152,"thread_start_us":78301,"threads_started":1,"wal-append.queue_time_us":190816}
I20260709 13:01:12.466540 10444 raft_consensus.cc:3055] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:12.467006 10444 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:12.468060 10444 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.471472 10275 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.473063 10184 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:12.473788 10184 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:12.398149 10482 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.360759 10497 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:12.399317 10474 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:12.376813 10105 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:12.490655  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 81176.1us
I20260709 13:01:12.402721 10505 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.306371 10484 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.412736 10499 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:12.413676 10412 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:12.384318 10256 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:12.498775  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:12.500713  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:12.504496  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:12.519675  9098 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:12.490188  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:12.493870 10482 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.488864 10184 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:12.522795  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 120305us
I20260709 13:01:12.394384 10494 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:12.489156  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 83333.6us
I20260709 13:01:12.417239 10480 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.527868 10502 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:01:12.528679 10511 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:12.532612 10130 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:12.533087  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:12.533612 10478 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:12.539861  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:12.512729 10505 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.515823 10473 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.512336 10257 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:12.551409  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.520056 10474 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:12.554667  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.558465 10519 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:12.559033 10519 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:12.559195 10517 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:12.559504 10519 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.559825 10517 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:12.534163 10506 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:01:12.565088 10514 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.565264 10506 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.534492  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:12.566882  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 150953us
I20260709 13:01:12.514912 10501 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:12.489384 10408 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:12.571247  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:12.576686  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:12.577358  8507 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:12.536816  8506 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:12.579317  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:12.547765 10130 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:12.594408  8507 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:12.555142 10215 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:12.597029  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:12.554780 10071 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:12.612809  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.617210 10475 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:12.565694 10514 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:12.596843  9097 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:12.579444 10488 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:12.578998  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:12.600237  9093 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:01:12.634490  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:12.600708 10257 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:12.636042 10447 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:12.603046 10511 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.604099 10215 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.604605 10461 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:12.639693  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:12.567106 10474 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.568205 10473 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.565769 10506 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.650154  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.697484  8506 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:12.649775 10130 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:12.650632 10520 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:12.612459 10307 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:12.612684 10478 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:12.514684 10508 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:01:12.518973 10499 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.622982 10477 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:12.663367  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:12.671960  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:12.675452 10333 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:12.676054 10444 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.677731  8504 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.640405 10412 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:12.684669 10474 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:12.685125 10516 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:12.686156  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:12.688393  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:12.696117 10521 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:01:12.699604  8434 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:12.701887 10479 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:12.630438 10514 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:12.715896  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:12.655568 10215 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:12.669267 10496 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.682978 10481 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:12.614066 10184 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:12.682092 10488 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:12.733349  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.725641  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:12.734994 10524 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:12.697516 10506 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:12.758726  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.689525 10511 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.728288 10520 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.779016 10504 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:12.779271 10436 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.904724  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.727196 10478 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.726223 10307 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.732962 10105 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:12.745105  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:12.804579  8429 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:12.929778 10438 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:12.906807 10523 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:12.951473  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:12.938804 10436 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.955134 10105 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:12.958067  8432 raft_consensus.cc:2368] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:12.905431  9096 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:12.808748 10388 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:12.905804 10459 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:12.804910 10256 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:12.905704  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:12.956398 10438 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.976276 10499 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:12.929937 10488 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:12.968807  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.924211 10520 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.939389 10504 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.965965 10105 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.983402 10438 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:12.819976 10494 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:12.804294 10412 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:12.979461 10275 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.507s	user 0.003s	sys 0.007s
I20260709 13:01:12.982427 10256 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.990969 10504 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.981282 10473 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.034878 10410 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:13.035492 10410 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:12.992561  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:12.956440 10523 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:12.945403  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.992911 10105 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.984807 10519 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.988260  8575 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:01:12.980350 10388 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.730768 10447 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.067981 10436 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.053606  9097 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:13.022840  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.061306  8576 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:01:13.049118 10256 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.997674 10459 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:12.947909 10479 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.069802 10510 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.138931  9101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.022s	sys 0.068s
W20260709 13:01:13.139353  9101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.022s	sys 0.068s
W20260709 13:01:13.142207  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 426831us
I20260709 13:01:13.143580 10447 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.145577 10523 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:12.820580 10516 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.079384 10511 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.148310 10275 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:13.182693  8550 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.711s (SENT) [suppressed 27 similar messages]
I20260709 13:01:13.190593 10523 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:13.201885 10519 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.201788 10523 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.159318 10478 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.160507  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:13.160955 10534 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:13.118153 10412 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.220808 10532 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.155970 10215 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.135308 10410 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.199985 10501 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:13.205330 10488 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.206305  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:13.241667 10178 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.898s	user 0.011s	sys 0.000s
I20260709 13:01:13.243824 10507 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:13.244063 10178 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:13.202801 10275 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.105652 10524 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.248658  8505 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:13.245721 10457 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:13.148662 10510 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.262632 10539 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.230091 10534 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.280810 10328 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.250873 10410 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:13.337240  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 154565us
I20260709 13:01:13.263243 10539 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.244488 10507 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.262622 10457 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:13.266108 10488 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:13.278710 10388 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.395682  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:13.292655 10256 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.339705 10461 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.242612 10532 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.396978  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:13.400660 10436 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:13.364894 10526 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.428050 10455 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:13.405061 10527 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.427286  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:13.465245 10388 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.427772 10436 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:13.413477 10488 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.247659 10501 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:13.514626 10545 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.269s	user 0.006s	sys 0.000s
W20260709 13:01:13.523092 10505 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.955s	user 0.012s	sys 0.000s
W20260709 13:01:13.524330  8427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 1651) took 1399 ms (client timeout 1711 ms). Trace:
I20260709 13:01:13.511376  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:13.500134 10496 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.417492 10461 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.510874 10455 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:13.531634  8427 rpcz_store.cc:269] 0709 13:01:12.125278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.125458 (+   180us) service_pool.cc:224] Handling call
0709 13:01:12.212413 (+ 86955us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b5800060398. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ae9c 00007f1a1621aa5b 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:13.524020 (+1311607us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540025a3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:13.524228 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261764224}
I20260709 13:01:13.520464 10436 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:13.546285  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:13.552680  8583 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:13.546584  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.553867  8427 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:13.547145 10488 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.548168 10478 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:13.517943 10534 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:13.563082 10461 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.543666 10455 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:13.563119 10478 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.517509 10538 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.551108  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 713) took 1048 ms. Trace:
W20260709 13:01:13.558478  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.567662  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 159779us
W20260709 13:01:13.560855  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.568490  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.568954  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.520256 10388 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.517763 10526 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.508445 10457 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:13.559397 10464 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.182s	user 0.006s	sys 0.006s
I20260709 13:01:13.561553  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:13.562314  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:13.538480 10541 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:01:13.566046  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.529042  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:13.579838  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.534287 10435 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:13.568037  9101 rpcz_store.cc:276] 0709 13:01:12.502510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.502623 (+   113us) service_pool.cc:224] Handling call
0709 13:01:12.521153 (+ 18530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.551540 (+ 30387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.551571 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.563074 (+ 11503us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.139732 (+576658us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:13.139776 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.139846 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.550910 (+411064us) raft_consensus.cc:1685] finished
0709 13:01:13.550928 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.551054 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30004,"raft.queue_time_us":30111,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":15371,"spinlock_wait_cycles":1280,"thread_start_us":531290,"threads_started":1,"wal-append.queue_time_us":702242}
I20260709 13:01:13.516294 10527 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.562355  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:13.582731  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.571020  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:13.589803 10435 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:13.579687  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:13.591960  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:13.592343 10536 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:01:13.592932 10537 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:01:13.592798  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 603) took 1051 ms. Trace:
I20260709 13:01:13.595485  8427 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:13.602234  9101 rpcz_store.cc:276] 0709 13:01:12.541104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.591983 (+1050879us) service_pool.cc:224] Handling call
0709 13:01:13.592291 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.592470 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.592499 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.592540 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:13.592587 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.592652 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.592747 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.602756  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 710) took 1101 ms. Trace:
I20260709 13:01:13.603184  9095 rpcz_store.cc:276] 0709 13:01:12.501727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.513611 (+ 11884us) service_pool.cc:224] Handling call
0709 13:01:12.567196 (+ 53585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.707262 (+140066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.707297 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.707972 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.063778 (+355806us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:13.158384 (+ 94606us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.192036 (+ 33652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.204174 (+ 12138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.602535 (+398361us) raft_consensus.cc:1685] finished
0709 13:01:13.602559 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.602699 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":866,"prepare.queue_time_us":427232,"prepare.run_cpu_time_us":206,"prepare.run_wall_time_us":2169,"raft.queue_time_us":62340,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":20260,"thread_start_us":478764,"threads_started":3,"wal-append.queue_time_us":661167}
I20260709 13:01:13.605513  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:13.606012  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:13.536491 10505 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.596208 10275 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:13.581167 10496 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.606562  8435 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:13.607573  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.579613 10539 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.596613  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.573261 10538 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.614367 10538 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.609440  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 297) took 1005 ms. Trace:
I20260709 13:01:13.614897  8583 rpcz_store.cc:276] 0709 13:01:12.604212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.597514 (+993302us) service_pool.cc:224] Handling call
0709 13:01:13.609383 (+ 11869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.615947  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:13.605552 10435 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.598505 10438 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:13.600891 10457 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:13.622290  8580 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:13.600674  8576 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:13.620975  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.637167  8428 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:13.640446  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:13.643909 10520 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.000s
I20260709 13:01:13.644479 10520 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.648314  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:13.649075  8581 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.620599 10438 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:13.650671 10438 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:13.630360 10435 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:13.654093 10245 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:13.658262  9097 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.000s
I20260709 13:01:13.658676  9097 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:13.659507  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 405) took 1122 ms. Trace:
I20260709 13:01:13.659710 10510 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.632508  9095 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:13.659900  8434 rpcz_store.cc:276] 0709 13:01:12.537266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.578423 (+ 41157us) service_pool.cc:224] Handling call
0709 13:01:13.659351 (+1080928us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b5400126454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:13.659450 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197755648}
I20260709 13:01:13.660969  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.661397 10532 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.661545  8434 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:13.662554  9093 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:13.664839 10478 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.665828  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 643) took 1162 ms. Trace:
W20260709 13:01:13.666940 10444 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.910s	user 0.010s	sys 0.004s
I20260709 13:01:13.667380 10449 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.666297  9094 rpcz_store.cc:276] 0709 13:01:12.503233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.513699 (+ 10466us) service_pool.cc:224] Handling call
0709 13:01:13.665126 (+1151427us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aeee 0000000000375939 00007f1a1e28e1e0 00007f1a1e3570c4 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:13.665283 (+   157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.665471 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.665498 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.665541 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:13.665577 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.665632 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.665772 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22369024}
I20260709 13:01:13.667888 10449 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:13.668529 10105 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.003s
I20260709 13:01:13.668887  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.669486  8434 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:13.669121 10105 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.670924 10449 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.632885  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1871) took 1090 ms. Trace:
W20260709 13:01:13.631389 10540 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
W20260709 13:01:13.633375 10482 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.089s	user 0.012s	sys 0.008s
I20260709 13:01:13.687574  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.681416  8435 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:13.688917  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 1658) took 1138 ms. Trace:
I20260709 13:01:13.690506  8428 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:13.689330  8435 rpcz_store.cc:276] 0709 13:01:12.550411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.605268 (+1054857us) service_pool.cc:224] Handling call
0709 13:01:13.688856 (+ 83588us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111936}
I20260709 13:01:13.617826 10496 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.693650  8435 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:01:13.697816 10472 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.572s	user 0.006s	sys 0.012s
W20260709 13:01:13.701524  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.702240 10439 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.707062  8428 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:13.707720  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1655) took 1158 ms. Trace:
I20260709 13:01:13.708103  8428 rpcz_store.cc:276] 0709 13:01:12.549650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.706465 (+1156815us) service_pool.cc:224] Handling call
0709 13:01:13.706760 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.707484 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.707669 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.713922  8428 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 5. Ops: []
W20260709 13:01:13.709617 10472 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.583s	user 0.007s	sys 0.012s
I20260709 13:01:13.715533 10505 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:13.716053 10527 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:13.718658  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.718791  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1656) took 1168 ms. Trace:
I20260709 13:01:13.719338  8428 rpcz_store.cc:276] 0709 13:01:12.549922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.713495 (+1163573us) service_pool.cc:224] Handling call
0709 13:01:13.713765 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.718562 (+  4797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.718738 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.720729  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1657) took 1170 ms. Trace:
I20260709 13:01:13.721189  8428 rpcz_store.cc:276] 0709 13:01:12.550194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.720012 (+1169818us) service_pool.cc:224] Handling call
0709 13:01:13.720288 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.720443 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.720467 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.720504 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:13.720533 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.720580 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.720682 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.727596  8581 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:13.728201  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 1876) took 1183 ms. Trace:
I20260709 13:01:13.728555  8581 rpcz_store.cc:276] 0709 13:01:12.544725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.647983 (+1103258us) service_pool.cc:224] Handling call
0709 13:01:13.728144 (+ 80161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.730211  8581 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:13.688341 10436 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.688952 10482 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.730971  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 294) took 1127 ms. Trace:
I20260709 13:01:13.732739  8581 rpcz_store.cc:276] 0709 13:01:12.603404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.729583 (+1126179us) service_pool.cc:224] Handling call
0709 13:01:13.729977 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.730710 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.730924 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.683593  8577 rpcz_store.cc:276] 0709 13:01:12.540743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.543191 (+  2448us) service_pool.cc:224] Handling call
0709 13:01:12.579175 (+ 35984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.655959 (+ 76784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.683109 (+ 27150us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.072767 (+389658us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.191518 (+118751us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:13.199756 (+  8238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.206470 (+  6714us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.611107 (+404637us) raft_consensus.cc:1685] finished
0709 13:01:13.611135 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.631228 (+ 20093us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21796,"raft.queue_time_us":107630,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5490,"thread_start_us":81485,"threads_started":1,"wal-append.queue_time_us":158825}
I20260709 13:01:13.739570  8577 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:13.740254  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1599) took 1048 ms. Trace:
I20260709 13:01:13.740573  8577 rpcz_store.cc:276] 0709 13:01:12.691864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.739050 (+1047186us) service_pool.cc:224] Handling call
0709 13:01:13.739372 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.739954 (+   582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.740192 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:13.741737  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.742857 10505 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:13.743359 10505 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.745298 10505 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:13.746210 10516 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:13.748914 10504 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.006s
I20260709 13:01:13.749337 10504 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.750414  8579 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:01:13.751834 10504 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.753528  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 605) took 1211 ms. Trace:
I20260709 13:01:13.754101  9101 rpcz_store.cc:276] 0709 13:01:12.541650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.603161 (+1061511us) service_pool.cc:224] Handling call
0709 13:01:13.603468 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.603806 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.603833 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.604709 (+   876us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.683918 (+ 79209us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:13.683967 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.684055 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.753339 (+ 69284us) raft_consensus.cc:1685] finished
0709 13:01:13.753358 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.753474 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":129,"thread_start_us":78879,"threads_started":1,"wal-append.queue_time_us":107211}
I20260709 13:01:13.755410  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:13.757647  8576 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:13.759157 10482 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.759714 10520 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.759904  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:13.761010 10496 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.701586 10438 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.761380  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1602) took 1039 ms. Trace:
I20260709 13:01:13.724881 10449 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:13.767701 10480 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.767784  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1604) took 1036 ms. Trace:
I20260709 13:01:13.723032 10245 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:13.710330 10439 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.770004 10526 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.770314  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1493) took 1551 ms. Trace:
I20260709 13:01:13.777076 10159 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:13.771519 10455 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.772907 10105 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.773278 10436 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.773177  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:13.779410  8581 rpcz_store.cc:276] 0709 13:01:12.731920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.766599 (+1034679us) service_pool.cc:224] Handling call
0709 13:01:13.767329 (+   730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.767492 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.767514 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.767553 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:13.767583 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.767632 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.767724 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.771200  8434 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:13.787237  8430 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:13.778662 10482 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:13.782568  8509 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:13.782593  8433 rpcz_store.cc:276] 0709 13:01:12.219216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.219346 (+   130us) service_pool.cc:224] Handling call
0709 13:01:13.769548 (+1550202us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b5800060398. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:13.769744 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.769917 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.769945 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.770002 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:13.770072 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.770143 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.770258 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17228032}
I20260709 13:01:13.789553  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1865) took 2098 ms. Trace:
I20260709 13:01:13.789978 10438 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.789949  8578 rpcz_store.cc:276] 0709 13:01:11.691312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.694670 (+  3358us) service_pool.cc:224] Handling call
0709 13:01:11.822859 (+128189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.893138 (+ 70279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.789364 (+1896226us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b54001171d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:13.789497 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113121024}
I20260709 13:01:13.791136  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.791407  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1870) took 1252 ms. Trace:
I20260709 13:01:13.791473 10058 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.791792  8579 rpcz_store.cc:276] 0709 13:01:12.538624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.538788 (+   164us) service_pool.cc:224] Handling call
0709 13:01:12.539102 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.750753 (+1211651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.791186 (+ 40433us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000663d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:13.791357 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2785148800}
I20260709 13:01:13.792330  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.792045 10058 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.793813  8579 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:13.780014  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1603) took 1049 ms. Trace:
I20260709 13:01:13.792915  8434 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:13.795246  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1605) took 1061 ms. Trace:
I20260709 13:01:13.795614  8579 rpcz_store.cc:276] 0709 13:01:12.733496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.793411 (+1059915us) service_pool.cc:224] Handling call
0709 13:01:13.793665 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.794196 (+   531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.794359 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.784039 10159 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.794642 10456 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:13.797721 10159 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.797863 10456 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.798918  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 397) took 1267 ms. Trace:
I20260709 13:01:13.799285  8429 rpcz_store.cc:276] 0709 13:01:12.531678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.531824 (+   146us) service_pool.cc:224] Handling call
0709 13:01:12.532142 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.955963 (+423821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.798676 (+842713us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54003f1e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:13.798863 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450411776}
I20260709 13:01:13.800096 10456 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.800500  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:13.802960  8506 raft_consensus.cc:2368] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3.
I20260709 13:01:13.803602 10130 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:13.782802 10245 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.806406 10409 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.807847 10245 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.782531 10449 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.809947 10449 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.811760 10455 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.811997  8430 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:13.812139  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:13.795992  8581 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:13.813449  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1607) took 1009 ms. Trace:
I20260709 13:01:13.813180 10159 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.813910 10530 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:13.813800  8581 rpcz_store.cc:276] 0709 13:01:12.803772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.794450 (+990678us) service_pool.cc:224] Handling call
0709 13:01:13.795835 (+  1385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.813191 (+ 17356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.813400 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.814518 10530 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:13.814929 10530 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:13.816305  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.812556  8430 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1495) took 1589 ms (client timeout 2020 ms). Trace:
W20260709 13:01:13.817782  8430 rpcz_store.cc:269] 0709 13:01:12.223021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.225660 (+  2639us) service_pool.cc:224] Handling call
0709 13:01:13.772955 (+1547295us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b5800060398. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:13.812502 (+ 39547us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14238592}
I20260709 13:01:13.794777 10436 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:01:13.819250  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1504) took 1005 ms. Trace:
I20260709 13:01:13.819571  8430 rpcz_store.cc:276] 0709 13:01:12.813904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.818567 (+1004663us) service_pool.cc:224] Handling call
0709 13:01:13.818805 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.818956 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.818980 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.819017 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:13.819052 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.819113 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.819203 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.820745  8333 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57088 (request call id 358) took 8649 ms. Trace:
I20260709 13:01:13.822786  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:13.823567  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 435) took 1419 ms. Trace:
I20260709 13:01:13.823872  8510 rpcz_store.cc:276] 0709 13:01:12.404270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.418632 (+ 14362us) service_pool.cc:224] Handling call
0709 13:01:13.822640 (+1404008us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:13.823509 (+   869us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137574656}
I20260709 13:01:13.825323  8510 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:01:10.957635  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:13.813465  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:13.831769 10307 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.831399 10058 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.832556 10058 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:13.832651 10413 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:13.833045  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 398) took 1300 ms. Trace:
I20260709 13:01:13.833274 10058 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:13.833410  8432 rpcz_store.cc:276] 0709 13:01:12.532694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.532833 (+   139us) service_pool.cc:224] Handling call
0709 13:01:13.832884 (+1300051us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54003a3254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:13.832994 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924004736}
I20260709 13:01:13.834304 10058 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.835285 10159 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.814937  8584 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:13.837340  8432 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:13.837685  8432 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:13.838722 10497 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:13.838816 10482 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.839174  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1500) took 1727 ms. Trace:
I20260709 13:01:13.801664  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:13.838481  8432 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.839378 10497 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.778784  8577 rpcz_store.cc:276] 0709 13:01:12.722047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.741300 (+1019253us) service_pool.cc:224] Handling call
0709 13:01:13.741566 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.741744 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.741777 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.741823 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:13.741862 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.741922 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.761324 (+ 19402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:13.845778  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.846823  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 436) took 1436 ms. Trace:
I20260709 13:01:13.873534  8505 rpcz_store.cc:276] 0709 13:01:12.410221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.416907 (+  6686us) service_pool.cc:224] Handling call
0709 13:01:12.685985 (+269078us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:13.846616 (+1160631us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b540033a754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:13.846758 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296609536}
I20260709 13:01:13.848591  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:13.850546 10159 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:13.851833 10482 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.794647  8576 rpcz_store.cc:276] 0709 13:01:12.729746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.756799 (+1027053us) service_pool.cc:224] Handling call
0709 13:01:13.757190 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.775227 (+ 18037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.778816 (+  3589us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:13.855114 10410 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 13:01:13.856142 10388 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.860157  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1503) took 1046 ms. Trace:
W20260709 13:01:13.862355  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.863029 10523 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:13.865059  8432 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:13.866247  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:13.871490  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 601) took 1331 ms. Trace:
I20260709 13:01:13.878988  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:13.877916 10480 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:13.917790  8430 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:13.902310  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1659) took 1351 ms. Trace:
I20260709 13:01:13.877719 10159 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.879980  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:13.873308 10515 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.821162  8333 rpcz_store.cc:276] 0709 13:01:05.171477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.171633 (+   156us) service_pool.cc:224] Handling call
0709 13:01:13.820667 (+8649034us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:09.574515 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:09.575229 (+   714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:09.575276 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:01:09.575310 (+    34us) tablet.cc:662] Decoding operations
0709 13:01:09.575909 (+   599us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:09.575997 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:09.576023 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:09.576488 (+   465us) tablet.cc:701] Row locks acquired
0709 13:01:09.576538 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:01:09.576712 (+   174us) write_op.cc:270] Start()
0709 13:01:09.576856 (+   144us) write_op.cc:276] Timestamp: P: 1783602069576642 usec, L: 0
0709 13:01:09.576878 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:09.636469 (+ 59591us) log.cc:844] Serialized 1298 byte log entry
0709 13:01:10.128525 (+492056us) op_driver.cc:464] REPLICATION: finished
0709 13:01:10.426355 (+297830us) write_op.cc:301] APPLY: starting
0709 13:01:10.426488 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:10.426721 (+   233us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:10.426881 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:10.427577 (+   696us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:10.482659 (+ 55082us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:01:10.484376 (+  1717us) write_op.cc:312] APPLY: finished
0709 13:01:10.534350 (+ 49974us) log.cc:844] Serialized 35 byte log entry
0709 13:01:10.534616 (+   266us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:10.534743 (+   127us) write_op.cc:454] Released schema lock
0709 13:01:10.534815 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:10.535323 (+   508us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:10.535362 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1207366,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":238629,"apply.run_cpu_time_us":3566,"apply.run_wall_time_us":124293,"num_ops":3,"prepare.queue_time_us":99090,"prepare.run_cpu_time_us":3926,"prepare.run_wall_time_us":62387,"replication_time_us":495343,"thread_start_us":150906,"threads_started":2}]]}
I20260709 13:01:13.920661  8433 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.881083  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:13.921458  8507 raft_consensus.cc:2410] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:01:13.881701 10531 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.756s	user 0.004s	sys 0.001s
I20260709 13:01:13.881968 10520 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:13.883038 10501 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:13.883884  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:13.884158  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 66760.8us
I20260709 13:01:13.890156  8427 rpcz_store.cc:276] 0709 13:01:12.813637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.562042 (+748405us) service_pool.cc:224] Handling call
0709 13:01:13.859963 (+297921us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5400239454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:13.860096 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43800448}
W20260709 13:01:13.894932  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.897656  8583 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:13.872815  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:13.918918  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:13.864645  8501 rpcz_store.cc:276] 0709 13:01:12.112160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.114148 (+  1988us) service_pool.cc:224] Handling call
0709 13:01:12.114468 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.369030 (+254562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.370445 (+  1415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.376467 (+  6022us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:12.378178 (+  1711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.838941 (+1460763us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54003c5d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:13.838989 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.839119 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571033856}
I20260709 13:01:13.961596  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:13.922773  8510 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:13.962992  8505 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:13.895926  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:13.970223  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:13.984215  8547 leader_election.cc:400] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3.
I20260709 13:01:13.984549  8547 leader_election.cc:403] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:13.966356 10436 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.986887  8506 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:13.927729 10455 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.987602  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1897) took 1882 ms. Trace:
I20260709 13:01:13.987044 10436 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.987867 10455 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:13.918267 10480 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:13.988119 10504 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:14.003245 10505 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:01:14.010763  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 431) took 1629 ms. Trace:
I20260709 13:01:14.011713 10178 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.012068 10159 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.009470 10530 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:13.890399 10256 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.985541 10449 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:13.965951  8501 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:14.036296  9100 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:13.919175  8428 rpcz_store.cc:276] 0709 13:01:12.550582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.722484 (+1171902us) service_pool.cc:224] Handling call
0709 13:01:13.775185 (+ 52701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.775892 (+   707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.775910 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.777949 (+  2039us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.899015 (+121066us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:13.899071 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.899159 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.902081 (+  2922us) raft_consensus.cc:1685] finished
0709 13:01:13.902102 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.902247 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":698,"thread_start_us":84683,"threads_started":1,"wal-append.queue_time_us":115186}
I20260709 13:01:13.917140 10523 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:13.984385 10518 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:14.020328  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 712) took 1518 ms. Trace:
W20260709 13:01:14.021025  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59362.6us
I20260709 13:01:14.019910  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.014858  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:14.015369  9068 connection.cc:256] RPC call timeout handler was delayed by -1.3770736069999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260709 13:01:14.017503  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:14.029290  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 109225us
I20260709 13:01:13.988015  8508 rpcz_store.cc:276] 0709 13:01:12.105740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.106055 (+   315us) service_pool.cc:224] Handling call
0709 13:01:12.106370 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.243214 (+136844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.243242 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.243279 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:12.243307 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.987383 (+1744076us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400153954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:13.987426 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.987545 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314300672}
I20260709 13:01:13.985846 10457 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.034826  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.035092  8433 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
W20260709 13:01:14.012444  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.044262  9101 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:14.019968  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.025672 10480 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:14.061964  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.998647 10440 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.984982 10484 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.074636  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:14.075950  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.076691  8581 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:14.078774  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:14.073628 10472 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.090095 10455 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:14.091399  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.073776 10410 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:01:14.092864  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:14.092927 10457 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.093611  8508 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:14.095898  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 78506.7us
I20260709 13:01:14.096612  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:14.031893  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.090829 10548 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:14.097720  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:14.098956  8432 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:14.066761  9099 rpcz_store.cc:276] 0709 13:01:12.502273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.502410 (+   137us) service_pool.cc:224] Handling call
0709 13:01:12.529862 (+ 27452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.551656 (+ 21794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.551685 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.566341 (+ 14656us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.958423 (+392082us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:12.958463 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.958525 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.845808 (+887283us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:13.966514 (+120706us) raft_consensus.cc:1685] finished
0709 13:01:13.966543 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.020252 (+ 53709us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14314,"raft.queue_time_us":43228,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":28623,"spinlock_wait_cycles":6527872,"thread_start_us":326523,"threads_started":1,"wal-append.queue_time_us":465872}
W20260709 13:01:14.069993  9068 connection.cc:256] RPC call timeout handler was delayed by -1.3204635399999347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
I20260709 13:01:14.099769  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:14.142725  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 44179.5us
I20260709 13:01:14.109326  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.144820  8582 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:14.069466  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.110289  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:14.068995  8507 raft_consensus.cc:2410] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:14.109725  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.207109  9100 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:14.211535  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:14.213166  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 115513us
I20260709 13:01:14.208055  8510 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:13.901276  9093 rpcz_store.cc:276] 0709 13:01:12.539679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.977673 (+437994us) service_pool.cc:224] Handling call
0709 13:01:12.983454 (+  5781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.663169 (+679715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.871269 (+208100us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b5400209c54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:13.871435 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524074240}
I20260709 13:01:14.061551 10449 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.212154 10105 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:14.224119  8508 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:13.955283 10515 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.218400  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.141976 10526 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:14.218878 10384 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:14.219260  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.292755  9099 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
W20260709 13:01:14.221165  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 126450us
I20260709 13:01:14.224898  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:14.090435 10472 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:14.226621  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.094837 10330 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.074154 10482 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:14.090159 10461 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:14.095387 10188 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.294015  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.142623 10413 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:14.299618  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.309625 10188 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.219527 10457 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:14.143435 10386 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:14.310875 10386 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:14.311275 10386 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:14.311708 10188 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.312214 10188 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.312593 10188 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.314793 10188 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.073540 10159 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.217s
I20260709 13:01:14.227056  9094 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:14.067485 10256 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.031955  8502 rpcz_store.cc:276] 0709 13:01:12.381254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.382911 (+  1657us) service_pool.cc:224] Handling call
0709 13:01:12.489568 (+106657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.512532 (+ 22964us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:12.556856 (+ 44324us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.817386 (+1260530us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b1800077f20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:01:13.966226 (+148840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.984338 (+ 18112us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:13.999253 (+ 14915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.010593 (+ 11340us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.010709 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13922,"prepare.queue_time_us":18631,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":46001,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":25514,"spinlock_wait_cycles":12393216,"thread_start_us":97804,"threads_started":1,"wal-append.queue_time_us":1351953}
I20260709 13:01:14.317561 10256 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:14.214596 10456 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.318056  8581 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:14.318511 10456 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:14.318776 10455 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:14.061232 10178 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.285965 10501 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.319770 10501 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.321319 10178 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:14.308759 10330 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.309353  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.230612 10130 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.322295 10130 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:14.323051 10530 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:14.287392 10492 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:14.323557 10330 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:14.211762 10484 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.324120 10130 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:14.323845 10492 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.324529 10484 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.326144  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.326727  8507 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:14.326663  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 300) took 1275 ms. Trace:
I20260709 13:01:14.327350 10520 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.327710  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.327864 10520 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.328526  9100 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:14.327389  8579 rpcz_store.cc:276] 0709 13:01:13.051722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.803259 (+751537us) service_pool.cc:224] Handling call
0709 13:01:13.803546 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.803846 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.803874 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.805230 (+  1356us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.020812 (+215582us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:14.231485 (+210673us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.231737 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.231841 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.326476 (+ 94635us) raft_consensus.cc:1685] finished
0709 13:01:14.326495 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.326611 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85960,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":175,"thread_start_us":407080,"threads_started":2,"wal-append.queue_time_us":224149}
I20260709 13:01:14.329154  8507 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:14.329685 10484 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:14.303076  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.317498  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:14.224941  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:14.328747 10472 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.075119 10523 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:14.330335  8510 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
I20260709 13:01:14.099769 10440 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:14.142419 10524 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:14.219307 10516 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:01:14.224341 10408 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:14.289846 10497 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:14.226454 10551 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:14.230121 10527 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 13:01:14.330015  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:14.377038  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.356462  8581 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:14.226910 10449 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:14.582460  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.293322 10412 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.224519 10522 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:14.595058  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:14.597548  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.599598  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:14.330830  8577 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:14.602068  8580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1592) took 2856 ms (client timeout 2020 ms). Trace:
I20260709 13:01:14.546290 10459 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:14.549896 10436 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:14.489884 10492 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.330826 10484 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:14.301298  9095 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:01:14.329988 10520 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:14.603444  8580 rpcz_store.cc:269] 0709 13:01:11.733744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.759902 (+ 26158us) service_pool.cc:224] Handling call
0709 13:01:12.688247 (+928345us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:14.589689 (+1901442us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54000163d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:14.589870 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021053568}
W20260709 13:01:14.596302 10058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.007s	sys 0.010s
I20260709 13:01:14.393482  8578 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:14.623452  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.330539 10461 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.602515 10472 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:14.629665  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.649844  8507 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:14.330945 10482 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.608852 10188 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:14.632622 10058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.007s	sys 0.010s
W20260709 13:01:14.655777  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 435078us
I20260709 13:01:14.589041 10551 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.596182 10408 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.598718 10412 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.630302 10501 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.630664 10492 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:01:14.661755  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 284023us
I20260709 13:01:14.663280  8584 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:14.604303 10522 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.642071  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.643868 10520 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:14.664178  9096 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.013s	sys 0.017s
W20260709 13:01:14.732959  9096 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.013s	sys 0.017s
I20260709 13:01:14.669312  8400 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:14.734268 10330 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:14.734380  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 65191.4us
I20260709 13:01:14.735129  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:14.735821 10330 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:14.736299 10330 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:14.736792 10472 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:14.737191 10330 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:14.662245  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 197767us
I20260709 13:01:14.653239  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.630911 10484 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.738623  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.754686  8580 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:14.711350  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:14.711723  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.719342  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 396) took 2183 ms. Trace:
I20260709 13:01:14.739272  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:14.755781  8426 rpcz_store.cc:276] 0709 13:01:12.531255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.534693 (+  3438us) service_pool.cc:224] Handling call
0709 13:01:12.551752 (+ 17059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.709027 (+157275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.709083 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.709616 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.154595 (+444979us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:13.154634 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.714375 (+1559741us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54003a4154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:14.714445 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.714506 (+    61us) raft_consensus.cc:1685] finished
0709 13:01:14.714526 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.714808 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48392,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":12882,"spinlock_wait_cycles":27820288,"thread_start_us":589301,"threads_started":2,"wal-append.queue_time_us":564805,"wal-append.run_cpu_time_us":2703,"wal-append.run_wall_time_us":1325553}
W20260709 13:01:14.721788 10504 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.001s
I20260709 13:01:14.676111 10563 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.741667  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.690486  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.762358  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 644) took 2250 ms. Trace:
I20260709 13:01:14.757190  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:14.732242 10551 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.762773  9102 rpcz_store.cc:276] 0709 13:01:12.503465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.524523 (+ 21058us) service_pool.cc:224] Handling call
0709 13:01:12.538179 (+ 13656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.567783 (+ 29604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.567804 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.567832 (+    28us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:12.567854 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.754184 (+2186330us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b54005d2d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:14.754227 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.754327 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67727232}
I20260709 13:01:14.646739 10523 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:14.753533 10245 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:01:14.768707  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:14.772234  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.768416  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:14.773561  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:14.768692  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.774344  8579 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:14.761523 10504 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3.
I20260709 13:01:14.776257  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.776490  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.755169 10515 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:14.778730  8507 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:14.778687  8580 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:14.761803 10436 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:14.783453  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:14.779266  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.783356 10188 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:01:14.778595  9094 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 2: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:14.767470 10307 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:14.802558  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.803694  8579 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:14.803725  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.807741  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.808254  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.808763  8580 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:14.765883 10388 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:01:14.778267 10410 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:14.815708 10410 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:14.816136 10410 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:14.818550 10388 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:14.818954 10388 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:14.819789 10388 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.820866 10388 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:14.821669 10386 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.510s	user 0.003s	sys 0.003s
I20260709 13:01:14.772598  9095 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:14.812743  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.832846  9102 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:14.833925  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.834623  9102 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:14.835716  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.836400  9102 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:14.812136  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.814613 10517 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.813613  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:14.826373  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.837834  8579 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:14.818352  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 402) took 2282 ms. Trace:
I20260709 13:01:14.754714 10520 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.817385  8577 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:14.803174 10436 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:14.767292 10563 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:14.805691 10569 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:14.838406  8435 rpcz_store.cc:276] 0709 13:01:12.536027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.691329 (+1155302us) service_pool.cc:224] Handling call
0709 13:01:13.693408 (+  2079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.694176 (+   768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.818168 (+1123992us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b54003f1950. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:14.818297 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3857152}
I20260709 13:01:14.839478  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:14.887566  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:14.888608  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:14.890213  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.840265  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.818967  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.843140  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:14.844218  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:14.847287 10462 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:14.850376  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:14.850531  9097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 716) took 2264 ms (client timeout 2769 ms). Trace:
I20260709 13:01:14.850963  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:14.899784  8426 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
W20260709 13:01:14.851779  8582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 1877) took 2293 ms (client timeout 1664 ms). Trace:
W20260709 13:01:14.900529  8582 rpcz_store.cc:269] 0709 13:01:12.558161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.597381 (+ 39220us) service_pool.cc:224] Handling call
0709 13:01:14.851617 (+2254236us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400283054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:14.851716 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3471283968}
I20260709 13:01:14.851645  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.856882  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.858511 10412 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.859100  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1611) took 1452 ms. Trace:
I20260709 13:01:14.859654 10484 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.863765  8504 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:14.863827  8509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1512) took 1706 ms (client timeout 1759 ms). Trace:
W20260709 13:01:14.924151  8509 rpcz_store.cc:269] 0709 13:01:13.157765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.640204 (+482439us) service_pool.cc:224] Handling call
0709 13:01:14.863646 (+1223442us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540008e3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:14.863775 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323371904}
W20260709 13:01:14.864991 10480 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.000s
I20260709 13:01:14.865280  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.868705  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:14.936519  8506 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.829147 10440 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:14.920753 10461 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:14.870546  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:14.870838  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:14.942654  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 72171.9us
I20260709 13:01:14.943188  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:14.924244  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 602) took 2383 ms. Trace:
I20260709 13:01:14.943673 10563 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:01:14.875581  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:14.944381 10563 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:14.944686  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 69170.3us
I20260709 13:01:14.879526  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.944897 10563 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:14.945461 10563 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:14.891294  8580 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:14.946638  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:14.947124  8580 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:14.901865  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.831197 10386 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:14.896595 10462 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:14.950599 10462 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:14.951519 10462 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.951793 10455 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:14.952459 10455 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:14.902922  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:14.954509  8430 raft_consensus.cc:2410] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:14.903182  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:14.955458  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:14.925091  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:14.957037  8432 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:14.882534 10436 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:14.902501  8503 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:14.934420  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:14.899423  9097 rpcz_store.cc:269] 0709 13:01:12.586379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.723670 (+137291us) service_pool.cc:224] Handling call
0709 13:01:14.850375 (+2126705us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b54006130d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:14.850475 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188121344}
I20260709 13:01:14.943895  8579 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:14.872939  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.955668  8508 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:14.933604  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:14.922850  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:14.922588  8583 rpcz_store.cc:276] 0709 13:01:13.407105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.615691 (+208586us) service_pool.cc:224] Handling call
0709 13:01:14.858932 (+1243241us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b540028c3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:14.859025 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646487936}
I20260709 13:01:14.967949  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:14.889487 10520 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:14.960026  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:14.969000  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.993062  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.994181  9102 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:14.974771  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.994928  8508 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:14.995008  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.995585  9102 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:14.996042  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:14.920868  9094 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:14.975658  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:15.000147  8504 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:15.000684  8579 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:15.001417  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:14.974398  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.004106  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:14.998729  9098 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:14.929082  8501 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:14.931401  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.004833  9102 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 2: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:15.011278  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:15.010831  8504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 430) took 2960 ms (client timeout 1720 ms). Trace:
I20260709 13:01:15.012054  8583 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:14.960675 10440 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.004671  8432 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:15.008249  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.014459  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.014823  9098 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
W20260709 13:01:15.012022  8504 rpcz_store.cc:269] 0709 13:01:12.040576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.040697 (+   121us) service_pool.cc:224] Handling call
0709 13:01:12.677307 (+636610us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b4c00472440. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1760ba20 00007f1a1761ca29 00007f1a175e2644 00007f1a17609f2d 00007f1a17609b93 00007f1a1933a18b 00007f1a1933acb5 00007f1a19335f30 00007f1a193377de 00007f1a1934327c 00007f1a1e304b17
0709 13:01:14.863401 (+2186094us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b58003ed5d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1929b0aa 00007f1a1931d447 00007f1a19335fe7 00007f1a193377de 00007f1a1934327c 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c
0709 13:01:15.000711 (+137310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2016554624}
I20260709 13:01:15.015105  9102 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:15.013120  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:14.971508 10482 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.018707  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:15.021692  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.022225  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.022928  9102 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:15.011855  9093 raft_consensus.cc:2393] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:01:15.011005 10446 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:01:14.975339 10461 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:14.932452 10480 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.024744  8579 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:01:15.031793  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.027475  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.032266  8579 pending_rounds.cc:85] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 4
I20260709 13:01:15.032742  8579 pending_rounds.cc:107] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:01:15.032771  8504 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:15.033219  8579 raft_consensus.cc:2889] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.025738  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:15.034235  9098 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:15.034921  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.034921  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.035718  8432 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:15.035889  9102 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:15.037434  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:15.038421  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.029976 10362 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.062964  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.039286  8508 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:15.063714  8426 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:15.063048 10362 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.045285  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.065397  9102 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:15.065600  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.066258  9093 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:15.066561  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:15.069063  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:15.084367  8433 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:15.069298 10439 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.069797 10565 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:15.070580  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.071487 10507 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.072338  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 653) took 1041 ms. Trace:
I20260709 13:01:15.024085 10526 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:15.088424  9100 rpcz_store.cc:276] 0709 13:01:14.030931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.210321 (+179390us) service_pool.cc:224] Handling call
0709 13:01:14.252711 (+ 42390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.328899 (+ 76188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.072127 (+743228us) spinlock_profiling.cc:243] Waited 75.6 ms on lock 0x7b54006685d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:15.072286 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173887232}
I20260709 13:01:15.021720 10440 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:15.074765 10455 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:15.075260  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.075528  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 304) took 1004 ms. Trace:
I20260709 13:01:15.091144  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.091446  8584 rpcz_store.cc:276] 0709 13:01:14.071275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.071371 (+    96us) service_pool.cc:224] Handling call
0709 13:01:15.075378 (+1004007us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54000aa0d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:15.075473 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037266688}
I20260709 13:01:15.062136  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.061846  8431 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:15.067375  9093 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:15.078578 10574 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:01:15.078456  8506 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:15.079186  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.104041  9098 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:15.079911  8576 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:15.104619  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 446) took 1064 ms. Trace:
I20260709 13:01:15.105015  8509 rpcz_store.cc:276] 0709 13:01:14.040074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.935251 (+895177us) service_pool.cc:224] Handling call
0709 13:01:14.935570 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.935819 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:15.022612 (+ 86793us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.104312 (+ 81700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.104357 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:15.104400 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.104456 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.104570 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":161551,"thread_start_us":167043,"threads_started":2}
I20260709 13:01:15.106797  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:15.107072  8576 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:15.107326  8509 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:15.080746  8580 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:15.108928  8583 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:15.109205  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.067461 10480 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:15.085980  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:15.088364  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:15.030510  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.110351  8430 raft_consensus.cc:2410] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:01:15.024989 10482 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.111030 10480 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:15.111441 10480 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:15.111289 10482 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:15.111851 10480 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:15.112813  9099 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:15.113330 10482 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:15.088711 10573 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:01:15.113884  9099 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:15.030393 10461 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.115592 10461 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.116835  9099 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:15.081175  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.117914  9099 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:15.118927 10480 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.120990 10480 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:15.110283  9097 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:15.122380  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1916) took 1124 ms. Trace:
I20260709 13:01:15.127290 10440 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:15.040343 10508 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:15.083698 10386 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:15.122750  8507 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:01:15.124508 10456 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:15.096602  8429 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:15.126196 10461 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:15.122731 10575 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:01:15.086833 10565 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:15.127455  8506 rpcz_store.cc:276] 0709 13:01:14.011445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.868423 (+856978us) service_pool.cc:224] Handling call
0709 13:01:15.122288 (+253865us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.153703  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.161645  8431 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
I20260709 13:01:15.161855  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.131882 10436 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.163046  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:15.163606  8506 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:15.164309 10436 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.137074  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:14.943742  9096 rpcz_store.cc:276] 0709 13:01:12.540669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.033385 (+492716us) service_pool.cc:224] Handling call
0709 13:01:13.076860 (+ 43475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.136769 (+ 59909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.139929 (+  3160us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.040870 (+900941us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18003901c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a
0709 13:01:14.041354 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.733431 (+692077us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:14.777372 (+ 43941us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.809247 (+ 31875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.812334 (+  3087us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.879912 (+ 67578us) raft_consensus.cc:1685] finished
0709 13:01:14.896849 (+ 16937us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.922949 (+ 26100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":97159,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":33744,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":18467,"spinlock_wait_cycles":3173632,"thread_start_us":706483,"threads_started":2,"wal-append.queue_time_us":702281}
I20260709 13:01:15.139036 10362 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.092365 10522 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:15.016001 10520 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:15.165726 10520 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.097223 10526 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:15.166675 10526 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:15.168026  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1520) took 1323 ms. Trace:
I20260709 13:01:15.168401  8434 rpcz_store.cc:276] 0709 13:01:13.844924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.881990 (+ 37066us) service_pool.cc:224] Handling call
0709 13:01:13.882351 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.882749 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.882784 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.883220 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.921903 (+ 38683us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:13.921940 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.922001 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.166254 (+1244253us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b1800022a20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:01:15.167717 (+  1463us) raft_consensus.cc:1685] finished
0709 13:01:15.167736 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.167951 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2014,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":11777,"spinlock_wait_cycles":10063744,"thread_start_us":38300,"threads_started":1,"wal-append.queue_time_us":31461}
I20260709 13:01:15.169988  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.171012  8433 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:15.172528  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.173326  8427 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:15.174134  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.174633  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:15.174901  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.175578  8432 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:15.176218  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.178256  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.178864  8431 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:15.179997 10455 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:15.180522 10455 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:15.181517  8582 raft_consensus.cc:2410] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:15.182606 10362 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:15.159543  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:15.187665  8430 raft_consensus.cc:2410] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:15.130843 10508 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.160230  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.188386  8426 raft_consensus.cc:2368] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:15.181354 10455 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.174640  8427 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:15.196301 10565 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.194902 10508 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:15.195089 10520 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.198503 10215 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.199391 10563 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.210210  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.211352  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:15.206276  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.212292 10563 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:15.212596  9095 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:15.215042 10565 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:15.217451  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.217610  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:15.218182  9093 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.218691  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.152995  8577 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:01:15.208171  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.208820  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 301) took 1138 ms. Trace:
I20260709 13:01:15.219941  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:15.220157  8510 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:15.224988  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.225395  9099 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:15.226215  9098 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:15.227160  8476 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:15.242844  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:15.194087 10410 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:15.243379 10449 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.000s
I20260709 13:01:15.250734 10215 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:15.227959 10511 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:15.258896  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:15.264750  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.273090  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.281041  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.282949  8504 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 2: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:15.259265  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:15.288298  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.298811  9098 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
I20260709 13:01:15.274649  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.297864  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:15.279209 10215 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:15.225049  8578 rpcz_store.cc:276] 0709 13:01:14.070435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.075479 (+  5044us) service_pool.cc:224] Handling call
0709 13:01:15.208653 (+1133174us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b54001a4354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:15.208767 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107691392}
I20260709 13:01:15.303314  8510 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:15.303746  8509 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:15.304275 10215 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.278618 10449 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.321389  8505 raft_consensus.cc:2368] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4.
I20260709 13:01:15.305375 10456 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:15.319815 10515 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:15.293371 10410 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.339093  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.282260 10511 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:15.347635  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.350135  8509 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:15.300457 10479 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.306322 10440 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:15.380766  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.641637  8435 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:15.642225  9099 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:15.597173  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 448) took 1556 ms. Trace:
W20260709 13:01:15.644002  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.607651  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:15.313860  9096 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:15.604652  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.613049  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.616914  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.597703  8509 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:15.646162  8433 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 1.
W20260709 13:01:15.614799  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.563524  9102 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:15.313594 10388 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.599437  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:15.604890  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.646911  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 449) took 1606 ms. Trace:
I20260709 13:01:15.648572  8509 rpcz_store.cc:276] 0709 13:01:14.040729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.379298 (+1338569us) service_pool.cc:224] Handling call
0709 13:01:15.597306 (+218008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.646686 (+ 49380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.646863 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.644673  8507 rpcz_store.cc:276] 0709 13:01:14.040509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.945711 (+905202us) service_pool.cc:224] Handling call
0709 13:01:15.104644 (+158933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.131239 (+ 26595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.380178 (+248939us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540005a0d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:15.597101 (+216923us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364807936}
I20260709 13:01:15.647754  8510 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:15.651172  8426 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:15.337955 10449 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.652696  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:15.653316  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53942.8us
I20260709 13:01:15.653430  8435 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:15.338438 10543 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:15.654747  9065 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:15.430691 10569 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:15.365773 10563 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.545778  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 432) took 3164 ms. Trace:
I20260709 13:01:15.613073  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:15.366434 10231 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:15.563062 10461 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.588577 10511 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.551978  9093 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:15.556777  8506 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:15.670921  8508 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:15.644461 10440 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:15.647038 10515 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.667646  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.667608  8435 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
W20260709 13:01:15.671409  8505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1915) took 1701 ms (client timeout 2046 ms). Trace:
W20260709 13:01:15.688375  8505 rpcz_store.cc:269] 0709 13:01:13.970500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.984682 (+ 14182us) service_pool.cc:224] Handling call
0709 13:01:15.671218 (+1686536us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001fcf54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:15.671357 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2871982592}
I20260709 13:01:15.662896 10480 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:15.580732 10520 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.660224 10569 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:15.658854 10388 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:15.691661  8501 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:01:15.652520 10215 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.672227  8431 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.691231 10440 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:15.689608 10522 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:15.668895 10231 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:15.666558 10563 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.705484  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 722) took 1076 ms. Trace:
I20260709 13:01:15.709738  9101 rpcz_store.cc:276] 0709 13:01:14.628735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.653141 (+ 24406us) service_pool.cc:224] Handling call
0709 13:01:14.653509 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.847627 (+194118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.847658 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.847710 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:14.847742 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.705289 (+857547us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400502154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:15.705330 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.705436 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446011264}
I20260709 13:01:15.697280 10480 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:15.662668 10543 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:15.715397 10586 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:01:15.664419  8503 rpcz_store.cc:276] 0709 13:01:12.381590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.382974 (+  1384us) service_pool.cc:224] Handling call
0709 13:01:13.858953 (+1475979us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:14.878740 (+1019787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.974677 (+ 95937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.545495 (+570818us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540008e3d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:15.545686 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338518144}
I20260709 13:01:15.717342  8503 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:15.704258 10522 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.724181  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1518) took 1623 ms. Trace:
I20260709 13:01:15.725030 10215 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.696044 10515 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.723385  9094 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:15.726645 10522 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:15.730571 10508 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:01:15.757019 10408 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.722819 10569 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.763950  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.765192  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:15.765812  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.766577  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:15.767064  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.767174  9098 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:15.768883 10515 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:15.770337 10520 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:15.773624  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:15.726971  8501 rpcz_store.cc:276] 0709 13:01:14.099262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.613689 (+1514427us) service_pool.cc:224] Handling call
0709 13:01:15.662728 (+ 49039us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.706406 (+ 43678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.722591 (+ 16185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.774348  8435 raft_consensus.cc:2368] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:15.775151  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.776124  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.776818  8435 raft_consensus.cc:2410] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:15.774361  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.778399 10388 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:15.766086  9093 raft_consensus.cc:2410] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:15.780297  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.781400  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.782459  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.783438  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.751567 10231 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.787060  8509 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:15.805245  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1519) took 1665 ms. Trace:
I20260709 13:01:15.805559  8509 rpcz_store.cc:276] 0709 13:01:14.140277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.649652 (+1509375us) service_pool.cc:224] Handling call
0709 13:01:15.786701 (+137049us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:15.786861 (+   160us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.804994 (+ 18133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.805193 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8134912}
I20260709 13:01:15.806160  8581 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:15.806847  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.788496  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.788750  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:15.793320  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.819854  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:15.794515  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:15.828032  8580 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:15.828219  8432 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:15.796449 10583 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:01:15.798722  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.800463 10543 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:15.802358  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.808626  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.837939  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 607) took 1097 ms. Trace:
I20260709 13:01:15.827385  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:15.828176 10480 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.826306 10515 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.817435 10504 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:15.758407 10508 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:15.809687  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.839007 10184 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.903221  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:15.904635  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:15.813800  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:15.817593  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.905807  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 92098.6us
I20260709 13:01:15.839370  9102 rpcz_store.cc:276] 0709 13:01:14.740558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.090455 (+349897us) service_pool.cc:224] Handling call
0709 13:01:15.563287 (+472832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.648810 (+ 85523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.837772 (+188962us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400560ed0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:15.837886 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080904448}
I20260709 13:01:15.818063  8550 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:15.906810  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:15.907505 10565 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:15.840332  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.908258 10565 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:15.908793 10565 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:15.909067  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.909605 10565 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.910161  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.911194  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.911600 10461 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:15.911703  8428 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:15.912065 10461 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:15.912503 10461 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.912609  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:15.913677  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.825371  8398 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:15.831969  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:15.843312  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.843189  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:15.915210  8578 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:15.915397  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:15.832581  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:15.846086  9097 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:15.832800  8579 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:15.916702  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:15.916764  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:15.833199  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:15.843544 10231 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.917878  8576 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:15.918057  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.842907  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.919570  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:15.919973  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.920667  8503 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:15.921077  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:15.833273  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:15.832320  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.850329  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:15.836396  8502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1524) took 1545 ms (client timeout 1749 ms). Trace:
I20260709 13:01:15.907439  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.922878  9093 raft_consensus.cc:2368] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3.
I20260709 13:01:15.839397  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 729) took 1117 ms. Trace:
I20260709 13:01:15.923594  9094 rpcz_store.cc:276] 0709 13:01:14.722504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.031271 (+308767us) service_pool.cc:224] Handling call
0709 13:01:15.839143 (+807872us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54000ebad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:15.839322 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399756160}
I20260709 13:01:15.924789  9102 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:15.851289 10515 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:15.922807  8502 rpcz_store.cc:269] 0709 13:01:14.291553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.317231 (+ 25678us) service_pool.cc:224] Handling call
0709 13:01:15.836192 (+1518961us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003732d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:15.836335 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589653248}
I20260709 13:01:15.852738 10504 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:15.926815 10515 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:15.854537  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.927956 10504 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:15.906539  8547 connection.cc:256] RPC call timeout handler was delayed by -1.2840775110000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260709 13:01:15.929244  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:15.857088  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.930716  8510 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:15.932067  8547 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:15.932250 10508 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:15.933048 10231 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:15.933393 10231 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.933432  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:15.933960 10231 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.860509  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1517) took 1761 ms. Trace:
I20260709 13:01:15.830260  8506 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:15.866178  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.936281 10447 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:15.873107  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.937384  8505 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:15.938059 10447 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.877676  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.874615  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:15.936146  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.879729  8507 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:15.941295  8426 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:15.847055  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:15.879451  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:15.943305 10462 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.943529  8504 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:15.890643 10588 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:01:15.943843 10462 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:15.917418  9095 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:15.899468  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.897305 10569 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:15.883735  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1618) took 1041 ms. Trace:
W20260709 13:01:15.907352  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 89383.5us
I20260709 13:01:15.902824 10543 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:01:15.841334  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:15.951911  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:15.952126 10408 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:15.952509 10408 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:15.952440  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 111179us
I20260709 13:01:15.953122 10408 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:15.953277 10504 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:15.921840  8503 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:01:15.934711  8508 rpcz_store.cc:276] 0709 13:01:14.098985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.464099 (+1365114us) service_pool.cc:224] Handling call
0709 13:01:15.670771 (+206672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.671262 (+   491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.860264 (+189002us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54003a07d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:15.860435 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474455936}
I20260709 13:01:15.894294  8427 raft_consensus.cc:2368] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:15.938537 10447 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.856174  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:15.953821  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:15.956301  8433 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.894541  8435 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:15.953133  8550 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:15.928035  8502 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:15.956075  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:15.846139  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:15.950001  8582 rpcz_store.cc:276] 0709 13:01:14.841831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.933360 (+ 91529us) service_pool.cc:224] Handling call
0709 13:01:15.883554 (+950194us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54001176d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:15.883679 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430574336}
I20260709 13:01:15.959031  8550 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:15.976084  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:15.838063  8432 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:15.891414 10440 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:15.963656  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 138383us
I20260709 13:01:15.979265  8504 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
W20260709 13:01:15.964656  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 60119.3us
I20260709 13:01:15.922713  8501 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:15.982719  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:15.978737  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:15.985882  8506 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:15.980526  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:15.902709  8332 catalog_manager.cc:5697] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:15.990206 10479 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:16.038070  8549 leader_election.cc:400] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3.
W20260709 13:01:16.038425  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 59763.3us
I20260709 13:01:16.041285  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:16.038688  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 62690.3us
W20260709 13:01:16.002888  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 69493.6us
I20260709 13:01:16.042714  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.039875  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:16.043716  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 300559us
I20260709 13:01:16.027369  8332 catalog_manager.cc:5697] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:16.055960  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 75498.9us
I20260709 13:01:16.056877  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:16.073529  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 418831us
I20260709 13:01:15.946210 10446 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:16.089813 10507 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.091317 10462 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:15.872243  8431 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:16.092280  8434 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:16.093878 10231 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.097097 10231 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:16.077721 10591 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:01:16.097949 10458 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.045454 10456 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:16.093775  8433 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
W20260709 13:01:16.100328  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 43572.3us
I20260709 13:01:16.110437  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:16.106577  9099 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:15.985536 10409 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:16.114602  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:16.101104  8332 catalog_manager.cc:5697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.892813 10563 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:15.971678 10511 raft_consensus.cc:2764] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:16.107583  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.053983 10562 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:15.985016 10388 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:15.985862 10504 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:16.138904 10504 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.990969 10459 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.132517  8549 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.139747 10523 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.111953 10458 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:16.054334 10275 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.141047  8575 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:16.111406 10427 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:16.141798 10427 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:16.054530 10528 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.141870  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:16.142234 10427 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:16.129490  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.037990 10410 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:16.143144 10410 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:16.143615 10410 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.146123  9098 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:16.146318 10456 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:16.146806  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.099066 10446 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.147104 10456 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:16.147384 10446 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:16.129572 10479 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:16.148818 10458 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:16.148487 10479 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.149346 10458 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:16.149674 10458 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:16.130123  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:16.139662  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:16.163635  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 120958us
I20260709 13:01:16.142607  9096 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:16.152300  9102 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.894428 10522 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:16.129685  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 88490.3us
I20260709 13:01:16.131328  8435 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:01:16.154695  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 114942us
I20260709 13:01:16.169257  8475 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.165863  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.115103 10409 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.170743  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:16.119558  8332 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.178378  8398 leader_election.cc:400] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4.
I20260709 13:01:16.181350  8398 leader_election.cc:403] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:16.179201  9102 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:16.186846  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.188338  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:16.189424  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:16.190194 10528 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:16.190621 10528 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.189294  8332 catalog_manager.cc:5697] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.190929 10528 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.191920  8332 catalog_manager.cc:5697] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 3 to 4, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 4 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.194231 10515 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.195782 10515 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:16.196233 10515 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.196607 10515 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:16.200119 10507 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:16.200675 10507 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.201059 10507 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:16.164852 10563 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:16.180315 10457 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:16.211772  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1675) took 1011 ms. Trace:
I20260709 13:01:16.211969 10563 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:16.212986 10457 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:16.213454 10457 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:16.213124 10563 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.214186 10449 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:16.214320 10458 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.215485 10526 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:16.215636  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:16.267649  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 52118.2us
I20260709 13:01:16.268440  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.212196  8429 rpcz_store.cc:276] 0709 13:01:15.200161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.782105 (+581944us) service_pool.cc:224] Handling call
0709 13:01:15.782399 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.782771 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.782802 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.783265 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.073129 (+289864us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:16.073183 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.074776 (+  1593us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.184878 (+110102us) raft_consensus.cc:1685] finished
0709 13:01:16.186111 (+  1233us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.211709 (+ 25598us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17202,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":289484,"threads_started":1,"wal-append.queue_time_us":289186}
I20260709 13:01:16.180138 10184 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:16.163895 10508 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:16.218947  9097 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:16.164228 10562 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:16.219702 10427 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.136161 10231 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:16.123801 10480 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:01:16.186480 10388 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:16.164031 10504 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.224334  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:16.236348  9068 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.531s (SENT)
I20260709 13:01:16.234460  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:16.300752  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 66360.8us
I20260709 13:01:16.239202  8476 leader_election.cc:400] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:16.306190  8476 leader_election.cc:403] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:16.248507  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.210085  8332 catalog_manager.cc:5697] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 3 to 4, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:16.271719  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 161361us
I20260709 13:01:16.307512  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:16.279417  8434 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:16.171581 10543 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:16.279903  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.310842  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.311573  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:16.311987  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 77360.9us
I20260709 13:01:16.313405  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.186401 10409 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:16.217581 10446 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:16.328356  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 92025.6us
I20260709 13:01:16.289013 10508 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:16.228602 10522 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:16.225956  9095 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:16.171280 10569 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:01:16.280920 10215 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:16.266779 10526 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:16.308707  8332 catalog_manager.cc:5697] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 3, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.184727 10461 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:16.322851  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 99254us
I20260709 13:01:16.281087 10606 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:16.299945 10458 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.300484 10388 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.258641 10410 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:16.283733  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 101529us
I20260709 13:01:16.322511 10184 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:16.327236 10449 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:16.357497  8547 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:16.357070  8332 catalog_manager.cc:5697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.358639 10565 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.357601 10591 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.394742  8332 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 3, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 3 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:16.404085  8332 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.341548 10480 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:16.341595 10603 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:16.362614  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 248069us
I20260709 13:01:16.398967  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.338831 10609 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4.
I20260709 13:01:16.364233 10388 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.446156 10479 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:16.393570 10440 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:16.458036  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.392405 10184 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.453560  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:16.446673  9068 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.673s (SENT)
W20260709 13:01:16.394287  8575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1606) took 3651 ms (client timeout 2219 ms). Trace:
W20260709 13:01:16.465798  9068 leader_election.cc:336] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.673s (SENT)
I20260709 13:01:16.402846 10456 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:16.469540  8583 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:16.452416  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.472956  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:16.395510 10449 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:16.457540  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.446873  8332 catalog_manager.cc:5697] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 3, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.448081 10606 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:16.515592  9068 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.851s (SENT)
I20260709 13:01:16.547506  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.547526  8580 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
W20260709 13:01:16.550009  9068 leader_election.cc:336] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.815s (SENT)
I20260709 13:01:16.549265  8332 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.473779  9101 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.452980 10480 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:16.449697 10603 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.572636  8332 catalog_manager.cc:5697] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:16.571774  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 68972.7us
I20260709 13:01:16.574664  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:16.575477  8506 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:16.574664  8332 catalog_manager.cc:5697] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 3, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:16.578722  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.455600 10608 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:16.454424 10479 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:16.579423  8332 catalog_manager.cc:5697] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to <none>, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:16.448277 10459 consensus_queue.cc:1059] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:01:16.467404  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.468327 10184 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:16.447463 10447 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.588280  8332 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.457262 10522 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 13:01:16.612406  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.466462  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.452602 10484 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:01:16.467882 10457 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.597070  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.640962  8581 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:16.569370 10449 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:16.606045  9101 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:16.552443 10456 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:16.450484 10565 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:16.609521  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 220161us
W20260709 13:01:16.588845  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.584250 10608 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.591212 10479 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.458204 10601 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.580080 10603 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.457535 10526 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.403255 10562 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.597031 10275 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.640085 10427 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:16.648388  8506 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:16.648490  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:16.647961  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:16.654639  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 316330us
I20260709 13:01:16.459378 10508 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:16.585546 10614 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.469018  8575 rpcz_store.cc:269] 0709 13:01:12.743259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.414295 (+671036us) service_pool.cc:224] Handling call
0709 13:01:16.362479 (+2948184us) spinlock_profiling.cc:243] Waited 2.6 s on lock 0x7b540009a954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:16.388099 (+ 25620us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5981397248}
I20260709 13:01:16.662989  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:16.672078  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:16.674012  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:16.660305 10522 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:16.649382 10607 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.658736 10608 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:16.665553 10602 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:16.677755  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:16.678432  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:16.661468 10446 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:16.679859  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:16.651641 10622 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.687124  9101 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:01:16.668504  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.666142 10480 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.673568 10526 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:16.801790  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 129752us
I20260709 13:01:16.679029 10461 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:16.679610 10522 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:16.817739  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.700042 10515 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:01:16.754558 10410 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:16.701382 10627 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:16.696812 10440 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:16.698100 10457 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:16.799431 10612 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
W20260709 13:01:16.769284 10408 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.000s
I20260709 13:01:16.700995 10447 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:16.775409  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.843173 10480 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:16.846431 10597 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
W20260709 13:01:16.862986 10610 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.391s	user 0.000s	sys 0.001s
I20260709 13:01:16.700156 10625 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.185s
I20260709 13:01:16.702901 10607 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.864571 10461 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.866940 10507 consensus_meta.cc:287] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.665s	user 0.003s	sys 0.009s
I20260709 13:01:16.927812 10408 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.860101 10515 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:16.699396 10628 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.228s
I20260709 13:01:16.937069  8578 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:16.675976 10614 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.858826 10629 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:16.841305 10609 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:01:16.768443 10623 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.252s
I20260709 13:01:16.911688 10440 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:16.758343 10602 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.697029 10456 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:16.962050  8476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.006s	sys 0.005s
W20260709 13:01:16.963416  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 119847us
W20260709 13:01:16.965621  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.018s
W20260709 13:01:16.971565  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 171939us
I20260709 13:01:16.860371 10621 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.162s
W20260709 13:01:16.973690  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.000s	sys 0.019s
W20260709 13:01:16.973256  8476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.007s	sys 0.005s
W20260709 13:01:16.974404  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 651042us
W20260709 13:01:16.974443  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 661090us
I20260709 13:01:16.974989  8476 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:16.967473 10528 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.000s
W20260709 13:01:16.968140 10613 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 13:01:16.975196  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:16.970297  8575 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:01:16.981546 10620 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:01:16.983090 10607 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:16.984853 10409 consensus_meta.cc:287] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.000s
I20260709 13:01:16.947299 10522 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:16.986517 10458 consensus_meta.cc:287] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.000s
I20260709 13:01:17.031391  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1626) took 2099 ms. Trace:
I20260709 13:01:16.968593 10459 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.989089  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:16.989316 10440 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:16.990038  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.990123 10528 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:16.990895 10641 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:16.993546  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.995610 10408 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:16.997073 10614 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:16.997668  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:16.998070 10606 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:17.031792  8504 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:17.040499 10410 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:17.034194  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:17.035102  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:17.036103  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 60952.2us
I20260709 13:01:16.951923 10461 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:17.037622  8584 rpcz_store.cc:276] 0709 13:01:14.932252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.094178 (+161926us) service_pool.cc:224] Handling call
0709 13:01:15.128108 (+ 33930us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.128468 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:15.128503 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.128930 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.757971 (+629041us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b1800205ba0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:01:16.171801 (+413830us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:16.171930 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.172191 (+   261us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.998958 (+826767us) raft_consensus.cc:1685] finished
0709 13:01:16.998976 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.031329 (+ 32353us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2899,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4296,"spinlock_wait_cycles":28536704,"thread_start_us":413441,"threads_started":1,"wal-append.queue_time_us":1221443}
I20260709 13:01:16.977006 10629 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:16.950935 10507 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.039644  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:17.057035 10388 consensus_meta.cc:287] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.002s
I20260709 13:01:17.042303  8580 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:17.047005  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:17.050077  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:17.058063  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.067943  8426 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:17.058967  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:17.032033 10565 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:17.064568  8506 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.041462  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.055365  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:17.038266 10447 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:01:17.068022  8433 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.058964  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.068674  8509 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:17.057348  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:17.073001  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:17.070828  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:17.057936 10522 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.076037  8434 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:17.039234 10409 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.077652  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:17.077904  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.053181 10635 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.039969 10603 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.080003  8581 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:17.071077  8501 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:17.087177  8433 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:17.088073  8506 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:17.088784 10615 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:17.089228 10615 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.089574 10615 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.090996  8547 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:17.051329 10459 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } }
I20260709 13:01:17.092244  8433 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:17.077096 10410 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:17.067557  8578 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:17.108273  8582 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:17.073072 10388 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.061573 10638 consensus_queue.cc:1059] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:01:17.123595 10410 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.106107 10446 raft_consensus.cc:2764] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:17.111209 10456 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:17.128284  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 129542us
I20260709 13:01:17.131145 10627 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.133322  8427 raft_consensus.cc:2368] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4.
I20260709 13:01:17.138819  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:17.113273  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:17.113336 10648 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:01:17.145318 10388 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.110008 10184 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.153398  9101 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:01:17.153779  9101 pending_rounds.cc:85] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 5
I20260709 13:01:17.153982  9101 pending_rounds.cc:107] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:17.154222  9101 raft_consensus.cc:2889] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:17.079346 10635 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:17.159956  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 89195.7us
I20260709 13:01:17.135993 10641 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:17.161314  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:17.161448  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:17.141855 10456 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:17.163254  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.165940  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:17.167495  8426 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:17.165251  8504 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:17.168460  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:17.169104  8426 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:17.169701  8577 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:17.170331 10606 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:17.171168  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:17.174291 10184 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.174976 10459 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:17.176059 10456 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:17.176813 10504 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.849s	user 0.004s	sys 0.005s
I20260709 13:01:17.176445 10608 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:17.177997 10449 consensus_meta.cc:287] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.003s
I20260709 13:01:17.178952  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.181571 10528 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:17.182001 10633 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:17.148490 10638 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.198640  8504 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:17.181736 10461 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:17.201167  8584 raft_consensus.cc:2376] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4. Re-sending same reply.
I20260709 13:01:17.204241  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:17.136056 10629 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:17.207213 10462 raft_consensus.cc:3055] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:17.209743  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.215226  8398 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:17.189126 10606 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.222775  8430 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:17.223821  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:17.224992  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:17.226241  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.210898  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:17.211686 10602 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.222448 10462 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:17.243227 10641 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.244752 10608 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.234549 10609 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:17.245609 10609 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:17.246475 10609 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.233000 10528 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:17.232784 10606 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.210124 10449 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.210265 10504 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:17.315621  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 150260us
I20260709 13:01:17.239886 10507 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.332080  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.332917  8578 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:17.333663  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.333774  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:17.334420  8578 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:17.335279  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.336270  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:17.336409  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:17.337112 10388 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:17.337296  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.338238  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:17.338898 10388 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.339706  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.367730  8579 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:17.378011  8501 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:17.347246 10603 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.390431 10449 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.396209  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:17.369671 10614 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:17.402489  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:17.420913  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 198133us
I20260709 13:01:17.392468  8578 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.422751  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:17.415481 10614 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:17.425869 10504 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.429472  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:17.430662  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:17.435227 10515 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:17.436951  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:17.437569  8475 connection.cc:256] RPC call timeout handler was delayed by -1.9963833230000319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 13:01:17.438675 10562 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:17.439090 10562 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:17.439464 10562 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:17.440625  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0225407469999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260709 13:01:17.441382  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:17.435292 10642 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:17.440390 10449 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:17.443975 10449 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.446242 10449 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.446372 10642 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:17.447471 10449 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:17.447624  8578 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:17.449067  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:17.449152  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:17.451723 10449 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:17.454937 10635 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.454449  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:17.456751 10449 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:17.457298 10449 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:17.457718 10449 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.458320  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.459227  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:17.460325  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:17.460974 10609 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:17.461792 10625 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:17.462179 10625 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:17.462457  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:17.462560 10625 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:17.463189  8581 raft_consensus.cc:2368] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4.
I20260709 13:01:17.463406 10642 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:17.463933  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.464532  8581 raft_consensus.cc:2368] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4.
I20260709 13:01:17.465226  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:17.467202  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:17.461205  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 311) took 1061 ms. Trace:
I20260709 13:01:17.472636  8504 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:17.473634  8506 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:17.475356  8505 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:17.479072  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.479072  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:17.480022  9101 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:17.480473  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:17.481000  9102 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.369854 10462 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.484434  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:17.484555  9101 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:17.426402 10526 raft_consensus.cc:2764] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:01:17.487759  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.487591  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:17.497958  9102 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:17.430783 10608 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:17.513195  8428 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:17.516848  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.518594  8581 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:17.518740  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.523375  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:17.494627 10447 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:17.529244  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:17.531036  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:17.531728  8508 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:17.494778 10640 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:17.527498  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.532446  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:17.509114 10457 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:17.532469  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:17.529834  8583 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:17.535187  8508 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:17.532733  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:17.526593  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:17.510524 10408 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.533027  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:17.537480  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:17.538280  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:17.540752  8505 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:17.541066  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:17.543322  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:17.544245  8428 raft_consensus.cc:2410] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:17.544917 10669 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:17.548542  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:17.509192 10607 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:17.546708  9093 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:17.551183 10607 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:17.539211 10507 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.554702 10507 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:17.556679 10507 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:17.556896 10449 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:17.499010 10651 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:01:17.559185 10408 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:17.560756 10606 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.561205 10408 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:17.561635  9093 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:17.533612 10526 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:01:17.525768 10614 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.564394 10614 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.565375  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.566459  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:17.561939  8504 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:17.557879  8506 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
W20260709 13:01:17.568902  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78166.8us
I20260709 13:01:17.570206  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.570813  8580 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.569348  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:17.528505 10447 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:17.474675  8577 rpcz_store.cc:276] 0709 13:01:16.399452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.402640 (+  3188us) service_pool.cc:224] Handling call
0709 13:01:17.461006 (+1058366us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54001a2f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:17.461130 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1186391296}
I20260709 13:01:17.571872  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:17.573323  8505 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
W20260709 13:01:17.567785 10601 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.881s	user 0.006s	sys 0.004s
I20260709 13:01:17.536981 10457 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.579190 10447 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.588415 10562 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:17.590235 10457 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.595841 10627 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:17.596241 10627 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:17.597090 10627 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:17.597733 10457 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:17.599085  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:17.599715  8584 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:17.600363 10457 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:17.603533  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:17.553602 10625 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:17.579247  8581 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:17.604691  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:17.574235  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:17.603688  8507 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:17.608078  8584 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:17.578670  8502 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:17.577384  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:17.610760  8581 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: [1.3-3.4]
I20260709 13:01:17.536206 10617 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:01:17.611176  8584 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:17.579828 10408 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:17.613689  8580 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:17.614444  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:17.601759 10601 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:17.621758 10651 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.614125 10641 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:17.628608 10638 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:17.629458 10606 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:17.632804  8510 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
W20260709 13:01:17.633594 10479 consensus_meta.cc:287] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.970s	user 0.006s	sys 0.003s
I20260709 13:01:17.615782  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:17.576118 10410 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:01:17.611474 10627 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.634966  8581 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:17.636179  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:17.994175  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 358071us
I20260709 13:01:17.997256  8581 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 13:01:18.000917  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 385188us
I20260709 13:01:18.001570  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:17.874181 10615 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.003s
I20260709 13:01:18.004920  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:17.636286 10408 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:17.934558 10562 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:17.854251 10449 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:17.839778 10608 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:17.953118 10625 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:17.662189 10457 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.002977 10641 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:17.662127 10670 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.664067 10671 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.384s
I20260709 13:01:17.650110  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 756) took 1018 ms. Trace:
I20260709 13:01:18.000212 10674 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:01:18.010953  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:18.156663  9095 rpcz_store.cc:276] 0709 13:01:16.617507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.618270 (+   763us) service_pool.cc:224] Handling call
0709 13:01:17.482397 (+864127us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:17.482593 (+   196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.482980 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.483014 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:17.498891 (+ 15877us) log.cc:844] Serialized 26 byte log entry
0709 13:01:17.576577 (+ 77686us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:17.576625 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.576697 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.577948 (+  1251us) raft_consensus.cc:1685] finished
0709 13:01:17.577978 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.635485 (+ 57507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2379,"raft.queue_time_us":668,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":18863,"spinlock_wait_cycles":14189440,"thread_start_us":44006,"threads_started":1,"wal-append.queue_time_us":77659}
I20260709 13:01:18.159508  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:17.634112 10479 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.161080  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:18.161713  8581 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:18.162384  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:18.006587 10526 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.097162 10456 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.166606 10526 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.167248 10456 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.168715 10526 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.000348 10632 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:18.012036 10408 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:18.009027 10640 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.004688 10651 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:18.170496 10651 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.171047 10651 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.172667 10632 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.173169 10632 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:18.173528 10651 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.174062 10640 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.105808 10457 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.174855 10640 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:18.001179 10666 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.367s	user 0.000s	sys 0.007s
W20260709 13:01:18.096794  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 77334.6us
I20260709 13:01:17.973876 10447 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:18.110294  8426 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.195990 10447 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:18.102846 10591 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.114737 10449 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.005291 10615 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.101594 10641 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:18.221937 10641 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:18.148386 10614 consensus_meta.cc:287] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.006s
I20260709 13:01:18.096822 10629 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.007893  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:18.208948  8426 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:18.210703 10591 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.210790 10449 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:18.231673  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.058s	sys 0.079s
W20260709 13:01:18.232143  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.058s	sys 0.079s
W20260709 13:01:18.231664  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 223816us
I20260709 13:01:18.233023 10526 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:18.234606 10526 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:18.235251 10449 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:18.236294  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:18.232457  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 689466us
W20260709 13:01:18.238001  9067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 2.066s (SENT) [suppressed 42 similar messages]
I20260709 13:01:18.239133  8400 leader_election.cc:400] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4.
I20260709 13:01:18.240219  8400 leader_election.cc:400] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4.
I20260709 13:01:18.241122  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:18.249006  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 1.6753e+06us
I20260709 13:01:18.253072  8581 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:18.257476  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:18.259847  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:18.260058  8580 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.042s	sys 0.080s
W20260709 13:01:18.260515  8580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.042s	sys 0.080s
I20260709 13:01:18.262547  8508 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:18.269421  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:18.270049  9102 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
W20260709 13:01:18.274878  9068 connection.cc:256] RPC call timeout handler was delayed by -1.6620600580000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:01:18.275488  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.276551  9068 connection.cc:256] RPC call timeout handler was delayed by -1.5531600580000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
W20260709 13:01:18.276861  9068 connection.cc:256] RPC call timeout handler was delayed by -1.5351600580000309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
W20260709 13:01:18.277257  9068 connection.cc:256] RPC call timeout handler was delayed by -1.5123099889999594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
I20260709 13:01:18.277874 10614 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:18.278749 10614 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.285045 10614 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:18.277953  9068 connection.cc:256] RPC call timeout handler was delayed by -1.2885757949999856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2604s for a response
W20260709 13:01:18.317205  9068 connection.cc:256] RPC call timeout handler was delayed by -1.2507600580000258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2523s for a response
I20260709 13:01:18.318751 10601 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:18.319171 10601 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:18.320515  8510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 1935) took 1655 ms (client timeout 1975 ms). Trace:
I20260709 13:01:18.320691  9068 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:18.324311  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:18.320926  8510 rpcz_store.cc:269] 0709 13:01:16.665104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.665264 (+   160us) service_pool.cc:224] Handling call
0709 13:01:18.320372 (+1655108us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b54003c5d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:18.320462 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2149094784}
I20260709 13:01:18.270334 10674 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:18.251746 10608 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:18.299741 10479 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.299404 10609 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.299221 10627 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:18.235491 10526 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.330289 10677 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.236173 10629 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:18.298431 10562 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:18.324116 10640 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.332067 10457 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.343084  8502 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:18.341961 10615 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:18.348768 10456 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.345999 10625 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:18.341848 10609 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.345445 10627 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.360635 10640 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:18.348953 10677 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:18.385591  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 147609us
I20260709 13:01:18.386389  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:18.388185  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:18.388865  8583 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:18.390484  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.401006 10677 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.373059 10625 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:18.409549 10625 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:18.412590 10629 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:18.386965 10640 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.413410 10627 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.415616 10591 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:18.415702 10640 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.416402 10591 raft_consensus.cc:2764] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:01:18.425858  9067 connection.cc:256] RPC call timeout handler was delayed by -1.0539936929999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 13:01:18.427971  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:18.428617  9102 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.437585  9102 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:18.440168  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:18.524084  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:18.523731  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:18.527097  8430 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.527422  9101 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:01:18.505442  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 184794us
I20260709 13:01:18.440521  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:18.528601  9068 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:18.483217  8583 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:18.530553  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:18.530628  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:18.531971  8583 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:18.528635  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:18.532748  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:18.533479  8583 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:18.534322  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:18.535301  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:18.536392  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:18.536549  8430 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:18.537098  8583 raft_consensus.cc:2368] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:18.537714  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:18.537830  8427 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:18.533210  9101 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.528554  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:18.522713 10614 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:18.440681  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:18.532691 10616 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.883s	user 0.003s	sys 0.017s
I20260709 13:01:18.462644 10694 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:18.545096  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:18.723812  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 193299us
I20260709 13:01:18.694898  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1894) took 1530 ms. Trace:
I20260709 13:01:18.725272  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:18.716668  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 102946us
I20260709 13:01:18.609427  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 1707) took 1179 ms. Trace:
I20260709 13:01:18.723615  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:18.728926  8475 leader_election.cc:400] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:18.728808  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:18.729571  8475 leader_election.cc:403] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:01:18.729426  8426 rpcz_store.cc:276] 0709 13:01:17.430256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.448820 (+ 18564us) service_pool.cc:224] Handling call
0709 13:01:18.609226 (+1160406us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540030eb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:18.609357 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518843136}
I20260709 13:01:18.722393  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:18.726639  9099 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:18.732465  9101 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:18.733032  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:18.684515  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 155293us
I20260709 13:01:18.733172  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:18.736963  9101 raft_consensus.cc:2410] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:01:18.737884  8509 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:18.738052  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:18.738906  9102 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:18.725875  8580 rpcz_store.cc:276] 0709 13:01:17.164589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.614626 (+450037us) service_pool.cc:224] Handling call
0709 13:01:17.614872 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.615049 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:18.260928 (+645879us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.694438 (+433510us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:18.694507 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:18.694583 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.694671 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.694825 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":725048,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":108,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":2145,"thread_start_us":1027422,"threads_started":2}
I20260709 13:01:18.739791  8428 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:18.740087  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1938) took 1579 ms. Trace:
I20260709 13:01:18.740957  8509 rpcz_store.cc:276] 0709 13:01:17.160438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.161904 (+  1466us) service_pool.cc:224] Handling call
0709 13:01:18.737567 (+1575663us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:18.737734 (+   167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.739857 (+  2123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.740025 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7487232}
I20260709 13:01:18.742983  8509 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:18.613981  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:18.740312  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:18.748313  8583 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:18.748624  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:18.749253  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:18.753151  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:18.753677  9099 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:18.754976  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:18.743467  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:18.607065  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:18.757354  8502 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:18.757565  8431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 1692) took 1715 ms (client timeout 2019 ms). Trace:
I20260709 13:01:18.757742  8502 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:18.758098  8431 rpcz_store.cc:269] 0709 13:01:17.041726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.047379 (+  5653us) service_pool.cc:224] Handling call
0709 13:01:18.606852 (+1559473us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800060398. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:18.757500 (+150648us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5310208}
I20260709 13:01:18.759874  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:18.724153 10642 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:18.762135  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:18.787227  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:18.787873  8509 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:18.546725 10609 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.594480 10689 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:18.759385 10631 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.738685 10614 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.787441 10642 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:18.600471 10695 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.795948 10695 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:18.794849  8431 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:18.798457  8427 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:18.799453 10695 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:18.800588 10642 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:18.802063 10642 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.753729  9101 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:18.786772  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:18.673103 10637 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:18.788746  8583 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:18.734735 10624 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.763656  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:18.792368  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 70645.5us
I20260709 13:01:18.759150  8502 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.794838  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:18.808791  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:18.808933  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:18.809484  8426 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:18.739950 10604 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.584084 10693 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:18.807790  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 84261.4us
I20260709 13:01:18.604862 10641 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.793845 10689 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.807014  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:18.809065  8580 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:18.755435  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:18.808450  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 83262.4us
I20260709 13:01:18.809657  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:18.810316  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:18.786542 10674 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:18.737546 10694 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:18.807364  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:19.161115  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.819821  8502 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.163230  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:19.159991  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.180439  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:19.181295  8435 raft_consensus.cc:2376] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5. Re-sending same reply.
I20260709 13:01:19.181480  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:19.182716  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:19.182821  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:18.805887  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:19.184998  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.200138 10446 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:19.050944 10669 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:19.185134  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:19.166460  8426 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:19.187788  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:19.189052  8584 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:19.167160  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:18.911832  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 98138.8us
I20260709 13:01:19.193672  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:18.814213  9100 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:19.196885  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:19.004104  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:18.852916 10457 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.903700  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 626) took 1873 ms. Trace:
I20260709 13:01:19.220822  9102 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:19.205802 10607 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:01:18.546967 10632 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.222409 10642 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:19.222743 10631 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.222872 10642 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:19.202463 10565 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.205076 10697 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.807076  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:19.201099 10446 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.255704 10653 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:19.211154 10606 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:19.211350 10671 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.216499 10633 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.218041  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1643) took 1208 ms. Trace:
I20260709 13:01:19.218101 10457 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.219866 10410 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:19.220539  9093 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:19.205986 10669 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:19.225971  8435 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:19.232313 10622 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.232597  8505 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:19.233137  8580 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:19.234001  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 315) took 2766 ms. Trace:
I20260709 13:01:19.232345  8583 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:19.216665  8577 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:19.234895  8429 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:19.235555  8579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 310) took 2836 ms (client timeout 2604 ms). Trace:
I20260709 13:01:19.236017  9101 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:19.236876 10697 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.261585  8584 rpcz_store.cc:276] 0709 13:01:18.009880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.016102 (+  6222us) service_pool.cc:224] Handling call
0709 13:01:18.211604 (+195502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.216885 (+1005281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.217640 (+   755us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b540028c8d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:19.217926 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2246250752}
I20260709 13:01:19.238766 10631 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:18.859066 10629 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.082670 10462 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:19.277581 10231 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.278462 10231 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.279721 10410 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.054246 10601 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.042865 10618 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:19.282300  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1645) took 1265 ms. Trace:
I20260709 13:01:19.282709 10618 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:19.282842  8577 rpcz_store.cc:276] 0709 13:01:18.016790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.215541 (+1198751us) service_pool.cc:224] Handling call
0709 13:01:19.216141 (+   600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.273608 (+ 57467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.282200 (+  8592us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:19.283917 10697 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.284550  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:19.284364 10618 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.240268  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 1937) took 2089 ms. Trace:
I20260709 13:01:19.159269  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:19.240355  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47189us
I20260709 13:01:19.241912  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:19.071128  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 635) took 1592 ms. Trace:
I20260709 13:01:19.289765 10622 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:19.290283 10622 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:19.290921 10622 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:19.292292  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:19.243311  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 437370us
I20260709 13:01:19.221125  9097 rpcz_store.cc:276] 0709 13:01:17.030601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.037077 (+  6476us) service_pool.cc:224] Handling call
0709 13:01:17.067645 (+ 30568us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:17.088029 (+ 20384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.088069 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:18.673541 (+1585472us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b1800391120. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1760ba20 00007f1a1761ca29 00007f1a175e2644 00007f1a17609f2d
0709 13:01:18.675047 (+  1506us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b4c00336d40. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1760ba20 00007f1a1761ca29 00007f1a175e2644 00007f1a17609f2d 00007f1a17609b93 00007f1a1933a18b 00007f1a1933acb5 00007f1a1933c004 00007f1a1933b729 00007f1a19340d96 00007f1a19335adb
0709 13:01:18.689458 (+ 14411us) log.cc:844] Serialized 582 byte log entry
0709 13:01:18.756826 (+ 67368us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:18.764004 (+  7178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.790478 (+ 26474us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.903463 (+112985us) raft_consensus.cc:1685] finished
0709 13:01:18.903482 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.903637 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8068,"raft.queue_time_us":75726,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7915,"spinlock_wait_cycles":161991936,"thread_start_us":53662,"threads_started":1,"wal-append.queue_time_us":100097}
I20260709 13:01:19.226758 10565 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.245550 10632 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:18.914837  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 640) took 1430 ms. Trace:
I20260709 13:01:19.247556  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:19.225498 10642 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.248411 10543 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:19.208253  9095 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:18.921154 10614 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:19.250376 10388 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:19.326642 10565 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:19.326922 10388 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:19.327201  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:19.327389 10388 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:19.327865  8502 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:19.328676 10388 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.256042 10446 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.216421  8576 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:18.792800 10708 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.261289 10606 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.808241 10456 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:19.262830 10671 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:18.806128 10637 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:19.206471 10603 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.238979  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1557) took 1701 ms. Trace:
I20260709 13:01:19.272132  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 337) took 1059 ms. Trace:
I20260709 13:01:19.274919  8430 raft_consensus.cc:2368] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:19.269459  8582 rpcz_store.cc:276] 0709 13:01:16.468900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.469378 (+   478us) service_pool.cc:224] Handling call
0709 13:01:16.577321 (+107943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.108900 (+531579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.233391 (+2124491us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400282654. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:19.233785 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220453632}
I20260709 13:01:19.272199  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1646) took 1255 ms. Trace:
I20260709 13:01:19.019737 10707 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:19.272773  8579 rpcz_store.cc:269] 0709 13:01:16.399168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.399272 (+   104us) service_pool.cc:224] Handling call
0709 13:01:19.235103 (+2835831us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b54003e0b54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:19.235327 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2038021504}
I20260709 13:01:19.276242 10457 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.276384  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:19.288880  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47272.7us
I20260709 13:01:19.288774 10631 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.285766  8577 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:19.024190 10639 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.302623  8506 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.302326  9098 rpcz_store.cc:276] 0709 13:01:17.484292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.484680 (+   388us) service_pool.cc:224] Handling call
0709 13:01:18.913916 (+1429236us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:18.914183 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.914441 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.914476 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:18.914530 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:18.914578 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.914646 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.914770 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12020992}
I20260709 13:01:19.303726 10642 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.303910  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:19.367228  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:19.368654  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:19.369342  8505 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:19.286296  8501 rpcz_store.cc:276] 0709 13:01:17.150939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.154564 (+  3625us) service_pool.cc:224] Handling call
0709 13:01:17.192684 (+ 38120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.389051 (+196367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.239709 (+1850658us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54003737d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:19.240035 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348952960}
I20260709 13:01:19.370105 10565 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:18.898451 10641 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.371403 10639 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:19.372104  9098 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:19.343374 10674 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.373910 10523 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:19.306747 10689 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.393972 10523 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:18.820562 10693 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.000988 10624 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:19.308696  8432 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:19.310282 10410 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:19.311271 10694 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:19.311887 10710 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:18.817793 10604 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.400489  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:19.314702  8575 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:19.317631  8427 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:19.318377  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:19.317767 10669 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.041831 10409 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.319764 10627 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.319969  9095 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:19.320665  9101 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:19.289945  9096 rpcz_store.cc:276] 0709 13:01:17.479093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.483502 (+  4409us) service_pool.cc:224] Handling call
0709 13:01:17.521722 (+ 38220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.521920 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:17.522232 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.012172 (+1489940us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b1800390ca0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a
0709 13:01:19.059952 (+ 47780us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b1800390ca0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:01:19.070582 (+ 10630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.070670 (+    88us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:19.070762 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.070869 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.071037 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7098,"prepare.queue_time_us":541,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2312,"raft.queue_time_us":24301,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"spinlock_wait_cycles":114488064,"thread_start_us":66930,"threads_started":2,"wal-append.queue_time_us":23836}
I20260709 13:01:19.406144 10669 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.406520 10604 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.297740 10618 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.409333 10693 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:19.322908  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1650) took 1291 ms. Trace:
I20260709 13:01:19.307397  9097 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.323251  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:19.412626  8584 rpcz_store.cc:276] 0709 13:01:18.031581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.314244 (+1282663us) service_pool.cc:224] Handling call
0709 13:01:19.322206 (+  7962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.322533 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.322569 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.322639 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:19.322669 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.322729 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.322839 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:19.415988  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 97763.3us
I20260709 13:01:19.329124  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:19.071373 10690 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:19.294618 10231 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.334502  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1644) took 1322 ms. Trace:
W20260709 13:01:19.338299  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 107586us
I20260709 13:01:19.340586  8580 rpcz_store.cc:276] 0709 13:01:18.209802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.186923 (+977121us) service_pool.cc:224] Handling call
0709 13:01:19.269412 (+ 82489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:19.341203  8583 rpcz_store.cc:276] 0709 13:01:18.017211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.806794 (+789583us) service_pool.cc:224] Handling call
0709 13:01:19.269605 (+462811us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:19.345422 10606 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.346174 10671 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.349500  8429 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:19.350368 10603 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.457276  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:19.351485  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:19.351686  8579 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:19.352531  8582 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:19.353868 10456 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:19.459419  8508 raft_consensus.cc:2376] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4. Re-sending same reply.
I20260709 13:01:19.459769 10456 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.460578  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:19.461434  8508 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:19.463373 10632 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.464097 10632 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.465051 10231 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:19.465627 10231 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.466094 10231 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.466559  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 338) took 1229 ms. Trace:
I20260709 13:01:19.466686 10632 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:19.466936  8582 rpcz_store.cc:276] 0709 13:01:18.237237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.351559 (+1114322us) service_pool.cc:224] Handling call
0709 13:01:19.351969 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.458936 (+106967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.466501 (+  7565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:19.467478  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:19.468438  8508 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:19.468626  8582 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:19.469058 10708 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.352710  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:19.354784 10631 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.355218 10637 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.356549  8577 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 13:01:19.359006  9093 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:19.359658 10388 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.362056  9094 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:19.371079 10565 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:19.352671 10601 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.305197 10629 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.376050 10639 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.380878  8506 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:19.381583  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:19.381798  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:19.383147  8435 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:19.387403  8550 leader_election.cc:400] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4.
I20260709 13:01:19.481089  8550 leader_election.cc:403] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:01:19.387944  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45416.1us
I20260709 13:01:19.381807  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:19.389413  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:19.390347  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:19.403578  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.404626  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 330) took 1384 ms. Trace:
W20260709 13:01:19.422566  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 85809.9us
I20260709 13:01:19.340481  8504 rpcz_store.cc:276] 0709 13:01:17.537402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.537989 (+   587us) service_pool.cc:224] Handling call
0709 13:01:19.238554 (+1700565us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b540033ac54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:19.238809 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50213248}
I20260709 13:01:19.458591  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1912) took 1191 ms. Trace:
I20260709 13:01:19.483150  8579 rpcz_store.cc:276] 0709 13:01:18.267174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.351039 (+1083865us) service_pool.cc:224] Handling call
0709 13:01:19.351383 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.458329 (+106946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.458533 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:19.470606  8582 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:19.482043 10565 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:19.490474  8428 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:19.490365  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1651) took 1135 ms. Trace:
W20260709 13:01:19.498214  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 108087us
I20260709 13:01:19.495838  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:19.423309 10523 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.506701 10462 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.507108 10523 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:19.413022 10622 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.507943  8584 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:19.472456 10604 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:01:19.454670  8576 rpcz_store.cc:276] 0709 13:01:18.010637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.214959 (+1204322us) service_pool.cc:224] Handling call
0709 13:01:19.215582 (+   623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.331597 (+116015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.333447 (+  1850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:19.416020 10627 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.517716  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:19.522403  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1655) took 1132 ms. Trace:
I20260709 13:01:19.524933  8584 rpcz_store.cc:276] 0709 13:01:18.390153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.423161 (+1033008us) service_pool.cc:224] Handling call
0709 13:01:19.482463 (+ 59302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.517904 (+ 35441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.522342 (+  4438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:19.517217 10708 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:19.530349  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 149892us
I20260709 13:01:19.530623  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1656) took 1110 ms. Trace:
W20260709 13:01:19.531118  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.531503  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:19.532564 10511 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:19.532625  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:19.533213 10511 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:19.505262 10694 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.530959  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 770) took 1035 ms. Trace:
W20260709 13:01:19.531575  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.530992  8580 rpcz_store.cc:276] 0709 13:01:18.420102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.458629 (+1038527us) service_pool.cc:224] Handling call
0709 13:01:19.508393 (+ 49764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.530307 (+ 21914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.530332 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.530388 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:19.530422 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.530475 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.530575 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:19.533880  8508 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.539863 10515 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4.
I20260709 13:01:19.540766 10515 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:19.540726 10647 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:19.542037 10647 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:19.543347 10647 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:19.537609  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 185026us
I20260709 13:01:19.550704  8504 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:19.550904  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49083.2us
I20260709 13:01:19.508394  8431 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:19.484771  8575 rpcz_store.cc:276] 0709 13:01:18.020563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.313427 (+1292864us) service_pool.cc:224] Handling call
0709 13:01:19.313990 (+   563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.403434 (+ 89444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.404554 (+  1120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:19.541759 10515 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:19.555769  8510 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:19.556114  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 68322.1us
I20260709 13:01:19.551111 10456 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.557834 10690 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.558694  9100 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:19.559069 10275 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:01:19.498757  8577 rpcz_store.cc:276] 0709 13:01:18.354721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.355597 (+1000876us) service_pool.cc:224] Handling call
0709 13:01:19.356101 (+   504us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:19.479619 (+123518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.490292 (+ 10673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:19.535986 10511 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:19.562654 10515 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:19.568405  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:19.560957  8333 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 5 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.546187 10606 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.550972 10693 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.548138 10637 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.572819  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:19.576284  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:19.577306  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:19.583017 10694 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.584900  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:19.591943  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:19.575071 10639 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:19.585768  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 103259us
I20260709 13:01:19.596572  8504 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:19.599859  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:19.536273  9094 rpcz_store.cc:276] 0709 13:01:18.495768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.755154 (+259386us) service_pool.cc:224] Handling call
0709 13:01:19.530729 (+775575us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54004d44d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:19.530880 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383703936}
I20260709 13:01:19.624837 10565 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.630263  8476 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:19.632135  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:19.632382  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:19.634093 10642 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:19.635164 10642 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:19.635725 10607 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:19.636086 10607 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:19.636718  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:19.636955 10607 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.637588 10618 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:19.638092 10618 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:19.638345 10515 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.638993 10671 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:19.639533 10671 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:19.639137 10618 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.640017 10515 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:19.641007  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.640599 10671 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.610431 10456 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:19.592438 10633 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.596915  8431 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:19.633425  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:19.614895 10606 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.650348 10642 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:19.654089  8435 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:19.651589 10642 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.657552 10641 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.664381 10641 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:19.642270 10622 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:19.666383  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:19.667207  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 85165.6us
I20260709 13:01:19.668176 10622 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:19.668715 10622 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:19.669710 10622 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.654738 10231 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.670578 10633 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.672977 10633 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.642007 10671 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:19.673389 10231 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:19.655544 10624 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:19.675235 10624 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:19.676373 10624 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.678797  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:19.648362 10456 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.680444 10456 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.681349 10669 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:19.683315 10694 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.658677 10607 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:19.688153  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 116990us
I20260709 13:01:19.689198  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:19.692783 10629 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.693558 10629 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:19.659508 10722 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.660081 10653 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:19.679988 10409 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:19.693941  8507 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:19.694330  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:19.649011 10690 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:19.659056  8578 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.025s	user 0.006s	sys 0.012s
I20260709 13:01:19.697065  8504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:01:19.658380 10446 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.707319 10606 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:19.710537  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.645714 10674 consensus_queue.cc:1059] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 13:01:19.777032  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 155730us
I20260709 13:01:19.705930  9097 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:19.778976  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 89920.5us
I20260709 13:01:19.711310 10603 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.714805  8333 catalog_manager.cc:5697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.715977 10721 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:19.717445  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:19.718304  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:19.718488  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:19.720057  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:19.721236 10708 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:19.709923 10730 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:01:19.684798  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:19.728799  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.738334  8426 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:19.782433  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:19.750255  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 216766us
W20260709 13:01:19.785557  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.741612 10409 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.656625 10627 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.790632  8584 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:19.797040 10409 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:19.782917  8578 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
W20260709 13:01:19.816726  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 157816us
I20260709 13:01:19.755316 10523 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:19.814888  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1564) took 1072 ms. Trace:
I20260709 13:01:19.809962  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:19.836930  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 152371us
I20260709 13:01:19.806250  8333 catalog_manager.cc:5697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.795361  8576 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:19.793551  8575 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:19.841640  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.838305  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 60681.3us
I20260709 13:01:19.804695  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 649) took 1211 ms. Trace:
I20260709 13:01:19.792240 10629 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.838107  8507 rpcz_store.cc:276] 0709 13:01:18.742908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.789641 (+ 46733us) service_pool.cc:224] Handling call
0709 13:01:18.795072 (+  5431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.737837 (+942765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.806340 (+ 68503us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54001fed54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:19.814810 (+  8470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029956352}
I20260709 13:01:19.808279 10565 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.862100 10647 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.840567 10690 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:19.843549 10627 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.848791 10388 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:19.886770  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 76877.8us
W20260709 13:01:19.870014  9068 leader_election.cc:336] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.507s (SENT)
I20260709 13:01:19.872478 10644 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:19.873199  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:19.874213 10622 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:19.862877  8333 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 3, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 3 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:19.852164 10601 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:01:19.900117  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:19.904282  8332 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57104 (request call id 380) took 7349 ms. Trace:
I20260709 13:01:19.902658  8333 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 5, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 5 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.886325 10446 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.889007 10388 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:19.847118  9097 rpcz_store.cc:276] 0709 13:01:18.588262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.306594 (+718332us) service_pool.cc:224] Handling call
0709 13:01:19.307111 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.782696 (+475585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.796717 (+ 14021us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:19.906417 10689 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.004s
I20260709 13:01:19.901640 10708 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.874876 10647 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.902050 10622 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:19.919270 10388 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.929744  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:19.897924 10231 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:01:19.923993 10644 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:19.934453 10707 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.935554  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1647) took 1781 ms. Trace:
W20260709 13:01:19.946674  8319 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 09de6eee9632412ebe0a904f65cd2a3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5ffc86752d264d0c81f68028e6413a91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:19.902803 10627 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.954572  8581 rpcz_store.cc:276] 0709 13:01:18.017516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.289821 (+1272305us) service_pool.cc:224] Handling call
0709 13:01:19.290287 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.290763 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:19.436040 (+145277us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.709079 (+273039us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:19.792439 (+ 83360us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.792499 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:19.792577 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.792656 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.799304 (+  6648us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2453,"prepare.queue_time_us":264125,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":56219,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":6369,"spinlock_wait_cycles":3224832,"thread_start_us":390841,"threads_started":3,"wal-append.queue_time_us":111175}
I20260709 13:01:19.956442  8504 raft_consensus.cc:606] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:19.956872  8504 raft_consensus.cc:614] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:19.957342 10627 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:19.920011 10618 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:01:19.959437  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.959931  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.936337  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.962374 10729 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:01:19.937137 10735 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:01:19.963403 10647 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:19.904716  8332 rpcz_store.cc:276] 0709 13:01:12.453897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.458458 (+  4561us) service_pool.cc:224] Handling call
0709 13:01:19.798833 (+7340375us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:17.037373 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:17.143387 (+106014us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:17.146497 (+  3110us) write_op.cc:435] Acquired schema lock
0709 13:01:17.150543 (+  4046us) tablet.cc:662] Decoding operations
0709 13:01:17.378629 (+228086us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:17.386457 (+  7828us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:17.387556 (+  1099us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:01:17.599850 (+212294us) tablet.cc:701] Row locks acquired
0709 13:01:17.599866 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:01:17.600003 (+   137us) write_op.cc:270] Start()
0709 13:01:17.600113 (+   110us) write_op.cc:276] Timestamp: P: 1783602077599959 usec, L: 0
0709 13:01:17.600130 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:01:17.600805 (+   675us) log.cc:844] Serialized 6739 byte log entry
0709 13:01:18.387958 (+787153us) op_driver.cc:464] REPLICATION: finished
0709 13:01:18.585902 (+197944us) write_op.cc:301] APPLY: starting
0709 13:01:18.593695 (+  7793us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:18.600499 (+  6804us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:18.600628 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:18.602583 (+  1955us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:18.602858 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:01:18.602899 (+    41us) write_op.cc:312] APPLY: finished
0709 13:01:18.603222 (+   323us) log.cc:844] Serialized 119 byte log entry
0709 13:01:18.603944 (+   722us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:18.604099 (+   155us) write_op.cc:454] Released schema lock
0709 13:01:18.604149 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:18.610293 (+  6144us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:18.610327 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1315670,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":154720,"apply.run_cpu_time_us":4093,"apply.run_wall_time_us":31941,"num_ops":17,"prepare.queue_time_us":166963,"prepare.run_cpu_time_us":35964,"prepare.run_wall_time_us":1017425,"raft.queue_time_us":126352,"raft.run_cpu_time_us":10248,"raft.run_wall_time_us":160725,"replication_time_us":772254,"thread_start_us":325148,"threads_started":4,"wal-append.queue_time_us":632272,"wal-append.run_cpu_time_us":24794,"wal-append.run_wall_time_us":1370849}]]}
I20260709 13:01:19.938227 10736 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.893687 10690 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.918484 10446 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:19.946185  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 73151.5us
I20260709 13:01:19.925837 10689 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.946638  8333 catalog_manager.cc:5697] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:19.947399 10629 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:19.950135  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 47160.2us
I20260709 13:01:19.950848 10644 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.952139 10622 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:19.953356  9068 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.701s (SENT)
I20260709 13:01:19.976099  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:19.965667  8550 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:19.966634  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.927491 10708 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.938781 10456 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:19.975704 10671 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:19.982224 10690 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:19.982721  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 53095.5us
I20260709 13:01:19.983381 10446 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:19.979126  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44475.7us
I20260709 13:01:19.938589 10511 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:19.987824  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.002192 10690 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.990814  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:19.997413 10456 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:19.997915  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 44611.9us
I20260709 13:01:19.998526  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:20.000017 10722 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.972911 10693 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:20.004117  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.977350  8333 catalog_manager.cc:5697] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, term changed from 1 to 2, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to <none>, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:20.005725  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:20.013983  8504 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:19.973897 10707 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.020277 10511 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:20.022536  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.023272  8430 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:20.024143  9099 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:20.023406 10604 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:19.999022 10671 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:20.025362  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:20.027586  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.003818 10629 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:20.036144  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:20.046110  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:20.047487  8430 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:01:20.048602  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50213.3us
I20260709 13:01:20.052276  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.041925 10674 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:20.054557 10674 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:20.054946 10674 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.056457 10737 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:20.056864 10737 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:20.063491 10671 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:20.062811  8333 catalog_manager.cc:5697] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193), VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194), VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195), VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 3 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: NON_VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: true } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:20.040549 10629 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.064525 10737 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.072960  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:20.339262  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.276131  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.345785  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.344167  9099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 698) took 1743 ms (client timeout 2230 ms). Trace:
I20260709 13:01:20.057878 10722 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:20.306509  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 693) took 1778 ms. Trace:
I20260709 13:01:20.320293  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.065052  8333 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 3, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 3 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:20.348449  8426 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
W20260709 13:01:20.222160  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 169436us
W20260709 13:01:20.348938  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 266619us
I20260709 13:01:20.097039  8504 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:20.111698  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:20.347043  9099 rpcz_store.cc:269] 0709 13:01:18.598792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.754702 (+155910us) service_pool.cc:224] Handling call
0709 13:01:20.322383 (+1567681us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54006685d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:20.341967 (+ 19584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2826210176}
I20260709 13:01:20.111351  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.223599  8430 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:20.343600  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:20.110064  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.112113  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.362990  8427 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:20.364756  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.365353  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:20.321466 10462 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.347966 10629 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:20.098372 10689 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:20.107250 10708 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:20.321681 10456 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.091521  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.315196 10697 raft_consensus.cc:3055] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.085150 10693 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:20.376631  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.101629  8578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 1903) took 2934 ms (client timeout 1975 ms). Trace:
I20260709 13:01:20.368155  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:20.315419 10511 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.351804  9102 rpcz_store.cc:276] 0709 13:01:18.523081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.221727 (+698646us) service_pool.cc:224] Handling call
0709 13:01:19.531405 (+309678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.531701 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:19.598302 (+ 66601us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.915374 (+317072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.915568 (+   194us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:19.923051 (+  7483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.923119 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.300787 (+377668us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54004d44d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:20.300942 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2893,"prepare.queue_time_us":179817,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":17375,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9550,"spinlock_wait_cycles":681375104,"thread_start_us":315896,"threads_started":2,"wal-append.queue_time_us":365517}
I20260709 13:01:20.105996  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:20.383455  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.372249 10721 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:20.248904 10694 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.386404  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.386808  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.050817 10409 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.351739 10722 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:20.432977  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.110697 10607 consensus_queue.cc:1059] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.270s
I20260709 13:01:20.371538 10606 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:20.395061  8433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:01:20.384320  8333 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 5, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 5 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.396384  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:20.250061 10639 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:01:20.402405  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:20.402774  8476 leader_election.cc:400] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4.
I20260709 13:01:20.403342  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:20.397248 10642 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:01:20.432720  8503 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.384721 10737 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.405119  8505 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:20.405414 10638 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.397830 10511 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:20.409361  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.457051  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.410125  8582 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:20.410871  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:20.439889  8435 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:20.387849 10697 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:20.442279  8433 raft_consensus.cc:606] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:20.456019  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:20.413708 10565 consensus_meta.cc:287] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 13:01:20.392657 10632 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.444736  8430 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:20.398093 10721 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.445621  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.464529  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:20.445899  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 65315us
I20260709 13:01:20.448122  8509 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.434803 10722 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.452857 10653 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.404435 10462 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:20.449800  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 172258us
I20260709 13:01:20.445178  8333 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:20.493875  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 91286.5us
I20260709 13:01:20.386013 10456 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:20.454522  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.432435  8431 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:20.458693  8433 raft_consensus.cc:614] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:20.093644 10388 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.495774  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.456018 10619 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:20.498857  8333 catalog_manager.cc:5697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.444550 10606 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:20.387094  8578 rpcz_store.cc:269] 0709 13:01:17.167544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.458076 (+290532us) service_pool.cc:224] Handling call
0709 13:01:20.101313 (+2643237us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540009a954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:20.101499 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2658455936}
I20260709 13:01:20.467303 10721 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.468909  9097 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.469460  8434 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:20.474169 10638 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.475013 10627 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:20.478420 10752 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:01:20.482189 10632 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.483534  8502 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:20.512938  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:20.484367  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:20.485769 10409 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:20.489100  9102 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:20.443269 10604 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:20.497280  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:20.497524  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 65940.4us
I20260709 13:01:20.454639 10671 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:20.499933  8427 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:20.500185  8435 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:20.449237  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:20.505015  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 51399us
I20260709 13:01:20.503602 10606 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:20.511390  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:20.501984 10707 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:20.525810 10671 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.529278  9094 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:20.509801  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.498883 10619 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:20.523221  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:20.523840  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.510517 10565 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.460156 10694 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.508065  8501 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:01:20.536664  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.536963  8476 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:20.537323  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.530431  9100 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:20.530515  8582 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:20.531955  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:20.519016  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:20.519616  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:20.521662 10604 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:20.533921  9068 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.170s (SENT)
I20260709 13:01:20.532423  8434 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:20.501346 10653 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:20.542706  8426 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:20.543380  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:20.539919  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:20.544386  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:20.546790 10647 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:20.547314 10647 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:20.547706 10647 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.546818  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:20.549831  9102 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.550110 10410 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:20.550688 10410 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:20.544986 10627 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:20.551685 10627 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:20.553928  8581 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:20.555768  8427 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:20.557328 10693 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:20.558262 10627 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:20.557816  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.171s (SENT)
I20260709 13:01:20.568002  8430 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:20.568356  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:20.542462 10753 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:20.577316  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:20.577701 10388 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:20.531836 10639 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:01:20.580766 10753 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.552537 10231 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:20.553023 10707 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.589979  8509 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
W20260709 13:01:20.564791  8400 connection.cc:256] RPC call timeout handler was delayed by -1.6547807570000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
I20260709 13:01:20.531215 10601 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:01:20.582149  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.593551  9099 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:20.595024  8426 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:20.596052  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:20.597622  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.604228  8432 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:20.551625 10410 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.578264 10693 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:20.609687  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:20.610605  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 52840.1us
I20260709 13:01:20.545938 10565 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.578125 10764 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:01:20.621381 10456 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:20.621507 10694 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:20.594353 10231 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:20.621840  9094 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:20.622265  8502 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:01:20.636287  9100 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:01:20.636658  9100 pending_rounds.cc:85] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 6
I20260709 13:01:20.623898 10632 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:20.626757 10624 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.607023 10755 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:20.594127 10753 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.616722 10638 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:20.628647 10674 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.002s
I20260709 13:01:20.636878  9100 pending_rounds.cc:107] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:01:20.553263 10697 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.647078 10653 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:20.647588 10697 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.647967  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:20.649379  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:20.650213 10689 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:20.650081 10409 consensus_queue.cc:1175] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0b9f7467deed4381835a85ffd0e88af6" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:20.650959 10689 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:20.610915 10693 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:20.654227 10693 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.654567 10462 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:20.657051  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:20.639410  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:20.658568  8581 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:20.634184 10231 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:20.660194  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:20.660818  9095 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.608035 10619 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:20.662930 10619 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:20.663338 10618 raft_consensus.cc:3055] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:20.663714 10618 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:20.664528 10618 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.665695 10618 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:20.666275  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:20.666754 10671 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:20.666862  8578 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.670610  8584 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:20.673533 10707 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:20.639925  8582 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:20.640694  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:20.594693 10629 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:20.645793  9100 raft_consensus.cc:2889] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:20.646623 10674 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.687740  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:20.688633  9094 raft_consensus.cc:2410] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:20.689033 10231 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:20.689450  9095 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:20.685015  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:20.691982 10231 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:20.712208  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:20.643746  8502 raft_consensus.cc:606] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:20.713380  9099 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:20.705142  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:20.712332 10409 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:20.717932  9102 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:20.719045  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.719099  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:20.719190  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 69887.3us
I20260709 13:01:20.644873 10511 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:20.723446  8504 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:20.682721 10737 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.726280  8433 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:20.731788  9068 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:20.684975 10707 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.733103  8575 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:20.733170  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:20.733422  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:20.733879  9094 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:20.734128  8501 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:20.723299 10632 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:20.735061  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:20.735690 10632 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:20.736132  8583 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 1. Current term is 3. Ops: []
I20260709 13:01:20.736524  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:20.736649 10632 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:20.720918  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:20.738385  9100 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:20.739248 10231 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:20.739790 10565 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:20.740233 10231 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:20.740608 10231 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:20.741350  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:20.731117  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:20.742779  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:20.742558  8504 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:20.715737  8502 raft_consensus.cc:614] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:20.752642  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:20.820540  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 133976us
I20260709 13:01:20.760025 10231 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:20.722497 10456 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 13:01:20.790849  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.827224  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 95501.2us
I20260709 13:01:20.712399 10624 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:20.830006  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:20.748337 10511 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:20.856763  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.823025 10689 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:01:20.857611 10674 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:20.859539  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.821973 10231 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:20.863682  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.863763  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:20.757345 10565 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:20.820171  8501 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:20.868511  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:20.876667  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.877161  8510 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:20.824664 10629 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:20.872591  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:20.873106  8575 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:20.873860  8576 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:20.773697  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.760130  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:20.749123 10707 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.825368  8578 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:20.830281 10755 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:20.855712 10511 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:20.823179 10708 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:01:20.903347  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:20.903972  8582 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.897150  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:20.905925  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:20.906414  8431 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:20.905792 10755 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:20.912566  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 205509us
I20260709 13:01:20.908568 10755 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:20.923321 10773 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:01:20.924363 10693 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.878355 10754 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:20.925688  8475 leader_election.cc:336] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.653s (SENT)
I20260709 13:01:20.908869 10511 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:20.936538  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 106632us
I20260709 13:01:20.757258 10737 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.939800  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:20.948951 10737 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:20.937165 10754 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:20.955984 10754 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.915549  8503 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:20.956522 10624 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:20.903548 10606 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.958635 10606 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:20.959461  8510 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:20.954541 10604 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:20.961949 10604 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:20.962539  8509 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:20.964093  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:20.964756  8576 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:20.970192  9097 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:20.971444 10722 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:20.972584  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.974208 10737 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:20.976153  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:20.976722  8507 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:20.964469 10753 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:20.987259 10693 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:20.989280  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:20.990056  8578 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:20.991269  8582 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:20.992770  9065 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:21.000640  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.001760  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.003935  8428 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:21.004365  8582 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
W20260709 13:01:21.005913  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50804us
W20260709 13:01:21.005980  8319 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 09de6eee9632412ebe0a904f65cd2a3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5ffc86752d264d0c81f68028e6413a91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:01:21.009599 10776 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:01:21.009752  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:20.916894 10721 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.009912  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:20.993122 10707 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:21.010931  8583 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:21.017073  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.020453  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 94803.3us
I20260709 13:01:21.036365  8508 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:21.006104 10708 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:21.035686 10462 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.043295 10708 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.051271  8575 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:21.058425  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:21.050220 10722 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.060917 10708 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.063947  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:21.043213  8431 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:21.039974 10674 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:01:21.066972 10721 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.070437  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:21.059744 10462 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:21.080904  9068 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:21.070782 10707 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:21.083528  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:21.057114 10624 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:01:21.072593  9065 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:21.081979  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:21.070847 10511 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:21.083320  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:21.085677 10693 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:21.086505 10462 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:21.063871 10641 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:21.079497 10647 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 13:01:21.094329 10624 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:21.083750 10642 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:21.084740 10753 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.096801 10707 consensus_queue.cc:1243] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:21.087060 10565 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:21.092176  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:21.108206 10641 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.100075  8506 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:21.092399  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:21.108505  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:21.112387  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:21.099483 10693 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:21.124071  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:21.111706 10647 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:21.141196  8501 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:21.112371 10642 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:21.147403 10511 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:21.169200  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 60781.5us
I20260709 13:01:21.177984  8550 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:21.169492  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 57176.8us
I20260709 13:01:21.112943 10710 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.110868 10624 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:21.177994  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 85673.5us
I20260709 13:01:21.171700 10618 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.186949 10618 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.189009 10618 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.190970 10647 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:21.174407 10627 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:21.196074 10627 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:21.196971 10627 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:21.198465 10638 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:21.199004 10638 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:21.199878 10638 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:21.200531  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.202196  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:21.171514 10693 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.177066 10642 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:21.207535  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:21.207669  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:21.208439  8584 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:21.183601 10669 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.210747 10669 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:21.212556 10775 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.389s	user 0.003s	sys 0.004s
I20260709 13:01:21.184173  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:21.181262  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:21.170898 10641 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.152918 10707 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:21.213646  8435 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:21.208132  8510 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.215020  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:21.229825  8505 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:21.178457 10644 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:21.235656  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:21.239377  8507 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:21.214345 10669 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.241995  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:21.228937 10707 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.231382 10710 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:21.253473  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 180942us
I20260709 13:01:21.237584 10462 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:21.269479  8505 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:21.266985  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:21.269126  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:21.271624  8507 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:21.230629 10618 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:01:21.282696  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.284919  8432 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:21.247160 10707 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.287050  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:21.287869  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.246652 10694 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:21.287317  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.231815 10754 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.269601 10462 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.295066  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:21.269698 10647 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.286373 10669 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:21.302094  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:21.304495  8582 raft_consensus.cc:2376] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4. Re-sending same reply.
I20260709 13:01:21.305558  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:21.302891  8580 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:21.276029 10632 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:21.291606 10710 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:21.314777 10710 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.315151 10710 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:21.315258 10642 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.316432  8428 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:21.299396 10694 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:21.291195 10511 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:21.327858  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.328920  8510 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:21.329886  8507 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:01:21.301412 10462 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:21.300851 10674 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:21.334623  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.341619  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:21.342618  8505 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:01:21.344774  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 165743us
I20260709 13:01:21.340291  8579 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
W20260709 13:01:21.357806  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.395347  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:21.327840 10511 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.396068  9101 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.275727 10624 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:21.332350 10669 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:21.405193  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:21.302702 10647 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:21.343426 10674 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.318702 10708 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:21.411864  8547 leader_election.cc:336] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.570s (SENT)
I20260709 13:01:21.402060 10511 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:21.428107  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.428509  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:21.410825  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:21.432258  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:21.434307  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:21.435362  8578 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:21.414188 10674 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.437711 10754 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:21.428874  8581 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:21.440891  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.442909  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.444737 10642 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.447824  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:21.419245  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:21.457064  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.459717  8580 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:21.424480 10624 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:21.471787  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.473824  8476 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:21.476190  8476 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:21.476156  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:21.480971  8428 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.486441  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:21.486707  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:21.487193  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:21.487452  8427 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:21.487804  8432 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:21.488426  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:21.489077  9068 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:21.401610 10694 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.486212 10722 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:21.476635 10790 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:01:21.504125  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:21.504977  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:21.519814  9102 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:21.519912  8430 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
W20260709 13:01:21.475442 10786 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:01:21.493739 10606 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:21.511722  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:21.424024 10604 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:01:21.513060  9100 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:21.493785 10653 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:21.516037  8428 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:21.527231  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:21.453467 10674 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.475569 10794 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:21.457872 10795 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:21.478441  9094 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:21.495812 10754 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.536222  8584 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:21.514971 10722 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.558247 10722 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:21.558938  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:21.559514  9100 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:21.560312  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:21.562218 10789 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:21.513254 10755 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:01:21.562731 10674 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.563558  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:21.563810 10795 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.530524 10231 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:01:21.545382 10708 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:21.521711  8501 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:21.565308  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:21.566648  8508 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:21.556360  8582 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:21.564304  9098 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:21.564894 10629 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:21.527954  9099 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:21.555907  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:21.569528  9102 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:21.572890  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.574008  9095 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:21.575459  8426 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:21.518450 10669 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.578111 10689 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:21.578509 10689 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:21.579396 10689 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.580650 10689 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.584671  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:21.584880  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 84626.4us
W20260709 13:01:21.595863  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 95598.1us
I20260709 13:01:21.605724  9101 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:21.577464 10511 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.612934  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:21.537523 10721 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:01:21.537575 10737 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:01:21.615468  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 82048.4us
I20260709 13:01:21.618499  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:21.614952  9099 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:21.586683 10795 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:21.621552  8505 raft_consensus.cc:2410] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:21.621932  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:21.625528  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:21.628917 10565 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.000s
I20260709 13:01:21.629348 10565 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:21.632279 10629 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:21.634351 10647 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:21.638820 10693 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.640908 10693 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:21.642638 10710 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.644042 10462 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:21.645535 10710 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:21.556488 10794 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.657188 10806 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:21.660300 10511 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.611802 10754 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.661845  9100 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
W20260709 13:01:21.662323 10780 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.794s	user 0.003s	sys 0.000s
I20260709 13:01:21.662963 10754 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:21.664232  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1923) took 1037 ms. Trace:
I20260709 13:01:21.664601  8577 rpcz_store.cc:276] 0709 13:01:20.626785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.633943 (+  7158us) service_pool.cc:224] Handling call
0709 13:01:20.636455 (+  2512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:20.645163 (+  8708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:20.675020 (+ 29857us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:20.740550 (+ 65530us) log.cc:844] Serialized 26 byte log entry
0709 13:01:20.867247 (+126697us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:20.941770 (+ 74523us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.955252 (+ 13482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.995312 (+ 40060us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.625447 (+630135us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:21.663866 (+ 38419us) raft_consensus.cc:1685] finished
0709 13:01:21.663990 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.664142 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2418,"prepare.queue_time_us":123689,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":13666,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":73170,"spinlock_wait_cycles":19604736,"thread_start_us":173641,"threads_started":2,"wal-append.queue_time_us":126741}
I20260709 13:01:21.666219 10794 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:21.667093  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 70410.2us
I20260709 13:01:21.658990 10806 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:21.647550 10231 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:21.670325 10231 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.670738 10231 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.670243 10806 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.671351 10802 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:21.671743 10802 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:21.669562 10606 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:21.674345 10802 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.675470 10802 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.656157 10799 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:21.678558 10799 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.681070 10799 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:21.688987 10456 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.689664 10456 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.660642 10707 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.715713 10707 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:21.744217 10641 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.504s	user 0.002s	sys 0.005s
I20260709 13:01:21.744966 10641 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:21.749060  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 79977.4us
I20260709 13:01:21.752620  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:21.758493  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:21.751420 10799 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.753346 10707 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.761329 10456 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.685041 10722 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.752645 10629 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.761489  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:21.764786 10799 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.760077  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:21.765795  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:21.766068  8501 raft_consensus.cc:2376] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6. Re-sending same reply.
I20260709 13:01:21.776732 10707 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.804772  8510 raft_consensus.cc:2410] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:21.805963  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:21.812333  8506 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:21.804351 10737 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.814850 10808 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:21.814585 10737 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.816093 10653 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.816546 10653 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:21.817216 10737 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.819573  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:21.819767 10462 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:21.820165  8426 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:21.807190 10629 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:21.823001 10653 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:21.823490 10629 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:21.828526  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:21.809321 10456 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:21.833165  8502 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:21.841104  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:21.859743  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54245.3us
I20260709 13:01:21.861836  8509 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:21.873648  8509 pending_rounds.cc:85] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 1
I20260709 13:01:21.873909  8509 pending_rounds.cc:107] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:21.874157  8509 raft_consensus.cc:2889] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.863803  8432 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:21.865736 10722 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.866750 10799 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:21.871743  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 66397.3us
W20260709 13:01:21.863209 10812 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:21.848986 10231 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.877928  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:21.931213  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:21.914619  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:21.881512 10606 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:21.939499  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:21.881220 10627 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:01:21.912699 10632 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:21.884043 10707 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:21.883363 10231 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.940387 10606 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:21.939608  8510 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.939085 10722 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:21.926095  8475 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.605s (SENT)
I20260709 13:01:21.940518  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:21.949030  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:21.950541 10753 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:21.953274 10641 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:21.941207 10632 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:21.955298 10632 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:21.949968 10722 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.955977  8510 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:21.956059 10722 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.957453  9094 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:21.959460  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:21.960041  9101 raft_consensus.cc:2376] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6. Re-sending same reply.
I20260709 13:01:21.959960  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.961143  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:21.961747  9102 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
W20260709 13:01:21.965308  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.965989  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:21.967079 10632 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:21.967911 10694 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:21.968086  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:21.969349  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.970315 10669 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:21.970927 10669 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:21.971474 10669 consensus_queue.cc:1243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:21.973206 10669 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:21.975416  8400 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:21.983803  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 57765.5us
W20260709 13:01:21.985916  8475 leader_election.cc:336] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.830s (SENT)
I20260709 13:01:21.988062  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:21.988256  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:21.989465  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:21.989965  8583 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:21.990641  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.989465  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:21.991408  8581 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:21.986090 10606 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:21.994745 10802 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:21.995743 10803 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:21.995983  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.000804  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.007843  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.007925  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.008754  8584 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.996286  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:21.997713 10803 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.030205 10803 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.030896 10694 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:22.031649 10694 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:22.031962 10694 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:22.032730 10694 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:22.002485  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.038491  8578 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:22.038791  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:22.039983  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:22.040664  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:22.040853  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:22.041410  8427 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:22.042223  8549 leader_election.cc:336] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.650s (SENT)
I20260709 13:01:22.015892  8577 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:22.043392  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:22.030144  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:22.012423  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:22.015486  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:21.996876 10632 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:22.018567  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:22.018635  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:22.017892 10624 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:22.048493  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:22.048583  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:22.048763 10624 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.049537  8506 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:22.050558 10815 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:22.050941 10624 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:22.011732 10753 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:01:22.051254 10629 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:22.051301  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:22.050313  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:22.052814  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:22.053462  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:22.053700  8503 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:22.019662  9095 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:22.019780  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:22.000083 10641 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:22.011442  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.022219 10674 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.022620 10511 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.023640  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.023921  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.024622  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.026345  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.027026  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.028539  8576 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:22.061959 10604 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:22.069438  8549 leader_election.cc:336] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.903s (SENT)
I20260709 13:01:22.046528  9100 raft_consensus.cc:2368] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5.
I20260709 13:01:22.069722 10604 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.069931  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:22.070144 10604 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:22.046123  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 44178.1us
I20260709 13:01:22.047195  8508 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.033810 10694 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.054582  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:22.056079  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:22.054004  8506 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.050973  8435 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:22.061918  8504 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:22.063130  9102 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:22.063387  9098 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:22.063016  9099 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:21.995607 10606 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.068223 10456 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:22.068337  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.068635  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.068895 10808 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:22.095502  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:22.118351  8426 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.055778  8510 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:22.079550  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:22.062284 10674 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.101591  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.101733  9101 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:22.102589  8509 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:22.122061  9100 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:22.077517  8584 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:22.112630  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:22.111904  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:22.104563  8475 leader_election.cc:336] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.605s (SENT)
I20260709 13:01:22.123660  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:22.123844  8430 raft_consensus.cc:2410] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:22.121685  8507 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:22.061956  8575 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.055572 10806 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.057123  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:22.152989  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 48469.4us
W20260709 13:01:22.153821  8475 leader_election.cc:336] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.663s (SENT)
I20260709 13:01:22.144204  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.156497  9102 raft_consensus.cc:2376] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4. Re-sending same reply.
I20260709 13:01:22.144999  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.056241 10409 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:22.056418 10818 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:22.146977  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.157645  9099 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.158001  9100 raft_consensus.cc:2368] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5.
I20260709 13:01:22.147148  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.158589  9098 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:22.159734  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.161101  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.068928  9096 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:22.163200  9098 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:22.070780 10641 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:22.177254 10641 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.178304  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.150468  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:22.170697  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.172456 10674 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:22.138785 10638 raft_consensus.cc:3055] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:22.174664  9095 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:22.095021 10410 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
W20260709 13:01:22.174747  8475 leader_election.cc:336] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.731s (SENT)
I20260709 13:01:22.175418  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.218282  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:22.218518  9100 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:22.176283  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.183790  8427 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:22.183790  8508 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:22.219724  9098 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:22.185251  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.222054  9102 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:22.062507 10511 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.055024 10627 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:01:22.130728 10629 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:22.207450  8509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77b025d136d04841aa2759be7b816f77"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:01:22.235244  8509 raft_consensus.cc:606] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:22.235687  8509 raft_consensus.cc:614] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:22.182185 10721 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:22.247654  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 72929.1us
I20260709 13:01:22.249217  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.194859 10805 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.221189  9065 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:22.121568 10632 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:01:22.223204  8506 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:22.250047  9100 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:22.209447 10638 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:22.256397  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.259677  9098 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:22.232678 10624 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:22.261427  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 155267us
I20260709 13:01:22.195245 10737 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:01:22.215058  9096 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:22.207437 10802 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:01:22.283088  9101 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:22.255722 10669 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:22.225361  8426 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:22.229671 10674 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:01:22.292164  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.293928  9098 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.261989 10707 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:22.237066 10722 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.264391 10755 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:22.320556  9102 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 2.
I20260709 13:01:22.321920  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.322768  9102 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
W20260709 13:01:22.323222 10826 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:22.323872  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:22.324229 10827 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:01:22.324719  9102 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:22.325781  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.325897  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.326907  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.328279  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.329022  9102 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:22.329985  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.330905  9102 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:22.331815  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.332461  9102 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.263326 10807 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:01:22.338828  8333 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57098 (request call id 368) took 5093 ms. Trace:
I20260709 13:01:22.341295  9102 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:22.342408  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.343039  9102 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:22.346249 10638 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.347330 10511 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:22.347777 10638 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:22.315177 10755 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:22.289059 10642 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:01:22.351584  9102 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:22.259555 10805 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:22.361320  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 210922us
I20260709 13:01:22.308259  9099 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:22.290390 10669 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.289836  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.355829  9100 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:22.362748  9098 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:22.297293  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:22.370215  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 73005.1us
I20260709 13:01:22.339221  8333 rpcz_store.cc:276] 0709 13:01:17.245890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.264195 (+ 18305us) service_pool.cc:224] Handling call
0709 13:01:18.332494 (+1068299us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a9090 00007f1a19347f3a 00007f1a1f0fe1cc 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc 00007f1a1d6bc392 00007f1a1767a48c 00007f1a176798c6
0709 13:01:22.338760 (+4006266us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:20.858414 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:21.074896 (+216482us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:21.074954 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:01:21.074972 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:21.099494 (+ 24522us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:21.099573 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:21.099605 (+    32us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:01:21.243277 (+143672us) tablet.cc:701] Row locks acquired
0709 13:01:21.272918 (+ 29641us) write_op.cc:260] PREPARE: finished
0709 13:01:21.293408 (+ 20490us) write_op.cc:270] Start()
0709 13:01:21.293571 (+   163us) write_op.cc:276] Timestamp: P: 1783602081288705 usec, L: 0
0709 13:01:21.293596 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:01:21.413275 (+119679us) log.cc:844] Serialized 5066 byte log entry
0709 13:01:21.830290 (+417015us) op_driver.cc:464] REPLICATION: finished
0709 13:01:21.850078 (+ 19788us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933ae28 00007f1a1cd75581 00007f1a1cd74d58 00007f1a1cd799f1 00007f1a1cd799a9 00007f1a1cd79939 00007f1a1cd79901 00007f1a1cd78b2d 000000000038f354 000000000038f199
0709 13:01:21.913520 (+ 63442us) write_op.cc:301] APPLY: starting
0709 13:01:21.913923 (+   403us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:21.915331 (+  1408us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:21.915372 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:21.947475 (+ 32103us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:21.952000 (+  4525us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:01:21.952055 (+    55us) write_op.cc:312] APPLY: finished
0709 13:01:21.952473 (+   418us) log.cc:844] Serialized 89 byte log entry
0709 13:01:21.952693 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:21.952829 (+   136us) write_op.cc:454] Released schema lock
0709 13:01:21.952894 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:21.953353 (+   459us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:21.953382 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":84067,"reported_tablets":32,"spinlock_wait_cycles":11467648,"child_traces":[["op",{"apply.queue_time_us":82489,"apply.run_cpu_time_us":8190,"apply.run_wall_time_us":40212,"num_ops":12,"prepare.queue_time_us":232364,"prepare.run_cpu_time_us":50182,"prepare.run_wall_time_us":1000334,"raft.queue_time_us":236519,"raft.run_cpu_time_us":26196,"raft.run_wall_time_us":60654,"replication_time_us":536516,"spinlock_wait_cycles":11929984,"thread_start_us":281827,"threads_started":4,"wal-append.queue_time_us":145311}]]}
I20260709 13:01:22.363147  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:22.373023  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:22.367473  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 291692us
I20260709 13:01:22.368109  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.375460  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:22.327255  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.391472  9098 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:01:22.392060  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:22.398900  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.399586  9101 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:22.404359  9100 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:01:22.410674  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 345001us
I20260709 13:01:22.411163  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.368850 10669 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.411367  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:22.400669 10808 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:22.393064 10619 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:22.422803  8429 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:01:22.423569 10722 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:22.423911  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:22.424590 10803 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:22.426090  8501 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:22.427175 10805 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:22.397892 10629 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:22.412127  8549 leader_election.cc:336] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.969s (SENT)
I20260709 13:01:22.428359  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:22.389098  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.430330  9096 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:22.431190  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:22.429862  8549 leader_election.cc:336] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.116s (SENT)
I20260709 13:01:22.432185  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:22.433836  9101 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:22.412528  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46764.4us
I20260709 13:01:22.435986  8509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:01:22.436678  8509 raft_consensus.cc:606] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:22.437088  8509 raft_consensus.cc:614] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:22.441897  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:22.442663  8426 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:22.403841 10818 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:22.431592  8578 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:22.463088 10627 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:22.389103 10642 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:22.431737  9096 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:22.480229 10604 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.481664  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.487998  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.491183  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.492473 10629 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:22.494503  8575 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:22.432518 10511 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:22.497215  8509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:01:22.517213  8509 raft_consensus.cc:606] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:22.499781  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.506217  9100 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.505772  9101 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.447865 10409 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:22.434878 10619 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:22.527809  9101 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:22.390378 10755 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:22.530303  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:22.551476  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.552341  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 151063us
W20260709 13:01:22.554986  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 163002us
I20260709 13:01:22.557659  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.558276  8579 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.563840  9100 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:22.522682 10456 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:22.511390  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:22.518159 10707 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:22.517058 10511 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.512380 10627 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:22.523759 10815 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:22.517761  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:22.516677 10818 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:22.570647  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:22.523592 10808 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:22.571090  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:22.584215  8427 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:22.585222  9101 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:22.578963  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.586434  8584 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.587970  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:22.589398  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:22.554557  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:22.578224  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:22.590602 10818 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.591311  8576 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:22.580984  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:22.591626 10707 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.592371  8582 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:22.593065 10604 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:22.578441  8503 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:22.578418 10511 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.595350  8429 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:22.596408  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 81314.5us
I20260709 13:01:22.598111  8509 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:22.598160  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:22.598408  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:22.598595 10674 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:22.600203  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:22.600425 10834 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:22.600903 10834 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:22.601675 10834 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.602862  8577 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:22.602880 10834 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.604938  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:22.575784 10694 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:22.602186 10836 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.605903 10632 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:22.567431 10807 consensus_queue.cc:1175] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dacb523538a14c7cb335ab9c18f4111b" responder_term: 6 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: [3.2-5.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:22.607982 10694 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:22.576613 10755 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.594488  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:22.611334  8579 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:22.575063 10837 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.600270 10674 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:22.616735  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:22.617875  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.618574  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.601465 10627 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:22.608594  8475 leader_election.cc:336] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.128s (SENT)
I20260709 13:01:22.611914 10632 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.633214  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:22.617870 10694 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:22.639650  8584 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:22.608049 10808 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:22.653941  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45364.7us
I20260709 13:01:22.654933  8429 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
W20260709 13:01:22.659703  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.667791  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.669124  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.672027  8579 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:22.672861  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:22.673116  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:22.673076  8581 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:22.673897  8579 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:22.675354  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:22.678256  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:22.634411 10632 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.699832  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.700476  8582 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.704098 10410 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:22.635162 10674 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:22.705088  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.707845  8580 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.610214 10619 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.705799  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:22.712359  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:22.613773 10836 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.714098  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:22.708858  8581 pending_rounds.cc:85] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 5
I20260709 13:01:22.714823  8581 pending_rounds.cc:107] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:01:22.674412  8503 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:22.709393 10846 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:22.627647 10669 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.704573 10410 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:22.628631 10409 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:22.680640 10694 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.715081  8581 raft_consensus.cc:2889] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:22.709769 10737 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:22.730619  8430 raft_consensus.cc:2368] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:22.731837  8582 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:22.733160  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:22.733801  8582 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.667373 10653 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:22.613348 10799 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:01:22.716948  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:22.630327 10837 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.717176  8579 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:22.721676 10722 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.746609  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:22.721400 10805 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:22.730446 10737 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:22.761267  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44401.5us
I20260709 13:01:22.766501  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:22.741508  8578 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:01:22.738122 10642 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:22.768929  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 170574us
I20260709 13:01:22.755577  8582 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:22.765630 10737 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:22.763144 10641 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:22.795377  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 365493us
I20260709 13:01:22.723483 10846 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:22.806941  8549 leader_election.cc:336] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.183s (SENT)
I20260709 13:01:22.771013 10805 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:22.809923  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:22.820097  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:22.821275  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54871.4us
I20260709 13:01:22.822688  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:22.777318  8577 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:01:22.824085  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 77869.6us
I20260709 13:01:22.834175  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:22.768301 10674 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.809996  8503 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:22.814639 10805 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:22.858449  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:22.778534 10642 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:22.859083  8510 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.768123 10410 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:22.859740  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:22.843290 10818 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.847729 10833 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:22.861451 10805 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:22.886266  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 64227.1us
I20260709 13:01:22.906141  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:22.915139  8510 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:22.918242  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:22.883431 10808 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:22.882730 10707 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:22.930308 10856 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 13:01:22.931003 10848 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 13:01:22.931836 10854 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:01:22.932552 10638 consensus_meta.cc:287] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 13:01:22.935019 10642 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:22.884747 10836 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:22.916217 10669 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:22.883064 10818 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:22.919219 10799 consensus_queue.cc:1243] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:22.922835 10804 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:22.957165 10807 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:22.957521 10804 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:22.958782 10818 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:22.958678 10804 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:22.960281 10839 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:01:22.949877 10653 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:01:22.961228 10849 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:01:22.955719 10707 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:22.947546 10641 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:22.935446  9096 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:22.945204 10868 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:22.944940 10853 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:22.999887  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55142.7us
W20260709 13:01:22.985456  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 125750us
I20260709 13:01:22.991421  8584 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:23.235018  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54330 (request call id 94) took 1186 ms. Trace:
I20260709 13:01:23.129595 10619 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:23.044755  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:23.250833  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 250147us
I20260709 13:01:23.252060 10883 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:23.252784 10860 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.370s	user 0.002s	sys 0.000s
I20260709 13:01:23.253698  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:23.219034 10737 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.182578 10877 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:23.084573 10653 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:23.100082 10627 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:01:23.159927  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:23.181105 10882 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:23.184559  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:23.054311  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 220240us
W20260709 13:01:23.261287  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 76839.3us
I20260709 13:01:23.182052 10884 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.274381 10884 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.276750 10884 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:22.979346 10847 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:01:23.277827 10868 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:23.278565 10868 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.279163  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 800) took 1254 ms. Trace:
I20260709 13:01:23.279645  9102 rpcz_store.cc:276] 0709 13:01:22.024789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.352222 (+327433us) service_pool.cc:224] Handling call
0709 13:01:22.352469 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:22.352928 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.352952 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:22.363771 (+ 10819us) log.cc:844] Serialized 26 byte log entry
0709 13:01:22.571747 (+207976us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:22.571801 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.571894 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.278922 (+707028us) raft_consensus.cc:1685] finished
0709 13:01:23.278960 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.279101 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"thread_start_us":151628,"threads_started":1,"wal-append.queue_time_us":281893}
I20260709 13:01:23.114957  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:22.983708 10837 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:23.178525 10462 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:23.281950 10462 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:23.282482  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.283440  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:23.283056 10462 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:23.284169  8502 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:23.284808 10462 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.284940  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1601) took 1210 ms. Trace:
W20260709 13:01:23.119428 10859 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:01:23.285715  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:23.207924 10606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.011s	sys 0.002s
I20260709 13:01:23.086935 10511 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:23.289783 10830 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.862s	user 0.003s	sys 0.000s
I20260709 13:01:23.293207 10511 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:23.117780 10722 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:22.995060 10853 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.294137  8502 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:01:23.287905 10606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.013s	sys 0.002s
I20260709 13:01:23.281921  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 728) took 1086 ms. Trace:
I20260709 13:01:23.295436  9095 rpcz_store.cc:276] 0709 13:01:22.196000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.260908 (+ 64908us) service_pool.cc:224] Handling call
0709 13:01:23.109226 (+848318us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:23.281854 (+172628us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10930944}
I20260709 13:01:23.296993 10866 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:23.030776  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:23.297526 10866 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:23.298583  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 267877us
I20260709 13:01:23.299276  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:23.299105 10805 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.299659 10866 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:23.299899 10511 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.300217 10866 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:23.300418 10511 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:23.300891 10866 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:23.300990  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:23.157269 10755 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.534s	user 0.000s	sys 0.009s
I20260709 13:01:23.030109  8580 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:23.241128  8583 rpcz_store.cc:276] 0709 13:01:22.035103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.041218 (+  6115us) service_pool.cc:224] Handling call
0709 13:01:23.221615 (+1180397us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54001a3454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a19345735 00007f1a1933d9fa 00007f1a1e3054c9 00007f1a17881c54 00007f1a17881be2 00007f1a17881b11 00007f1a17881a8c 00007f1a17880d42 00007f1a1767a48c 00007f1a176798c6
0709 13:01:23.221893 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971358080}
I20260709 13:01:23.302500 10805 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:23.155325 10632 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:23.303220  8319 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 09de6eee9632412ebe0a904f65cd2a3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5ffc86752d264d0c81f68028e6413a91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:23.303514  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:23.304311 10632 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:23.304353 10511 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:23.304560 10737 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:23.258512 10883 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:01:23.259251 10624 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:23.305769 10840 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.261694  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:23.306006  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:23.257068  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:23.262560 10882 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:01:23.306692  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45082.5us
W20260709 13:01:23.132615 10875 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:01:23.309903 10882 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:23.310173  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:23.311338  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:23.311970 10863 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.437s	user 0.002s	sys 0.000s
I20260709 13:01:23.312765  8430 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:23.088555 10641 raft_consensus.cc:697] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:23.314836  8434 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:23.309909 10627 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:23.285468  8433 rpcz_store.cc:276] 0709 13:01:22.074515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.075052 (+   537us) service_pool.cc:224] Handling call
0709 13:01:22.118561 (+ 43509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:22.301672 (+183111us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:22.301724 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:22.307986 (+  6262us) log.cc:844] Serialized 26 byte log entry
0709 13:01:22.350313 (+ 42327us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b48002f0358. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:01:22.567409 (+217096us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:22.567444 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.960767 (+393323us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:23.284634 (+323867us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b5400200154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:23.284681 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.284726 (+    45us) raft_consensus.cc:1685] finished
0709 13:01:23.284738 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.284858 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61993,"raft.run_cpu_time_us":1919,"raft.run_wall_time_us":116893,"spinlock_wait_cycles":114998272,"thread_start_us":279509,"threads_started":2,"wal-append.queue_time_us":304167}
I20260709 13:01:23.289891 10855 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:23.290479  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 497) took 1250 ms. Trace:
I20260709 13:01:23.312798 10707 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:23.294220 10853 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.302049 10873 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:23.305209 10832 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.317644 10855 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:23.316390 10627 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:23.319967 10855 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.320180  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:23.258270 10653 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:23.322064 10669 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:23.322463  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:23.322700 10653 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.323443 10669 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:23.323879 10653 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:23.273227  8426 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:23.306700  8509 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.262423  8330 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 2 to 3, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 3 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.310895 10882 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.311841  9097 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:23.312813  9100 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:23.335649  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:23.336041  8330 catalog_manager.cc:5697] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 1 to 2, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 2 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.336829 10832 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.268733 10674 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:23.087947  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:23.309749  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:23.398468  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 88810.9us
I20260709 13:01:23.385762 10853 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.258637 10619 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.306162 10883 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:23.305953 10624 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:23.314728 10861 log.cc:927] Time spent T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.431s	user 0.000s	sys 0.001s
W20260709 13:01:23.316920  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59905.7us
W20260709 13:01:23.412063  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 324193us
I20260709 13:01:23.315672 10641 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.308707  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:23.318195 10606 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:23.340637  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:23.341364  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:23.341434  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:23.421221  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:23.421404 10624 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:23.342168  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.343279  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:23.420135  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:23.337646  8330 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 2 to 4, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 4 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:23.344424  9068 leader_election.cc:400] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:23.288371 10868 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:23.345590  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:23.346246  8430 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:23.323396 10802 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:23.347055  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:23.324939 10669 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:23.430266 10669 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:23.348691  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:23.428092  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.431720  9099 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:23.317684  8501 rpcz_store.cc:276] 0709 13:01:22.040290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.040404 (+   114us) service_pool.cc:224] Handling call
0709 13:01:23.290290 (+1249886us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540008ded4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:23.290419 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753715456}
I20260709 13:01:23.319228 10803 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:23.338290 10627 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:23.360949  8509 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
W20260709 13:01:23.361666  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.347229 10674 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:23.366591 10231 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:23.443017 10674 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.369274 10844 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:23.306310 10840 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.373287 10865 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:23.378131 10511 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:23.380465  9095 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:23.380726  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:23.384060  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:23.449574  8508 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:23.449748  8433 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:23.450093  8507 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:23.386662 10410 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:23.389546 10872 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.297s	user 0.002s	sys 0.000s
I20260709 13:01:23.411303  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:23.411656  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:23.452720  8580 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:23.412933  8549 leader_election.cc:400] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5.
I20260709 13:01:23.417237  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:23.453421  8549 leader_election.cc:403] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:23.416780  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:23.420650  9102 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:23.422676  9101 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.453941  8581 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:23.455924  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 75289.3us
I20260709 13:01:23.343336  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:23.423686  9068 leader_election.cc:403] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:23.412487 10883 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:23.426277 10755 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:23.427464  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:23.428022  8330 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 5 to 6, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 6 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.422386 10606 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.440300  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:23.419518 10808 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:23.412722 10877 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:23.425031  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:23.419909  9100 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.460361  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:23.419931 10866 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:01:23.461589  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 122403us
I20260709 13:01:23.462517  8506 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:23.464921  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:23.473340 10883 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.474668 10883 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.478295 10840 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:23.466470  9093 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:23.480827  8475 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.686s (SENT) [suppressed 47 similar messages]
I20260709 13:01:23.456121 10873 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:23.482683  8576 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 2.
I20260709 13:01:23.483489 10755 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:23.483150 10855 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.496582  8582 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:23.467638  8330 catalog_manager.cc:5697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:23.466980 10799 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:01:23.470682 10837 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:23.454957 10868 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.485661 10853 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:23.449177 10865 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:23.486850  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:23.469640  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:23.488273 10885 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.236s	user 0.000s	sys 0.003s
I20260709 13:01:23.441154 10802 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:23.487325  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 74508.2us
W20260709 13:01:23.533408  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 108437us
I20260709 13:01:23.540681  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:23.468873 10606 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.542595 10624 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.490128  8508 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:23.492540  9101 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:23.431267 10669 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.462291 10805 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:23.511579  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:23.547320  8510 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:23.542009  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:23.535452  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:23.536760  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67224.6us
I20260709 13:01:23.484341 10755 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.537156  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:23.533872  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:23.543180 10624 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.555846  8583 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:23.500236 10840 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:23.546327  9098 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:23.517783  9100 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:23.554171  8330 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 2 to 3, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 3 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.548596  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:23.499567 10873 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.486876 10845 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5.
W20260709 13:01:23.544557  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 63745.2us
I20260709 13:01:23.470754 10409 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:01:23.471918 10694 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:01:23.547494 10511 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:23.535068 10604 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.551211 10818 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:23.579407  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:23.592697  8435 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:23.583774  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:23.558452 10638 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:23.580914  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:23.569051 10707 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:23.569461  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:23.572109  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:23.581106 10836 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.550576  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:23.559870 10808 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:23.601724  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 468) took 1083 ms. Trace:
I20260709 13:01:23.555990 10837 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:23.538753 10868 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.575367  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:23.618592  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:23.620357  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:23.608927 10845 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:23.558110 10878 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:01:23.575809 10805 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:23.610409  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:23.611186  8435 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:23.591621 10818 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:23.613312  8432 rpcz_store.cc:276] 0709 13:01:22.514579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.522981 (+  8402us) service_pool.cc:224] Handling call
0709 13:01:23.583635 (+1060654us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b5800060398. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:23.593380 (+  9745us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6616960}
I20260709 13:01:23.646162 10818 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.575634 10627 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:01:23.598915 10638 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:23.647033 10638 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.628525 10511 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:23.651087 10511 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.628774 10902 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:23.606501  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 146191us
I20260709 13:01:23.653370  8581 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:23.654104  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:23.637605 10845 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:23.655200 10845 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.655257 10900 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:23.597282 10604 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:23.655673 10818 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:23.611683 10865 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.614496 10876 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:23.577293 10873 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.653726 10902 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:23.662544 10818 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:23.786612 10629 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:23.796710  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:23.799971  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:23.842296 10638 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.844805  8508 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:23.791698 10876 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:23.845546  8429 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:23.798480  8576 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:23.795626  8504 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:23.786901 10606 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:23.825194 10840 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.843736 10629 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:23.815503 10632 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.805375 10898 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:23.811193  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:23.774451 10802 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:23.847421  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 237054us
I20260709 13:01:23.920420  8549 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:23.792106 10462 raft_consensus.cc:2764] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:23.789391 10836 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:23.848002  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:23.773785  8502 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:23.808540 10846 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:23.843698  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.849254  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 195223us
I20260709 13:01:23.629447 10619 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:23.850283  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.850751 10882 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.665342 10845 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.773730 10837 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.817896  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:23.853166  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 234621us
I20260709 13:01:23.854354  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:23.914047 10855 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:23.916164 10231 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.923782  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:23.934196 10231 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.934741  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:23.929157  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:23.924757  8398 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:23.934577  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:23.935576  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:23.936748  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:23.937726  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:23.939337  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:23.941080  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:23.944041  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:23.944895  9101 raft_consensus.cc:2410] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:23.945351 10883 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.946302  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:23.946959  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:23.955281  9100 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:23.947363 10900 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:23.942251 10846 raft_consensus.cc:2764] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:23.947875 10853 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:23.948086 10624 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:23.942251 10866 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:23.763393  9093 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:23.949888  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:23.950941  8581 raft_consensus.cc:2955] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:23.950760 10409 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:23.895851 10876 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:23.986402 10873 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:23.918737 10638 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:23.924921 10902 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.948812 10883 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:23.964387 10231 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:23.966297  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 408836us
I20260709 13:01:23.928413 10632 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.973758  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:23.975417  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:23.948132  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:23.941916 10604 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:23.956444 10808 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:01:23.954236 10865 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.991252 10853 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:23.622370 10807 raft_consensus.cc:2955] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:24.012332 10853 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.983253  9102 raft_consensus.cc:2376] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5. Re-sending same reply.
I20260709 13:01:23.949293 10803 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:23.955971 10410 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:23.963263 10836 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:23.930101 10840 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:23.950973 10642 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:01:24.023054  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 85138.9us
I20260709 13:01:24.000501  8579 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:24.002236  8583 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:23.989760  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:24.005475  9099 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:23.951054 10647 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:24.008137  8547 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:23.928260 10898 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:23.987821 10409 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.972790 10511 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:23.950511 10674 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:01:24.004894  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 56855.7us
I20260709 13:01:24.010978 10737 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:24.028891 10669 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:24.039309  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.041564 10231 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:24.016251 10868 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:24.038618 10647 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:24.045306  8582 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:24.017233 10835 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:24.045568  8580 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:24.044709 10878 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:24.059154  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:24.055001  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:24.072743  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:24.026901 10836 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:23.992182 10805 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:24.051532  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:24.104769  8429 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:24.053287 10409 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.025416 10803 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:24.025233 10410 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:24.098281  8576 raft_consensus.cc:2410] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:01:24.111410  8475 leader_election.cc:336] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.060s (SENT)
I20260709 13:01:24.093572 10647 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.114446  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:24.015574 10629 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:24.093983 10835 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:24.088631  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:24.115608  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 131259us
I20260709 13:01:24.038303 10876 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:24.126140  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:24.128571  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:24.116654 10886 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:24.137640  8549 leader_election.cc:336] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.843s (SENT)
I20260709 13:01:24.117239 10707 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:24.140671  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:24.120368 10606 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:24.113471 10641 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:01:24.125147 10835 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:24.093420 10669 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:24.181224  8432 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:24.144641 10912 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:24.146162 10832 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:24.139319 10876 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:24.146504 10836 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:24.130015  9097 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:01:24.144191  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 71736.8us
I20260709 13:01:24.143798  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:24.170642 10632 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:24.171020  8578 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:24.139600 10604 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:01:24.138234 10878 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:24.133668 10915 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:24.147733 10707 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:24.131204 10737 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:24.313479  8581 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:24.318554  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:24.328944  8508 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:24.325294  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:24.353247  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 209576us
I20260709 13:01:24.350689  8507 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:24.362149  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:24.362763  8581 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:24.326546 10707 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:24.369009 10858 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:24.313282 10883 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:24.143467 10886 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:24.330650 10912 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.318864 10802 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:24.391182  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 486694us
W20260709 13:01:24.406683  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.457386  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:24.363487 10840 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:24.574335  8581 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:24.384091 10410 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:24.394640 10873 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:24.583245 10669 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:24.583036 10873 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:24.585220 10873 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:24.587543 10882 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.646s	user 0.004s	sys 0.005s
I20260709 13:01:24.555291  8502 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:01:24.647969  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 190666us
I20260709 13:01:24.650312  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:24.641973 10647 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.001s
I20260709 13:01:24.642009 10707 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:24.387632 10902 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:24.556030 10912 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:24.658506 10882 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:24.752858 10647 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:24.942541 10929 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.296s	user 0.000s	sys 0.000s
I20260709 13:01:24.943477 10647 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:24.944036 10925 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.290s	user 0.000s	sys 0.000s
I20260709 13:01:24.945544 10853 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:24.966710  8475 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.008s	sys 0.029s
W20260709 13:01:24.967278  8475 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.009s	sys 0.029s
W20260709 13:01:24.967828  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 602650us
I20260709 13:01:24.971578  8435 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:25.027428  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.076s	user 0.014s	sys 0.036s
W20260709 13:01:25.028100  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.077s	user 0.014s	sys 0.036s
W20260709 13:01:25.028502  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 1.10374e+06us
I20260709 13:01:24.737815 10799 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.276s
I20260709 13:01:24.971940 10853 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.070425 10882 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.080817  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2021) took 1283 ms. Trace:
I20260709 13:01:25.030306  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:25.165441 10927 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:25.178937  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.181111 10915 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.181668 10915 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:25.184610 10915 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:25.185699  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 153070us
I20260709 13:01:25.155941  8510 rpcz_store.cc:276] 0709 13:01:23.797730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.799017 (+  1287us) service_pool.cc:224] Handling call
0709 13:01:23.799358 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.919672 (+120314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.919702 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.928861 (+  9159us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.986635 (+ 57774us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b18003796c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:01:24.353301 (+366666us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:24.353355 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.353445 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.946244 (+592799us) raft_consensus.cc:1685] finished
0709 13:01:24.946262 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.080737 (+134475us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141549,"raft.queue_time_us":128841,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":10582,"spinlock_wait_cycles":10482560,"thread_start_us":366379,"threads_started":1,"wal-append.queue_time_us":462975}
I20260709 13:01:25.253157  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:25.152971 10882 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.266923 10853 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:25.030207 10642 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.121744 10898 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:25.279979 10865 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.268s	user 0.001s	sys 0.009s
I20260709 13:01:25.258942 10619 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:25.300523  9098 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:25.265779 10606 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:01:25.314116  8583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.008s	sys 0.030s
W20260709 13:01:25.315702  8583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.008s	sys 0.031s
W20260709 13:01:25.314558  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.240s	user 0.007s	sys 0.031s
W20260709 13:01:25.316594  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.007s	sys 0.032s
I20260709 13:01:25.283795 10642 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:25.317164  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.25109e+06us
I20260709 13:01:25.299458 10927 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:25.288106 10619 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:25.324807  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:25.327402  8509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.010s	sys 0.052s
W20260709 13:01:25.327828  8509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.011s	sys 0.052s
I20260709 13:01:25.328665  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1619) took 1012 ms. Trace:
I20260709 13:01:25.329232  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:25.338304  8504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.001s	sys 0.024s
W20260709 13:01:25.344856  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 91773.8us
I20260709 13:01:25.350625  8581 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:25.330096 10927 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:25.364015  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:25.374742 10882 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:25.357169 10898 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:25.376757  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1615) took 1433 ms. Trace:
W20260709 13:01:25.378930 10807 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.366s	user 0.007s	sys 0.007s
I20260709 13:01:25.377290  8435 rpcz_store.cc:276] 0709 13:01:23.943636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.943804 (+   168us) service_pool.cc:224] Handling call
0709 13:01:23.944148 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.972059 (+1027911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.376423 (+404364us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400200154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:25.376666 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2362348288}
W20260709 13:01:25.389317 10931 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.104s	user 0.015s	sys 0.022s
I20260709 13:01:25.352836 10886 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:25.390447 10886 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:25.391027 10886 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:25.393409 10886 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:25.395080  8576 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:25.362076 10897 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:25.424152 10912 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:25.425297 10619 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:25.425915 10902 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:25.421722 10897 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:25.465540 10832 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:25.466352 10832 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.468858 10913 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:25.469408 10913 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:25.329062  8509 rpcz_store.cc:276] 0709 13:01:24.316582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.316707 (+   125us) service_pool.cc:224] Handling call
0709 13:01:24.324415 (+  7708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.324600 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:24.639831 (+315231us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.328327 (+688496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.328384 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:25.328432 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.328493 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.328611 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":941824,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":91,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3408,"thread_start_us":1002950,"threads_started":2}
I20260709 13:01:25.436180  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:25.451454 10882 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.502910  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:25.504078  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1616) took 1188 ms. Trace:
W20260709 13:01:25.511148  8475 leader_election.cc:336] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.584s (SENT)
W20260709 13:01:25.508414  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 179226us
I20260709 13:01:25.499877 10865 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:25.514869  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:25.504640 10642 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:25.578121  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 63358.2us
I20260709 13:01:25.579066  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:25.582212  8475 leader_election.cc:336] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.686s (SENT)
I20260709 13:01:25.582785  8475 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:25.512482 10835 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.325s	user 0.012s	sys 0.000s
I20260709 13:01:25.586236  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:25.451977 10927 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:25.505434  8504 rpcz_store.cc:276] 0709 13:01:24.315625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.318108 (+  2483us) service_pool.cc:224] Handling call
0709 13:01:24.324526 (+  6418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.324684 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:24.737799 (+413115us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.503434 (+765635us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.503660 (+   226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.503716 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:25.503782 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.503870 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.504010 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":969,"prepare.queue_time_us":943314,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":38316,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":16644,"spinlock_wait_cycles":5903104,"thread_start_us":1176791,"threads_started":3,"wal-append.queue_time_us":741396}
I20260709 13:01:25.505590 10845 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:25.507715 10805 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.509512 10946 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:25.613906 10942 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:01:25.613607 10946 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.614168 10802 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:25.584996 10606 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:01:25.615449 10943 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:25.615810 10946 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:25.617296  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1956) took 1591 ms. Trace:
I20260709 13:01:25.617619  9101 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:25.598687 10835 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.617621  8583 rpcz_store.cc:276] 0709 13:01:24.025764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.025896 (+   132us) service_pool.cc:224] Handling call
0709 13:01:24.045712 (+ 19816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.046089 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.046130 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.059691 (+ 13561us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.316253 (+1256562us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:25.502533 (+186280us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.505059 (+  2526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.505133 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.617117 (+111984us) raft_consensus.cc:1685] finished
0709 13:01:25.617135 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.617245 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2172,"raft.queue_time_us":9747,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":13626,"thread_start_us":1356221,"threads_started":2,"wal-append.queue_time_us":1332188}
I20260709 13:01:25.622061  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:25.622426  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:25.622599  8583 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:25.603556  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:25.623230  9096 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
W20260709 13:01:25.604979  8475 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.361s (SENT)
I20260709 13:01:25.624274  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:25.624833  9096 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.625034 10939 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:25.625717 10939 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:25.628199 10939 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:25.633112  9099 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:01:25.585246 10876 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.309s	user 0.012s	sys 0.000s
I20260709 13:01:25.505645 10882 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.644544  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:25.638681  9099 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:25.622669 10835 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:25.572343 10912 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:01:25.620651 10944 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:01:25.505035 10913 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.610536 10902 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:25.606812 10911 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:25.611160  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:25.587405 10865 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.658007 10844 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.677738 10876 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.683378 10902 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.683094 10841 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.682698 10846 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:25.682364 10899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.882s	user 0.054s	sys 0.084s
I20260709 13:01:25.639989 10805 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:25.640511 10947 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:01:25.689008 10915 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.710176  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:25.606288 10897 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.728500  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:25.729869  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:25.722522 10899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.923s	user 0.055s	sys 0.084s
I20260709 13:01:25.734615  9101 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:25.735006  9094 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:25.777796  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:25.710234  8577 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:25.717338 10902 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.779754  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:25.782904  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:25.725548 10846 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.781198  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:25.783282  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:25.794507  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:25.783488  9099 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:25.771262 10409 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.656s	user 0.012s	sys 0.000s
W20260709 13:01:25.791857 10930 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.505s	user 0.012s	sys 0.019s
I20260709 13:01:25.714293 10844 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:25.736954 10958 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.715979 10876 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.815850 10876 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:25.797892  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 187719us
I20260709 13:01:25.815851  9099 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:25.803797  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:25.817708  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:25.808696  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:25.820506  9094 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:25.821362  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:25.822724  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:25.823292  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:25.824810  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:25.827430 10805 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:25.818675 10962 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.828877 10962 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:25.809405 10957 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:25.809321 10865 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:25.772544 10915 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.810225 10958 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.811165  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:25.811210  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:25.722618 10841 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.818096  9101 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 3: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:25.816136 10902 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.807868  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1957) took 1780 ms. Trace:
I20260709 13:01:25.783927 10952 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.819229  9099 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:25.779768 10837 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:01:25.804949 10409 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:25.818432 10939 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:01:25.809563 10846 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:25.831557 10962 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:25.942437 10952 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:26.066370  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 255203us
I20260709 13:01:26.069113  8429 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:26.072613  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2017) took 2584 ms. Trace:
I20260709 13:01:26.072980 10952 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.069931  8579 rpcz_store.cc:276] 0709 13:01:24.027863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.028006 (+   143us) service_pool.cc:224] Handling call
0709 13:01:25.499980 (+1471974us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:25.500245 (+   265us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:25.504861 (+  4616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.504893 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:25.505433 (+   540us) log.cc:844] Serialized 52 byte log entry
0709 13:01:25.713912 (+208479us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:25.785307 (+ 71395us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.801152 (+ 15845us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.801324 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.801387 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.807652 (+  6265us) raft_consensus.cc:1685] finished
0709 13:01:25.807671 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.807808 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69769,"prepare.run_wall_time_us":3266,"raft.queue_time_us":8821,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":7368,"spinlock_wait_cycles":69874432,"thread_start_us":150453,"threads_started":2,"wal-append.queue_time_us":216278}
W20260709 13:01:25.841985 10948 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:01:25.943784 10409 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.071271 10629 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:26.068279 10832 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:25.915251 10969 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:26.081203 10950 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:26.083841 10915 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:25.875547  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 364) took 1876 ms. Trace:
I20260709 13:01:25.945091 10837 consensus_queue.cc:1243] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:26.075045 10962 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:26.073056  8505 rpcz_store.cc:276] 0709 13:01:23.488501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.488634 (+   133us) service_pool.cc:224] Handling call
0709 13:01:23.535830 (+ 47196us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:23.918542 (+382712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.918574 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:23.954776 (+ 36202us) log.cc:844] Serialized 52 byte log entry
0709 13:01:24.284870 (+330094us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:24.284913 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.388770 (+1103857us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:26.072282 (+683512us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54001fed54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:26.072332 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.072374 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:26.072387 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.072537 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14104,"raft.queue_time_us":258035,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":18523,"spinlock_wait_cycles":303057024,"thread_start_us":294775,"threads_started":1,"wal-append.queue_time_us":308133}
I20260709 13:01:26.102566  8584 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:26.103158  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1958) took 2072 ms. Trace:
I20260709 13:01:26.103471  8584 rpcz_store.cc:276] 0709 13:01:24.030621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.030811 (+   190us) service_pool.cc:224] Handling call
0709 13:01:26.102145 (+2071334us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:26.102403 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.102931 (+   528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.103102 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18297600}
I20260709 13:01:26.091553  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:25.879714  9096 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:26.107031  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:26.107605  9096 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:26.108417  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:26.108944  9096 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:26.109686  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:26.114241  9096 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:26.115051  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:26.115643  9096 raft_consensus.cc:2376] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7. Re-sending same reply.
I20260709 13:01:25.823335  9094 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:26.098850  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:26.116310 10902 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.116448  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:26.138479 10624 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:26.138742  9096 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.127400  9099 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:26.139077 10624 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:26.139750  8506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 507) took 2654 ms (client timeout 2784 ms). Trace:
I20260709 13:01:26.139881  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:26.140443  9099 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
W20260709 13:01:26.140162  8506 rpcz_store.cc:269] 0709 13:01:23.485435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.486620 (+  1185us) service_pool.cc:224] Handling call
0709 13:01:26.139556 (+2652936us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b540008ded4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:26.139677 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4354639616}
I20260709 13:01:26.130609 10914 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:26.142464  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:26.142560 10914 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.144685 10914 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.148226  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:26.149019  8580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1710) took 1785 ms (client timeout 1618 ms). Trace:
W20260709 13:01:26.149348  8580 rpcz_store.cc:269] 0709 13:01:24.363938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.364084 (+   146us) service_pool.cc:224] Handling call
0709 13:01:26.148080 (+1783996us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:26.148947 (+   867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8090880}
I20260709 13:01:26.143072  9099 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:26.151695  9102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 807) took 2208 ms (client timeout 1579 ms). Trace:
W20260709 13:01:26.152082  9102 rpcz_store.cc:269] 0709 13:01:23.943717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.949687 (+  5970us) service_pool.cc:224] Handling call
0709 13:01:26.151537 (+2201850us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b5400594a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:26.151634 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7872256}
W20260709 13:01:26.152941  8549 connection.cc:256] RPC call timeout handler was delayed by -1.6866733169999293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260709 13:01:26.141366 10624 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:26.153330  8549 connection.cc:256] RPC call timeout handler was delayed by -1.3842733169999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 13:01:26.154137  8549 connection.cc:256] RPC call timeout handler was delayed by -1.0917733169999337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
I20260709 13:01:26.153257  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:26.153231 10914 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:26.154661 10231 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:26.154910  8549 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:26.142035  9093 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:26.155812  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:26.156546 10231 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:26.159137  9102 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:26.159925  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:26.160426  9102 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:26.161777  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:26.164337  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:26.164577  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.166970  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:26.171487 10231 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:26.104362 10962 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.171736  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.165462 10456 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.174530 10958 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.130968 10802 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:26.170317 10846 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:26.175424 10802 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:26.175596 10846 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.177377 10802 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.172612 10832 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:26.180012  8579 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:26.182296  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.184823  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.185436  8581 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:26.170614 10915 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:26.170463 10835 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.173611  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:26.189904  9099 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:26.191170  8579 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:26.172950 10902 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.173560 10962 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:26.173270  9093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 700) took 2123 ms (client timeout 1839 ms). Trace:
I20260709 13:01:26.173205 10897 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.194469  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:26.197922  8579 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:26.194659  9099 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:01:26.180423 10961 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.189500 10958 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:26.193415 10846 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.210227  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.210748  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2022) took 2412 ms. Trace:
I20260709 13:01:26.212576  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.214138  8579 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:26.230481  8580 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
W20260709 13:01:26.214695  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50615.8us
I20260709 13:01:26.217304 10456 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:26.195739 10835 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:26.228997 10805 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.208987 10961 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.233161 10841 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.242321  8433 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:26.234573  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.243117  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.243355  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:26.243896  8428 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:26.244230  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.244720  8432 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:26.230520 10802 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:26.245638 10802 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.245922  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.246603  8579 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:26.247262  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:26.247654 10802 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:26.196053  9093 rpcz_store.cc:269] 0709 13:01:24.048180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.053238 (+  5058us) service_pool.cc:224] Handling call
0709 13:01:26.098686 (+2045448us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:26.171282 (+ 72596us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14701952}
I20260709 13:01:26.250615  9093 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:26.250594 10857 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:26.251057  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:26.196832 10902 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:26.252496  8428 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:26.256155 10953 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:26.256356 10950 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:26.256812 10950 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:26.264209  8579 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.202260 10897 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.230613  9096 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:26.232940  8577 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:26.269356  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.270494  8507 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:26.271706  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.238287 10914 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.277662  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:26.278767  8428 raft_consensus.cc:2376] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6. Re-sending same reply.
I20260709 13:01:26.278919  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.280329  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.281193  8433 raft_consensus.cc:2410] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:26.281636  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.282038  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:26.282217  8510 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:26.283039  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.284044  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.284394  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:26.285064  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:26.285377  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.285622  8510 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.286161  8504 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:26.286415  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.286901  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.286947  8579 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:26.287815  8504 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:26.288766  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.284054  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.290696  8509 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:26.291879  8428 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:26.293497  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.293859  8510 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:26.269960  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:26.295156  8577 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:26.295992  8429 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:01:26.295102  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.297034  8432 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:26.297986  8507 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:26.266397 10911 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:26.271476 10802 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.308164  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:26.256184 10619 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:01:26.309865  8549 leader_election.cc:336] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.579s (SENT)
I20260709 13:01:26.306281  9095 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:26.226236  8501 rpcz_store.cc:276] 0709 13:01:23.797953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.803498 (+  5545us) service_pool.cc:224] Handling call
0709 13:01:23.847141 (+ 43643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.962918 (+115777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.978490 (+ 15572us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.820813 (+1842323us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b1800379720. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a
0709 13:01:25.839001 (+ 18188us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b2c0005c2d8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:01:25.839670 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:01:26.165135 (+325465us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:26.169725 (+  4590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.169877 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.206084 (+ 36207us) raft_consensus.cc:1685] finished
0709 13:01:26.208814 (+  2730us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.210691 (+  1877us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103504,"raft.queue_time_us":130481,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":1836,"spinlock_wait_cycles":14216832,"thread_start_us":310908,"threads_started":1,"wal-append.queue_time_us":364660}
I20260709 13:01:26.313071 10835 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.313573 10835 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.252944 10805 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:26.314047 10835 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.314730 10902 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.315025  9093 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:26.290484 10914 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.316309 10835 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.317087 10835 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:26.317543 10835 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.257753 10950 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.256776 10953 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:26.266578 10952 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:01:26.276518 10898 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:26.305480 10911 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:26.317934 10835 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.327999  9096 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:01:26.369493 10911 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:26.364033 10619 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:26.319613 10802 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.099968  8575 rpcz_store.cc:276] 0709 13:01:23.999446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.005882 (+  6436us) service_pool.cc:224] Handling call
0709 13:01:24.044406 (+ 38524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.105350 (+ 60944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.108057 (+  2707us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.144790 (+ 36733us) log.cc:844] Serialized 26 byte log entry
0709 13:01:24.285834 (+141044us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:24.285884 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.285957 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.791327 (+1505370us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:25.875255 (+ 83928us) raft_consensus.cc:1685] finished
0709 13:01:25.875273 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.875484 (+   211us) inbound_call.cc:177] Queueing success response
0709 13:01:26.141924 (+266440us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b48000b1558. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
Metrics: {"mutex_wait_us":14451,"raft.queue_time_us":21990,"raft.run_cpu_time_us":49896,"raft.run_wall_time_us":2045079,"spinlock_wait_cycles":78316800,"thread_start_us":140653,"threads_started":1,"wal-append.queue_time_us":141048}
I20260709 13:01:26.391957 10953 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.394250 10802 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.378895 10619 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:26.396847 10619 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.398145 10619 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.406711 10835 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.408318  8502 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:26.412458 10835 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.420375 10882 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.424536  9099 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:26.430503 10914 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.430763 10897 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.378331 10950 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:26.436678  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 107433us
W20260709 13:01:26.437829  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:26.452555  8547 connection.cc:256] RPC call timeout handler was delayed by -1.5668183459999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 13:01:26.453773  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.447181 10962 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.456585  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.457908  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.458106 10962 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.458700  8507 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:26.459965  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:26.463709 10803 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.468843 10808 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:26.470404 10808 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.473292 10808 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.474995 10908 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.475533 10908 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:26.479493  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.486083  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.488288  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.491381  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.494352  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.489467  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.489207  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.497653  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.511435  8506 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:01:26.511682  9098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 801) took 2574 ms (client timeout 1843 ms). Trace:
I20260709 13:01:26.490139  8433 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:26.511895  9102 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:26.481536  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:26.512382  8433 pending_rounds.cc:85] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 2
I20260709 13:01:26.512718  8433 pending_rounds.cc:107] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:26.513032  8433 raft_consensus.cc:2889] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:26.494431  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:26.512212  9098 rpcz_store.cc:269] 0709 13:01:23.937029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.937502 (+   473us) service_pool.cc:224] Handling call
0709 13:01:26.511475 (+2573973us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54005b6b54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:26.511620 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3131638656}
I20260709 13:01:26.515002  8435 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:26.515443  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:26.488914  8431 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:26.519238  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.522837  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:26.517712  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 209675us
I20260709 13:01:26.542907  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:26.534476 10967 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:26.543527  8434 raft_consensus.cc:2376] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5. Re-sending same reply.
I20260709 13:01:26.523062  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.544020 10882 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.543860 10967 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.544605 10882 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.534509 10963 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.546846 10882 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.546573 10963 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:26.547379 10920 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.281s	user 0.011s	sys 0.002s
I20260709 13:01:26.481688 10958 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.525445  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.481583 10456 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.524287 10873 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.526052  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.483718  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.490339  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:26.491063  8502 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:01:26.477982 10908 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:26.532579  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 232551us
I20260709 13:01:26.479804  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.510054 10806 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.492923 10799 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.482038  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.510802 10840 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.541577  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.515992  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:26.521111 10629 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:26.549898  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.525991 10853 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:26.554850  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.557578  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:26.526590 10865 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.526683 10832 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:01:26.558982  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.547416 10882 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:26.559744 10967 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.577378  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.560083 10456 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:26.609817  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:27.195456  8427 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:27.195536  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:27.167558  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.974483  8476 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:26.739331  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 203885us
I20260709 13:01:26.789214  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:27.199026  9098 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.614251  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:27.200089  8577 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:27.200731 10456 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:27.017825  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 750) took 1282 ms. Trace:
I20260709 13:01:27.044600  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:26.569643  8502 pending_rounds.cc:85] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 2
I20260709 13:01:27.198591  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:26.560194 10958 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:27.194553 10844 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:27.995098  8502 pending_rounds.cc:107] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 5.3
W20260709 13:01:27.852619  9101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.009s
I20260709 13:01:27.995623  8502 raft_consensus.cc:2889] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:27.995890  9101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.010s	sys 0.009s
W20260709 13:01:26.618263  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:27.288712  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 314294us
I20260709 13:01:27.997481  9094 rpcz_store.cc:276] 0709 13:01:25.731827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.171531 (+439704us) service_pool.cc:224] Handling call
0709 13:01:26.191511 (+ 19980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.836921 (+645410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.848595 (+ 11674us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.856953 (+  8358us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:26.963745 (+106792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.967845 (+  4100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.014613 (+ 46768us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":316371,"raft.queue_time_us":349742,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8219,"thread_start_us":184275,"threads_started":1}
I20260709 13:01:26.643693 10961 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:27.202751  8434 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:26.582882  8501 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:27.999925 10996 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.000198  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1630) took 1514 ms. Trace:
I20260709 13:01:28.000622  8501 rpcz_store.cc:276] 0709 13:01:26.485409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.490105 (+  4696us) service_pool.cc:224] Handling call
0709 13:01:28.000132 (+1510027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:26.971222  9095 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:27.189800 10868 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:28.002197  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 724) took 1032 ms. Trace:
I20260709 13:01:28.002483 10868 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.740288  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 701) took 2691 ms. Trace:
I20260709 13:01:28.000562 10996 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.004542 10868 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.003475  9100 rpcz_store.cc:276] 0709 13:01:24.049193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.050118 (+   925us) service_pool.cc:224] Handling call
0709 13:01:25.127007 (+1076889us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:25.127262 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.127535 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:25.422323 (+294788us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.644910 (+222587us) log.cc:844] Serialized 14 byte log entry
0709 13:01:26.490553 (+845643us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b1800391840. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:01:26.492290 (+  1737us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b1800391840. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:01:26.739687 (+247397us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.739769 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:26.739840 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.739930 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.740205 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48542,"prepare.queue_time_us":378831,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":2489,"raft.queue_time_us":886076,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":175,"spinlock_wait_cycles":113202944,"thread_start_us":727355,"threads_started":3,"wal-append.queue_time_us":267552,"wal-append.run_cpu_time_us":2195,"wal-append.run_wall_time_us":1120052}
I20260709 13:01:27.222697  8581 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:26.981021  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:28.006230  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:28.006870 10962 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:28.007368 10962 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:28.008034  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 798672us
I20260709 13:01:28.008283 10962 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.009034  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:27.289294 10846 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.010612  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:26.586931  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.011471  8429 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:28.011979  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1638) took 1443 ms. Trace:
I20260709 13:01:28.011869  8398 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:28.012719 10989 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:28.010792 10976 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.013360 10989 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:26.740684  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 207038us
I20260709 13:01:26.609880 10988 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 1.465s
I20260709 13:01:28.014945 10989 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:26.617833 10806 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.016407 10997 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.017120 10806 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.016906 10997 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.017609 10806 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.639555  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:28.018916 10997 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:27.367518 10903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.297s	user 0.012s	sys 0.041s
I20260709 13:01:27.221517 10629 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.208873 10963 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.620059 10805 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.613727 10911 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:28.049795  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.050791  9094 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:28.051355 10911 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.617722 10799 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:27.201454  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 685452us
I20260709 13:01:27.628623 10992 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.424s
I20260709 13:01:28.052184  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:28.052518  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:26.609719  8575 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
W20260709 13:01:27.826277  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.008s	sys 0.017s
W20260709 13:01:28.053406  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.008s	sys 0.023s
W20260709 13:01:28.053690  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.08056e+06us
I20260709 13:01:28.050612 10958 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:26.700605  8582 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:28.053874  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.054322 10958 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:27.304733 10803 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.024194  8398 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:28.054819 10958 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.057922 10976 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:28.059528 10958 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.060039 10958 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:28.062191 10989 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.062178 11007 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:28.062945 10989 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.063086 11007 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.064958 10989 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:28.065798  8575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 366) took 1587 ms (client timeout 1609 ms). Trace:
W20260709 13:01:28.024893  8432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1640) took 1448 ms (client timeout 1669 ms). Trace:
W20260709 13:01:28.024986  8435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1637) took 1470 ms (client timeout 1845 ms). Trace:
I20260709 13:01:27.026554  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:28.067538  8432 rpcz_store.cc:269] 0709 13:01:26.576921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.577066 (+   145us) service_pool.cc:224] Handling call
0709 13:01:28.024835 (+1447769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.067986  8506 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:28.068686  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:26.984762  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:27.999464  8433 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1634) took 1464 ms (client timeout 1784 ms). Trace:
I20260709 13:01:27.202095  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:28.070811  8433 rpcz_store.cc:269] 0709 13:01:26.535091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.535250 (+   159us) service_pool.cc:224] Handling call
0709 13:01:27.999408 (+1464158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.187764 10994 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.999845  8434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1636) took 1451 ms (client timeout 1890 ms). Trace:
I20260709 13:01:27.288945 10865 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:27.511533  9098 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
W20260709 13:01:27.674748  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.086984  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 719) took 1298 ms. Trace:
I20260709 13:01:27.023099  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.087437  9098 rpcz_store.cc:276] 0709 13:01:26.788815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.788953 (+   138us) service_pool.cc:224] Handling call
0709 13:01:28.086923 (+1297970us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:28.013177  8581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 1977) took 1456 ms (client timeout 1666 ms). Trace:
W20260709 13:01:27.484556  8580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.022s	sys 0.041s
I20260709 13:01:26.974156  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:27.202819  9102 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:27.772395  9099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.003s	sys 0.010s
W20260709 13:01:28.089612  9099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.008s	sys 0.010s
I20260709 13:01:28.089700  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 718) took 1309 ms. Trace:
I20260709 13:01:27.407907  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.002588  9095 rpcz_store.cc:276] 0709 13:01:26.969769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.970339 (+   570us) service_pool.cc:224] Handling call
0709 13:01:26.970763 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.001903 (+1031140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.002136 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:28.085376  8434 rpcz_store.cc:269] 0709 13:01:26.548948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.549075 (+   127us) service_pool.cc:224] Handling call
0709 13:01:27.999778 (+1450703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256320}
I20260709 13:01:28.090054  9102 rpcz_store.cc:276] 0709 13:01:26.780876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.781032 (+   156us) service_pool.cc:224] Handling call
0709 13:01:27.202658 (+421626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.089465 (+886807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.089650 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:28.088774  8581 rpcz_store.cc:269] 0709 13:01:26.556742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.557286 (+   544us) service_pool.cc:224] Handling call
0709 13:01:28.013038 (+1455752us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b540009a954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:28.013128 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57081088}
I20260709 13:01:27.516077  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.036687  8584 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.093735  9095 pending_rounds.cc:85] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 5
I20260709 13:01:28.094015  9095 pending_rounds.cc:107] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:28.094295  9095 raft_consensus.cc:2889] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:28.096338 10865 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.096872  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2045) took 1123 ms. Trace:
I20260709 13:01:28.097211  8504 rpcz_store.cc:276] 0709 13:01:26.973815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.973915 (+   100us) service_pool.cc:224] Handling call
0709 13:01:28.096817 (+1122902us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:27.873394  8474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.000s	sys 0.008s
W20260709 13:01:28.098304  8474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.044s	user 0.002s	sys 0.009s
I20260709 13:01:28.088307  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2043) took 1115 ms. Trace:
I20260709 13:01:28.099575  8505 rpcz_store.cc:276] 0709 13:01:26.972856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.972999 (+   143us) service_pool.cc:224] Handling call
0709 13:01:28.088249 (+1115250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.100507  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.103263  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.103886  8505 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
W20260709 13:01:28.028915  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 353521us
W20260709 13:01:28.037341  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 1.05633e+06us
I20260709 13:01:28.035892  8429 rpcz_store.cc:276] 0709 13:01:26.569072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.569254 (+   182us) service_pool.cc:224] Handling call
0709 13:01:28.011923 (+1442669us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:27.119174  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 603703us
I20260709 13:01:28.105636  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:26.617492  8576 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:27.473585 10899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.012s	sys 0.020s
W20260709 13:01:28.106353 10899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.470s	user 0.012s	sys 0.027s
I20260709 13:01:28.041088  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 706) took 2423 ms. Trace:
I20260709 13:01:28.031098 10844 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:28.107126 10844 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:28.106374  8576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 368) took 1627 ms (client timeout 1875 ms). Trace:
W20260709 13:01:28.108686  8576 rpcz_store.cc:269] 0709 13:01:26.479439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.479566 (+   127us) service_pool.cc:224] Handling call
0709 13:01:28.106314 (+1626748us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.010548 10846 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.048485 10629 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.110693  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:28.111536 10846 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:27.305081 10947 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:28.045665 10997 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:27.353202 10619 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:27.304961 10897 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.761s
I20260709 13:01:28.083006 10806 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.117300 10897 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:28.045795 10903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.070s	user 0.020s	sys 0.057s
I20260709 13:01:26.996083  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:28.118150 10997 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:28.119076  9096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 722) took 1254 ms (client timeout 1667 ms). Trace:
W20260709 13:01:28.119626  9096 rpcz_store.cc:269] 0709 13:01:26.864484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.961880 (+ 97396us) service_pool.cc:224] Handling call
0709 13:01:28.119005 (+1157125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.120107 10997 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:28.066721 10803 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:28.114452 10947 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:28.121383 10947 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:28.120796 10803 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:28.123421 10803 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.010928 10996 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.126287  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 721) took 1290 ms. Trace:
I20260709 13:01:28.126663  9099 rpcz_store.cc:276] 0709 13:01:26.836446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.863960 (+ 27514us) service_pool.cc:224] Handling call
0709 13:01:26.966210 (+102250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.966507 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.966543 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.147037 (+180494us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b2c000913e8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:01:27.147454 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.089987 (+942533us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:28.090044 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.090107 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.112184 (+ 22077us) raft_consensus.cc:1685] finished
0709 13:01:28.112203 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.126222 (+ 14019us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18538880,"thread_start_us":942157,"threads_started":1,"wal-append.queue_time_us":962086}
I20260709 13:01:28.054785  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1711) took 3688 ms. Trace:
I20260709 13:01:28.128297  8582 rpcz_store.cc:276] 0709 13:01:24.366043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.366252 (+   209us) service_pool.cc:224] Handling call
0709 13:01:26.700056 (+2333804us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:26.700364 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.054523 (+1354159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.054734 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3162368}
I20260709 13:01:28.070133  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.129822  8432 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:28.129988  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:28.071473  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1641) took 1488 ms. Trace:
I20260709 13:01:28.130734  8430 rpcz_store.cc:276] 0709 13:01:26.583145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.583364 (+   219us) service_pool.cc:224] Handling call
0709 13:01:28.071320 (+1487956us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:28.067606  8435 rpcz_store.cc:269] 0709 13:01:26.554415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.554575 (+   160us) service_pool.cc:224] Handling call
0709 13:01:28.024933 (+1470358us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:28.070618  8575 rpcz_store.cc:269] 0709 13:01:26.478771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.481712 (+  2941us) service_pool.cc:224] Handling call
0709 13:01:28.065738 (+1584026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.073431  8507 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:28.132311  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2046) took 1148 ms. Trace:
I20260709 13:01:28.132714  8507 rpcz_store.cc:276] 0709 13:01:26.983453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.984461 (+  1008us) service_pool.cc:224] Handling call
0709 13:01:28.132241 (+1147780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.073832  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2044) took 1100 ms. Trace:
I20260709 13:01:28.075788 10799 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.133558  8506 rpcz_store.cc:276] 0709 13:01:26.973357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.973538 (+   181us) service_pool.cc:224] Handling call
0709 13:01:28.073773 (+1100235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.135699 10619 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:28.138178 10996 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.138677 10996 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:28.140504 10996 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:28.140632 10988 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:28.143085 10996 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:28.072039 10994 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.144193 10997 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:28.144543 10997 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:28.145287 10997 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.145871 10994 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.133546  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 726) took 1118 ms. Trace:
I20260709 13:01:28.148252  9102 rpcz_store.cc:276] 0709 13:01:27.015276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.090905 (+1075629us) service_pool.cc:224] Handling call
0709 13:01:28.091210 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.132466 (+ 41256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.132494 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:28.132534 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:28.132601 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.133351 (+   750us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b54000eae54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:28.133393 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.133496 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22810,"raft.queue_time_us":24243,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":41688832}
I20260709 13:01:28.054765  9094 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:26.640147  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1961) took 2591 ms. Trace:
I20260709 13:01:28.169304  8578 rpcz_store.cc:276] 0709 13:01:24.048340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.053591 (+  5251us) service_pool.cc:224] Handling call
0709 13:01:24.120681 (+ 67090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.287050 (+166369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.639878 (+2352828us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b540018c250. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:26.640065 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23399296}
I20260709 13:01:28.026938 10913 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.174410  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:28.175431  8510 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:27.627889 10990 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.449s
I20260709 13:01:28.000619 10882 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:28.177150 10882 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:28.177642 10882 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:27.589830  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.182816  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 1793) took 1034 ms. Trace:
I20260709 13:01:28.183131 10993 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:26.568174 10873 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.183715 10993 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.185272 10873 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:26.843915  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1621) took 2526 ms. Trace:
I20260709 13:01:26.637423 10624 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:26.996140 10991 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:28.078990  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.190835  9100 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:28.191535  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 731) took 1003 ms. Trace:
I20260709 13:01:28.191910  9100 rpcz_store.cc:276] 0709 13:01:27.188462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.078667 (+890205us) service_pool.cc:224] Handling call
0709 13:01:28.191472 (+112805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.192994  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:27.996533  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1627) took 1512 ms. Trace:
I20260709 13:01:27.288961 10967 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:27.317535 10456 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:28.220072 10991 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.222307 10456 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.224082 10991 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.183172  8431 rpcz_store.cc:276] 0709 13:01:27.148790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.514163 (+365373us) service_pool.cc:224] Handling call
0709 13:01:28.182752 (+668589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.221851 10967 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:26.971066 10914 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.999380 10961 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:28.088966  8580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.342s	user 0.027s	sys 0.041s
I20260709 13:01:28.231537  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1980) took 1670 ms. Trace:
I20260709 13:01:28.231876  8580 rpcz_store.cc:276] 0709 13:01:26.560672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.702653 (+141981us) service_pool.cc:224] Handling call
0709 13:01:26.703046 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.703488 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.703526 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:26.708686 (+  5160us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.231230 (+1522544us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:28.231269 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.231331 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.231368 (+    37us) raft_consensus.cc:1685] finished
0709 13:01:28.231378 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.231485 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":588,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"thread_start_us":1484067,"threads_started":1,"wal-append.queue_time_us":1294416}
I20260709 13:01:28.112277  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 720) took 1323 ms. Trace:
I20260709 13:01:28.113057  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1642) took 1483 ms. Trace:
I20260709 13:01:28.097977  8584 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
W20260709 13:01:28.235503  8584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 1979) took 1675 ms (client timeout 1693 ms). Trace:
W20260709 13:01:28.235962  8584 rpcz_store.cc:269] 0709 13:01:26.559627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.639252 (+ 79625us) service_pool.cc:224] Handling call
0709 13:01:28.235431 (+1596179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.117398 10806 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.131480  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:28.233304  9101 rpcz_store.cc:276] 0709 13:01:26.789171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.790845 (+  1674us) service_pool.cc:224] Handling call
0709 13:01:26.827487 (+ 36642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.828021 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.828092 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.168143 (+340051us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b2c000913e8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:01:27.206573 (+ 38430us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.996410 (+789837us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:27.996457 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.996519 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.112003 (+115484us) raft_consensus.cc:1685] finished
0709 13:01:28.112022 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.112222 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":334151552,"thread_start_us":660133,"threads_started":1,"wal-append.queue_time_us":770331}
W20260709 13:01:28.240197  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 108768us
I20260709 13:01:28.241256  9068 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:28.241551  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:28.151954  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.233439  8426 rpcz_store.cc:276] 0709 13:01:26.629934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.630105 (+   171us) service_pool.cc:224] Handling call
0709 13:01:27.199157 (+569052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.289618 (+ 90461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.289661 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.336451 (+ 46790us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.863671 (+527220us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:27.863730 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.863832 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.112815 (+248983us) raft_consensus.cc:1685] finished
0709 13:01:28.112842 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.112995 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90049,"raft.queue_time_us":105268,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12643,"thread_start_us":424899,"threads_started":1,"wal-append.queue_time_us":750418}
I20260709 13:01:28.152128  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.109761 10844 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.152410  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:27.300949 10840 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.113842  9097 rpcz_store.cc:276] 0709 13:01:25.617388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.621521 (+  4133us) service_pool.cc:224] Handling call
0709 13:01:25.621926 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:26.570871 (+948945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.573469 (+  2598us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:27.376601 (+803132us) log.cc:844] Serialized 52 byte log entry
0709 13:01:27.873963 (+497362us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:27.874024 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.874161 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.025812 (+151651us) raft_consensus.cc:1685] finished
0709 13:01:28.027718 (+  1906us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.038289 (+ 10571us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":810551,"raft.queue_time_us":811386,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":342687,"threads_started":2,"wal-append.queue_time_us":474848}
I20260709 13:01:28.066038 11007 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.158053  8506 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:28.158277 10846 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:28.158419 10911 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:01:28.132311 10865 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:28.031950 10853 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.117982 10897 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:28.160069 11002 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:28.167321  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.168905  8508 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:28.166708 10619 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.185734  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:28.112594 10868 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:27.521003 10995 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.245082 10992 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.220256  9099 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:28.247604 10994 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.266930  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.219888  8502 rpcz_store.cc:276] 0709 13:01:26.484353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.490422 (+  6069us) service_pool.cc:224] Handling call
0709 13:01:26.490753 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.996218 (+1505465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.996469 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.188243 10624 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:28.228498  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.151295 10997 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.226989 10456 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.191001  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 727) took 1171 ms. Trace:
I20260709 13:01:28.257870  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.279050  8580 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
W20260709 13:01:28.258458  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 72804.1us
W20260709 13:01:28.258716  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 1.06008e+06us
I20260709 13:01:28.280181  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:28.244982 10961 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:28.161325  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:28.252656 10990 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:01:28.195300  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.269188  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.270004  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.301613  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.257843 11007 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.254640 10844 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:28.239930 10914 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.258945 10799 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:28.261154 10873 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.344130 10624 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.344761 10846 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:28.344465 10873 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.345381 10624 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:28.345266 10846 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.276829  9101 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:28.304178 10805 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:28.346369 10805 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:28.347997 10846 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.260532  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:28.264658 10806 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:28.348690  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.348817 10806 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:28.349262 10806 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.287756  9102 raft_consensus.cc:2376] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4. Re-sending same reply.
I20260709 13:01:28.187376 10629 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.290000  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.351028  9099 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:28.351838  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.352397  9099 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
W20260709 13:01:28.352234  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 91759.2us
I20260709 13:01:28.353297  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.290179  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.255103 10991 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:01:28.289522 10456 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.302536  8580 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:28.324590  8426 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:01:28.323305  8319 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 09de6eee9632412ebe0a904f65cd2a3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5ffc86752d264d0c81f68028e6413a91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:28.268357  9096 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
W20260709 13:01:28.337433  8549 leader_election.cc:336] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.767s (SENT)
I20260709 13:01:28.301970  8582 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:28.305764  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.339231  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.341427  8583 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:28.336858  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.353996  9099 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:28.358333  8576 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:28.358753  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:28.359333  9099 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.360021  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.360594  8583 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 1.
I20260709 13:01:28.361366  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.359246  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.355124  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.362337  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.362527  8576 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:28.362908  8502 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:28.357089  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.364015  8582 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:28.364253  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:28.362903  8580 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:01:28.363181  8476 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:28.357219 10914 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.361848 10806 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:28.353104 10844 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.355921  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.367800  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.368117 10806 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.368420  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:28.368991  9102 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.368861 10806 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:28.369630 10806 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:28.356421  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:28.370325  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.356865  9097 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:28.373036  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.374125 10991 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:28.357719 10999 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:01:28.376888  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.290638 10619 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:28.378877  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.266676 10995 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.330114 10962 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:28.357332  9100 raft_consensus.cc:2410] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:01:28.377655  9096 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:28.368510  8581 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:28.399282  8578 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:28.400450  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.401265  9096 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 1.
I20260709 13:01:28.402570  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.280652  9094 rpcz_store.cc:276] 0709 13:01:27.017189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.053587 (+1036398us) service_pool.cc:224] Handling call
0709 13:01:28.188802 (+135215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.362038  8583 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:28.393936  8582 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:28.340353 10993 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:28.379132 10803 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:28.404254 10962 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.405488 10803 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:28.405964 10803 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:28.186256  8503 rpcz_store.cc:276] 0709 13:01:24.317213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.318169 (+   956us) service_pool.cc:224] Handling call
0709 13:01:24.388325 (+ 70156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.894999 (+506674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.924411 (+ 29412us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.290122 (+365711us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.512110 (+221988us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:25.513587 (+  1477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.761364 (+1247777us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540008e8d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:26.772385 (+ 11021us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.773443 (+  1058us) raft_consensus.cc:1685] finished
0709 13:01:26.801602 (+ 28159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.843844 (+ 42242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10704,"raft.queue_time_us":93179,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":150936,"spinlock_wait_cycles":462425984,"thread_start_us":157696,"threads_started":1,"wal-append.queue_time_us":307237,"wal-append.run_cpu_time_us":1814,"wal-append.run_wall_time_us":1001840}
I20260709 13:01:28.278512 10897 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.407058 10803 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.408574 10803 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.398393  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.393956 10846 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:28.422940 10805 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.401312  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.365964 10914 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:28.489349  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.490216  9101 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:28.490526  9099 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:28.491472  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.492033  9099 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:28.492769  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.410660  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.495184  9102 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:28.496465  9102 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:28.381111  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.394088 10873 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.419051 10840 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:28.420694  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.421700 10967 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:01:28.422473  8576 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:01:28.423753  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.333556 10994 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:01:28.403846  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.344154 10799 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.512292  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:28.513031  8426 raft_consensus.cc:2376] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6. Re-sending same reply.
I20260709 13:01:28.393395  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:28.412631  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.516251  9100 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:28.517546  9100 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:28.500584  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.518352  8581 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:28.397521 10619 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:28.516270  8549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.280s (SENT) [suppressed 27 similar messages]
I20260709 13:01:28.334350 11007 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:28.493700  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.498520 10914 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.508760  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.508940  9102 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:28.519855  9097 raft_consensus.cc:2376] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6. Re-sending same reply.
I20260709 13:01:28.503252  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:28.522008  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.523500  9099 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:28.526563  8582 raft_consensus.cc:2410] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:01:28.530484  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 252929us
W20260709 13:01:28.531898  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 290382us
I20260709 13:01:28.510910 10799 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.538954  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.539824  8582 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:28.533509  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:28.508167  8503 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:28.553045  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:28.373158 10806 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:28.528599 10914 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.544989  8577 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:01:28.568472  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:28.563477  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:28.580708  8426 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:28.521742 10976 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:28.550451 10868 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:28.578473  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.599577  8432 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:28.568915 10806 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:28.576115  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 212967us
I20260709 13:01:28.518926  9094 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
W20260709 13:01:28.555469 10832 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.005s	sys 0.020s
I20260709 13:01:28.550423 10962 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.582782  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:28.549213 11017 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:28.589962  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:28.553751 10947 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:28.603396  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.591259  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:28.584226 10456 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:28.577236  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:28.605005  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 492945us
I20260709 13:01:28.605186 10806 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:28.605443 10832 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.005s	sys 0.022s
I20260709 13:01:28.632774  9099 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:28.611369  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:28.635394  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:28.636811 10846 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:28.637283 10846 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:28.637660  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.637763 10846 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.638008  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.638540  8426 raft_consensus.cc:2410] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:28.639837  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.644901  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:28.645061  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.651110  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.652037  9096 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:28.654465  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.655061  9102 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:28.612102  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:28.577667 10409 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.017s	sys 0.013s
I20260709 13:01:28.591279 10996 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:28.663647 10996 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:28.664140 10996 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.592397  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.670763  8428 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:28.617200 11017 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:28.673688  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.617606  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.621023 10629 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.598635 10853 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.675009  8430 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:28.686410  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:28.691646  8581 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:28.622879 10456 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:28.665673 10409 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.017s	sys 0.013s
I20260709 13:01:28.626281 10865 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:28.697424  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:28.633998 11020 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.715196  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:28.713577  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78259.9us
W20260709 13:01:28.685504 10882 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.004s
I20260709 13:01:28.722945  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:28.723239  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.723827  8510 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:28.724259  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:28.725337  9065 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:28.725996  8582 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:28.674984 11032 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:28.674315  8576 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:28.711585 10456 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.732264  9067 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:28.739969  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.740731  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.740931  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:28.692651 10989 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:28.732107  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.735103  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.735895  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.720705 10840 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.737429  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.738179  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.751039  8432 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:28.720789 11020 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:28.743726  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:28.714102 10865 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.764947  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.691716  8431 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:28.744644  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.745028  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.748250  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.736379  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.766525  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.767611  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.747362  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.752105  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.711369 10853 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:28.728585 10994 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:28.769229 10994 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.728318 10995 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:28.769858  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 188467us
I20260709 13:01:28.739831 11002 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:28.718775 10967 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:01:28.747615 11013 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:01:28.739711 10873 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:28.748454 10990 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:28.775141  8400 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:28.746176 10993 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.747799  8577 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:28.752045 11016 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:28.786309  8428 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:28.760242 10840 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:28.821980  9100 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:28.823645  8429 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:01:28.728770 10882 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:28.819456 11034 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:01:28.820029  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:28.764590 10897 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:28.773015 10865 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.765671 11020 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.839195  9101 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:28.850522  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:28.851233  9101 raft_consensus.cc:2376] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7. Re-sending same reply.
W20260709 13:01:28.852531  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74360.1us
I20260709 13:01:28.779241 11002 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:28.748824 11010 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:01:28.752283 10989 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.785135 10990 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:28.712080 10976 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.782200 11007 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.781638 10619 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.727448 10868 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.784160 10873 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.872078  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:28.872352  9098 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:28.820541  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:28.877774  8576 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:28.833395 10840 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.878556 11017 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.882910  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:28.884907  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:28.842566  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 237612us
I20260709 13:01:28.838814 10991 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:28.887346  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 112299us
I20260709 13:01:28.837388 11016 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:28.912668 11016 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:28.914136 10629 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:28.914325  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.914711 10629 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:28.914943  8508 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:28.889803  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:28.916111  8505 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:28.917558  8398 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:28.896173  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:28.897325  8550 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:28.928710  8432 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
W20260709 13:01:28.931794  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59773.3us
I20260709 13:01:28.933255  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:28.934557  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47519.4us
I20260709 13:01:28.943192  8506 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:28.876952 10990 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.871614  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:28.895414 11026 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:01:28.881592 10873 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.870227 11002 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.881036 11027 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:28.911515 10882 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:28.901058  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:28.981715  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 46559.6us
W20260709 13:01:28.964752 11035 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:01:29.016029  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:28.965049 10844 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:28.965195 10947 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:28.965638 10961 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:28.887907 10803 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:29.036423  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.915851 10991 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:28.977922  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 234284us
I20260709 13:01:28.956808 10992 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.015180  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:28.986467  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 53296.2us
I20260709 13:01:28.988476  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:29.042145  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:28.992528  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:28.988158  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:28.997385  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:28.986584  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.856616 10897 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:29.032502  8428 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:28.916049 10805 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:01:28.981941 11027 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.055212  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:29.056277  8433 raft_consensus.cc:2410] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:29.042393  8507 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:28.915617 10629 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:28.978665  9094 raft_consensus.cc:2376] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6. Re-sending same reply.
I20260709 13:01:28.977466 11053 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:29.072742 10992 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.036398 10865 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.098747  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 732) took 1910 ms. Trace:
W20260709 13:01:29.099350 10997 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.000s
I20260709 13:01:29.100154 11064 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:29.100353 10996 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.027880 11017 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:01:29.103515 10963 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:29.114948  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:29.115280 10913 consensus_meta.cc:287] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.944s	user 0.008s	sys 0.003s
W20260709 13:01:29.115849  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 73126.4us
I20260709 13:01:29.036782 10803 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.041533 10844 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:29.124842  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 82853.7us
I20260709 13:01:29.041536 11010 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:29.139505  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 243389us
I20260709 13:01:29.075431 11007 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:29.074908 10947 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:29.152884  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 235396us
W20260709 13:01:29.153882  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 256616us
I20260709 13:01:29.075165 10961 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:29.087124 10995 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:29.160907  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 725) took 2182 ms. Trace:
I20260709 13:01:29.076143 11027 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:29.170073  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 186330us
I20260709 13:01:29.131281 11014 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:29.178740  8579 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
W20260709 13:01:29.181450  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.177327  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48399.5us
I20260709 13:01:29.121548 11053 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:29.210515  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:29.240177  8505 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:29.213537  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:29.209725  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:29.178716 10963 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:29.573552  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:29.210089 11021 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.211529  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:29.575700  9102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.018s	sys 0.010s
I20260709 13:01:29.508013  8508 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:29.680549  9102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.018s	sys 0.010s
I20260709 13:01:29.505226  8550 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:29.491587  8435 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.007s	sys 0.009s
W20260709 13:01:29.309944 11000 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:29.507675  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:01:29.279585 10456 consensus_meta.cc:287] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.002s
I20260709 13:01:29.492975  9098 rpcz_store.cc:276] 0709 13:01:26.978699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.088414 (+1109715us) service_pool.cc:224] Handling call
0709 13:01:28.088754 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.877621 (+788867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.160629 (+283008us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b540007b054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:29.160839 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1801507200}
W20260709 13:01:29.422273 10899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.009s	sys 0.006s
W20260709 13:01:29.584024  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.551887  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 342257us
I20260709 13:01:29.279465  9096 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:29.216868 10996 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:29.679526  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:29.210129 10844 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:29.681618  8435 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.011s	sys 0.012s
W20260709 13:01:29.695308  8549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.039s	sys 0.147s
I20260709 13:01:29.504213 10865 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:29.699494  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:29.573665 11020 consensus_meta.cc:287] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.000s
I20260709 13:01:29.332399 10897 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:29.211097 10803 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:29.685582  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:29.687150  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:29.687359  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 476877us
W20260709 13:01:29.309702 10846 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.671s	user 0.005s	sys 0.003s
I20260709 13:01:29.215253 10992 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:29.491510 10947 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:29.305408 11050 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:01:29.681813 11021 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:29.696677  8549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.039s	sys 0.147s
W20260709 13:01:29.732227  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 1.00791e+06us
I20260709 13:01:29.733567  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:29.305685 11051 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:29.439102 11060 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:29.333105 11044 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.350s
W20260709 13:01:29.699810  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 207712us
I20260709 13:01:29.740517  8550 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:29.741662  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:29.509696 10993 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:29.556077 10989 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:29.679107 11059 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:01:29.688831 10899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.009s	sys 0.007s
I20260709 13:01:29.335278 11009 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.581882 11017 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:29.504282 11007 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:29.555585 11053 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:29.552289 10962 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.144s
I20260709 13:01:29.700556 10844 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:29.699651 10995 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:29.484133 11002 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.706840 10997 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:29.690708 10456 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.551710 11010 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.731889 10947 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:29.731570 10805 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:29.732960 10992 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:29.749212 10993 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.726478 11067 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:29.146054  9095 rpcz_store.cc:276] 0709 13:01:27.188710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.093219 (+904509us) service_pool.cc:224] Handling call
0709 13:01:28.093533 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:28.142339 (+ 48806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.142377 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:28.142968 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 13:01:28.506884 (+363916us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:28.507451 (+   567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.514175 (+  6724us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.098494 (+584319us) raft_consensus.cc:1685] finished
0709 13:01:29.098518 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.098683 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17399,"raft.queue_time_us":19858,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":348274,"threads_started":1,"wal-append.queue_time_us":386533}
W20260709 13:01:29.774842 10991 consensus_meta.cc:287] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.000s
I20260709 13:01:29.739017 10996 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:29.779163 10993 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:29.763002 11012 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.145s	user 0.004s	sys 0.007s
I20260709 13:01:29.728848 10846 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.707165 11020 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:29.765307 11037 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:29.767704 11081 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:29.760574 10873 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.000s
I20260709 13:01:29.731913 10963 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.756009 11007 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:29.870316 10963 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:29.757985 11009 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.886437 11009 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:29.770745 10997 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.887380 10997 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:29.770180 10995 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:29.890393 10995 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:29.765846 11069 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:01:29.756503 11016 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:01:29.895063 11016 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:29.895433 11016 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:29.779965 10992 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.896270 11016 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:29.897363 11016 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:29.831434 11020 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:29.897851 10992 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:29.833391 11010 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:29.834893 11014 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:29.898600 11014 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:29.841619 11039 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.966s	user 0.000s	sys 0.001s
I20260709 13:01:29.846894 11040 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:29.862282 11002 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:29.902535 11040 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:29.903415 11040 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.904356 11040 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:29.788381 10990 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.773s	user 0.005s	sys 0.005s
I20260709 13:01:29.784309 11042 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:29.905802 10990 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.877871 11030 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:29.908176 11030 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:29.911485 11021 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:29.920594 11053 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:29.909345 11030 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.927142 11030 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:29.929075 10997 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:29.938225 11053 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:29.939049 11067 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:29.508548  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:29.974128  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 465419us
I20260709 13:01:29.505084  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:29.986743  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 481557us
I20260709 13:01:29.988971  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:29.993592  8431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.016s	sys 0.025s
W20260709 13:01:29.994222  8431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.016s	sys 0.025s
W20260709 13:01:29.998154  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 289607us
I20260709 13:01:29.998713  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 496) took 1248 ms. Trace:
I20260709 13:01:29.999564  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:30.002560  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:29.700282  8505 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:30.007483  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2057) took 1118 ms. Trace:
I20260709 13:01:30.008013  8510 rpcz_store.cc:276] 0709 13:01:28.888478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.888631 (+   153us) service_pool.cc:224] Handling call
0709 13:01:28.888981 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.934221 (+ 45240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.934248 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.956678 (+ 22430us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.115020 (+158342us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:29.115083 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.115189 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.006819 (+891630us) raft_consensus.cc:1685] finished
0709 13:01:30.006865 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.007188 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85620,"raft.queue_time_us":92369,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":21898,"spinlock_wait_cycles":1332992,"thread_start_us":88985,"threads_started":1,"wal-append.queue_time_us":896304}
I20260709 13:01:30.010731  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1640) took 1021 ms. Trace:
I20260709 13:01:30.011379  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.013376  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.009647  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.015837  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1633) took 1030 ms. Trace:
I20260709 13:01:30.024514  8508 rpcz_store.cc:276] 0709 13:01:28.985782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.985886 (+   104us) service_pool.cc:224] Handling call
0709 13:01:29.507848 (+521962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.681035 (+173187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.015373 (+334338us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54000d7ad0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:30.015625 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128990976}
I20260709 13:01:30.026113  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.027490  8508 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:01:30.027963  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1638) took 1039 ms. Trace:
I20260709 13:01:30.028349  8508 rpcz_store.cc:276] 0709 13:01:28.989003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.025680 (+1036677us) service_pool.cc:224] Handling call
0709 13:01:30.027884 (+  2204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:30.025903  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.018172  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 531) took 1398 ms. Trace:
I20260709 13:01:30.030705  8502 rpcz_store.cc:276] 0709 13:01:28.616078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.618108 (+  2030us) service_pool.cc:224] Handling call
0709 13:01:28.618477 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.727841 (+109364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.731358 (+  3517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:28.740290 (+  8932us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:28.745272 (+  4982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.013578 (+1268306us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b54003a07d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:30.013661 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.013952 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220280192}
I20260709 13:01:30.023754  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1817) took 1144 ms. Trace:
I20260709 13:01:30.032219  8430 rpcz_store.cc:276] 0709 13:01:28.879455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.879807 (+   352us) service_pool.cc:224] Handling call
0709 13:01:28.880105 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.120716 (+240611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.120758 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:29.120801 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:29.120834 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.023246 (+902412us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400001754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:30.023309 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.023555 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552858496}
I20260709 13:01:30.033226  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:30.023898  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.034195  8426 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:30.035270  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:29.999226  8432 rpcz_store.cc:276] 0709 13:01:28.750414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.751838 (+  1424us) service_pool.cc:224] Handling call
0709 13:01:29.998278 (+1246440us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54003a2354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:29.998479 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368135040}
W20260709 13:01:30.023074  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.011173  8506 rpcz_store.cc:276] 0709 13:01:28.989512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.573120 (+583608us) service_pool.cc:224] Handling call
0709 13:01:30.010498 (+437378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:30.037206  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1637) took 1048 ms. Trace:
I20260709 13:01:30.037954  8508 rpcz_store.cc:276] 0709 13:01:28.988716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.029289 (+1040573us) service_pool.cc:224] Handling call
0709 13:01:30.029751 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.036876 (+  7125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.036902 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:30.036963 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:30.036990 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.037043 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.037157 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:30.014732  8510 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.040079  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:30.022912  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1641) took 1033 ms. Trace:
I20260709 13:01:30.041359  8505 rpcz_store.cc:276] 0709 13:01:28.989803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.008840 (+1019037us) service_pool.cc:224] Handling call
0709 13:01:30.022810 (+ 13970us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:30.005319  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:29.702378  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 194781us
W20260709 13:01:30.054734  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.057159  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 315458us
I20260709 13:01:29.736102  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:30.061483  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.061866  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.064606  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.063268  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.067471  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 383) took 1577 ms. Trace:
I20260709 13:01:30.067570  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:30.069036  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1990) took 1402 ms. Trace:
I20260709 13:01:30.069411  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 374) took 1748 ms. Trace:
W20260709 13:01:30.069350  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.070145  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:30.068214  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 332182us
I20260709 13:01:30.071043  8581 rpcz_store.cc:276] 0709 13:01:28.666339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.872922 (+206583us) service_pool.cc:224] Handling call
0709 13:01:28.922674 (+ 49752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.327831 (+405157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.327875 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.328453 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.745011 (+416558us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:29.745058 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.746574 (+  1516us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.068498 (+321924us) raft_consensus.cc:1685] finished
0709 13:01:30.068535 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.068858 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":176715,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":468766,"threads_started":2,"wal-append.queue_time_us":322896}
I20260709 13:01:30.067389  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 382) took 1631 ms. Trace:
I20260709 13:01:30.074927  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1724) took 1821 ms. Trace:
I20260709 13:01:30.075259  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:30.073895  8575 rpcz_store.cc:276] 0709 13:01:28.435534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.489957 (+ 54423us) service_pool.cc:224] Handling call
0709 13:01:28.515498 (+ 25541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.566459 (+ 50961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.569623 (+  3164us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.631290 (+ 61667us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.818691 (+187401us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:28.888482 (+ 69791us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.179718 (+291236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.202627 (+ 22909us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.066790 (+864163us) raft_consensus.cc:1685] finished
0709 13:01:30.066846 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.067144 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33105,"prepare.queue_time_us":20989,"prepare.run_cpu_time_us":1177,"prepare.run_wall_time_us":18863,"raft.queue_time_us":195596,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":12259,"thread_start_us":256835,"threads_started":2,"wal-append.queue_time_us":350620}
I20260709 13:01:30.075621  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:30.073213  8580 raft_consensus.cc:2410] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:30.077126  8583 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:30.075419  8584 rpcz_store.cc:276] 0709 13:01:28.253229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.253371 (+   142us) service_pool.cc:224] Handling call
0709 13:01:28.253768 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.254179 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:28.524669 (+270490us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.054429 (+529760us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.054622 (+   193us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.116392 (+ 61770us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.116541 (+   149us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:29.116572 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.116641 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.074426 (+957785us) raft_consensus.cc:1685] finished
0709 13:01:30.074461 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.074725 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43719,"prepare.queue_time_us":365233,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":229416,"raft.run_cpu_time_us":481,"raft.run_wall_time_us":67167,"spinlock_wait_cycles":18688,"thread_start_us":733538,"threads_started":2,"wal-append.queue_time_us":783556}
I20260709 13:01:30.074993  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:30.071430  8579 rpcz_store.cc:276] 0709 13:01:28.321285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.321393 (+   108us) service_pool.cc:224] Handling call
0709 13:01:28.370129 (+ 48736us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:30.068975 (+1698846us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400066dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:30.069203 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865158784}
I20260709 13:01:30.068264  8578 rpcz_store.cc:276] 0709 13:01:28.490276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.501844 (+ 11568us) service_pool.cc:224] Handling call
0709 13:01:28.542750 (+ 40906us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:28.595553 (+ 52803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.597913 (+  2360us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:28.727183 (+129270us) log.cc:844] Serialized 52 byte log entry
0709 13:01:29.035605 (+308422us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:29.068937 (+ 33332us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.069206 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.069310 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.066844 (+997534us) raft_consensus.cc:1685] finished
0709 13:01:30.066899 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.067227 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15549,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":16681,"raft.queue_time_us":156126,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":35440,"thread_start_us":207772,"threads_started":1,"wal-append.queue_time_us":1087147}
I20260709 13:01:30.079595  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:30.087706  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.088236  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:30.088975  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:30.090233  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 839) took 1410 ms. Trace:
I20260709 13:01:30.090787  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 723) took 3126 ms. Trace:
I20260709 13:01:30.092119 10624 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:30.090685  9102 rpcz_store.cc:276] 0709 13:01:28.679909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.681961 (+  2052us) service_pool.cc:224] Handling call
0709 13:01:28.696914 (+ 14953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.697262 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.697290 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.721191 (+ 23901us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.681300 (+960109us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:29.681352 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.681428 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.089620 (+408192us) raft_consensus.cc:1685] finished
0709 13:01:30.089668 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.089928 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5697,"raft.queue_time_us":14893,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":7249,"thread_start_us":921363,"threads_started":1,"wal-append.queue_time_us":1087470}
W20260709 13:01:29.861542 10799 consensus_meta.cc:287] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.306s	user 0.011s	sys 0.000s
I20260709 13:01:30.093914  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 741) took 1443 ms. Trace:
I20260709 13:01:30.094519  9096 rpcz_store.cc:276] 0709 13:01:28.653273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.654669 (+  1396us) service_pool.cc:224] Handling call
0709 13:01:28.654974 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.697798 (+1042824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.093149 (+395351us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400500854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:30.093640 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254546816}
I20260709 13:01:30.094938 10799 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.096199 10619 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:30.096889 10619 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.097429 10619 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:30.098719  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:30.099259  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:30.102712  8582 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:30.103369 10868 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.099570  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.101066 10799 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.104558 10456 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:30.105257 10799 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.104204 10868 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:29.775756 10805 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:30.112607 10805 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:30.113215 10806 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.435s	user 0.009s	sys 0.001s
I20260709 13:01:30.113353  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:30.089026  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:30.114750  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.115480 10868 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.116241 10868 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:30.117072 10868 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.105584 10873 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.115491  8502 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:01:30.122416 10853 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:30.123230 10853 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.090730  8579 raft_consensus.cc:2410] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:30.110852  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:30.106436  8578 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:01:30.125049  8580 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:30.111074 10911 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:30.118263 10799 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:30.126307 10865 consensus_queue.cc:1175] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ffc86752d264d0c81f68028e6413a91" responder_term: 4 status { last_received { term: 4 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 4 index: 7 } }
I20260709 13:01:30.128208 10799 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.128654 10911 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:30.129388 10911 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:30.130568 10899 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:30.130436 10913 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:30.131247 10899 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:29.857051 10914 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.268s	user 0.013s	sys 0.000s
W20260709 13:01:30.134289  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.123745 10873 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:30.134778 10911 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.133975 10899 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.135491 10914 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.137301  8504 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:30.138444  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:30.138708  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1634) took 1152 ms. Trace:
I20260709 13:01:30.139510  8504 rpcz_store.cc:276] 0709 13:01:28.987694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.987827 (+   133us) service_pool.cc:224] Handling call
0709 13:01:30.138457 (+1150630us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003732d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:30.138629 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2515368192}
I20260709 13:01:30.140918  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.091323  9093 rpcz_store.cc:276] 0709 13:01:26.964147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.965684 (+  1537us) service_pool.cc:224] Handling call
0709 13:01:27.022654 (+ 56970us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:28.006445 (+983791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.006474 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:28.007111 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 13:01:28.263250 (+256139us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:28.264960 (+  1710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.398145 (+133185us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54005479d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:28.398194 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.762381 (+1364187us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:30.090293 (+327912us) raft_consensus.cc:1685] finished
0709 13:01:30.090361 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.090606 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34289,"raft.queue_time_us":23812,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":10886,"spinlock_wait_cycles":2278207232,"thread_start_us":245541,"threads_started":1,"wal-append.queue_time_us":570243}
I20260709 13:01:29.981490  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:30.100159  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:30.134555  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:29.829363 10846 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:30.150080 10914 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.152102 10913 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:30.152644 10913 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:30.153106 10913 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:30.153707  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 162919us
I20260709 13:01:30.113737 10806 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.155104  8507 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:30.155948 10914 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.156356  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1647) took 1085 ms. Trace:
I20260709 13:01:30.156826 10914 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.147439 10868 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:30.150743  8506 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:30.156840  8507 rpcz_store.cc:276] 0709 13:01:29.071064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.031233 (+960169us) service_pool.cc:224] Handling call
0709 13:01:30.031652 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.155509 (+123857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.156097 (+   588us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400372dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:30.156272 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283478400}
I20260709 13:01:30.125676 10853 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:30.162849 10409 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:30.165714  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:30.166289  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.167075  8507 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:30.167711 10806 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.168027  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.150307  8584 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:29.908182 10990 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:29.790983 10991 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.173276 10958 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:30.174487 10991 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:30.174497 10958 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:30.176772 10958 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.178648  8507 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:30.151738  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 170506us
I20260709 13:01:30.183432 10456 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:30.183753  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 95777.7us
I20260709 13:01:30.184118 10456 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.181227 10958 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.188040  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:30.194137  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 189100us
I20260709 13:01:30.169791 10806 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:30.123498  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.223140 10846 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:30.223870 10846 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:30.224413 10846 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:30.224490  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:30.226454 11016 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:30.227289 11016 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.227788 11016 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.228613 11044 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.235651 11044 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.199679 10806 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.240808  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:30.266455  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.251489 10996 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:30.276252  8504 raft_consensus.cc:2410] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:01:30.284170 10844 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.274925 10806 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.299736  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.300616  8502 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.300778 11090 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:29.792341 10993 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:30.321806  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 138714us
I20260709 13:01:30.326792  8333 catalog_manager.cc:5697] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.329005  8333 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 3 to 4, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 4 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:30.338399  8584 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:30.341519  8432 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:30.342689  8506 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:30.298425 10409 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:30.335721  8510 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:30.349852  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1646) took 1311 ms. Trace:
I20260709 13:01:30.350370  8510 rpcz_store.cc:276] 0709 13:01:29.045273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.012938 (+967665us) service_pool.cc:224] Handling call
0709 13:01:30.349783 (+336845us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:30.341135  8507 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:30.362135 11020 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:30.362860 11016 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:30.362973 10832 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:30.363361 10997 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:30.363994 11011 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:30.365159 10805 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:30.369630  8435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.001s	sys 0.025s
I20260709 13:01:30.361742 10996 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.370610  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:30.364034 11009 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:30.370371 10624 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:30.349653 10409 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.379914  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:30.394169  8435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.002s	sys 0.026s
W20260709 13:01:30.393703  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 280602us
I20260709 13:01:30.378264 10456 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:30.392794 10409 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.381070 11009 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:30.333665 10947 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.393477 10914 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:30.400399 10844 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:30.425153 11042 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:30.422941 10993 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.397094 11020 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:30.415402  8430 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:30.431049  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50078.4us
I20260709 13:01:30.433041  8432 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:30.431347  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:30.435485 10629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.008s	sys 0.017s
W20260709 13:01:30.435962 10629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.008s	sys 0.017s
I20260709 13:01:30.436026 10619 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:30.436836 11101 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:01:30.348577 11090 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.412106 11057 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:30.444489  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:30.445945 11030 consensus_meta.cc:287] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
I20260709 13:01:30.446329  9065 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:30.420984 11009 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:30.413386 11074 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.451015 11030 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:30.454458  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 153563us
W20260709 13:01:30.457202  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 52470.5us
W20260709 13:01:30.462683 10963 consensus_meta.cc:287] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.005s
W20260709 13:01:30.466220  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 177132us
W20260709 13:01:30.466825  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 134035us
I20260709 13:01:30.467226 10947 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.467326 10619 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:30.468689 10840 consensus_meta.cc:287] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.590s	user 0.007s	sys 0.017s
I20260709 13:01:30.469781  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:30.471863  8333 catalog_manager.cc:5697] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:30.472663  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 82538.3us
I20260709 13:01:30.454301 11030 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:30.439832  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:30.447031 11042 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:30.485460 11002 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:30.502655  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:30.489233 11020 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.491950 11030 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:30.494210 10803 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.765s	user 0.017s	sys 0.005s
I20260709 13:01:30.494465  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:30.495970 10840 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.430873 11021 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:01:30.503033  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:30.477594 11011 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:30.515902  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:30.517637 10991 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:30.518232 10991 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:30.519305  9096 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:30.521729  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:30.523774 10947 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:30.526638 10995 consensus_meta.cc:287] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.003s
I20260709 13:01:30.527113 10995 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.521493 10913 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.539911 11090 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.541431 11042 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.527971 10993 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:30.546082 10994 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.547255  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 530) took 1931 ms. Trace:
I20260709 13:01:30.547835  9102 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
W20260709 13:01:30.549235 11027 consensus_meta.cc:287] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.974s	user 0.007s	sys 0.005s
I20260709 13:01:30.549111 10624 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:30.550740 10996 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:30.552155 10846 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.554059 10840 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.532795 11002 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:30.531670 10803 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.554795 11076 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:30.492399 11057 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.558163 11016 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:30.614542  8330 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32800 (request call id 243) took 12227 ms (client timeout 15000 ms). Trace:
I20260709 13:01:30.528522 11011 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:30.589888 11007 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.012s
I20260709 13:01:30.517767 11044 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:30.554185  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 59842.6us
I20260709 13:01:30.581254  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:30.581733  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 48404.6us
I20260709 13:01:30.582962  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.580492 10805 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:30.519333 10991 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.640791  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.641656  8505 raft_consensus.cc:2368] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7.
I20260709 13:01:30.583557  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.584229  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:30.584410  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:30.584563  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.584919  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 98170.3us
I20260709 13:01:30.587903 10846 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:30.588296 11027 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.589298  8502 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
W20260709 13:01:30.590281  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.591089 11014 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.002s
I20260709 13:01:30.592028 10806 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:30.598297  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.581081  8333 catalog_manager.cc:5697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 3 to 4, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 4 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.601594 10913 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.605611 10995 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:01:30.653448  8506 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:30.654452 10806 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:30.606242  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:30.606629  9102 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:30.606877  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:30.655964  9095 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.575325  8503 rpcz_store.cc:276] 0709 13:01:28.615733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.622486 (+  6753us) service_pool.cc:224] Handling call
0709 13:01:28.696606 (+ 74120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.018814 (+1322208us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b1800378d60. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a19337060 00007f1a19337bfb 00007f1a1934264b
0709 13:01:30.019325 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:30.019885 (+   560us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.360145 (+340260us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:30.434043 (+ 73898us) log.cc:844] Serialized 26 byte log entry
0709 13:01:30.438236 (+  4193us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:30.438272 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.438360 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.528761 (+ 90401us) raft_consensus.cc:1685] finished
0709 13:01:30.543604 (+ 14843us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.547071 (+  3467us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67889,"prepare.queue_time_us":179954,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":167332,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":42880,"spinlock_wait_cycles":2877312,"thread_start_us":549148,"threads_started":2,"wal-append.queue_time_us":315137}
I20260709 13:01:30.580536 10624 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:30.635124 11057 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.614168 10994 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.662701  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.663421  8505 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:30.664541 10994 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:30.561784  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:30.576093  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 149556us
W20260709 13:01:30.665446  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 103776us
I20260709 13:01:30.623018 10803 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:30.614993  8330 rpcz_store.cc:269] 0709 13:01:18.330444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.351729 (+ 21285us) service_pool.cc:224] Handling call
0709 13:01:19.245839 (+894110us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a9090 00007f1a19347f3a 00007f1a1f0fe1cc 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc 00007f1a1d6bc392 00007f1a1767a48c 00007f1a176798c6
0709 13:01:30.557935 (+11312096us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:24.015814 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:24.136044 (+120230us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:24.138997 (+  2953us) write_op.cc:435] Acquired schema lock
0709 13:01:24.141436 (+  2439us) tablet.cc:662] Decoding operations
0709 13:01:24.586454 (+445018us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:24.586514 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:24.586540 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:01:24.587055 (+   515us) tablet.cc:701] Row locks acquired
0709 13:01:24.587075 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:24.587218 (+   143us) write_op.cc:270] Start()
0709 13:01:24.587324 (+   106us) write_op.cc:276] Timestamp: P: 1783602084587172 usec, L: 0
0709 13:01:24.587345 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:24.894999 (+307654us) log.cc:844] Serialized 2434 byte log entry
0709 13:01:26.644683 (+1749684us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a162350ac 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b
0709 13:01:28.569771 (+1925088us) op_driver.cc:464] REPLICATION: finished
0709 13:01:29.217016 (+647245us) write_op.cc:301] APPLY: starting
0709 13:01:29.217119 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:29.217323 (+   204us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:29.217346 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:29.218147 (+   801us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:29.218372 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:01:29.218427 (+    55us) write_op.cc:312] APPLY: finished
0709 13:01:29.218687 (+   260us) log.cc:844] Serialized 53 byte log entry
0709 13:01:29.218857 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:29.218966 (+   109us) write_op.cc:454] Released schema lock
0709 13:01:29.219011 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:29.420284 (+201273us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:29.424373 (+  4089us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55679,"reported_tablets":26,"spinlock_wait_cycles":299636608,"child_traces":[["op",{"apply.queue_time_us":582112,"apply.run_cpu_time_us":2582,"apply.run_wall_time_us":94375,"num_ops":6,"prepare.queue_time_us":367341,"prepare.run_cpu_time_us":83095,"prepare.run_wall_time_us":4124459,"raft.queue_time_us":489473,"raft.run_cpu_time_us":15131,"raft.run_wall_time_us":255255,"replication_time_us":3941928,"spinlock_wait_cycles":203676416,"thread_start_us":3808679,"threads_started":4,"wal-append.queue_time_us":3099422}]]}
I20260709 13:01:30.666600  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:30.667223 10805 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:30.666697  8333 catalog_manager.cc:5697] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 5, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:30.667613 10805 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.668025 10805 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:30.657155 10911 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:30.669327 10911 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:30.630172  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1800) took 2075 ms. Trace:
I20260709 13:01:30.669801 11053 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:30.630681 11076 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:30.644588  9093 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:30.670177 11110 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:01:30.671500  8508 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:30.671882 10846 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.672827  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.647421  8504 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:30.648366  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 64269.3us
I20260709 13:01:30.649412 11027 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:30.650166  8501 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:30.650826  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:30.651712  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:30.652333 11014 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.653134  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:30.657347  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.507702 11074 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.658816  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:30.656862  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:30.669723 10911 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.679823  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.686554  9097 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:30.672497 10846 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.687656 10994 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:01:30.724684 11057 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.705719  8333 catalog_manager.cc:5697] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 3 to 5, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:01:30.751606 11057 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.645764 11007 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.740695  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:30.670188  8435 rpcz_store.cc:276] 0709 13:01:28.554275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.586296 (+ 32021us) service_pool.cc:224] Handling call
0709 13:01:28.601181 (+ 14885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.601365 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:29.700774 (+1099409us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.502430 (+801656us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:30.535025 (+ 32595us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:30.544441 (+  9416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.577180 (+ 32739us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.630112 (+ 52932us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73220,"prepare.queue_time_us":171449,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":81900,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2020,"thread_start_us":1791269,"threads_started":2,"wal-append.queue_time_us":582367}
I20260709 13:01:30.724951  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:30.761377  8426 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:30.707794  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.756052  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.756343  8506 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:30.725793  9065 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:30.688920  9098 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 2: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:30.729874  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:30.762344  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.734815  9100 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
W20260709 13:01:30.767513  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 48687.9us
I20260709 13:01:30.768230  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:30.706090  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:30.782315  8429 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:30.782205  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:30.758870 11057 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:30.710844 11053 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:30.816568 10994 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.830606  8426 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:30.753475  8333 catalog_manager.cc:5697] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 3, leader changed from <none> to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:30.831641  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 89348.7us
I20260709 13:01:30.770186  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.785176 10993 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:30.833483  8505 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:30.832347  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:30.831027  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 183908us
I20260709 13:01:30.835585  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:30.834093  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:30.706559 10806 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:01:30.838887  9098 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:30.841128  9102 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:30.842790  8503 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:30.830907  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:30.833760 11011 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.856825  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:30.858795 11074 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:30.859220  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:30.854727 11090 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:30.862562 10844 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:30.863402 11040 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.959s	user 0.012s	sys 0.012s
W20260709 13:01:30.863788 11099 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.253s	user 0.001s	sys 0.001s
I20260709 13:01:30.839139 11042 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:30.816666 11076 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.841573 10994 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.671501 11002 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.832223  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:30.812242 11027 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:01:31.051477  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 199511us
W20260709 13:01:31.188252  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.159525  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.224084  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 227997us
I20260709 13:01:31.199496  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:30.855587  8333 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 3, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.224888  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:30.866868  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:30.838725  9096 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:30.886371  8509 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:31.091058  9097 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
W20260709 13:01:31.224994  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 209258us
I20260709 13:01:31.232004  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:30.838763 10993 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:31.206344  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:30.871153 11111 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 13:01:30.884552  9095 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:30.865607 11007 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:30.877262 11016 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:31.251847  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:31.251065  8547 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:31.096942 10995 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:31.242079  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:31.257071 11049 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:31.257290  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:31.051949 10846 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:31.260228  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:31.237708 10840 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:31.263329  8505 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:31.263257  8431 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:30.882684 10624 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:31.265645  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 398888us
I20260709 13:01:31.242719 10993 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:31.243609 10914 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:31.282069 11074 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:31.285188 10806 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.285409 11074 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:31.286015 11074 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:31.285808 10806 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:31.289572 10619 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:31.289922 10806 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:31.290341 10846 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:31.290702  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 57903.2us
I20260709 13:01:31.291555  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:31.292114  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:31.292868 11016 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:31.258744  9093 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
W20260709 13:01:31.261915  8501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1639) took 2264 ms (client timeout 1718 ms). Trace:
W20260709 13:01:31.294533  8501 rpcz_store.cc:269] 0709 13:01:28.989242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.139405 (+150163us) service_pool.cc:224] Handling call
0709 13:01:30.883142 (+1743737us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b54001fd954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:31.243678 (+360536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215291136}
I20260709 13:01:30.874192 11009 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.295948 10806 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.296257  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:31.296487 10806 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.297922  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:30.887130 11053 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:30.871397 10409 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.264242  8510 raft_consensus.cc:2410] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:30.872008 11030 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:30.872759 10988 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.391s
I20260709 13:01:31.280905 11011 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:31.297801 11009 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:31.302122  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:31.273993 10840 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:31.320478  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78517.3us
I20260709 13:01:31.264602 11014 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:31.337459  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54949us
W20260709 13:01:31.316759  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 45736.6us
W20260709 13:01:31.346762  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.339407  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:31.298525 11044 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:31.298355  8503 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:31.298393 10619 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:31.319253 10914 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:31.348685  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:31.347975 10805 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.001s
I20260709 13:01:31.369796  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:31.298347 11007 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:01:31.349059  8333 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 3, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:31.389209  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 91393us
I20260709 13:01:31.283731 10995 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.368361 11049 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:31.367532 10619 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:31.398608  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:31.397537  8507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.006s	sys 0.027s
W20260709 13:01:31.399753  8507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.007s	sys 0.027s
I20260709 13:01:31.369340 11057 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:31.351359 10996 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:01:31.409665  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:31.405817  8333 catalog_manager.cc:5697] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:31.391939 11014 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:31.403879 10911 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.002s
I20260709 13:01:31.419235  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:31.420240  8333 catalog_manager.cc:5697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 3 to 4, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 4 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:31.408785  9067 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 1.609s (SENT)
I20260709 13:01:31.421973  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:31.402691 11068 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:31.385987 10805 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:31.435323  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 43883.5us
I20260709 13:01:31.436331  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:31.407356 11030 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:31.406829 11049 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:31.441097  8502 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:31.407825 10806 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:31.447165  8509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1649) took 2375 ms (client timeout 1746 ms). Trace:
W20260709 13:01:31.455260  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50977.3us
I20260709 13:01:31.414196 10991 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.448822  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:31.470942  8509 rpcz_store.cc:269] 0709 13:01:29.071744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.114692 (+ 42948us) service_pool.cc:224] Handling call
0709 13:01:31.430745 (+2316053us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540008cad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:31.447060 (+ 16315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3803137408}
I20260709 13:01:31.445250 11016 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:31.439530 11027 raft_consensus.cc:2764] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:31.494560 10840 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.467789 10844 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:31.506175 10844 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:31.506678 10844 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.507162 10805 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:31.508108 10409 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:31.489075  8333 catalog_manager.cc:5697] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 3, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.488422 10991 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.515225 11014 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:31.515827 11014 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:31.516675 11014 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:31.517560  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 112528us
I20260709 13:01:31.518543 11049 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.522543 10624 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:31.522850  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:31.523147 10844 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.452075 10846 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:31.424350 11057 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.426394 10911 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:31.535105  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 127788us
I20260709 13:01:31.504432 11016 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:31.550089 10840 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.483224 10914 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.527891 11030 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.529616 11068 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:31.561915  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:31.568485  8434 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.578826  8429 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:31.554205 10996 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:31.563927 11016 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:31.564348  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:31.563006 10995 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:31.551461 10624 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:31.561635 11030 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.562371 10840 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:31.563853 11068 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:31.564827 10844 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:31.612385 11057 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:31.624716  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:31.623737 11090 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:31.629452 11030 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:31.619231 11068 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:31.635499  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 71300.1us
I20260709 13:01:31.615268 10624 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:31.652135  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:31.626260 11027 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:31.650533 11057 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.716226  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 361381us
W20260709 13:01:31.718276  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48542.6us
I20260709 13:01:31.661598 10991 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:31.661451 11027 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:31.717901  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.732499  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.629768 11090 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.708545 11007 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:31.740772  9067 leader_election.cc:336] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 1.875s (SENT)
I20260709 13:01:31.740607  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:31.741981  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:31.742497  8502 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:31.743165  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:31.748792  8398 leader_election.cc:400] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7.
I20260709 13:01:31.749167  8398 leader_election.cc:403] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:31.712687 10806 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:01:31.751873 10967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.007s	sys 0.017s
I20260709 13:01:31.752156  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:31.735656 11027 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:31.717976 10911 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:31.752357 10967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.007s	sys 0.017s
I20260709 13:01:31.767287 10993 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.771699 10624 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:31.715322 10619 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:31.790380  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49638.8us
I20260709 13:01:31.799235  8506 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:31.800987  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:31.801843  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53299.7us
I20260709 13:01:31.750699 11040 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:31.731581 11057 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:31.803694  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 276302us
W20260709 13:01:31.804154  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 351440us
I20260709 13:01:31.813287  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:31.816553  9067 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 1.932s (SENT)
I20260709 13:01:31.819924  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:31.820742  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:31.821056  8502 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:31.822615  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:31.823293  8505 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:31.823437  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2070) took 1139 ms. Trace:
I20260709 13:01:31.825686 10619 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:31.806588 11040 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:31.826398 11040 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:31.826519 10805 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:31.827394 11120 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:31.825820 11074 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.003s
I20260709 13:01:31.828099 11120 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:31.828208 11074 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.800549 10846 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:31.823812  8504 rpcz_store.cc:276] 0709 13:01:30.683825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.981992 (+298167us) service_pool.cc:224] Handling call
0709 13:01:31.018487 (+ 36495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.050345 (+ 31858us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:31.425399 (+375054us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.823059 (+397660us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.823111 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:31.823162 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.823265 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.823382 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13155,"prepare.queue_time_us":460417,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":15383,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":1908,"thread_start_us":680433,"threads_started":2}
W20260709 13:01:31.830789  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 114664us
I20260709 13:01:31.784799 11123 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:31.827437 11135 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.782066 11007 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.781172 11068 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:31.820046 10911 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.842425  8502 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:31.858142 11134 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:31.857590 10914 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:31.875566  8510 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:31.841795 11120 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:31.882975  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:31.883553 10996 raft_consensus.cc:697] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:31.844825 10991 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:31.850436 10846 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.879319 10967 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.923568 10619 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:31.924068 10967 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.926082 10619 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:31.926468 10619 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:31.927261  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:31.928314  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2071) took 1238 ms. Trace:
I20260709 13:01:31.928745  8508 rpcz_store.cc:276] 0709 13:01:30.689620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.986521 (+296901us) service_pool.cc:224] Handling call
0709 13:01:31.107299 (+120778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.229502 (+122203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.229523 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.244787 (+ 15264us) log.cc:844] Serialized 26 byte log entry
0709 13:01:31.717572 (+472785us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:31.717614 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.717683 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.928074 (+210391us) raft_consensus.cc:1685] finished
0709 13:01:31.928117 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.928253 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":384,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":440311,"threads_started":1,"wal-append.queue_time_us":619811}
I20260709 13:01:31.930511  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:31.931602  9094 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:31.931923  8508 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:31.927428 10619 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.933462 10619 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:31.934127 11126 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:01:31.934546  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:31.911247 11116 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
W20260709 13:01:31.912197 11121 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:01:31.860805 11135 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.936125  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2067) took 1278 ms. Trace:
I20260709 13:01:31.937139 11135 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:31.936467  8507 rpcz_store.cc:276] 0709 13:01:30.659776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.770682 (+110906us) service_pool.cc:224] Handling call
0709 13:01:30.814911 (+ 44229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.873562 (+ 58651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.873605 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:30.874117 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:01:31.400285 (+526168us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:31.400333 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.400422 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.935928 (+535506us) raft_consensus.cc:1685] finished
0709 13:01:31.935947 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.936069 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15509,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":35738,"thread_start_us":525779,"threads_started":1,"wal-append.queue_time_us":742066}
I20260709 13:01:31.937659 11135 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.938190 11135 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:31.890909 10409 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:31.922104 11122 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.940140 11122 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:31.922652  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 106139us
I20260709 13:01:31.922254 10846 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.906841 11074 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:31.945317  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.946238  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:31.890432 11076 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:31.907769  8501 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:31.987716 10996 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.990675 10803 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:31.991089 10803 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:31.991961 10803 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:31.993134 10803 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.000391  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:31.977514  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 68608.5us
I20260709 13:01:31.947244 10619 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:32.005863 10991 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:32.015007 10991 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.015376 10991 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:32.017645 11002 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:32.021111  9067 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 1.991s (SENT)
I20260709 13:01:32.021534  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:32.013370  9065 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:32.027252  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.030947  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.031927  9095 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:32.032210  9097 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:01:32.033919  9093 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:32.034349  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2072) took 1328 ms. Trace:
I20260709 13:01:32.035061  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:32.035818  9096 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.037647 11068 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:32.048763  9093 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:31.963996 11011 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:01:32.050894  9094 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:32.003538 11076 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:32.062978  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.064990  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:32.065909  8507 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:32.019974 10619 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:32.034754  8503 rpcz_store.cc:276] 0709 13:01:30.706128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.861535 (+155407us) service_pool.cc:224] Handling call
0709 13:01:30.861869 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.368141 (+506272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.034113 (+665972us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b540033ac54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:32.034290 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003326336}
W20260709 13:01:32.082181  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 146393us
W20260709 13:01:32.081396  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 268184us
I20260709 13:01:32.080492  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:32.085716  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:32.084185  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:32.085963  8429 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:32.056187 11002 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:32.082101 10994 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:32.090356  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:32.126358 11076 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.126919  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:32.127848  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:32.128623  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44548.6us
I20260709 13:01:32.129423 11040 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.130668 11074 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:32.131744 10846 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:32.132035  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.132180 11128 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:32.132289 11011 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:32.132635  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.133220 10967 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:32.133270  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.134584 11135 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:32.135426  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:32.136246 11007 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:32.136435  8427 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:32.137403  9094 raft_consensus.cc:2955] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:32.138928  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:32.139690  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:32.235734  9102 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.140633 10993 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:32.235217  8428 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:32.142335 10619 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.054965 11016 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.115419 11134 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:32.107771  8434 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 13:01:32.252666  8434 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:32.156363  9096 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:32.253046  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:32.158812  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:32.180905  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 171001us
I20260709 13:01:32.183604  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:32.181651  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 91820us
I20260709 13:01:32.123143 11042 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:32.199461  8435 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:32.255014  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.203493  9095 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:01:32.256222  9095 pending_rounds.cc:85] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 6
I20260709 13:01:32.209167  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:32.146601  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:32.216811  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:32.211421  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:32.217846  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:32.227826  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 80184.2us
I20260709 13:01:32.229691  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:32.260720  8432 raft_consensus.cc:2410] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:01:32.231976  8578 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:32.261698  8579 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:32.239447  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:32.211825 11014 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:32.222797 11128 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:32.226765  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.241650 11146 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:32.222397 11044 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:01:32.260423  8575 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 2: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:32.256542  9095 pending_rounds.cc:107] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:01:32.287793  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.271200  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:32.297691  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.288064  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:32.294480  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:32.296615  9095 raft_consensus.cc:2889] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:32.293257  8501 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.270488  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:32.260715  9093 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:32.298272  9068 leader_election.cc:336] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.530s (SENT)
I20260709 13:01:32.304641  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:32.311405  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:32.304337 11142 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.336922 11142 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.304418  8577 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:32.287648 11009 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:01:32.294602 10846 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:32.341521 10846 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.342166  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.342918  8576 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:32.343959  9093 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:32.345791  8509 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:32.346728  8504 raft_consensus.cc:2410] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:01:32.351503  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 96806.5us
I20260709 13:01:32.288285  8503 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:32.352461  8501 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
W20260709 13:01:32.367641  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 69396.2us
I20260709 13:01:32.289127 10911 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7.
I20260709 13:01:32.280120 11146 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:32.355662  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:32.295369 11074 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:32.354154  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 142838us
I20260709 13:01:32.259860 11011 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:32.349355 11027 consensus_meta.cc:287] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 13:01:32.379736  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.384966 11146 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:32.385473 11027 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.385716  9095 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:32.387028  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:32.387595 11027 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:32.305361 10844 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:32.389324  9099 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:32.277277 11014 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.384114 11044 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:32.388391  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:32.347278 10914 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:32.396507  8547 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:32.346596 10619 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.392073  8502 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:32.384735  8319 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 09de6eee9632412ebe0a904f65cd2a3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5ffc86752d264d0c81f68028e6413a91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:32.347170 11144 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.401470  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.402628  9098 raft_consensus.cc:2410] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:32.351130 10846 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:32.269368 11147 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 13:01:32.408046  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:32.408046  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.408591 11009 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.408155  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:32.411708  9101 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.275980 11042 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:32.412217  8504 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:32.412267  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.412956  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.413046  9098 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:32.417035  8580 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:01:32.424690  9102 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:32.397467 10967 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.293735 11134 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:32.396016 10914 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:32.433732  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:01:32.446966  8550 leader_election.cc:336] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.746s (SENT)
I20260709 13:01:32.413722 11044 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:32.447837  9068 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.786s (SENT)
I20260709 13:01:32.436338 10846 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:01:32.443235 10914 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:32.452730 11147 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:32.453054  8582 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:32.453715 11149 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:32.456028  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.456895  8580 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:01:32.429651 10844 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:32.453147 11147 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:32.447626  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:32.431540  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:32.472470  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.427574 10911 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:01:32.410145 11144 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.428339 11009 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.483625 11044 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.484309  8435 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:32.476229  9093 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:32.490660  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.498668  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.499363  9102 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:32.500435  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.490996  8582 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:32.501434  9102 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:32.503743  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.505105  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.506407  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.507290  9102 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:32.508065  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:32.513836  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 66917.5us
I20260709 13:01:32.474987 11137 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:32.516538  8584 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:32.521459  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.524276  9093 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:32.529421  9093 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:32.510010 10844 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:32.529958  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 117707us
I20260709 13:01:32.429982 11128 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.533249  8580 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:01:32.533735  9095 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:32.511860 11142 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:32.534442  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.472254 10967 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:32.528056 10991 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 13:01:32.537003  9093 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:32.539553  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:32.540169  9095 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.521219 11016 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:32.512578 11074 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.545172  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:32.545840 11146 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.546420 11134 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:32.531858 11137 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:32.547307  8430 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:32.659443  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:32.585302  9068 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.849s (SENT)
I20260709 13:01:32.600911  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:32.660182  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:32.661141  9095 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:32.547684  8428 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:32.558857  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.656653  8429 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:32.665387  9101 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:32.596719  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:32.669781  9098 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:32.600569 10803 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.003s
I20260709 13:01:32.679872  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:32.547850 11154 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:01:32.681605  9093 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:32.682542 11128 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.597359 11011 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:32.657423 10844 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:32.543993 10991 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:32.693543  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:32.694289  8584 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:32.694605 10991 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:32.695075  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:32.695302  9102 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:32.696142  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:32.652998 10914 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:32.688174  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:32.688519  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 103269us
I20260709 13:01:32.700107 10914 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:32.680024 11142 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:32.701040  9068 leader_election.cc:336] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.947s (SENT)
I20260709 13:01:32.701496 11142 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:32.702740  9068 leader_election.cc:336] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.051s (SENT)
I20260709 13:01:32.703786  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:32.704960  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:32.705675  9093 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:32.707185 11120 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:32.707605 11120 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:32.688169 10967 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:32.708530  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.709693  9095 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:01:32.710464 11161 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.087s	user 0.002s	sys 0.000s
I20260709 13:01:32.689625  8433 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:32.690361 11137 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:32.529268 11147 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:32.747269  8507 raft_consensus.cc:2410] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:32.748425  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:32.561599 11164 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.208s
I20260709 13:01:32.739008  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:32.687460 11068 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.632s	user 0.006s	sys 0.007s
I20260709 13:01:32.754249  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.757812  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:32.762681  9101 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:32.757476 11040 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:32.772290 11042 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:32.772678  9100 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:32.773363 11009 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:32.775138  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:32.778553  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:32.783308  8432 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:32.787182  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.788060  8579 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:32.788370  8578 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:32.789240  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.790750  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.791666  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:32.792047  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.793229  8579 raft_consensus.cc:2410] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:01:32.794009  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.796084  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:32.796993  8503 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:32.799269  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:32.801328  8583 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:32.802973  8583 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.805500  8504 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:32.812208  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.830585  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:32.832243  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:32.834448  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:32.843655 11173 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:01:32.844240 11174 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:01:32.866554  8583 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:01:32.977365  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.986791  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:32.987416  8505 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:32.987923  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:32.865767  8578 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:32.864601  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:32.926455  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:32.995281  8580 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:33.012037  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.011466  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:32.889273  9068 leader_election.cc:336] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.885s (SENT)
I20260709 13:01:33.015473  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:32.862341  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:32.866750  8506 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:33.037817  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:33.038991  8583 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:33.042336  8428 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:33.043942  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:33.045708  8507 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:33.047536  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:33.033401  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:33.038592  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:32.922432 11141 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.791s	user 0.002s	sys 0.002s
I20260709 13:01:33.056406  8510 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:33.056823  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:32.940578 11162 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:32.967131 11147 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.963829 11140 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:33.059366  8502 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:33.061076  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.920856 11074 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.964210  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:33.063428  8508 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.089104  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:33.089771  9094 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:32.937736  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:32.951696 11014 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:33.067718  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:33.066864 11143 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:01:32.865020 11164 raft_consensus.cc:3055] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:33.012825 11057 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:33.037361 11027 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:33.073801  8433 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:32.939102 11122 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:32.857415 11144 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:33.068322 10991 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260709 13:01:33.165621  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 94781.7us
I20260709 13:01:33.174537  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:33.175171  9102 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:33.078933  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 189690us
I20260709 13:01:32.839344 11123 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.222s
W20260709 13:01:33.080773  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 89310.2us
I20260709 13:01:33.090451  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.065547  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:33.092857  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:33.181849  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:32.868690 11119 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:33.067509 10846 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:33.056092 11042 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:33.123257  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.127085  8577 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:33.062901 11162 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:33.074391 11140 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:33.136750  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.138441  8426 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:32.858340 11120 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:33.094362 11009 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:33.160491  9094 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:33.200767  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:33.126729 11164 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:33.186708  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:33.187479  9099 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.044806 11134 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:01:33.188448  8427 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:01:33.193035  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.094823 11074 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.156354 10803 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.186218 10846 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.193356 10914 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:33.177333  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.204689  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.205552  8429 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:33.185087 11027 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:33.249047  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.162499 11014 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:01:33.221189  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.222151 11120 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:33.236136  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49530.4us
I20260709 13:01:33.234434 10846 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.199996 11009 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:33.275074 11009 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.191412 11068 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:01:33.277710 11068 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:33.278076 11068 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:33.238143 10803 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.278925 11068 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:33.279886 10803 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:33.280054 11068 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:33.250234 10914 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.204195  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:33.281948  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:33.282207  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:33.283771  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:33.285079  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:33.286165  8431 raft_consensus.cc:2368] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7.
I20260709 13:01:33.287086  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.287703  8429 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:33.288475  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:33.288956  8429 raft_consensus.cc:2376] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6. Re-sending same reply.
I20260709 13:01:33.289708  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.291049  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.291543  8502 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.291811  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.292095  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.266996  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.292641  8430 raft_consensus.cc:2376] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7. Re-sending same reply.
I20260709 13:01:33.292876  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.293334  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.294145  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:33.294451  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:33.294716  9101 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:33.295547  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:33.295857  9093 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:33.291049  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:33.296525  9097 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:33.296990  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:33.221868 11135 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.297940  9100 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:33.282219 10914 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:33.308576  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.310540 11027 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.293831  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:33.221884 11042 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.314533  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:33.315411 11122 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:33.315750 11042 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:33.293632  8429 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:33.316294 10967 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.310588 11009 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.267686  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:33.316982  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.317916  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:33.318966  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.319458 11142 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:33.319895  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.318127  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.320995  8429 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:33.257582 11167 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.322062  8429 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:33.322577 11167 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.324693 11167 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:33.328928  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 1998) took 1025 ms. Trace:
I20260709 13:01:33.330358 11009 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:33.329591  8581 rpcz_store.cc:276] 0709 13:01:32.303460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.303584 (+   124us) service_pool.cc:224] Handling call
0709 13:01:32.712040 (+408456us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:32.712313 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.750313 (+ 38000us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:32.831322 (+ 81009us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.328303 (+496981us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.328520 (+   217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.328577 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:33.328638 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.328712 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.328842 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94458,"prepare.queue_time_us":396289,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":92,"raft.queue_time_us":88229,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":16427,"spinlock_wait_cycles":16636160,"thread_start_us":405093,"threads_started":3,"wal-append.queue_time_us":365022}
I20260709 13:01:33.290385  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.298097 11135 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:33.356909 11135 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:33.265461  9102 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:33.300192 11176 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:01:33.357964  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:33.300644  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:33.301083 11190 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:01:33.361757 11119 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:33.362356 11119 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:33.363471 11123 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:33.302335 11175 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:01:33.237674 11157 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.372762 11157 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.375547 11157 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:33.315815 11122 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:33.376288 11122 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:33.269412 11162 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:33.299484  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:33.294181  8427 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:33.293443  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.336844  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.338037  8579 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:33.264988  8432 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:33.341220  8502 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.343861 11142 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:33.349292  8550 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:33.351253  8508 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:33.352377  8505 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: [4.4-5.5]
I20260709 13:01:33.353016  8506 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:33.329054  8503 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.001s
I20260709 13:01:33.334668  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:33.354723  8431 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:33.360273  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:33.226315 11040 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:33.241123  9096 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:33.376363 11074 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:33.452121  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.465003  8503 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
W20260709 13:01:33.499439  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 150173us
I20260709 13:01:33.505213  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:33.506206  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.508066 11009 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:33.513490 11162 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.518093 11190 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:33.525632  8576 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.527360  8576 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:33.529009  8576 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:33.482225 11177 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.271s	user 0.003s	sys 0.001s
I20260709 13:01:33.466928  8430 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:33.386584  9094 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 13:01:33.469762  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 150559us
I20260709 13:01:33.544099  9094 pending_rounds.cc:85] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 7
I20260709 13:01:33.544502  9094 pending_rounds.cc:107] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:33.544555  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:33.544912  9094 raft_consensus.cc:2889] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.546767  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:33.546413  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:33.550738  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:33.575747  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.552620  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:33.584335  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.578001 11157 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:33.586066  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:33.592561  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:33.596294  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 296838us
I20260709 13:01:33.596851  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:33.597466  8580 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:33.574805  8583 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:33.553532 11123 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:33.599141  8583 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:01:33.602926  8505 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.604919  9067 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:33.597362  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:33.599629 10991 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:33.607574  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:33.637073  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 448870us
I20260709 13:01:33.637270  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:33.609143  8582 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.580751 10967 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:33.641475  8502 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.642845  8510 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:33.646176  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.646311  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.647163  8426 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:33.648543  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.678378  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:33.590821 10619 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
W20260709 13:01:33.681775  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.700569  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:33.701115  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.701484  8508 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:33.507198  8427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37072d40853c44b1b312489112c9250e"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:01:33.607069 11090 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:33.703460  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.677279 11002 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:33.705469  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 108255us
I20260709 13:01:33.582376 11076 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:01:33.640781 10991 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.682229  8550 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:33.710731  8583 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.706377  8430 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:33.711916  8506 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:33.715461  8582 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.703032  8427 raft_consensus.cc:606] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:33.717408  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:33.774258  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.774572  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:33.780874  8506 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:33.752453  9068 leader_election.cc:336] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.507s (SENT)
I20260709 13:01:33.775533  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:33.783082  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.538s (SENT)
I20260709 13:01:33.783160  8426 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 2.
I20260709 13:01:33.783478  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:33.783696  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:33.784356 10967 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:33.784919  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:33.785521  8502 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:33.785709  8583 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:33.785897  8582 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:33.606442  8576 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:33.786743  8502 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:33.788612  8506 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.789489  8502 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:33.789583  8506 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:33.789708 11009 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:33.595649 11157 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:33.790403 11009 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:33.649586 11120 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.138s
I20260709 13:01:33.787410  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:33.674413  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69564us
I20260709 13:01:33.607329 11190 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:33.640602  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.677486 11068 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:33.494630 11164 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.640362 11042 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
I20260709 13:01:33.790910  8502 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:01:33.869822  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:33.993566 11190 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:33.713933  8503 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:33.953130 11027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.036s	sys 0.013s
W20260709 13:01:33.994776 11027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.037s	sys 0.014s
W20260709 13:01:33.851675 11147 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.000s
I20260709 13:01:33.994907 11190 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.790800 11009 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.996044 11190 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.836948 11140 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:33.996322 11009 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.927203  8506 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:01:33.997280 11140 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:33.978838  8584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.017s	sys 0.018s
I20260709 13:01:33.998788  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.859163  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:33.999465  8430 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:33.677992 11142 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:33.999930  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1744) took 1140 ms. Trace:
I20260709 13:01:33.640472 11057 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:34.000801  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.000922 11057 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.001207  9067 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:33.987540  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 410380us
W20260709 13:01:33.796838  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 114691us
I20260709 13:01:34.024180  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:33.998931  8584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.017s	sys 0.018s
I20260709 13:01:34.027850  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2005) took 1479 ms. Trace:
I20260709 13:01:34.028348  8584 rpcz_store.cc:276] 0709 13:01:32.548922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.696940 (+148018us) service_pool.cc:224] Handling call
0709 13:01:32.750014 (+ 53074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.752412 (+  2398us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:33.030701 (+278289us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.027251 (+996550us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.027425 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.027478 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:34.027541 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.027626 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.027776 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":366125,"prepare.run_cpu_time_us":5997,"prepare.run_wall_time_us":14949,"thread_start_us":1202496,"threads_started":2}
I20260709 13:01:34.004777  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:33.821779  9068 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.614s (SENT) [suppressed 38 similar messages]
W20260709 13:01:34.005236  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.861763 11134 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:33.993348 11143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.015s	sys 0.029s
I20260709 13:01:33.705133 11167 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:34.038757  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:34.003077 11192 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 13:01:34.051213  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:33.793856 10991 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:33.992502 11002 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:34.002244  8575 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.003s
W20260709 13:01:34.066610  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 282949us
I20260709 13:01:34.032223 11057 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.059580  8504 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:34.063694  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.079432  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:34.079790  8432 raft_consensus.cc:2368] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7.
I20260709 13:01:34.000411  8576 rpcz_store.cc:276] 0709 13:01:32.859091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.529862 (+670771us) service_pool.cc:224] Handling call
0709 13:01:33.582379 (+ 52517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.999708 (+417329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.999878 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.076442 11002 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.092449 11002 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:34.058212 11068 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.094977 11068 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:34.065572 10844 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:34.098421 10844 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:34.098908 10844 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.856845 11119 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.102216 11119 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:34.104203 10846 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.829s	user 0.013s	sys 0.012s
I20260709 13:01:34.104751 10846 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:34.106050  8578 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:33.830710 11157 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.078296 11164 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.054322 11090 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.076570 11167 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:34.115356 11167 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:34.118873 11162 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:34.120855 11162 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:34.124614  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:34.125335  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.126401  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.126739  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.127147  8434 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:34.128217  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.125363  8426 raft_consensus.cc:2376] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4. Re-sending same reply.
I20260709 13:01:34.125759  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.129518  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:34.130259  8426 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:01:34.056366 11143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.015s	sys 0.030s
I20260709 13:01:34.035974 11134 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.078436  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:34.134102  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 55750.9us
I20260709 13:01:34.128252  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:34.080271 10967 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.036571 11074 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:34.051182 11142 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.057929  8550 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.139779  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.141782  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:34.143193  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:34.143986  8432 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:34.145231  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.142882  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.065811  8575 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:34.153657  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.153859  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.155356  8508 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:01:34.155970  8434 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:34.156778  8583 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:34.157204  9101 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:34.155351  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 97478.3us
I20260709 13:01:34.158947  8550 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:34.134971 11044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.004s	sys 0.019s
I20260709 13:01:34.160182  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:34.134704 11134 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.163492  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.169642  9095 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:34.164340  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:34.165279  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.165797  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:34.170723  8434 raft_consensus.cc:2376] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7. Re-sending same reply.
I20260709 13:01:34.167052  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.171888  9100 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:34.146415 11090 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:34.174129  9093 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:34.146186 11027 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:34.187557 11193 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:01:34.186151  9097 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:34.158383 11194 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:34.189357  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:34.190454  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.192850  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1747) took 1332 ms. Trace:
I20260709 13:01:34.193989  9095 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:01:34.163044 11044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.004s	sys 0.019s
I20260709 13:01:34.197690  8430 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:34.201443 10967 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:34.156468 11119 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:34.202217 11201 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:34.202971 11119 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.195506 11027 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:34.206455 11195 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 13:01:34.206491  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.206482 10967 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.143285 10996 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:01:34.208488 11119 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:34.208873 10967 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:34.209307  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.209561  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 793) took 1351 ms. Trace:
I20260709 13:01:34.205859 11027 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:34.209950  9098 rpcz_store.cc:276] 0709 13:01:32.857826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.036854 (+179028us) service_pool.cc:224] Handling call
0709 13:01:33.062457 (+ 25603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:33.088358 (+ 25901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.088400 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:33.144191 (+ 55791us) log.cc:844] Serialized 26 byte log entry
0709 13:01:33.472382 (+328191us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:33.482096 (+  9714us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.482310 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.482380 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.209377 (+726997us) raft_consensus.cc:1685] finished
0709 13:01:34.209394 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.209511 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49699,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":5566,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":34195,"thread_start_us":272498,"threads_started":1,"wal-append.queue_time_us":534630}
I20260709 13:01:34.213066 11126 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:34.213454 11126 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:34.195758 11143 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.213941  8430 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:01:34.214459  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.214274 11126 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.215333 11126 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.215410 11027 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:34.217983  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:34.220050  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:34.227417  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:34.228067  8508 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:34.228204  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:34.228969  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1755) took 1366 ms. Trace:
I20260709 13:01:34.229344  8577 rpcz_store.cc:276] 0709 13:01:32.892859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.227910 (+1335051us) service_pool.cc:224] Handling call
0709 13:01:34.228914 (+  1004us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.221412  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:34.230792  8581 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:34.231244  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1745) took 1371 ms. Trace:
I20260709 13:01:34.231564  8581 rpcz_store.cc:276] 0709 13:01:32.859388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.333450 (+474062us) service_pool.cc:224] Handling call
0709 13:01:34.221288 (+887838us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:34.231194 (+  9906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19655936}
I20260709 13:01:34.233279  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:34.223798  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.239104  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:34.174255 11068 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:34.252556 11068 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.252923 11068 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.193423  8580 rpcz_store.cc:276] 0709 13:01:32.859938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.598607 (+738669us) service_pool.cc:224] Handling call
0709 13:01:33.598883 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.606538 (+  7655us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:33.680191 (+ 73653us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.192443 (+512252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.192490 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:34.192532 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.192644 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.192782 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71490,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":8459,"thread_start_us":357802,"threads_started":1}
I20260709 13:01:34.163092  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1752) took 1301 ms. Trace:
I20260709 13:01:34.187009 11090 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.247246 11190 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:34.159551 11142 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:34.168399 11191 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.225016  8431 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:01:34.249126  9093 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:34.252233 11122 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.747s	user 0.001s	sys 0.007s
W20260709 13:01:34.276216  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.263576  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.247196  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:34.271626  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 554237us
I20260709 13:01:34.248025  9098 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:34.196892 11194 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:34.273507  8473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.018s	sys 0.014s
I20260709 13:01:34.291675  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:34.292429  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.295799  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.306399  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.310968  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.312588  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.274032 11090 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.332273  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.290973 10846 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:34.269567  8575 rpcz_store.cc:276] 0709 13:01:32.861305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.285844 (+424539us) service_pool.cc:224] Handling call
0709 13:01:34.161405 (+875561us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:34.401856  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69647.9us
I20260709 13:01:34.406715  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.408193  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.298815 11194 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.332894 11143 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:34.330511 11040 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.291319 11122 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:34.427497  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.426494  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 604702us
I20260709 13:01:34.366916 11044 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.397998 10967 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:34.431439  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.394356 10619 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:34.401911 11052 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:34.447335  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 408289us
W20260709 13:01:34.450114  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 394097us
W20260709 13:01:34.451916  9068 leader_election.cc:336] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.036s (SENT)
I20260709 13:01:34.469102  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.400677 10991 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:34.470511  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.473804  9068 leader_election.cc:336] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.755s (SENT)
W20260709 13:01:34.479094  9068 leader_election.cc:336] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.211s (SENT)
W20260709 13:01:34.452337 11076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.007s	sys 0.007s
I20260709 13:01:34.444799 11164 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:34.449844 11204 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.478766 11040 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:01:34.487564 11144 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:34.444267 11143 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.490723 11162 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:01:34.483065 11076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.007s	sys 0.008s
I20260709 13:01:34.446875 10967 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.450212 10619 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:34.501857  8549 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.478062 11206 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:34.510072  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.499281  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 135662us
W20260709 13:01:34.506706  9068 leader_election.cc:336] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.950s (SENT)
I20260709 13:01:34.511006  8400 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:34.473686 11208 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:01:34.495679 11144 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:34.530740 11144 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:34.531911 11144 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:34.533349  8578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1758) took 1602 ms (client timeout 1766 ms). Trace:
W20260709 13:01:34.533782  8578 rpcz_store.cc:269] 0709 13:01:32.931080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.060838 (+129758us) service_pool.cc:224] Handling call
0709 13:01:34.533163 (+1472325us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540028c3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:34.533289 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2368684928}
I20260709 13:01:34.511904  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.495867 11203 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:01:34.535457 10967 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:34.536484 11197 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:01:34.538009 11215 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:34.538388 11142 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:34.517357 11076 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:34.511806 11209 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:01:34.539829 11209 raft_consensus.cc:3055] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:34.540256 11209 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:34.542784 11202 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:34.543793 10991 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:34.543942 11042 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:34.544423 11042 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:34.545270 11042 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.511495 11201 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:34.575881  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:34.522420 11205 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:01:34.523742 11143 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:34.524552 11207 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:01:34.526057  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2081) took 1235 ms. Trace:
I20260709 13:01:34.545753 11090 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.589959  8510 rpcz_store.cc:276] 0709 13:01:33.290996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.294169 (+  3173us) service_pool.cc:224] Handling call
0709 13:01:34.525902 (+1231733us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b540008ded4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:34.525988 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93322112}
W20260709 13:01:34.547684 11009 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.000s
I20260709 13:01:34.549382  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:34.555864 11215 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:34.551254  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:34.552805  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:34.553161 11200 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:34.553481 11206 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:34.618372 10844 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:01:34.618829 10844 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:34.618709 11206 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:34.554241 11147 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:34.621727 10844 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:34.554939 11191 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:34.555413 11122 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:34.557184  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:34.521109 11068 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:34.558231  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47313.9us
W20260709 13:01:34.630402  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 158705us
W20260709 13:01:34.562465  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50648.7us
I20260709 13:01:34.631176  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:34.631958  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:34.572690  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 66020.5us
I20260709 13:01:34.634359  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:34.582767  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.496387 11164 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:34.521479 11057 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.535475  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1766) took 1602 ms. Trace:
W20260709 13:01:34.637212  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 184423us
I20260709 13:01:34.550383 11120 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:34.596813 10619 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:34.573689 11142 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:34.597319 11204 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.599226 11090 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:34.589418 11201 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.599934  9096 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:34.541235 11209 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.602402  8510 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:34.613976  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:34.663156  8584 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:34.605839 11009 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.615984  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 572) took 1009 ms. Trace:
I20260709 13:01:34.597322 11042 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.667385 11209 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.668725 11009 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:34.664798 11201 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.554490  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:34.638250  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.622833  8578 raft_consensus.cc:2376] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7. Re-sending same reply.
I20260709 13:01:34.675391 11068 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:34.639513  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:34.676723  8580 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:34.643371  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:34.678478  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:34.637635  8583 rpcz_store.cc:276] 0709 13:01:32.933416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.786463 (+853047us) service_pool.cc:224] Handling call
0709 13:01:34.156380 (+369917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.157200 (+   820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.535286 (+378086us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54000163d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:34.535419 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850004352}
I20260709 13:01:34.680320 11162 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.680145 11194 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.680986 11162 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.646317 11126 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:34.595204 11215 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:34.649047  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.648131 11221 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.656989  8581 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:34.622221 11191 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:34.612923 11200 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:34.660809  8576 raft_consensus.cc:2368] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4.
I20260709 13:01:34.622635 11147 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:34.662698  9102 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:34.641633 10844 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:34.640117  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:34.641997 11002 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.681663 11162 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:01:34.685860  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:34.686796  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.641096 11120 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:34.665275  8509 rpcz_store.cc:276] 0709 13:01:33.629976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.630144 (+   168us) service_pool.cc:224] Handling call
0709 13:01:33.678682 (+ 48538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:33.681572 (+  2890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.681601 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:33.777142 (+ 95541us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.078569 (+301427us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:34.078608 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.078730 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.615705 (+536975us) raft_consensus.cc:1685] finished
0709 13:01:34.615734 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.615908 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2490,"raft.queue_time_us":23147,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":69582,"thread_start_us":220130,"threads_started":1,"wal-append.queue_time_us":522988}
I20260709 13:01:34.692896  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:34.692998 11164 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:34.693647  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 55515.9us
I20260709 13:01:34.728260  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.669364  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:34.729429  8575 raft_consensus.cc:2410] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:34.654923  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:34.735663  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.702159 11009 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.694411 11126 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:34.748692  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:34.743883  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 103874us
I20260709 13:01:34.707717 11042 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:34.753556  8505 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:34.737572  8431 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:34.761193  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.770785  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:34.764675  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.765538  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.776573  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.778285  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:34.745829 11074 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:34.718091 11208 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:01:34.790573  8579 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.787261  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:34.734795 10619 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:01:34.757009 11134 consensus_meta.cc:287] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.001s
W20260709 13:01:34.797405  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.798274  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:34.799037  8507 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:34.738361 11090 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:34.754163 10844 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:34.801627  8576 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:34.802796 11122 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:34.785357 11068 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:34.753983 11222 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:34.818960  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 164115us
I20260709 13:01:34.705084 11221 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.826905  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.760592 11164 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:01:34.838375  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.863282  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:34.863986  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.864802  9096 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:01:34.865558  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:34.866118  9095 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.864027  9100 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:34.859561  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:34.768846 10914 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:01:34.863178  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.800061 11042 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:34.868216  8579 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:01:34.800733 11074 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:34.882745  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.883386  9101 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:34.883277 11074 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.884222  9095 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:34.884233 11143 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:34.885622  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 135153us
I20260709 13:01:34.886348  8508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:01:34.886919  8508 raft_consensus.cc:606] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:34.759096 11216 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:01:34.816870 10844 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:34.878556 11140 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:01:34.878624 10846 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:01:34.888378  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50089.9us
I20260709 13:01:34.817176 11122 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:34.789916 11200 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.918500 11122 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.919037 11200 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.920606  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:34.890736 11040 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:34.922302  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.922449 11040 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:34.922866 11040 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:34.923249 11040 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.925240  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:34.892315 11234 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:34.892295 10914 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:34.926358 11234 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:34.926517 11044 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.926658 10914 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:34.927205 11009 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:34.927726 10914 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.928442  8581 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:34.826817 11007 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:01:34.928905 10914 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:34.892901 11217 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:01:34.897629 11057 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:34.760078 11147 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:34.823212 11027 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
W20260709 13:01:34.878832  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 82149.9us
I20260709 13:01:34.875375 11042 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:34.910701  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 51237.1us
I20260709 13:01:34.975551  9094 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:34.892441 11233 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.807243 11134 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.932910  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:34.933629  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.931093  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.941854  8508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:01:34.991077  8508 raft_consensus.cc:606] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:34.991475  8508 raft_consensus.cc:614] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:34.943387 11144 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:34.951043  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 63462.4us
I20260709 13:01:34.993134  8400 leader_election.cc:400] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4.
I20260709 13:01:34.993319  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:34.990603  9100 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:34.784334 11191 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:34.953316  8475 connection.cc:256] RPC call timeout handler was delayed by -1.614901241000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 13:01:34.997452  8475 connection.cc:256] RPC call timeout handler was delayed by -1.6104012410000337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:01:34.997838  8475 connection.cc:256] RPC call timeout handler was delayed by -1.5636012410000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:01:34.998232  8475 connection.cc:256] RPC call timeout handler was delayed by -1.5501012410000499s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:01:34.998584  8475 connection.cc:256] RPC call timeout handler was delayed by -1.5312012410000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 13:01:34.998903  8475 connection.cc:256] RPC call timeout handler was delayed by -1.5240012410000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:01:34.999199  8475 connection.cc:256] RPC call timeout handler was delayed by -1.4061012410000444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 13:01:34.999485  8475 connection.cc:256] RPC call timeout handler was delayed by -1.3971012410000299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 13:01:34.999828  8475 connection.cc:256] RPC call timeout handler was delayed by -1.3872012410000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 13:01:35.000152  8475 connection.cc:256] RPC call timeout handler was delayed by -1.36200124100003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:01:35.000481  8475 connection.cc:256] RPC call timeout handler was delayed by -1.183801241000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 13:01:34.961663 11122 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:34.955751  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.957680  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.963311 11164 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.877040 11222 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:34.974493  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:35.014074  9097 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.974498  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:34.904630 10844 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.983716 10619 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:34.986387 11234 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.988510 11040 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.837790 11206 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:01:34.990497  9093 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:34.993497  8400 leader_election.cc:403] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:34.904273  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 77588.8us
I20260709 13:01:34.876996  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:34.993829 11194 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:34.858065 11120 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:35.051898  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 58907.8us
I20260709 13:01:34.978463 11042 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.781926 11215 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:34.986419 11147 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.064843  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.022396  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.022964  8508 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:35.008673  9102 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:34.992569 11144 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:35.048504  9101 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:35.107859  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.979851  8503 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: [4.4-5.5]
I20260709 13:01:35.052702  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:35.057118  9097 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:34.951458 11126 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:35.050328 11218 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 13:01:34.998095 10846 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:01:35.050407 11234 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:35.023912 10996 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:01:35.078250 11224 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:01:35.023985 10619 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.080204  8575 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:35.099237  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.099924  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:35.100095  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:35.099968  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:35.101995  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:35.102702  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:35.102953  8432 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:35.105268  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 83434.6us
W20260709 13:01:35.106769  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 113521us
I20260709 13:01:35.106987  8508 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:35.023356 11164 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:35.192512 11235 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:35.170471  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 57019.7us
W20260709 13:01:35.173924  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.024897 11191 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.242146 11239 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:35.242944 11239 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:35.244053 11228 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:01:35.097435 11120 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.245455 10619 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:35.246834 11240 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:35.247539  8432 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:35.248620 11251 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:35.246660 11241 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:01:35.109820 11144 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.164069 11222 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:35.250867 11134 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:35.107302 11206 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:35.220353  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.222810  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 170184us
W20260709 13:01:35.255198  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 167621us
I20260709 13:01:35.096487 11244 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.236285  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:35.262816 11134 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:35.263226 11134 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:35.263600 11134 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:35.267427  8508 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:01:35.268419  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:35.268651  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:35.269464  8508 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:35.270347  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:35.273013  8427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
W20260709 13:01:35.236469  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.246634  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:35.250094 10846 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:35.210633  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:35.294284  8433 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:35.110657 11142 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:35.257194  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.173286 11208 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.276540  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:35.273679  8427 raft_consensus.cc:606] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:35.276122  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:35.293344  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.304620  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 64071.8us
I20260709 13:01:35.238698 11221 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:35.316305  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:35.316946  8432 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.255728 11040 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:35.319314  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 60967.2us
I20260709 13:01:35.240029 11209 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:01:35.321218  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 74656.6us
I20260709 13:01:35.324970  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:35.326499 11250 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.326630  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.327095 11250 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.328459 11206 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:35.328851 11206 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:35.329182 11206 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.333012 11221 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:35.334668 11255 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:35.336637 11242 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.240s	user 0.000s	sys 0.003s
I20260709 13:01:35.338579 11243 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:35.339039 11243 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:35.339903 11243 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.341128 11243 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.327952  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.351272  8433 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:35.352813  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:35.373350  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 308551us
I20260709 13:01:35.319676 11122 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:35.378178  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:35.378832  8501 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
W20260709 13:01:35.379062  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 51189.3us
I20260709 13:01:35.379772  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:35.306934 11248 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:35.371973 11201 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.000s
I20260709 13:01:35.324047  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:35.384812  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.386042  8426 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:35.380743  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:35.260686 11235 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:35.338605 11164 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:35.326651 11009 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:35.374774 11222 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:35.403083  8431 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.001s
I20260709 13:01:35.398679 11042 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.405835 11157 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.389569 10803 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:35.410571  8432 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
W20260709 13:01:35.425485  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 105490us
W20260709 13:01:35.426422  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44502us
I20260709 13:01:35.531347  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:35.309710 11208 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:35.533466 11235 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:35.427858  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 47238.2us
W20260709 13:01:35.428556  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 128059us
W20260709 13:01:35.431862  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.433221  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48456.5us
I20260709 13:01:35.436683  8575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:01:35.437335 11074 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:35.444641  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 168152us
I20260709 13:01:35.539682  8428 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:35.540619  9096 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:35.546602  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:35.452068 11044 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.525s	user 0.002s	sys 0.007s
I20260709 13:01:35.450120 11252 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:35.534332 11249 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:01:35.560832  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:35.454743 11057 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:35.395714 11201 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.453477  8431 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:35.470508 10844 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.503006 11231 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:35.517710 11254 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:35.518725 11219 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.842s	user 0.000s	sys 0.004s
I20260709 13:01:35.400313 11040 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:35.527180 10914 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:35.536144  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.536434  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.540957  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:35.455340  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 155259us
I20260709 13:01:35.538300  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:35.546435  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.410583 11122 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:35.548214  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:35.566933 11044 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:35.451656 11251 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.558678 11120 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:35.544476 10803 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:35.540371 11157 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:35.644030  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 103135us
W20260709 13:01:35.644155  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 97752.1us
I20260709 13:01:35.644843  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:35.563130 11259 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:35.563650 11263 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:35.563558 11261 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:01:35.529031 11222 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:35.566185  9101 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:35.568221 11076 raft_consensus.cc:2764] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:01:35.570734 11254 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.575835 11250 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:35.561975  8575 raft_consensus.cc:606] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:35.580452  8510 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:35.668442  8575 raft_consensus.cc:614] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:35.588023 10844 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:35.559702 11074 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.592932 11144 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.551151 10846 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:35.669929 10846 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.671005 11074 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:35.671309 11144 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:35.534006 11208 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:35.595741 11256 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.145s	user 0.004s	sys 0.007s
I20260709 13:01:35.673074 10846 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:35.597105 11042 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:35.558729 11252 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.630662  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:35.553289  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.674576 11252 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:35.675860  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 122797us
I20260709 13:01:35.677209 11140 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:35.674994  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 44391.5us
I20260709 13:01:35.677848 11140 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:35.629335 11204 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:01:35.642324  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 104145us
I20260709 13:01:35.678850 11204 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:35.585743 11201 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:35.679349  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:35.561731 11009 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:01:35.679929 11265 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:35.680841 11009 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:35.681052  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:35.681275 11009 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:35.650621  9068 leader_election.cc:336] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.525s (SENT)
I20260709 13:01:35.681547  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:35.637396 11122 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:35.656657 11234 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:01:35.666564 10803 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.690920  9068 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.646569 11126 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:35.667399 11254 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:35.668483  8510 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:35.678328  8550 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:35.681689 11009 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:35.651966  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.654209 11057 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:35.652540 11255 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:35.651671  8577 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:35.689170  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:35.784763  8507 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:35.695943  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:35.783221  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1701) took 1593 ms. Trace:
I20260709 13:01:35.696575  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:35.786875  8432 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:35.697427  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:35.787953  8426 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:35.680791  8576 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:35.686138 11244 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4.
I20260709 13:01:35.619596 11231 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.788658  8576 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:35.786163  8434 rpcz_store.cc:276] 0709 13:01:34.189614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.189883 (+   269us) service_pool.cc:224] Handling call
0709 13:01:34.190253 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.198546 (+  8293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.198585 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.244492 (+ 45907us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.574292 (+329800us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:34.574386 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.574516 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:35.517770 (+943254us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:35.691993 (+174223us) raft_consensus.cc:1685] finished
0709 13:01:35.692016 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.783140 (+ 91124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28126,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":27758976,"thread_start_us":243321,"threads_started":1,"wal-append.queue_time_us":360202}
I20260709 13:01:35.691149 11122 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.688191 11042 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:35.679117 11140 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:35.779644 11144 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.693951 11002 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:35.804472  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 152566us
I20260709 13:01:35.798781  8576 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.813709  8576 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:35.792915  8510 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.802650  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:35.815131  8510 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:35.796248  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:35.694326 11209 consensus_queue.cc:1059] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:01:35.804268 11254 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.780810 11201 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:35.694610 11265 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:01:35.818624  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:35.819278 11275 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:35.819655 11280 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:35.820482 11258 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.319s	user 0.004s	sys 0.000s
I20260709 13:01:35.821234 11253 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:35.824779 11209 raft_consensus.cc:3055] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:35.826392  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 175813us
I20260709 13:01:35.871703  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:35.872457  9101 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:35.819289  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.803603  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 124316us
W20260709 13:01:35.844002  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.846087  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:35.803952 11007 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:01:35.664636 11263 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.853320  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:35.854511  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:35.881078  9097 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.855140  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:35.855474  9102 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:01:35.874181  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.876102  8579 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:35.876345  8510 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:35.650014 11251 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:35.873912  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:35.878598  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:35.961468  9099 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:35.808905 11042 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:35.877758  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:35.876609  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 238753us
I20260709 13:01:35.966872  9097 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:35.967087  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:35.856366 11234 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:35.967962  9095 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:35.856076 11201 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:35.815205 11144 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:35.969720  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:35.960006  9100 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:35.958151  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:35.974965 11191 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.732s	user 0.007s	sys 0.002s
I20260709 13:01:35.976117 11252 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:36.021968 11144 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:36.023026 11252 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:35.877035 11280 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:36.025012 11134 consensus_meta.cc:287] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.001s
I20260709 13:01:36.024955 11280 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.025564 11232 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:36.026094 11232 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.026430 11232 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:35.979909 11251 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:35.981068  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 107025us
I20260709 13:01:35.982508 11042 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:35.877039 11209 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:36.110317  8430 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:36.020931  8575 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:36.043958 11283 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:36.051672  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 178655us
W20260709 13:01:36.114190  9068 leader_election.cc:336] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.138s (SENT)
I20260709 13:01:36.114625  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:35.963725  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:36.115542  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 151914us
W20260709 13:01:36.089443  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.117960  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.838238 11222 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.119838  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:01:36.048535 11200 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.129s	user 0.008s	sys 0.004s
I20260709 13:01:36.025527 11134 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.003921 11234 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:36.230562  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 116387us
W20260709 13:01:36.232231  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 112457us
I20260709 13:01:35.962433 11275 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:36.242046  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 560988us
I20260709 13:01:35.962087 11253 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:36.329344  8427 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:36.293299  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 265076us
I20260709 13:01:36.110035 11007 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:36.340255  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44334.3us
I20260709 13:01:36.335427  9101 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:36.335089 11074 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:36.224587 11042 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:36.295130 11251 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:36.244849 11157 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:36.242435 11119 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:36.356272  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:36.361793  8502 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:36.336875 11283 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:36.369119  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1692) took 1101 ms. Trace:
I20260709 13:01:36.369767  8502 rpcz_store.cc:276] 0709 13:01:35.267324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.270106 (+  2782us) service_pool.cc:224] Handling call
0709 13:01:36.356131 (+1086025us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:36.369042 (+ 12911us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10621312}
I20260709 13:01:36.346850 11007 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:36.396605 11007 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:36.398346 11262 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.399049 11262 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:36.402149 11140 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.402827 11140 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:36.403035 11275 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.405462 11140 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:36.328612 11191 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:01:36.297549 11009 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.359728 11251 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.401705 11262 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:36.348723 11200 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:01:36.440194 11227 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.518s	user 0.001s	sys 0.021s
W20260709 13:01:36.441537 11194 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:01:36.470045  8509 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:36.476361  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.414186 11140 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.417794 11144 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.353358 11074 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.480043 11140 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.482172 11140 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:36.480119 11144 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:36.478586  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 137498us
I20260709 13:01:36.423545 11251 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:36.485554  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:36.478674  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 143028us
W20260709 13:01:36.477299 10803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.065s	sys 0.072s
I20260709 13:01:36.360023 11042 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.482762 11074 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:36.474788 11262 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:36.523622  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:36.511377 11206 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.182s	user 0.010s	sys 0.002s
I20260709 13:01:36.502523  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:36.522172 11221 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:36.531759  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:36.532171 11221 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:36.532898  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:36.533057 11221 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:36.507227  8430 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 1862) took 1423 ms (client timeout 1882 ms). Trace:
I20260709 13:01:36.508445  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 417) took 1954 ms. Trace:
I20260709 13:01:36.353107 11209 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:36.534224  8430 rpcz_store.cc:269] 0709 13:01:35.083384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.102337 (+ 18953us) service_pool.cc:224] Handling call
0709 13:01:36.506995 (+1404658us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54001d38d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:36.507148 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335544192}
W20260709 13:01:36.534849 11272 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.879s	user 0.009s	sys 0.007s
I20260709 13:01:36.534312  8577 rpcz_store.cc:276] 0709 13:01:34.553881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.554230 (+   349us) service_pool.cc:224] Handling call
0709 13:01:36.508196 (+1953966us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54000aa0d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:36.508371 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2132766592}
I20260709 13:01:36.535597  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:36.536186  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1855) took 1455 ms. Trace:
I20260709 13:01:36.533876  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:36.537109 11257 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.041s	user 0.004s	sys 0.023s
I20260709 13:01:36.537225  8431 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:36.538589  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 895) took 1486 ms. Trace:
W20260709 13:01:36.538691 11247 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.317s	user 0.005s	sys 0.011s
I20260709 13:01:36.538939  9093 rpcz_store.cc:276] 0709 13:01:35.051895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.052679 (+   784us) service_pool.cc:224] Handling call
0709 13:01:35.053428 (+   749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.164558 (+111130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.164590 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.175710 (+ 11120us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.352940 (+177230us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:35.352979 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.353047 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.536421 (+1183374us) spinlock_profiling.cc:243] Waited 973 us on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:36.538328 (+  1907us) raft_consensus.cc:1685] finished
0709 13:01:36.538355 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.538534 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279878,"raft.queue_time_us":57727,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":288451,"spinlock_wait_cycles":2237824,"thread_start_us":114237,"threads_started":1,"wal-append.queue_time_us":180430}
W20260709 13:01:36.495548  8576 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.001s
I20260709 13:01:36.536571  8435 rpcz_store.cc:276] 0709 13:01:35.081113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.081224 (+   111us) service_pool.cc:224] Handling call
0709 13:01:35.103781 (+ 22557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.451089 (+347308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.451119 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.495832 (+ 44713us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.537111 (+ 41279us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:35.537166 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.537272 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.534310 (+997038us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:36.535902 (+  1592us) raft_consensus.cc:1685] finished
0709 13:01:36.535922 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.536120 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14800,"raft.queue_time_us":130028,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":9985,"spinlock_wait_cycles":12188544,"thread_start_us":361263,"threads_started":2,"wal-append.queue_time_us":140069}
I20260709 13:01:36.405786 11253 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.376956 11201 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:36.501629 10803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.065s	sys 0.073s
I20260709 13:01:36.548744  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:36.435773 11234 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.542361  8576 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:01:36.549495  8508 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:36.548929  8547 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:36.552707  8473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.010s	sys 0.024s
I20260709 13:01:36.545596  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:36.547989  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:36.553818  8434 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:36.549669  8576 pending_rounds.cc:85] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 7
W20260709 13:01:36.535518  8503 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.853s	user 0.006s	sys 0.002s
I20260709 13:01:36.555533  8576 pending_rounds.cc:107] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:01:36.555893  8576 raft_consensus.cc:2889] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:36.541683 11090 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:36.541474 11243 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.512814 11007 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:01:36.559870  8502 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:36.560787  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 428) took 1702 ms. Trace:
I20260709 13:01:36.566896  8576 rpcz_store.cc:276] 0709 13:01:34.858645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.858803 (+   158us) service_pool.cc:224] Handling call
0709 13:01:34.877624 (+ 18821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.680706 (+803082us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b5400152fa0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b6dc0 00007f1a193411c0 00007f1a19342231 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c
0709 13:01:36.560294 (+879588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.560718 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835241728}
I20260709 13:01:36.529352 11244 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:01:36.530351 11262 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:36.556941 11191 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:36.563894 11068 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:01:36.556752 11144 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:36.544462 11206 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.559684 11090 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:36.556970  8503 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:36.543684 11265 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:01:36.590633  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:36.567859 11134 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:36.627846  8502 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:36.611876 11074 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.629783  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:01:36.681021  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 51343us
I20260709 13:01:36.683211  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:36.627490 11122 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.000s
I20260709 13:01:36.632377  8505 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:36.681444 11009 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:36.684384 11134 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:36.579573 11287 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:01:36.612037 11281 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.572193 11243 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.683867  8576 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
W20260709 13:01:36.698093  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 200916us
I20260709 13:01:36.632483 11290 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.632843 11231 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:36.692763 11232 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.666s	user 0.005s	sys 0.006s
W20260709 13:01:36.704578  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 162661us
I20260709 13:01:36.732748  8475 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:36.734398  8434 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:36.701479 11134 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:36.738898 11134 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.703313 11283 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:36.740720 11283 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:36.733991 11254 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.909s	user 0.002s	sys 0.010s
I20260709 13:01:36.730659 11232 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.718516 11090 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.742551 11254 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:36.743060 11090 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.696676 11074 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:36.737715 11262 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:36.744390 11232 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:36.692951 11122 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.745489 11074 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:36.746591 11122 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:36.748219  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:36.748819  8576 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.749010  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:36.748147  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:36.753505  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:36.753688  8577 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:36.754323 11236 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:36.754724 11236 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:36.755432 11236 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:36.756465 11236 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.718364 11263 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:36.759016  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 127872us
I20260709 13:01:36.761883  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:36.761865  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:36.763281  8430 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:36.750626 11294 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:36.766542  8427 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:36.768020  8576 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:36.766202 11294 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:36.769471  9094 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 3. Ops: []
I20260709 13:01:36.771350  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:36.773257  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:36.701745 11281 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:36.719861 11290 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:36.999210  8501 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:01:36.908070  8504 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:37.001125  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:37.002279  8579 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:36.759153 10803 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.932054  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:37.011533  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:36.941936  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:36.933490  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:36.932497  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:37.016099  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:37.017311  8430 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:37.018205  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:37.020203  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:37.021312  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:37.022442  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:37.024739  8435 raft_consensus.cc:2410] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:01:37.025113  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:37.025868  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:36.827627 11286 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.142s	user 0.000s	sys 0.009s
I20260709 13:01:37.028635  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:37.029986  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:37.030081  9068 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:37.030882  8426 raft_consensus.cc:2368] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:37.033710  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:36.907829  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1691) took 1640 ms. Trace:
I20260709 13:01:36.778276 11222 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.777552 11042 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.036556  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:37.003026 11223 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:36.999501 11237 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:36.933068 11244 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.038283  9068 leader_election.cc:400] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:37.038283  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:37.057003  9068 leader_election.cc:403] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:37.008958 11009 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.008769 11007 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.930908 11265 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:37.017032 11167 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:36.931126 11296 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.037240 11254 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:37.055544  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:37.030679 11215 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:37.028295 11122 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:37.031538 11232 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:37.007928 11294 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:37.065300  9101 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:37.052264 11223 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:37.081568  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:37.035847  8503 rpcz_store.cc:276] 0709 13:01:35.267047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.292991 (+ 25944us) service_pool.cc:224] Handling call
0709 13:01:36.907548 (+1614557us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54000d7ad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:36.907742 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590160768}
I20260709 13:01:37.087884  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:37.089808  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:37.065459 11009 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.062697 11231 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
W20260709 13:01:37.096156  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.077862 11303 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.065407 11265 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:37.081050 11254 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:37.066937 11044 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:37.116135  9101 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:37.117391  8430 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:37.119438  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:37.064980 11297 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:37.120407  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:37.062422 11244 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.120954  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:37.127408  8427 raft_consensus.cc:2376] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4. Re-sending same reply.
I20260709 13:01:37.077673 11293 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:01:37.093441 11232 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:37.065136 11222 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:37.136974  9096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 808) took 2199 ms (client timeout 2233 ms). Trace:
W20260709 13:01:37.137534  9096 rpcz_store.cc:269] 0709 13:01:34.931025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.932634 (+  1609us) service_pool.cc:224] Handling call
0709 13:01:37.129936 (+2197302us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54006121d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:37.130094 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223525760}
I20260709 13:01:37.065384 11167 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:37.132310  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:37.133718  8431 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 2.
I20260709 13:01:37.063228 11007 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.140343  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:37.067376 11296 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.080426 11122 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.143198  9101 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:37.147401 11309 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:37.148051 11309 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:37.148506 11007 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.148597 11290 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:37.064493 11237 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.149013 11309 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.149608  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:37.150632  8427 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:37.118556 11303 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.156332 11237 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.157478  8430 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:37.125872 11120 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:37.127624 11234 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:37.123303 11206 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.163295  9101 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:37.169929 11167 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:37.175522  8577 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:37.177821 11009 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.129206 11297 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.179840 11122 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:37.180522 11297 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.181041  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:37.181756  8577 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
W20260709 13:01:37.183537 11251 consensus_meta.cc:287] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.001s
W20260709 13:01:37.183630 11299 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.177s	user 0.002s	sys 0.000s
I20260709 13:01:37.184983 11265 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:37.186213 11268 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.532s	user 0.000s	sys 0.014s
I20260709 13:01:37.186993 11296 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.187774 11223 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.188664 11120 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:37.237309 11120 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.196659  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:37.242722  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2113) took 1581 ms. Trace:
I20260709 13:01:37.243266  8505 rpcz_store.cc:276] 0709 13:01:35.661486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.861732 (+200246us) service_pool.cc:224] Handling call
0709 13:01:35.881306 (+ 19574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.688341 (+807035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.242418 (+554077us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b540008f7d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:37.242644 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724318464}
I20260709 13:01:37.123088 11254 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.173337 11243 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.154752 11310 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:37.216559 11248 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.704s	user 0.008s	sys 0.021s
W20260709 13:01:37.282862 11305 log.cc:927] Time spent T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:37.228199  9093 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:37.236161 11223 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:37.240731 11294 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.199465  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:37.280165 11248 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.770s	user 0.008s	sys 0.021s
I20260709 13:01:37.289745  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:37.292615  9101 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:37.295029  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:37.296674  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:37.297436  9101 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:37.172968 11281 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:37.214200 11251 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:37.290580 11236 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.000s
I20260709 13:01:37.322577  9098 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:37.327512 11294 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.282087 11310 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.292196 11303 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.336062 11203 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:37.342593 11254 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:37.343365 11298 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.240s	user 0.008s	sys 0.000s
I20260709 13:01:37.343757  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:37.344427  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:37.354084 11281 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:37.354117 11167 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:37.650960  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.352317  9101 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:37.574782  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:37.527904  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49627.8us
I20260709 13:01:38.362280  9095 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:37.726861  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:37.474906  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.363544  8510 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:38.353471  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 822) took 1152 ms. Trace:
W20260709 13:01:38.289280  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.582778  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:38.364523  9067 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.008s	sys 0.002s
I20260709 13:01:37.609143  8508 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:38.365331  9067 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.008s	sys 0.003s
W20260709 13:01:38.353504  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.360206  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 136830us
I20260709 13:01:37.604346  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 1876) took 1039 ms. Trace:
I20260709 13:01:38.367333  8434 rpcz_store.cc:276] 0709 13:01:36.565011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.565129 (+   118us) service_pool.cc:224] Handling call
0709 13:01:37.604111 (+1038982us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400127354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:37.604274 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263186688}
I20260709 13:01:37.361850  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:38.368904  8502 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:38.369362  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 589) took 1008 ms. Trace:
I20260709 13:01:38.369657  8502 rpcz_store.cc:276] 0709 13:01:37.360543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.361577 (+  1034us) service_pool.cc:224] Handling call
0709 13:01:38.369309 (+1007732us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.365657  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 802351us
I20260709 13:01:38.371730 11327 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:38.372344 11327 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.375555  9099 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:01:38.376487  8549 connection.cc:256] RPC call timeout handler was delayed by -1.5108239180000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:01:38.376505  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.364337  9101 rpcz_store.cc:276] 0709 13:01:37.201372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.314433 (+113061us) service_pool.cc:224] Handling call
0709 13:01:38.351873 (+1037440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.353120 (+  1247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.353387 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.378000  9095 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:37.307509 11316 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:38.385628  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.389267  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:38.392861  9101 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:38.393780  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:38.383333  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 828) took 1055 ms. Trace:
W20260709 13:01:37.840032 11274 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 2.185s	user 0.007s	sys 0.007s
W20260709 13:01:38.364672 11223 consensus_meta.cc:287] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.071s	user 0.009s	sys 0.003s
I20260709 13:01:38.379199  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:37.460245 11200 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.400992  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 437) took 1057 ms. Trace:
I20260709 13:01:38.401461 11251 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.401260 11200 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:37.596163 11204 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.402130 11251 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.714221 11040 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:38.402667 11251 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:38.402801 11040 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.403419 11310 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.375231 11281 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.385627  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:38.404712  8507 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:37.634450 11244 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:37.360162  8503 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:38.410187  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1698) took 2850 ms. Trace:
I20260709 13:01:38.410931  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 588) took 1051 ms. Trace:
I20260709 13:01:38.411306  8503 rpcz_store.cc:276] 0709 13:01:37.359537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.359658 (+   121us) service_pool.cc:224] Handling call
0709 13:01:37.359955 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.410654 (+1050699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.410876 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.386709  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:38.412730  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.413033  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.413380  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.413743  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.375651 11203 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:38.414372  8432 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:38.415987 11203 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:38.416544  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 818) took 1648 ms. Trace:
W20260709 13:01:37.644246 11301 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.534s	user 0.001s	sys 0.003s
I20260709 13:01:38.383541 11303 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:38.418401 11303 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.401029 11223 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.420605 11303 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:38.388485  9093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 813) took 1635 ms (client timeout 1589 ms). Trace:
I20260709 13:01:38.389215  9102 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:38.390075  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2112) took 2762 ms. Trace:
I20260709 13:01:38.410683  8501 rpcz_store.cc:276] 0709 13:01:35.559849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.559964 (+   115us) service_pool.cc:224] Handling call
0709 13:01:35.560249 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.001269 (+1441020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.409906 (+1408637us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54003728d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:38.410126 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3308578048}
W20260709 13:01:38.179407 10803 consensus_meta.cc:287] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.157s	user 0.012s	sys 0.001s
I20260709 13:01:37.355907 11243 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 2, Time since last communication: 1.036s
I20260709 13:01:37.934631 11052 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:38.391484  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 809) took 3460 ms. Trace:
I20260709 13:01:38.394948  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:38.391623  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.441525 11052 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.441807 10803 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.442950  9099 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:37.788236 11194 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.443949  9098 rpcz_store.cc:276] 0709 13:01:34.931295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.931400 (+   105us) service_pool.cc:224] Handling call
0709 13:01:34.931637 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.332958 (+2401321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.391276 (+1058318us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b5400500854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:38.391429 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5457710976}
I20260709 13:01:38.446174  8583 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:38.399664  8319 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 09de6eee9632412ebe0a904f65cd2a3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5ffc86752d264d0c81f68028e6413a91 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:38.400094  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:38.446985  8319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47375.6us
I20260709 13:01:38.447479  9101 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:38.376977 11167 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:38.403975 11200 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:38.122641 11221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.010s	sys 0.020s
I20260709 13:01:38.406459 11040 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.457188  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 820) took 1265 ms. Trace:
I20260709 13:01:38.457587  9102 rpcz_store.cc:276] 0709 13:01:37.192000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.193835 (+  1835us) service_pool.cc:224] Handling call
0709 13:01:38.388876 (+1195041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.421903 (+ 33027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.457041 (+ 35138us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540063d3d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:38.457142 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2747570048}
I20260709 13:01:38.414090  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:38.091095 11248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.008s
W20260709 13:01:38.421804  9093 rpcz_store.cc:269] 0709 13:01:36.753092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.753247 (+   155us) service_pool.cc:224] Handling call
0709 13:01:38.388215 (+1634968us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b540063d3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:38.388370 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937657088}
I20260709 13:01:38.422504  8509 rpcz_store.cc:276] 0709 13:01:35.627363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.800448 (+173085us) service_pool.cc:224] Handling call
0709 13:01:35.809373 (+  8925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.477517 (+668144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.389772 (+1912255us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54001fe354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:38.389956 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518795008}
I20260709 13:01:38.414054  8433 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:38.461016  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 576) took 1261 ms. Trace:
I20260709 13:01:38.461418  8433 rpcz_store.cc:276] 0709 13:01:37.199409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.413139 (+1213730us) service_pool.cc:224] Handling call
0709 13:01:38.460960 (+ 47821us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.632297 11222 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.390645 11309 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:38.426434  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:38.463258  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.431274 11254 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.427386  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.429634  8507 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
W20260709 13:01:38.442196  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47322.8us
I20260709 13:01:38.432436  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1852) took 3352 ms. Trace:
I20260709 13:01:38.416913  9096 rpcz_store.cc:276] 0709 13:01:36.767707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.163718 (+396011us) service_pool.cc:224] Handling call
0709 13:01:37.164076 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.167223 (+  3147us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:37.216648 (+ 49425us) log.cc:844] Serialized 14 byte log entry
0709 13:01:37.218404 (+  1756us) log.cc:844] Serialized 14 byte log entry
0709 13:01:37.218602 (+   198us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.219225 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.219411 (+   186us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:37.219636 (+   225us) log.cc:844] Serialized 14 byte log entry
0709 13:01:38.359899 (+1140263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.416205 (+ 56306us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b54005d4154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:38.416326 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.416370 (+    44us) raft_consensus.cc:1685] finished
0709 13:01:38.416384 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.416493 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9696,"prepare.queue_time_us":3508966,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":1140324,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":17650,"spinlock_wait_cycles":6294400,"thread_start_us":43181,"threads_started":2,"wal-append.queue_time_us":105687,"wal-append.run_cpu_time_us":3188,"wal-append.run_wall_time_us":1003196}
I20260709 13:01:38.446555  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.421010 11223 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.395437  9095 rpcz_store.cc:276] 0709 13:01:37.328284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.343470 (+ 15186us) service_pool.cc:224] Handling call
0709 13:01:38.383214 (+1039744us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.394680 11328 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:38.452250  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1710) took 3354 ms. Trace:
W20260709 13:01:38.459403 11248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.004s	sys 0.016s
I20260709 13:01:38.448770 11303 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:38.511968  8428 rpcz_store.cc:276] 0709 13:01:35.097815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.237233 (+139418us) service_pool.cc:224] Handling call
0709 13:01:35.242295 (+  5062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.540081 (+297786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.452054 (+2911973us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400127d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:38.452201 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676427520}
I20260709 13:01:38.513438 11303 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:38.513546  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.514123  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.514761  8428 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:38.514504 11303 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.515383 11068 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.515524  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.516108  8428 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:38.453006  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 826) took 1162 ms. Trace:
I20260709 13:01:38.401458  8575 rpcz_store.cc:276] 0709 13:01:37.343615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.343800 (+   185us) service_pool.cc:224] Handling call
0709 13:01:38.400933 (+1057133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.456405 11052 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.408257  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2108) took 2871 ms. Trace:
I20260709 13:01:38.458269  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.521719  9099 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:38.466398 11057 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.427923  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 561) took 1494 ms. Trace:
W20260709 13:01:38.514423 11307 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.429s	user 0.007s	sys 0.008s
I20260709 13:01:38.465523  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:38.554462  8576 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:38.555258  8432 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:38.555958  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 569) took 1577 ms. Trace:
I20260709 13:01:38.556372  8432 rpcz_store.cc:276] 0709 13:01:36.978300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.554797 (+1576497us) service_pool.cc:224] Handling call
0709 13:01:38.555059 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.555643 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.555890 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.457415 11221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.369s	user 0.010s	sys 0.028s
I20260709 13:01:38.511111  9094 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:38.511489  9093 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:38.404428 11310 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:01:38.514211  8434 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:38.451825 11194 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:38.516855  9101 rpcz_store.cc:276] 0709 13:01:37.290274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.451925 (+1161651us) service_pool.cc:224] Handling call
0709 13:01:38.452311 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.452562 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.452605 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.452670 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:38.452727 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.452799 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.452937 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.519738  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:38.520576  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.463487  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.573202  8433 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:38.468541  8429 rpcz_store.cc:276] 0709 13:01:35.080228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.080343 (+   115us) service_pool.cc:224] Handling call
0709 13:01:35.103436 (+ 23093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.515342 (+411906us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:35.515389 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.515452 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:35.515507 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.432171 (+2916664us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54003a2854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:38.432232 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.432379 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1737,"raft.queue_time_us":2297,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":11414,"spinlock_wait_cycles":942360960}
I20260709 13:01:38.521472  8504 rpcz_store.cc:276] 0709 13:01:35.536567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.537164 (+   597us) service_pool.cc:224] Handling call
0709 13:01:36.907747 (+1370583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.001800 (+ 94053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.408028 (+1406228us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000d7ad0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:38.408190 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3097134976}
I20260709 13:01:38.548269  8430 rpcz_store.cc:276] 0709 13:01:36.933749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.120138 (+186389us) service_pool.cc:224] Handling call
0709 13:01:38.427755 (+1307617us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b54003f0f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:38.427866 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80468864}
I20260709 13:01:38.575416  8433 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:38.575642  8430 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:01:38.576288  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 56630.5us
I20260709 13:01:38.576823  8430 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:38.576969  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:38.576663  8433 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:38.426884 11090 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:38.568440  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 827) took 1267 ms. Trace:
I20260709 13:01:38.580274  8429 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:38.515895 11303 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:38.565891  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 906) took 1143 ms. Trace:
I20260709 13:01:38.566761  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:38.580574  9094 rpcz_store.cc:276] 0709 13:01:37.300748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.459603 (+1158855us) service_pool.cc:224] Handling call
0709 13:01:38.510653 (+ 51050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.565277 (+ 54624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.568367 (+  3090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.583442  9093 rpcz_store.cc:276] 0709 13:01:37.423013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.467829 (+1044816us) service_pool.cc:224] Handling call
0709 13:01:38.511279 (+ 43450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.565596 (+ 54317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.565822 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.515885 11068 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:38.569232 11223 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.517570 11254 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.573378  8577 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:01:38.591078 11325 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.217s	user 0.005s	sys 0.000s
W20260709 13:01:38.592216 11324 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.218s	user 0.005s	sys 0.000s
W20260709 13:01:38.593732 11322 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.206s	user 0.003s	sys 0.003s
I20260709 13:01:38.594388  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 1878) took 1833 ms. Trace:
I20260709 13:01:38.594738 11281 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.594954  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 815) took 1830 ms. Trace:
I20260709 13:01:38.610357  8431 rpcz_store.cc:276] 0709 13:01:36.761169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.761297 (+   128us) service_pool.cc:224] Handling call
0709 13:01:38.594211 (+1832914us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540028ffd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:38.594330 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305087360}
I20260709 13:01:38.565136 11057 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.517675 11309 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.602432 11167 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:38.587212 11215 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.517s	user 0.005s	sys 0.008s
I20260709 13:01:38.574425 11251 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:38.583427 11090 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.549401 11328 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.611964  9100 rpcz_store.cc:276] 0709 13:01:36.764710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.764828 (+   118us) service_pool.cc:224] Handling call
0709 13:01:36.765115 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:36.765459 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:36.765485 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:36.765956 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.850645 (+ 84689us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:36.850700 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.850789 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.513861 (+1663072us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:38.594678 (+ 80817us) raft_consensus.cc:1685] finished
0709 13:01:38.594704 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.594899 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1050,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":1287,"spinlock_wait_cycles":116040960,"thread_start_us":84274,"threads_started":1,"wal-append.queue_time_us":294049}
I20260709 13:01:38.624852 11309 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:38.625388 11309 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:38.634928  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 243541us
W20260709 13:01:38.636075  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59186.5us
I20260709 13:01:38.636746  8431 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:38.637277  8431 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:38.638098 11330 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:38.638011  8431 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.638824 11330 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:38.638901  8431 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.639356 11330 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:38.640213 11330 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.636741  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:38.629192 11327 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.646340  8431 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:01:38.648762  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.649365  9100 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:38.649686  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.625947 11309 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:01:38.648762  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.651873  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.652340  8426 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:38.652388  9100 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:38.653594  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.653702  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.654520  9100 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:38.654920  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.655649  9093 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:38.655727  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.656342  8427 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:38.657218 11281 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.657339 11328 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.654639  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.674605  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:38.676044  8426 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 564) took 1699 ms (client timeout 1992 ms). Trace:
I20260709 13:01:38.674809  9102 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:01:38.676457  8426 rpcz_store.cc:269] 0709 13:01:36.976717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.038057 (+ 61340us) service_pool.cc:224] Handling call
0709 13:01:38.675899 (+1637842us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400290ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:38.675992 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3590399872}
W20260709 13:01:38.698458  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45227.6us
I20260709 13:01:38.698809  8475 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:38.700758  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:38.705485  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:38.706204  8507 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:38.657701 11281 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.719066  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:38.721688 11317 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.350s	user 0.008s	sys 0.002s
I20260709 13:01:38.729241  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:38.726322  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:38.705649 11194 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:38.739809  8504 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:38.704939 11294 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:38.704775 11282 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.689312 11052 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:01:38.719015 11328 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.752830  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:38.722915 11327 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:38.760933  8502 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:38.724599 11215 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:38.763001  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:38.681002 11040 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:01:38.755916  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.756558  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.765918  8430 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:38.767102  8431 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:38.756722  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.759241  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:38.728410 11209 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.724498 11203 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:38.758155  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:38.730611 11283 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:38.775269  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:38.769676  8426 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:38.777155 11057 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:38.778770  8460 heartbeater.cc:646] Failed to heartbeat to 127.7.41.254:45431 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.41.254:45431 timed out after 15.000s (SENT)
I20260709 13:01:38.775534 11204 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.772671 11254 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:38.764149 11309 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:38.760509 11068 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:38.742513 11223 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.783533 11309 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:38.783725 11223 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.784468 11309 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.770581  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:38.719103 11329 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:01:38.786748 11334 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:38.787531 11334 consensus_queue.cc:1243] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:38.722347 11222 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:01:38.774704  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.763096 11294 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:38.769721  8509 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:38.775401 11283 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:38.771793 11306 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.657s	user 0.005s	sys 0.010s
W20260709 13:01:38.792091  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.795243  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:38.796519  8504 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:38.761283 11282 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.765165 11328 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.789804 11294 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.769043 11327 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:38.844229  8475 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 1.964s (SENT) [suppressed 31 similar messages]
I20260709 13:01:38.845059 11333 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:38.845804 11333 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.849141  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.849918  9102 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:38.852011 11254 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.852418  9093 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:38.852689 11254 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.856539 11336 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.857178 11336 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:38.837759 11068 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:38.859282 11068 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.859721 11068 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:38.864051 11281 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.867228  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:38.823917  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:38.868639  8504 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:38.775143 11203 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:38.871914 11203 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.797133 11223 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:38.883685  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:38.884114  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.892391 11340 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:01:38.895565  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.792572 11057 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:38.795509 11283 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:38.791879 11332 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:01:38.772966 11215 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:38.931732  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:38.947579  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.961277  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.971720  9102 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: [3.6-4.7]
W20260709 13:01:38.974627  8549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.011s	sys 0.022s
W20260709 13:01:38.975039  8549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.011s	sys 0.022s
W20260709 13:01:38.975545  8549 connection.cc:256] RPC call timeout handler was delayed by -1.14854456300003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:01:38.975688 11337 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.976440 11337 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:38.978730  8474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.004s	sys 0.010s
W20260709 13:01:38.979233  8474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.005s	sys 0.011s
W20260709 13:01:38.980705  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.981825  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.974888  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 211952us
I20260709 13:01:38.988770  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:38.987840  9065 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:38.991466  9102 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: [4.5-5.6]
I20260709 13:01:38.910665 11332 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:38.902132 11057 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:38.992506  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 568) took 2014 ms. Trace:
W20260709 13:01:38.996704  8505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.017s
W20260709 13:01:38.997335  8505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.000s	sys 0.018s
W20260709 13:01:38.975939  8549 connection.cc:256] RPC call timeout handler was delayed by -1.1341445630000635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:01:39.000355  8578 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:39.002185  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:39.002811  8578 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:38.979830 11316 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.003s	sys 0.012s
I20260709 13:01:39.004317  8579 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:38.994827  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:39.005461  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.007519  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:39.007819  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:39.011961  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 571) took 2033 ms. Trace:
I20260709 13:01:39.014380  8432 rpcz_store.cc:276] 0709 13:01:36.978904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.557289 (+1578385us) service_pool.cc:224] Handling call
0709 13:01:38.557653 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.557898 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.557935 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.564830 (+  6895us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.796794 (+231964us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:39.004847 (+208053us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.011606 (+  6759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.011689 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.011735 (+    46us) raft_consensus.cc:1685] finished
0709 13:01:39.011755 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.011904 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28077,"prepare.queue_time_us":89853,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":329355,"threads_started":2,"wal-append.queue_time_us":244134}
W20260709 13:01:39.011130  9068 connection.cc:256] RPC call timeout handler was delayed by -1.618907274000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 13:01:39.016232  9068 connection.cc:256] RPC call timeout handler was delayed by -1.5712072740000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 13:01:39.011674  8508 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:39.009380  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:39.017925  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.011134  8582 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:39.021013  8579 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:39.021836  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:39.022317  9102 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:39.026283  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.026964  8580 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:01:39.002879 11275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.862s	user 0.001s	sys 0.015s
I20260709 13:01:39.034739  8506 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:39.035588  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 291033us
I20260709 13:01:39.044425  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.050251  8582 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
W20260709 13:01:39.050875  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.996543 11309 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:39.056310  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.064524  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:39.065315  8432 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:39.060715 11068 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:39.018306 11120 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:39.069535  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:39.010358 11316 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.003s	sys 0.012s
I20260709 13:01:38.994522 11332 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:39.017969 11351 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.069729  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.082960  8584 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:39.009660 11040 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.076678  9102 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:01:39.049523 11275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.918s	user 0.001s	sys 0.015s
I20260709 13:01:39.092271  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:39.073654 11340 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:39.094215  8583 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:39.096349  8506 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:39.068647  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:39.075289 11316 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:39.102079  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 435872us
I20260709 13:01:39.166532  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:39.103230  9102 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:01:39.091697 11338 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:39.078912 11223 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.151539  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.172694  8583 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:39.152148  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.076205 11120 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:39.153452  8476 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:39.153688  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 158934us
I20260709 13:01:39.173702  8584 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:39.086364 11328 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:39.088800 11254 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:39.161546  9093 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:39.098862 11027 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.026298 11335 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:01:39.109556 11333 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:39.209277  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.296691  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.159191 11327 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:39.093598 11040 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:39.174176  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:39.276441  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.160014 11336 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:39.174589  8575 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:39.319097 11362 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:39.320140  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.320349  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.320817  8575 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:39.321257  9094 raft_consensus.cc:2410] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:39.322067  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.321727  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.088202 11351 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:39.295334  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 286004us
I20260709 13:01:39.336393  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:39.305918  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.337368  8584 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:39.338302  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.339489  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:39.307353  8504 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:39.309821  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.315842 11337 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:39.091944 11057 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:39.316741 11369 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:39.317394 11068 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:39.318338 11363 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:39.318972 11347 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:39.323933  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.325222  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.325997  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.327181  9101 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:39.327922  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.340871  8583 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:39.422964  9065 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:39.425577  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.426450  8583 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:39.427484  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.342586  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.342962  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.343256  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.429486  9095 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:39.343848  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.322492 11335 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:39.347339  8508 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:39.432807  8578 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:39.323868 11353 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.215s	user 0.009s	sys 0.000s
W20260709 13:01:39.398563  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 62273.3us
W20260709 13:01:39.399713  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.317649 11283 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:39.437934  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.440081  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:39.335538 11358 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.177s	user 0.001s	sys 0.009s
I20260709 13:01:39.407013  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.440512  9100 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:39.405771  8435 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:39.277854 11350 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:39.308010 11254 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:39.407932  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 240214us
W20260709 13:01:39.406129  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 232049us
I20260709 13:01:39.345439 11215 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:39.276324 11223 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:39.166524 11332 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:39.305382 11027 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:39.349354 11369 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.430562  9096 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
W20260709 13:01:39.358876  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.476075  8507 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:39.398272 11275 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:01:39.437412  9101 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:39.442585  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 587) took 2083 ms. Trace:
I20260709 13:01:39.409471 11328 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:01:39.444294  9094 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:39.444792  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.445619  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.506255  8578 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:39.445932  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.438691  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:39.418653 11309 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:39.439433 11336 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:39.441525 11252 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.411517 11209 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:01:39.441074  9099 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:39.432644 11335 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:39.505839 11360 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:01:39.527572  9093 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:39.508976  9095 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:39.507143  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.507393  8505 rpcz_store.cc:276] 0709 13:01:37.359255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.430788 (+ 71533us) service_pool.cc:224] Handling call
0709 13:01:38.411024 (+980236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.411372 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.411401 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.411893 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.997945 (+586052us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:38.998001 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.998120 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.317155 (+319035us) raft_consensus.cc:1685] finished
0709 13:01:39.317178 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.432552 (+115374us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54003728d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:39.442521 (+  9969us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5304,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"spinlock_wait_cycles":2253319040,"thread_start_us":585577,"threads_started":1,"wal-append.queue_time_us":746814}
I20260709 13:01:39.529495  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.529623  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:39.530462  8505 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:39.530561  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.531316  8578 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:39.510555  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:39.513235  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.473147 11215 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.424443 11303 consensus_queue.cc:1059] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:01:39.519119  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:39.533458  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 61259.6us
I20260709 13:01:39.534178  8583 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
W20260709 13:01:39.534981  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 111981us
I20260709 13:01:39.535068  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:39.468801 11347 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:39.521160  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 173605us
I20260709 13:01:39.531643  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:39.439267 11316 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:39.518071 11363 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:39.525907 11252 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:39.479449 11369 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:39.523885 11328 consensus_queue.cc:1243] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:39.523571 11332 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:39.545598  9068 connection.cc:256] RPC call timeout handler was delayed by -1.4668072740000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 13:01:39.595208  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 60653.8us
I20260709 13:01:39.543164  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:39.563977  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:39.468780 11350 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:39.691730  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.693266  8505 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:39.706166  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:39.539986 11336 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:39.537757 11309 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:39.562415 11370 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.473417 11254 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:39.540145 11215 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:39.951700  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 413901us
W20260709 13:01:39.997402  8508 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.002s
W20260709 13:01:39.813489  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.768429  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:39.748257  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55587us
I20260709 13:01:39.715240 11040 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:40.028718  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.708178 11360 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:01:39.540380 11376 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.691586 11371 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:40.033921 11309 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:39.995585 11303 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:40.040186 11376 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.040906 11303 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:39.747972 11368 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.294s
I20260709 13:01:40.034433 11283 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:39.644938 11120 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.031311  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:39.692752 11344 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.398s	user 0.001s	sys 0.000s
I20260709 13:01:40.034410  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.010092 11387 raft_consensus.cc:3055] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:39.813892 11383 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:39.952484  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.506718 11341 consensus_queue.cc:1175] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0b9f7467deed4381835a85ffd0e88af6" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:01:39.849896 11349 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:01:39.907719 11355 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 13:01:39.893949 11209 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:39.732355 11364 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:39.856769 11380 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.748986  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:40.010202 11377 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:39.747788 11363 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:40.028390  8508 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:40.026597 11378 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.042687  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 825) took 2752 ms. Trace:
I20260709 13:01:40.061735  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:39.748451 11333 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.076205 11333 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.077068 11350 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:40.048240 11383 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.077694 11383 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:40.078667 11361 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.079245 11361 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.079949  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1773) took 1083 ms. Trace:
I20260709 13:01:40.080361  8576 rpcz_store.cc:276] 0709 13:01:38.996850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.996978 (+   128us) service_pool.cc:224] Handling call
0709 13:01:39.008522 (+ 11544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.106256 (+ 97734us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:39.306635 (+200379us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.050786 (+744151us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.059358 (+  8572us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.059614 (+   256us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:40.059650 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.059740 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.079746 (+ 20006us) raft_consensus.cc:1685] finished
0709 13:01:40.079767 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.079890 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122903,"prepare.queue_time_us":326486,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":641512,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":259,"thread_start_us":741713,"threads_started":4,"wal-append.queue_time_us":662674}
I20260709 13:01:40.083170 11275 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:40.083624 11275 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:40.084002 11275 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.082012 11333 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:40.086488 11375 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 13:01:40.033859 11370 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.045728  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:40.086995 11215 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.042672 11376 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:40.075008 11223 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.070935  9097 rpcz_store.cc:276] 0709 13:01:37.289878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.354608 (+ 64730us) service_pool.cc:224] Handling call
0709 13:01:37.355024 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:38.746567 (+1391543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.746639 (+    72us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:38.748229 (+  1590us) log.cc:844] Serialized 52 byte log entry
0709 13:01:39.019565 (+271336us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:39.425290 (+405725us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.593787 (+168497us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.042328 (+448541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.042423 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.042473 (+    50us) raft_consensus.cc:1685] finished
0709 13:01:40.042486 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.042619 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1077296,"prepare.queue_time_us":457007,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":111,"raft.queue_time_us":1249892,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":28898944,"thread_start_us":1537301,"threads_started":5,"wal-append.queue_time_us":405620}
I20260709 13:01:40.075599 11393 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:40.086133 11389 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.564664 11347 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.085906  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1774) took 1088 ms. Trace:
I20260709 13:01:40.073032  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.042507 11233 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:40.058972 11209 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:40.096392  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.129776  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 380834us
I20260709 13:01:40.131860  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2124) took 1034 ms. Trace:
I20260709 13:01:40.132376  8505 rpcz_store.cc:276] 0709 13:01:39.097756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.072735 (+974979us) service_pool.cc:224] Handling call
0709 13:01:40.131772 (+ 59037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.132527  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:40.133669  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.134333  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:40.117710  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:40.137075  8549 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:40.042017 11309 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:40.063491 11377 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.140187  8576 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:40.059152 11364 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:40.066808 11380 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.156131  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1715) took 1359 ms. Trace:
I20260709 13:01:40.126092 11392 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:39.979465 11336 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.042156 11303 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.152456 11377 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:40.160213 11370 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:40.161476 11380 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:39.716763 11335 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:40.163093 11335 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:40.164386 11401 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:40.142594 11203 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.266s	user 0.013s	sys 0.003s
I20260709 13:01:40.166142  9068 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:40.149070  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:40.170991  8505 raft_consensus.cc:2376] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6. Re-sending same reply.
I20260709 13:01:40.171587  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1721) took 1095 ms. Trace:
I20260709 13:01:40.151552  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:40.095677 11223 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.180294  8549 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:40.045394 11387 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:40.171972  8505 rpcz_store.cc:276] 0709 13:01:39.076325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.148808 (+1072483us) service_pool.cc:224] Handling call
0709 13:01:40.171513 (+ 22705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.183401 11387 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.184127  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:40.184568 11387 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.185261  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1722) took 1086 ms. Trace:
I20260709 13:01:40.193722 11254 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:40.195231 11396 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:40.130317 11389 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.061180 11379 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:01:40.153507 11398 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:40.198201 11389 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.198486 11398 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.095764 11378 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.198959 11398 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.200784 11378 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:40.178954 11309 raft_consensus.cc:2764] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:40.127552  8577 rpcz_store.cc:276] 0709 13:01:38.997168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.018101 (+ 20933us) service_pool.cc:224] Handling call
0709 13:01:39.088265 (+ 70164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.311705 (+223440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.323794 (+ 12089us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.443213 (+119419us) log.cc:844] Serialized 26 byte log entry
0709 13:01:39.642722 (+199509us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:39.642804 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.642915 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.085679 (+442764us) raft_consensus.cc:1685] finished
0709 13:01:40.085696 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.085843 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4756,"raft.queue_time_us":247725,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4673,"thread_start_us":232425,"threads_started":2,"wal-append.queue_time_us":524477}
I20260709 13:01:40.192121  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:40.185748  8505 rpcz_store.cc:276] 0709 13:01:39.098476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.183787 (+1085311us) service_pool.cc:224] Handling call
0709 13:01:40.185169 (+  1382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.207010  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:40.181145  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 137535us
I20260709 13:01:40.156657  8509 rpcz_store.cc:276] 0709 13:01:38.796407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.796527 (+   120us) service_pool.cc:224] Handling call
0709 13:01:38.821420 (+ 24893us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.821882 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.821925 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.822538 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.978275 (+155737us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:38.978329 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.978413 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.155908 (+1177495us) raft_consensus.cc:1685] finished
0709 13:01:40.155932 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.156073 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4494,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":9774,"thread_start_us":155367,"threads_started":1,"wal-append.queue_time_us":591004}
I20260709 13:01:40.155031 11350 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:40.217397  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:40.217734 11350 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:40.218840 11350 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.157050 11364 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.217412  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:40.214324  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.215735  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:40.227797  9101 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:40.177184 11392 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:40.204243 11209 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.191324 11223 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:40.209146 11068 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:40.201807 11383 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.210000 11251 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:40.172840 11203 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.238340  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:40.172477 11401 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:40.154842  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 611691us
I20260709 13:01:40.245066  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:38.997058  8428 rpcz_store.cc:276] 0709 13:01:36.977975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.516660 (+1538685us) service_pool.cc:224] Handling call
0709 13:01:38.548023 (+ 31363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.548410 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.548437 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.571822 (+ 23385us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.791637 (+219815us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:38.991325 (+199688us) log.cc:844] Serialized 14 byte log entry
0709 13:01:38.992198 (+   873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.992281 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.992323 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:38.992335 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.992453 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1192,"prepare.queue_time_us":94764,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":5549,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":15138,"thread_start_us":367548,"threads_started":2,"wal-append.queue_time_us":244824}
W20260709 13:01:40.493075  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.261451  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.244930  9097 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:40.241066  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0811611720000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 13:01:40.258287  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 1.1048e+06us
I20260709 13:01:40.412972  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2128) took 1249 ms. Trace:
I20260709 13:01:40.561861  8505 rpcz_store.cc:276] 0709 13:01:39.163042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.206660 (+1043618us) service_pool.cc:224] Handling call
0709 13:01:40.412874 (+206214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:40.544735  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 321104us
I20260709 13:01:40.353500  8575 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:40.241667  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:40.558840  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:40.244021  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1723) took 1091 ms. Trace:
I20260709 13:01:40.567104  9099 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:40.567487  8509 rpcz_store.cc:276] 0709 13:01:39.153049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.217120 (+1064071us) service_pool.cc:224] Handling call
0709 13:01:40.243958 (+ 26838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.480335  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:40.329190  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1707) took 1610 ms. Trace:
I20260709 13:01:40.333485  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:40.232340 11381 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:40.585299  8476 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:40.563267  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.619042 11233 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:40.569181 11398 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.622438 11233 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:40.623556 11233 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.624140  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 448) took 1086 ms. Trace:
I20260709 13:01:40.624799  8576 rpcz_store.cc:276] 0709 13:01:39.538146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.123417 (+585271us) service_pool.cc:224] Handling call
0709 13:01:40.623851 (+500434us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b54000663d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:40.624053 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10264960}
I20260709 13:01:40.625901 11398 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.626165 11090 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:40.626928 11398 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:40.627403 11398 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.627879 11398 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:40.568992 11283 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:40.235450 11275 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.629956  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1787) took 1596 ms. Trace:
I20260709 13:01:40.637074 11351 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:40.613912  8579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1794) took 1567 ms (client timeout 1634 ms). Trace:
I20260709 13:01:40.573442  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2017) took 1525 ms. Trace:
W20260709 13:01:40.570207  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 404135us
I20260709 13:01:40.240310  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1709) took 1515 ms. Trace:
W20260709 13:01:40.233155 11332 consensus_meta.cc:287] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
I20260709 13:01:40.637894  8576 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:01:40.637075  8580 rpcz_store.cc:276] 0709 13:01:39.033437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.042163 (+  8726us) service_pool.cc:224] Handling call
0709 13:01:39.042638 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.160278 (+117640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.160320 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.166616 (+  6296us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.629089 (+1462473us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b18003abac0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1
0709 13:01:40.629321 (+   232us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:40.629378 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.629500 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.629565 (+    65us) raft_consensus.cc:1685] finished
0709 13:01:40.629605 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.629879 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20043,"raft.queue_time_us":280012,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":12599,"spinlock_wait_cycles":80918272,"thread_start_us":165784,"threads_started":2,"wal-append.queue_time_us":329573}
W20260709 13:01:40.640981  8579 rpcz_store.cc:269] 0709 13:01:39.046756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.071766 (+ 25010us) service_pool.cc:224] Handling call
0709 13:01:40.333310 (+1261544us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:40.613851 (+280541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8545024}
W20260709 13:01:40.236660 11369 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.000s
I20260709 13:01:40.231706 11379 consensus_queue.cc:1243] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:40.236363 11209 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:40.238152 11347 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:40.238390 11223 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:40.310220 11329 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:40.643041  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:40.372812 11203 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.384931 11282 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.304275 11389 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.242755 11251 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.695827 11251 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:40.695484 11389 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.696766 11337 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:40.697160 11337 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:40.240388 11383 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:40.323526 11387 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.697993 11337 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.699168 11387 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.699899 11337 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:40.304114 11221 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:40.702390 11221 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.698750 11389 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.674268 11336 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:40.702817 11221 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:40.703084 11336 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.684629  9097 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:40.236922 11068 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.704063 11068 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:40.705732 11252 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.233515 11361 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:40.703467 11336 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:40.708942 11057 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:40.242403 11204 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:40.713712 11400 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:40.714164 11400 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:40.715013 11400 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.716224 11400 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:40.716913 11068 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.717427 11336 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.720000 11068 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.234238 11392 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.560453 11396 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.636534 11356 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:40.735725 11356 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:40.737610 11366 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.328s	user 0.004s	sys 0.010s
I20260709 13:01:40.739396 11336 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.637425 11275 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:40.304760 11335 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.378s
I20260709 13:01:40.630276 11364 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:40.701821 11387 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.634678 11283 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.569892 11316 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.690325 11329 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:40.730007 11347 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:40.231873 11391 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.464s
I20260709 13:01:40.681772 11369 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:40.648085 11381 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.504761 11377 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:40.753968 11398 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:40.754619 11401 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.756377 11398 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:40.745122 11396 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:40.783823  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.613094  8507 rpcz_store.cc:276] 0709 13:01:38.718755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.719244 (+   489us) service_pool.cc:224] Handling call
0709 13:01:38.729711 (+ 10467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.476489 (+746778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.328880 (+852391us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54001fd954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:40.329109 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716027776}
I20260709 13:01:40.349259  8503 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:40.796819  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:40.798699  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 213427us
I20260709 13:01:40.799420  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:40.800133  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:40.801643  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.641628  8575 rpcz_store.cc:276] 0709 13:01:39.047564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.352762 (+1305198us) service_pool.cc:224] Handling call
0709 13:01:40.353204 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.573082 (+219878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.573366 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.668982  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2019) took 1620 ms. Trace:
W20260709 13:01:40.803943  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 323582us
I20260709 13:01:40.646301  8501 rpcz_store.cc:276] 0709 13:01:38.725326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.725498 (+   172us) service_pool.cc:224] Handling call
0709 13:01:38.725755 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.725966 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:38.980568 (+254602us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.089852 (+109284us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.239815 (+1149963us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b180036f5e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:01:40.239971 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.240022 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:40.240076 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.240142 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.240253 (+   111us) inbound_call.cc:177] Queueing success response
0709 13:01:40.620796 (+380543us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b180036f5e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
Metrics: {"mutex_wait_us":7996,"prepare.queue_time_us":277003,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":5101,"raft.queue_time_us":1151428,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":185,"spinlock_wait_cycles":22811264,"thread_start_us":358746,"threads_started":2,"wal-append.queue_time_us":189900}
I20260709 13:01:40.804405  8576 rpcz_store.cc:276] 0709 13:01:39.053163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.637258 (+1584095us) service_pool.cc:224] Handling call
0709 13:01:40.637655 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.668560 (+ 30905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.668901 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.646476  8505 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:40.807858  8580 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: [5.6-7.7]
W20260709 13:01:40.808319  8547 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.016s	sys 0.044s
I20260709 13:01:40.808768  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2021) took 1752 ms. Trace:
I20260709 13:01:40.809254  8580 rpcz_store.cc:276] 0709 13:01:39.057242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.806454 (+1749212us) service_pool.cc:224] Handling call
0709 13:01:40.807183 (+   729us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:40.808419 (+  1236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.808676 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:40.808779  8547 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.016s	sys 0.044s
W20260709 13:01:40.810858  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 720358us
I20260709 13:01:40.811419  8580 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:40.812764  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2022) took 1754 ms. Trace:
I20260709 13:01:40.813084  8580 rpcz_store.cc:276] 0709 13:01:39.059621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.810299 (+1750678us) service_pool.cc:224] Handling call
0709 13:01:40.810868 (+   569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.812516 (+  1648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.812716 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:40.809366  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 250492us
I20260709 13:01:40.814177  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:40.807883  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.815011  8580 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:40.815698  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.816447  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:40.817353  8580 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 3.
I20260709 13:01:40.805665  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.801934  8476 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:40.820097  8550 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:40.829108  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:40.798743  8507 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:01:40.691126  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48202.9us
I20260709 13:01:40.831138  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.831172  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:40.832938  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.816527  8505 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:40.842811  8507 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:40.843114  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:40.843405  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.843971  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:40.845551  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.846000  9065 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:40.847055  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:40.847618  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:40.848353  8507 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:01:40.849556  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:40.837144  9068 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.939s (SENT)
I20260709 13:01:40.839421  9095 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:40.845258  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:40.841996  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:40.743324 11294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.420s	user 0.022s	sys 0.048s
W20260709 13:01:40.870240 11294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.558s	user 0.022s	sys 0.049s
I20260709 13:01:40.870512 11336 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:40.871093 11336 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:40.871522 11336 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:40.871390  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:40.872953 11275 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:40.873415 11275 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.851231  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:40.879685 11350 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:40.879974  8510 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:40.238247 11363 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.873828 11275 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.881079 11332 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:40.882339 11332 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.883908 11040 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:40.884338 11040 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.884720 11040 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:40.880195 11309 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:40.874822  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:40.748659 11347 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:40.630389 11194 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
W20260709 13:01:40.954818  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 105126us
I20260709 13:01:41.011727 11316 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:41.013494 11283 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:41.014412 11040 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:41.015607 11396 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:41.017606 11040 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:40.880311 11350 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.961532  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:40.922717  8578 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:41.020409  8505 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:41.024691  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 222977us
I20260709 13:01:40.997488 11309 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.919811 11052 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:40.920979 11120 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:40.747385 11329 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:40.926715 11398 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:41.024041 11350 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.036880 11215 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:41.042562  8501 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:40.711920 11204 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:41.032039 11120 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.032320 11052 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.030437 11309 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.052589 11052 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.053050  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2117) took 2027 ms. Trace:
I20260709 13:01:40.996870 11221 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:40.920559 11167 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.194s
I20260709 13:01:41.134435  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:41.935501  8509 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:41.935738  8582 raft_consensus.cc:2368] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
W20260709 13:01:41.936337  8582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2018) took 2888 ms (client timeout 1656 ms). Trace:
I20260709 13:01:41.937119 11204 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:41.937078  8582 rpcz_store.cc:269] 0709 13:01:39.047838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.050838 (+  3000us) service_pool.cc:224] Handling call
0709 13:01:41.134037 (+2083199us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:41.936181 (+802144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41430400}
W20260709 13:01:41.145831  9094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 787) took 1824 ms (client timeout 1672 ms). Trace:
I20260709 13:01:41.157903 11027 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:41.197598  8330 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:41.198535  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:41.144470  9093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 778) took 1825 ms (client timeout 1503 ms). Trace:
I20260709 13:01:41.183136 11371 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:41.331787  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 277574us
W20260709 13:01:41.115238  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 153927us
W20260709 13:01:41.119290  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.420682  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.934693  8501 rpcz_store.cc:276] 0709 13:01:39.022112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.918431 (+1896319us) service_pool.cc:224] Handling call
0709 13:01:41.031952 (+113521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.048317 (+ 16365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.048528 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:41.134215  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.179184  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 113409us
I20260709 13:01:41.333184  8505 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:41.137270  9101 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:01:41.419883  8506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1702) took 5792 ms (client timeout 2360 ms). Trace:
W20260709 13:01:42.000676  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.932322  9097 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:39.901901  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:41.132908  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:41.975802  9094 rpcz_store.cc:269] 0709 13:01:39.321070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.321819 (+   749us) service_pool.cc:224] Handling call
0709 13:01:41.145255 (+1823436us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54005f3a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:41.145581 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279278336}
I20260709 13:01:42.004240  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 610) took 1173 ms. Trace:
I20260709 13:01:41.333185 11369 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:41.051301 11120 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.639250 11347 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.094187 11364 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:41.518546 11275 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.007s
I20260709 13:01:41.195865  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:41.147629  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:41.050858 11316 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:41.118230 11330 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:41.276062 11402 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.028807  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 924) took 1188 ms. Trace:
I20260709 13:01:41.137245  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:41.987778 11371 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:41.598429 11336 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.718s	user 0.000s	sys 0.014s
I20260709 13:01:42.028038  8505 rpcz_store.cc:276] 0709 13:01:40.817489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.844937 (+ 27448us) service_pool.cc:224] Handling call
0709 13:01:41.991009 (+1146072us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:41.999684  8506 rpcz_store.cc:269] 0709 13:01:35.627800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.681258 (+ 53458us) service_pool.cc:224] Handling call
0709 13:01:41.419365 (+5738107us) spinlock_profiling.cc:243] Waited 3.35 s on lock 0x7b54003c8054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:41.419598 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7710053632}
I20260709 13:01:41.606530 11283 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:41.988210  9093 rpcz_store.cc:269] 0709 13:01:39.318324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.325730 (+  7406us) service_pool.cc:224] Handling call
0709 13:01:41.143870 (+1818140us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b5400625054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:41.144152 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221228800}
W20260709 13:01:41.095404  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 807061us
I20260709 13:01:41.051514 11215 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.038095  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:42.053900  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:42.054512 11215 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.054929 11402 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.057518 11402 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.041260 11330 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.058411 11330 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:42.061057 11350 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.871s	user 0.003s	sys 0.009s
I20260709 13:01:42.059535  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 457) took 1216 ms. Trace:
I20260709 13:01:42.046130 11422 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:42.062783 11283 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:41.158963 11398 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:42.065229 11283 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.064872 11398 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.052232 11363 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.053279  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:42.045941 11027 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:42.061537 11350 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:42.062345 11329 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.884s	user 0.007s	sys 0.007s
I20260709 13:01:42.042575  9097 rpcz_store.cc:276] 0709 13:01:40.825623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.123402 (+297779us) service_pool.cc:224] Handling call
0709 13:01:41.931827 (+808425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.003483 (+ 71656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.013918 (+ 10435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.038007 11275 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:41.176929 11251 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.067843  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:42.068579  9100 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:42.066442  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 926) took 1240 ms. Trace:
I20260709 13:01:42.058449 11336 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.066442  8583 rpcz_store.cc:276] 0709 13:01:40.834167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.136695 (+302528us) service_pool.cc:224] Handling call
0709 13:01:42.050676 (+913981us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:42.072441  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.22086e+06us
W20260709 13:01:42.073921 11400 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.217s	user 0.010s	sys 0.008s
I20260709 13:01:42.074265 11221 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.077877  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:42.080528  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.083704  9095 rpcz_store.cc:276] 0709 13:01:40.826517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.995214 (+168697us) service_pool.cc:224] Handling call
0709 13:01:41.195680 (+200466us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:42.066378 (+870698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18134272}
I20260709 13:01:42.087286  8501 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:42.094095  9096 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:42.095552 11275 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.096105 11350 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.082437 11329 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.102665 11329 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:42.104871  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.081584 11316 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:01:42.075621 11402 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.104667  8581 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:42.115875 11426 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:42.116680 11426 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.119549 11251 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.120240 11421 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.120994 11421 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.122157 11204 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:42.123437 11421 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.124809  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:42.127842  9098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.001s	sys 0.025s
W20260709 13:01:42.128548  9098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.001s	sys 0.026s
I20260709 13:01:42.126111  8506 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 3.
I20260709 13:01:42.132934  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:42.128197  8581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1786) took 3086 ms (client timeout 2188 ms). Trace:
I20260709 13:01:42.138188  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:42.138324  8476 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:42.139334  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:42.141507 11283 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:42.136271  8581 rpcz_store.cc:269] 0709 13:01:39.025485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.025639 (+   154us) service_pool.cc:224] Handling call
0709 13:01:41.132407 (+2106768us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:42.111693 (+979286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5444864}
I20260709 13:01:42.136902  8582 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.142295 11422 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.147270 11426 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.147333 11283 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:42.147979 11283 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:42.148414 11283 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.150485  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 455) took 1330 ms. Trace:
I20260709 13:01:42.151566  8583 rpcz_store.cc:276] 0709 13:01:40.813937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.085982 (+1272045us) service_pool.cc:224] Handling call
0709 13:01:42.144050 (+ 58068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.142366 11027 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:42.152714 11027 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.153110 11027 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.136411 11251 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.135994 11275 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.170714  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.129345 11363 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:42.173579  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.174697  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 456) took 1337 ms. Trace:
I20260709 13:01:42.163159 11421 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.175964  8583 rpcz_store.cc:276] 0709 13:01:40.833771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.155782 (+1322011us) service_pool.cc:224] Handling call
0709 13:01:42.171337 (+ 15555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.145342 11402 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.144548 11329 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:42.178490  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:42.179077  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.168538 11275 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.179512  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2119) took 3103 ms. Trace:
I20260709 13:01:42.183832 11381 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.190642  8505 rpcz_store.cc:276] 0709 13:01:39.074136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.143110 (+3068974us) service_pool.cc:224] Handling call
0709 13:01:42.165081 (+ 21971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.170393 (+  5312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.170411 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.177442 (+  7031us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:42.177489 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.177547 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.177656 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:42.193406  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.195269  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 451) took 1382 ms. Trace:
I20260709 13:01:42.195708  8581 rpcz_store.cc:276] 0709 13:01:40.812678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.156554 (+1343876us) service_pool.cc:224] Handling call
0709 13:01:42.195205 (+ 38651us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:42.197319  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.199326  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 60104.6us
I20260709 13:01:42.192135 11275 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:42.217499  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 163703us
W20260709 13:01:42.219388  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 224462us
W20260709 13:01:42.220121  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.220330  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.208449 11363 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.194085 11251 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.195473 11421 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:42.239852  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.236477 11027 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.233945 11120 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:42.255336 11381 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.256211 11120 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.255995 11381 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.268069  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 449) took 1456 ms. Trace:
I20260709 13:01:42.268649  8580 rpcz_store.cc:276] 0709 13:01:40.811894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.817975 (+  6081us) service_pool.cc:224] Handling call
0709 13:01:42.267820 (+1449845us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400348d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.267985 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2789912832}
I20260709 13:01:42.270298  8580 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:42.270462  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 920) took 1446 ms. Trace:
I20260709 13:01:42.270955  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2024) took 3207 ms. Trace:
I20260709 13:01:42.270903  9101 rpcz_store.cc:276] 0709 13:01:40.823898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.850240 (+ 26342us) service_pool.cc:224] Handling call
0709 13:01:40.863423 (+ 13183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.994910 (+1131487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.270170 (+275260us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400208354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:42.270375 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628420992}
I20260709 13:01:42.271422  8580 rpcz_store.cc:276] 0709 13:01:39.064194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.269554 (+3205360us) service_pool.cc:224] Handling call
0709 13:01:42.269979 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.270700 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.270875 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.272378 11363 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:42.274415  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2025) took 3208 ms. Trace:
W20260709 13:01:42.276228  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 127811us
I20260709 13:01:42.237959 11052 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:42.274811  9065 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:42.274986  8580 rpcz_store.cc:276] 0709 13:01:39.066858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.272557 (+3205699us) service_pool.cc:224] Handling call
0709 13:01:42.273108 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.273622 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.273661 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.273729 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:42.273791 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.273863 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.273985 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.285277  8583 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:01:42.288244 11371 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.289321 11052 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.288932 11167 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:42.299973 11167 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:42.292136 11402 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:42.292555  8575 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 2. Current term is 4. Ops: []
W20260709 13:01:42.292933  8508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2115) took 3284 ms (client timeout 1863 ms). Trace:
W20260709 13:01:42.293506  8584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 444) took 2781 ms (client timeout 2559 ms). Trace:
I20260709 13:01:42.299140  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 922) took 1474 ms. Trace:
I20260709 13:01:42.299425 11027 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:42.287091  8547 leader_election.cc:336] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 2.212s (SENT)
W20260709 13:01:42.302752  8508 rpcz_store.cc:269] 0709 13:01:39.008076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.021608 (+ 13532us) service_pool.cc:224] Handling call
0709 13:01:42.286287 (+3264679us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54003c5854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.292721 (+  6434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747111296}
I20260709 13:01:42.313187  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:42.303463  8584 rpcz_store.cc:269] 0709 13:01:39.511617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.513014 (+  1397us) service_pool.cc:224] Handling call
0709 13:01:42.293101 (+2780087us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540009bd54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.293267 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3422241664}
I20260709 13:01:42.304244  9096 rpcz_store.cc:276] 0709 13:01:40.824767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.850257 (+ 25490us) service_pool.cc:224] Handling call
0709 13:01:42.298854 (+1448597us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b54006130d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.299045 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123948416}
I20260709 13:01:42.314909  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 452) took 1491 ms. Trace:
I20260709 13:01:42.315348  8583 rpcz_store.cc:276] 0709 13:01:40.812977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.197491 (+1384514us) service_pool.cc:224] Handling call
0709 13:01:42.304046 (+106555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.263070 11347 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.316627  8580 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 6. Ops: []
I20260709 13:01:42.317355  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2026) took 3247 ms. Trace:
I20260709 13:01:42.317842 11347 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.319783  8584 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:42.314055 11336 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.320843  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2030) took 3238 ms. Trace:
I20260709 13:01:42.321273  8575 rpcz_store.cc:276] 0709 13:01:39.074229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.291817 (+3217588us) service_pool.cc:224] Handling call
0709 13:01:42.292217 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.302338 (+ 10121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.312798 (+ 10460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.322767  8575 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.322813 11421 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.323086 11381 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.323436  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2041) took 3170 ms. Trace:
I20260709 13:01:42.323685  9100 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:42.323861  8575 rpcz_store.cc:276] 0709 13:01:39.153309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.322177 (+3168868us) service_pool.cc:224] Handling call
0709 13:01:42.322507 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.323224 (+   717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.323385 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.324405 11432 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.325780 11430 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.321601 11251 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:42.335609  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 96605us
I20260709 13:01:42.336861 11421 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.337507 11402 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:42.337381 11421 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.338152 11402 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:42.338258 11430 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.339229 11402 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.339758 11421 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.340562 11430 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:01:42.320508  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2036) took 3220 ms. Trace:
I20260709 13:01:42.342150  8584 rpcz_store.cc:276] 0709 13:01:39.100109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.319209 (+3219100us) service_pool.cc:224] Handling call
0709 13:01:42.319558 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.320253 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.320449 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.348773  8583 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:42.326539  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:42.333369 11309 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.358103 11336 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.351802 11275 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:42.352964  8502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1713) took 3597 ms (client timeout 1556 ms). Trace:
W20260709 13:01:42.354705  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 67654us
I20260709 13:01:42.317687  8580 rpcz_store.cc:276] 0709 13:01:39.072913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.280287 (+3207374us) service_pool.cc:224] Handling call
0709 13:01:42.316447 (+ 36160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.317052 (+   605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.317268 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.349522 11371 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.360924  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2035) took 3261 ms. Trace:
I20260709 13:01:42.366103  8582 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
W20260709 13:01:42.364434  8502 rpcz_store.cc:269] 0709 13:01:38.761898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.764315 (+  2417us) service_pool.cc:224] Handling call
0709 13:01:42.327429 (+3563114us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540033a754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.352760 (+ 25331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4063987072}
I20260709 13:01:42.366410  8583 rpcz_store.cc:276] 0709 13:01:39.099851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.315960 (+3216109us) service_pool.cc:224] Handling call
0709 13:01:42.348415 (+ 32455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.358518 (+ 10103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.360869 (+  2351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.325074 11432 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:42.367980  8435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 560) took 5430 ms (client timeout 1939 ms). Trace:
W20260709 13:01:42.368424  8435 rpcz_store.cc:269] 0709 13:01:36.933476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.025654 (+ 92178us) service_pool.cc:224] Handling call
0709 13:01:42.363756 (+5338102us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b5400128254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.363911 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5188210560}
I20260709 13:01:42.369767 11433 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.370424  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.370393 11433 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.371297  9101 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
W20260709 13:01:42.371768  8504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 596) took 3364 ms (client timeout 1596 ms). Trace:
W20260709 13:01:42.372165  8504 rpcz_store.cc:269] 0709 13:01:39.007191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.007313 (+   122us) service_pool.cc:224] Handling call
0709 13:01:42.371455 (+3364142us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b540033a254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.371598 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680484096}
I20260709 13:01:42.372481  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.372835 11433 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.373415 11433 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.373631  8504 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:01:42.377928  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 128748us
I20260709 13:01:42.375310  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 604) took 1579 ms. Trace:
I20260709 13:01:42.373703  9097 raft_consensus.cc:1217] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Deduplicated request from leader. Original: 2.5->[5.6-7.7]   Dedup: 5.6->[7.7-7.7]
I20260709 13:01:42.361143 11422 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.382771  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 603) took 1580 ms. Trace:
I20260709 13:01:42.380086  9097 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:01:42.374825  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:42.382064  8582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 458) took 1532 ms (client timeout 1974 ms). Trace:
I20260709 13:01:42.383149  8504 rpcz_store.cc:276] 0709 13:01:40.795868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.372940 (+1577072us) service_pool.cc:224] Handling call
0709 13:01:42.373236 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.375691 (+  2455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.375875 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:42.383803  8582 rpcz_store.cc:269] 0709 13:01:40.834544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.049217 (+1214673us) service_pool.cc:224] Handling call
0709 13:01:42.366733 (+317516us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.374425  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.379892  8502 rpcz_store.cc:276] 0709 13:01:40.796330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.374269 (+1577939us) service_pool.cc:224] Handling call
0709 13:01:42.374525 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.374899 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.374925 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.374988 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:42.375029 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.375091 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.375213 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":159,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93}
I20260709 13:01:42.388456  8584 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:01:42.389760  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.391688  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 446) took 2871 ms. Trace:
I20260709 13:01:42.392076  8584 rpcz_store.cc:276] 0709 13:01:39.520354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.343187 (+2822833us) service_pool.cc:224] Handling call
0709 13:01:42.380953 (+ 37766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.388940 (+  7987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.391628 (+  2688us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:42.393646  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.393560  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.394606  9096 raft_consensus.cc:2410] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:01:42.393081 11425 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:01:42.376394 11347 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.375726 11426 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:42.393093  9095 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:42.394770  8582 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:42.397444  8502 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:42.301422 11167 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.402269 11427 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.406854  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:42.407903 11431 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:01:42.343487 11330 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.409595  8506 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.411718  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 450) took 1599 ms. Trace:
W20260709 13:01:42.412703  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.421181  8582 rpcz_store.cc:276] 0709 13:01:40.812345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.387372 (+1575027us) service_pool.cc:224] Handling call
0709 13:01:42.387650 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.411480 (+ 23830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.411668 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.423676  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 614) took 1321 ms. Trace:
I20260709 13:01:42.424074  8502 rpcz_store.cc:276] 0709 13:01:41.096000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.393438 (+1297438us) service_pool.cc:224] Handling call
0709 13:01:42.397084 (+  3646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.411195 (+ 14111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.417320 (+  6125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.387485 11381 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:42.431455  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 147837us
I20260709 13:01:42.426425  9094 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:42.434181  8580 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:42.436410 11303 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.436805  8577 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 1. Current term is 3. Ops: []
I20260709 13:01:42.439836  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.436498 11330 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.443611  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 927) took 1616 ms. Trace:
I20260709 13:01:42.444366  9098 rpcz_store.cc:276] 0709 13:01:40.826908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.150719 (+323811us) service_pool.cc:224] Handling call
0709 13:01:41.151322 (+   603us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:41.152020 (+   698us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:41.152461 (+   441us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.285931 (+1133470us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.315125 (+ 29194us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:42.366040 (+ 50915us) log.cc:844] Serialized 52 byte log entry
0709 13:01:42.366208 (+   168us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:42.366241 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.366327 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:42.443369 (+ 77042us) raft_consensus.cc:1685] finished
0709 13:01:42.443391 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.443552 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28945,"prepare.queue_time_us":49481,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":126962,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":2958,"thread_start_us":1123100,"threads_started":2,"wal-append.queue_time_us":974718}
I20260709 13:01:42.411607 11336 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.436466  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 919) took 1554 ms. Trace:
I20260709 13:01:42.432336  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.373924 11433 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.452831  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.455866  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1791) took 3410 ms. Trace:
I20260709 13:01:42.455297  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:42.456261 11377 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:42.456292 11336 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.457382  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2118) took 3388 ms. Trace:
I20260709 13:01:42.458122  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:42.462230  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.483527  9094 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.483681  9093 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:42.464454  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:42.464313 11422 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:42.446693 11356 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:42.470273 11309 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:42.470752 11381 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.460253  8577 rpcz_store.cc:276] 0709 13:01:39.045923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.203740 (+1157817us) service_pool.cc:224] Handling call
0709 13:01:40.243332 (+ 39592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.437224 (+2193892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.437891 (+   667us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54000668d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:42.455790 (+ 17899us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4938624256}
I20260709 13:01:42.450649  9099 rpcz_store.cc:276] 0709 13:01:40.823481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.850256 (+ 26775us) service_pool.cc:224] Handling call
0709 13:01:42.209068 (+1358812us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:42.215170 (+  6102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.238356 (+ 23186us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:42.264598 (+ 26242us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.377364 (+112766us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.377429 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:42.377492 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.377577 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.377716 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9642,"prepare.queue_time_us":20997,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":9778,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3710,"spinlock_wait_cycles":9338496,"thread_start_us":71647,"threads_started":1,"wal-append.queue_time_us":100551}
I20260709 13:01:42.490566  9101 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:42.424899 11347 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.473752  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.476336 11167 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.478434  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.485406  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 443) took 2975 ms. Trace:
I20260709 13:01:42.483302  8506 rpcz_store.cc:276] 0709 13:01:39.068866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.154418 (+3085552us) service_pool.cc:224] Handling call
0709 13:01:42.178778 (+ 24360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.420772 (+241994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.457093 (+ 36321us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54003737d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:42.457289 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499015424}
W20260709 13:01:42.496299  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.488775  9097 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:42.493637  8579 raft_consensus.cc:2368] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
W20260709 13:01:42.500646  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.491596 11223 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.501996  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.506335  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:42.506865  9097 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:42.506880  9099 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.508589  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.507511  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.494531  8575 rpcz_store.cc:276] 0709 13:01:39.506487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.324739 (+2818252us) service_pool.cc:224] Handling call
0709 13:01:42.325203 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.325715 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.325748 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.360738 (+ 34990us) log.cc:844] Serialized 26 byte log entry
0709 13:01:42.429807 (+ 69069us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:42.429845 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.429904 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:42.481766 (+ 51862us) raft_consensus.cc:1685] finished
0709 13:01:42.481792 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.481966 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1257,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":25743,"thread_start_us":61739,"threads_started":1,"wal-append.queue_time_us":85625}
W20260709 13:01:42.516568  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.517539  8577 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:42.515133  8509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2123) took 3419 ms (client timeout 3292 ms). Trace:
I20260709 13:01:42.489709 11329 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:42.519284  8509 rpcz_store.cc:269] 0709 13:01:39.095278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.801237 (+1705959us) service_pool.cc:224] Handling call
0709 13:01:42.511445 (+1710208us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540008d254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.515052 (+  3607us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604845952}
I20260709 13:01:42.491948 11421 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:42.535444  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.488196 11420 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:42.509253  8547 connection.cc:256] RPC call timeout handler was delayed by -1.1399008500000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.326s for a response
W20260709 13:01:42.516938  8400 connection.cc:256] RPC call timeout handler was delayed by -1.9304231080000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260709 13:01:42.536244  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.522862  9096 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:42.525123  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.546206  8575 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:42.502826 11223 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:42.502415 11347 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.531239  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.530493  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.535807  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.536089  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 600) took 1966 ms. Trace:
I20260709 13:01:42.537514  8581 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:42.530377  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.533622  8431 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:42.538730  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.530762  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:42.545493  8400 connection.cc:256] RPC call timeout handler was delayed by -1.8980231080000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 13:01:42.551932  8584 raft_consensus.cc:2410] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:01:42.552210  8427 raft_consensus.cc:2410] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:01:42.551959  8400 connection.cc:256] RPC call timeout handler was delayed by -1.8980231080000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 13:01:42.523447 11438 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.529677  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.556020  8580 raft_consensus.cc:2368] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
I20260709 13:01:42.537178  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.556056  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2023) took 3490 ms. Trace:
I20260709 13:01:42.556216  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.547286  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.549335  9094 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:42.477944 11283 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:42.545255  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.558816  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.559407  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.559995  8576 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:42.502861 11419 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:42.552749  8400 connection.cc:256] RPC call timeout handler was delayed by -1.6924227270000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 13:01:42.528038  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.521979 11329 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:42.526003 11381 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:42.537878 11275 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.550659  8508 rpcz_store.cc:276] 0709 13:01:40.569596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.318691 (+1749095us) service_pool.cc:224] Handling call
0709 13:01:42.511855 (+193164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.534907 (+ 23052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.534930 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.534996 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:42.535041 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.535103 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.535923 (+   820us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540008d250. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.536040 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443383680}
I20260709 13:01:42.594065  9098 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:42.530236  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:42.590967  9100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 925) took 1765 ms (client timeout 1981 ms). Trace:
I20260709 13:01:42.572849  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2116) took 3555 ms. Trace:
I20260709 13:01:42.553843 11420 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.554324  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.555275  8583 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:42.556699  8581 rpcz_store.cc:276] 0709 13:01:39.061985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.536911 (+3474926us) service_pool.cc:224] Handling call
0709 13:01:42.537268 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.551135 (+ 13867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.551343 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:42.557964  8429 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:42.580636  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.592792  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.558261  8435 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:01:42.534245 11221 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.606128  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.591348  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:42.585718  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:42.602730  9100 rpcz_store.cc:269] 0709 13:01:40.826087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.924650 (+ 98563us) service_pool.cc:224] Handling call
0709 13:01:41.198335 (+273685us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:01:42.590815 (+1392480us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b54005014d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.590909 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194679296}
W20260709 13:01:42.581409  8550 leader_election.cc:336] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.750s (SENT)
I20260709 13:01:42.560731  8577 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:42.560317  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.560832  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.606072  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.608801  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:42.606244  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.609287  8575 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.561519  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.561348  9093 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:42.561070  8505 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:42.584573  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.604592  9096 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:42.566154  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.602295  8432 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:42.611918  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:42.612809  9097 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:42.609089  8576 raft_consensus.cc:2376] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6. Re-sending same reply.
I20260709 13:01:42.575404  9099 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
W20260709 13:01:42.612850  8400 connection.cc:256] RPC call timeout handler was delayed by -1.6627472800000191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 13:01:42.573709  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1789) took 3528 ms. Trace:
I20260709 13:01:42.611899  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:42.614665  8400 connection.cc:256] RPC call timeout handler was delayed by -1.6334231079999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 13:01:42.615101  8400 connection.cc:256] RPC call timeout handler was delayed by -1.54302272700005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
I20260709 13:01:42.602947  8510 rpcz_store.cc:276] 0709 13:01:39.017506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.050556 (+ 33050us) service_pool.cc:224] Handling call
0709 13:01:39.085082 (+ 34526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.880593 (+1795511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.572588 (+1691995us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54003723d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:42.572772 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4114246016}
W20260709 13:01:42.615593  8400 connection.cc:256] RPC call timeout handler was delayed by -1.4737227270000517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
I20260709 13:01:42.615743  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:42.616044  8400 connection.cc:256] RPC call timeout handler was delayed by -1.4129231080000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 13:01:42.616353  9095 raft_consensus.cc:2410] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:42.618443 11221 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.618917  8431 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:42.620260  8431 pending_rounds.cc:85] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 4
I20260709 13:01:42.620523  8431 pending_rounds.cc:107] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:01:42.621881  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.620792  8431 raft_consensus.cc:2889] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.612038  8426 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:42.618814 11336 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:42.563907 11215 consensus_meta.cc:287] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:01:42.614913  8578 rpcz_store.cc:276] 0709 13:01:39.045322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.531789 (+486467us) service_pool.cc:224] Handling call
0709 13:01:39.532048 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.048964 (+1516916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.573470 (+1524506us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000659d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:42.573659 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3189625600}
I20260709 13:01:42.621523  8430 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:42.630005  8579 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 3: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:42.563023 11433 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.578470  8330 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 5 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.646445  8427 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:42.580328 11223 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.620782 11221 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.609727 11329 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.632022  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:42.632648  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.638804  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.578469 11356 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.641122  9102 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.641371  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.653846  8428 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:42.641871  9093 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:42.642517  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.643198  8580 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:42.643607  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:42.659363  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:42.644186  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.660485  8581 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:42.589552  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1710) took 3863 ms. Trace:
I20260709 13:01:42.647719  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.648373  8509 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:42.564795 11432 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.580932 11283 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.649506  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.645898  8502 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:42.651885  8582 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:42.650833  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.652607  9101 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:42.655362  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:42.655719  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.551702 11421 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:42.675558  9094 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.588297 11309 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:01:42.662642  8550 leader_election.cc:336] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.834s (SENT)
I20260709 13:01:42.645385  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:42.586922 11402 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:01:42.686652  9096 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:42.676321  8550 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:42.668068  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.694291  8506 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:42.696307  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.700930 11309 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:42.704010 11309 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:42.667284 11419 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:42.704917 11309 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.706226 11377 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.706409  9101 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:42.706965 11393 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.707275 11419 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.707581  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:42.707538 11393 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.707973  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.708602  8428 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:01:42.715549  8550 leader_election.cc:336] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.890s (SENT)
I20260709 13:01:42.702483  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.731385 11421 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.732885 11420 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:42.733943  8547 leader_election.cc:336] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.556s (SENT)
I20260709 13:01:42.734439  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:42.737473 11377 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.738971  8426 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:01:42.739334  8426 pending_rounds.cc:85] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 6
I20260709 13:01:42.739532  8426 pending_rounds.cc:107] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:01:42.739744  8426 raft_consensus.cc:2889] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.746381  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:42.750934  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.748684  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:42.753051  9096 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.756493  8428 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:42.647557 11215 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.758225  8580 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:42.759202  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 135780us
I20260709 13:01:42.759626  9065 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:42.761152  8583 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:42.762113 11347 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:42.762609 11347 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.763024 11347 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.653635 11438 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.766270  8427 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:42.766633  8434 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:42.694099 11356 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:42.767560 11215 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.768103 11438 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:42.768319  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.771188  8429 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:42.771487  8575 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:42.768821  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:42.773202  9101 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:42.774955  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.775380 11356 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.747762 11427 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:42.781376 11329 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:42.776448  8578 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:42.776891  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.784410  8432 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.773227 11309 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.778455  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.784502  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.774384  9094 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:42.787847  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.788765  8579 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:42.793215  8426 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:01:42.793430  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.800786  8435 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:42.802372  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.790540 11438 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:42.809628  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.814320  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:42.816514  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47812.8us
I20260709 13:01:42.816622  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:42.822913  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.818238 11329 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:42.818758  8428 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.821676  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.664755  8503 rpcz_store.cc:276] 0709 13:01:38.726475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.729213 (+  2738us) service_pool.cc:224] Handling call
0709 13:01:38.770991 (+ 41778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.795778 (+2024787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.589150 (+1793372us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54001fc054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:42.589386 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3522874752}
I20260709 13:01:42.829767  8427 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.831799  8398 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:42.833425 11303 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:42.833765 11303 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.834100 11303 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:42.842514  8550 leader_election.cc:336] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.999s (SENT)
I20260709 13:01:42.846652  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2131) took 2713 ms. Trace:
I20260709 13:01:42.847190  8505 rpcz_store.cc:276] 0709 13:01:40.133461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.194456 (+2060995us) service_pool.cc:224] Handling call
0709 13:01:42.221190 (+ 26734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.610459 (+389269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.846409 (+235950us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54001fed54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:42.846566 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781168512}
I20260709 13:01:42.858705  8330 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 5 to 6, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 6 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:42.860908  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:42.860438  8330 catalog_manager.cc:5697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 5, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 5 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.822283 11438 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.806311  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.799540 11432 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.874472  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.885004  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1720) took 3863 ms. Trace:
I20260709 13:01:42.824414  8426 raft_consensus.cc:2368] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
W20260709 13:01:42.904834  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 452554us
I20260709 13:01:42.906566  8428 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3.
I20260709 13:01:42.907516  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.908058  8428 raft_consensus.cc:2376] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8. Re-sending same reply.
I20260709 13:01:42.908646  8435 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:42.862015  8330 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 5 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:42.875557  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48156.1us
I20260709 13:01:42.875994  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:42.877238  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.883256  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.911782  8429 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:42.885829  8583 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:42.888619  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.867127  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.875353  8578 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:01:42.888209  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 399814us
W20260709 13:01:42.882154  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50426.1us
I20260709 13:01:42.897396  8427 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:42.821082  8432 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:42.919955  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:42.920992  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.921124  8430 raft_consensus.cc:2410] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:42.921732  8435 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:42.919955  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:42.922890  8547 leader_election.cc:336] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.721s (SENT)
I20260709 13:01:42.926693  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.926683  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:42.927534  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.928632  8432 raft_consensus.cc:2376] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8. Re-sending same reply.
I20260709 13:01:42.925551  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.903847  8507 rpcz_store.cc:276] 0709 13:01:39.021184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.966138 (+1944954us) service_pool.cc:224] Handling call
0709 13:01:42.379827 (+1413689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.395416 (+ 15589us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:42.461307 (+ 65891us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.883722 (+422415us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b180037e280. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:01:42.883880 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.883929 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:42.883980 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.884041 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.884797 (+   756us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540033a250. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:42.884933 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1343,"prepare.queue_time_us":47707,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":414717,"spinlock_wait_cycles":3250056832,"thread_start_us":62113,"threads_started":2,"wal-append.queue_time_us":39788}
I20260709 13:01:42.877686 11438 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.933926  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.879949 11377 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:42.935236  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:42.934654  8426 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:42.935947  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 611) took 2098 ms. Trace:
I20260709 13:01:42.937098  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.939208  8427 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:42.865590 11393 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:42.920197 11215 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:42.943497  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.946936  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.948021  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.942258  8330 catalog_manager.cc:5697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 4 to 5, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:01:42.947801  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.952872  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.954213  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.955582  8433 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:42.954982  8426 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:42.938488  8504 rpcz_store.cc:276] 0709 13:01:40.837991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.387992 (+1550001us) service_pool.cc:224] Handling call
0709 13:01:42.421273 (+ 33281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.446525 (+ 25252us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:42.543668 (+ 97143us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.935698 (+392030us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.935738 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:42.935775 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.935822 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.935908 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124443,"prepare.queue_time_us":48624,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":1721,"raft.queue_time_us":134478,"thread_start_us":248002,"threads_started":2}
I20260709 13:01:42.960402  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.962507  8578 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:42.963164  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.963764  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.963967  8579 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.964818  8429 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:42.965828  8432 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:42.969800  8330 catalog_manager.cc:5697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 4 to 5, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:01:42.960306 11420 raft_consensus.cc:2764] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:01:42.972225  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.974211  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.975757  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.976811  8432 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:01:42.978117  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:42.978803  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 56470us
I20260709 13:01:42.979139  8433 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:42.980327  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:42.980924  8435 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:42.982872  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.983119  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.986240  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:42.987682  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:42.988272  8430 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:42.990242  8428 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.948866 11215 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:42.999215  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:43.000044  8427 raft_consensus.cc:2410] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:42.983457  8576 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:42.987167  8584 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:42.995239  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.997067  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 74201.7us
I20260709 13:01:42.989709  8330 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 4 to 5, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:01:42.997200  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:43.009801  8432 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:43.012813 11392 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:43.014287  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.019469  8330 catalog_manager.cc:5697] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 4, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 4 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:43.020790 11303 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.021099  8330 catalog_manager.cc:5697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.022265 11421 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:43.022599  8330 catalog_manager.cc:5697] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 3, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 3 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.024170  8330 catalog_manager.cc:5697] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 4, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 4 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.006575 11215 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:43.026172  8430 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:43.027801  8330 catalog_manager.cc:5697] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 2 to 3, term changed from 3 to 4, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193), VOTER 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194), VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195), VOTER 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 4 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:43.032929  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 45882.6us
W20260709 13:01:43.038790  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 99693.3us
W20260709 13:01:43.039667  8547 leader_election.cc:336] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.750s (SENT)
I20260709 13:01:43.041222  8579 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:43.042162  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.040302  8547 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:43.043926  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:43.050014  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.049984  8427 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:01:43.050935  8427 pending_rounds.cc:85] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 5
I20260709 13:01:43.051180  8427 pending_rounds.cc:107] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:43.051393  8427 raft_consensus.cc:2889] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:43.057370  8433 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:43.062158  8428 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
W20260709 13:01:43.064561  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.065203  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 106668us
W20260709 13:01:43.075584  8547 leader_election.cc:336] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.779s (SENT)
I20260709 13:01:43.072808  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:43.077333  8330 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 6 to 7, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 7 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.063649 11377 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:43.084353  8333 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57104 (request call id 381) took 20662 ms (client timeout 15000 ms). Trace:
I20260709 13:01:43.085338  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:43.083379  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:43.086869  8547 leader_election.cc:336] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.834s (SENT)
I20260709 13:01:43.088256  8330 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 4, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 4 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:43.099799  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:43.102222 11420 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:43.102811 11451 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:01:43.104813  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.108822 11449 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.115s	user 0.000s	sys 0.002s
I20260709 13:01:43.114835 11303 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:43.079874 11309 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:43.127199 11427 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:43.131989 11420 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.132045 11419 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 13:01:43.144523  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69474.7us
I20260709 13:01:43.135200 11421 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 13:01:43.145727  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 58883.3us
W20260709 13:01:43.182101  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 82441.9us
I20260709 13:01:43.186231 11221 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:01:43.187532 11452 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260709 13:01:43.115944  8333 rpcz_store.cc:269] 0709 13:01:22.422288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.423168 (+   880us) service_pool.cc:224] Handling call
0709 13:01:43.083768 (+20660600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:32.038399 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:32.039295 (+   896us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:32.039369 (+    74us) write_op.cc:435] Acquired schema lock
0709 13:01:32.039406 (+    37us) tablet.cc:662] Decoding operations
0709 13:01:32.048727 (+  9321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:32.048808 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:32.048839 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:01:32.187059 (+138220us) tablet.cc:701] Row locks acquired
0709 13:01:32.220305 (+ 33246us) write_op.cc:260] PREPARE: finished
0709 13:01:32.256448 (+ 36143us) write_op.cc:270] Start()
0709 13:01:32.299958 (+ 43510us) write_op.cc:276] Timestamp: P: 1783602092241916 usec, L: 0
0709 13:01:32.299990 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:01:32.300737 (+   747us) log.cc:844] Serialized 4806 byte log entry
0709 13:01:33.523663 (+1222926us) op_driver.cc:464] REPLICATION: finished
0709 13:01:34.255222 (+731559us) write_op.cc:301] APPLY: starting
0709 13:01:34.255351 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:34.255722 (+   371us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:34.255876 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:34.483989 (+228113us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:34.486889 (+  2900us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:01:34.486950 (+    61us) write_op.cc:312] APPLY: finished
0709 13:01:34.487429 (+   479us) log.cc:844] Serialized 89 byte log entry
0709 13:01:34.652972 (+165543us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a162350ac 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b
0709 13:01:34.744855 (+ 91883us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:34.760786 (+ 15931us) write_op.cc:454] Released schema lock
0709 13:01:34.790327 (+ 29541us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:34.876646 (+ 86319us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:34.889673 (+ 13027us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":326684,"reported_tablets":28,"spinlock_wait_cycles":8064,"child_traces":[["op",{"apply.queue_time_us":664953,"apply.run_cpu_time_us":11991,"apply.run_wall_time_us":568548,"num_ops":12,"prepare.queue_time_us":520209,"prepare.run_cpu_time_us":42423,"prepare.run_wall_time_us":392098,"raft.queue_time_us":752715,"raft.run_cpu_time_us":41669,"raft.run_wall_time_us":556957,"replication_time_us":1194211,"spinlock_wait_cycles":10514688,"thread_start_us":1475924,"threads_started":5,"wal-append.queue_time_us":732922,"wal-append.run_cpu_time_us":18967,"wal-append.run_wall_time_us":2780562}]]}
I20260709 13:01:43.190528  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.191450  8504 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:43.192483  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.193090  8507 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:43.193971  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.195202  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.195946  8509 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 5: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:43.197203 11377 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:43.198200 11393 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:43.199100 11393 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:43.199430 11393 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:43.200345 11393 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:43.201473 11393 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.202376 11223 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:43.206811  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:43.152575  8576 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:43.151474  8330 catalog_manager.cc:5697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 5, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:43.186424  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:43.211776  8435 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:43.212745 11432 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.212376  8330 catalog_manager.cc:5697] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:01:43.213941 11453 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:01:43.214464  8330 catalog_manager.cc:5697] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:43.213094 11303 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:43.215703  8330 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.218255  9098 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:43.218701  8330 catalog_manager.cc:5697] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 4 to 5, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:01:43.221151  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:43.109400 11215 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.231717  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:43.234499  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:43.235105  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:43.157684 11420 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.230569  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.229858  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:43.174472 11433 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.130187 11347 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.238792  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:43.236869  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:43.261916  8434 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:43.182173 11419 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:43.275595 11419 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:43.276985 11419 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.278623 11419 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.278815  8429 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:01:43.250522  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.283975  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.287757  8501 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:43.244529 11356 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:43.293001 11392 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:43.293187 11356 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:43.294502  8428 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:01:43.295666  8547 leader_election.cc:336] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 2.360s (SENT)
W20260709 13:01:43.297953  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 66331.4us
W20260709 13:01:43.301409  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 94685.8us
I20260709 13:01:43.303437 11463 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:43.309098 11463 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:43.309711  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 224430us
I20260709 13:01:43.312310 11463 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.295290 11356 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:43.319772  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 173287us
I20260709 13:01:43.297333 11427 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:43.325197  9067 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:43.327060  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:43.330628  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:43.331248  8435 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:43.334124  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:43.352679 11347 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:43.353282  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.353935  8504 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.325645 11421 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:43.357002 11421 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.357550 11421 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.360894  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:43.361686  8428 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:01:43.362813  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:43.363619  8429 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:43.367422 11336 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:43.370680  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:43.371574  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:43.372291  8428 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:43.374330  8504 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:43.374413  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:43.375192  8433 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:01:43.376432  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 71777.4us
I20260709 13:01:43.377419  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:43.381119  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:43.383036  8434 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:43.387781  8432 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:01:43.304060 11438 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:43.390291  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 44966.2us
I20260709 13:01:43.381317 11427 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:43.394191 11347 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:43.343288 11221 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.394785 11347 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:43.395453 11465 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:43.396024 11465 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:43.395821 11347 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.396883 11465 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:43.393703 11427 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.392040  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:43.399842  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 221303us
I20260709 13:01:43.404783  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:43.405681  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 103562us
I20260709 13:01:43.344923 11433 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.416965  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:43.418630  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:43.418751  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:43.419305  8434 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.428821  8434 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
W20260709 13:01:43.442816  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.447772  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:43.453814  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:43.458664  8430 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:43.462693  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 47042.3us
W20260709 13:01:43.463696  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 57338us
I20260709 13:01:43.403087 11420 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.422101 11309 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:01:43.467073  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:43.468470  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:43.469158  8426 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.473826  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:43.420717 11329 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:01:43.477975  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 61098.5us
I20260709 13:01:43.454872 11456 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:43.502556  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.467146 11223 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:43.505771  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:43.507059  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:43.509127  8400 leader_election.cc:400] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
I20260709 13:01:43.509553  8400 leader_election.cc:403] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.463884 11336 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:43.486109 11402 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:43.491268 11461 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:43.494845 11215 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:43.524302  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.530776  8434 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:43.509891 11223 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:43.511171 11462 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.476573 11377 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:01:43.504972 11275 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:01:43.553646  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:43.554288  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.554556  8501 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:43.557166  8504 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:43.559115  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.559909  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.560550  8501 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:43.529701 11336 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:43.577169  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:43.616535  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.616850  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 151917us
I20260709 13:01:43.623103  8507 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:43.626793  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:43.632632  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 240635us
I20260709 13:01:43.616204 11215 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
I20260709 13:01:43.636974  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:43.613097 11303 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:43.643321  8504 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:43.647286  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.650584  8509 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:43.624557 11438 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:43.644030  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:43.658704  8501 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:43.660569  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.636175 11479 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.634752  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.614226 11460 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.197s
I20260709 13:01:43.633766 11476 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:43.642272 11303 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:43.672801  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.675608  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:43.688766  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.692001 11392 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:43.692453 11392 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:43.696602  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.697243  8507 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.701519  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.702209  8509 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.702963 11393 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:43.703382 11393 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:43.704252 11393 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.705590 11393 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:43.707077 11303 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.708349 11303 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.710547 11422 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:43.710953 11422 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:43.711779 11422 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:43.712898 11422 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.713713  8503 raft_consensus.cc:2376] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 3. Re-sending same reply.
W20260709 13:01:43.718916 11467 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
W20260709 13:01:43.728149  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.677161 11336 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:43.739660 11356 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:43.677811 11420 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:43.642588 11223 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:43.746958 11421 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:43.748255  8429 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:43.750166  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.751336 11421 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:43.674572 11476 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.671597 11479 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.764725 11479 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:43.667248 11215 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:43.760874 11476 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:43.777931  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 297663us
I20260709 13:01:43.790334 11476 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:43.792737 11476 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:43.693300 11392 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.809353  8510 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:43.796983  8426 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:43.802906  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 158908us
I20260709 13:01:43.812935  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:43.814929  8509 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
W20260709 13:01:43.809351  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 302293us
W20260709 13:01:43.817762  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.817752  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.818222  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.816010  9065 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:43.818296  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.820462  8504 raft_consensus.cc:2368] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6.
I20260709 13:01:43.822788  9097 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:43.825121  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:43.828210  9094 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:43.828722  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:43.816708  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:43.831223  9098 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:01:43.832401  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:43.833155  8579 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.834563  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:43.834510  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:43.836026  8584 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:43.831214  8581 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:43.831555  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.837677  8510 raft_consensus.cc:2368] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6.
I20260709 13:01:43.837977  8584 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:43.840397  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:43.807827 11356 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:43.843545  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:43.885931  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 216545us
I20260709 13:01:43.886796  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:43.885510  8576 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:43.888078  8584 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:43.888507  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:43.889238  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:43.889492  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:43.848405  8503 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:43.888484  8584 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:43.885479  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:43.891021  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49306.5us
I20260709 13:01:43.886713  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:43.898502  8579 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:43.898869  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:43.899660  8580 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:43.899843  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:43.900328  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:43.900695  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:43.901333  8580 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.900954  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:43.844797 11275 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:43.903697  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.808048 11463 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:43.906746  8577 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:43.907512  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:43.926265  8575 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.915997  9097 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:43.920428  8507 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:43.856741 11478 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:43.893977  8584 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:43.924484  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:43.925196  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:43.931160  8584 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.818377 11485 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:43.903895  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.903160 11356 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:43.937386  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 111999us
I20260709 13:01:43.844121 11479 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:01:43.939863  9095 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:43.940042  8435 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:43.941058 11478 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:43.941639 11479 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:43.929378  8400 leader_election.cc:400] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
I20260709 13:01:43.942343  8400 leader_election.cc:403] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.893231 11462 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.946208  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:43.932219  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.947067  9097 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:43.842330 11377 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:01:43.938601  9094 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:43.927378 11477 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.835716 11476 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:01:43.941581  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:43.929147  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:43.943681  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:43.944829  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:43.933480  8582 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:43.948544  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 135486us
I20260709 13:01:43.968580  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.950666  8575 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
W20260709 13:01:43.978925  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 52813us
I20260709 13:01:43.979804  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:43.980573  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.982194  8550 leader_election.cc:400] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:01:43.982613  8550 leader_election.cc:403] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.985073  8583 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:43.985718  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 84838.8us
I20260709 13:01:43.993619  8501 raft_consensus.cc:2368] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:01:43.985257  8584 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:01:43.985917  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:43.994717  8584 pending_rounds.cc:85] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 7
I20260709 13:01:43.945574 11485 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:43.940243 11275 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:43.942246 11479 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:43.948428 11303 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
I20260709 13:01:43.948379 11167 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:44.025059  8584 pending_rounds.cc:107] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:01:44.034929  8584 raft_consensus.cc:2889] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:43.942284 11478 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:44.023555 11221 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:44.036819  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50704.6us
W20260709 13:01:44.084446  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.984476 11491 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:44.025008  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:44.084431  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:44.097358  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:44.092773  9098 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:44.106688  9097 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
W20260709 13:01:44.119609  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 146846us
W20260709 13:01:44.119803  9068 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.678s (SENT) [suppressed 53 similar messages]
I20260709 13:01:44.121990  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:44.086390 11221 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.087678 11309 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.128057  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:44.259126  8507 raft_consensus.cc:2376] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8. Re-sending same reply.
I20260709 13:01:44.132766  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:44.137750  8580 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:01:44.132578 11461 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.000s
I20260709 13:01:44.143225 11463 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:44.142963 11485 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:44.144567 11493 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:01:44.144093 11479 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:44.276563 11492 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:01:44.160867  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.277850  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.160840 11377 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:44.160424 11498 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:01:44.120625 11491 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:44.122850 11477 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:44.202297  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.240489  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:44.272444  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:44.258476 11221 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:44.284500  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 164720us
I20260709 13:01:44.290146  8508 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:44.298415  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:44.275355 11461 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:44.306553  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 184647us
I20260709 13:01:44.307487  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:44.311586 11498 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:44.150755 11275 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:44.319809  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.328327  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.333768 11498 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:44.334869  8550 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:44.281921 11377 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:44.270506 11309 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:44.440137 11491 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:44.455082  8509 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:01:44.438946 11426 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:44.464321  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:44.444856  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.470860  8509 pending_rounds.cc:85] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 6
W20260709 13:01:44.448689  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 351398us
I20260709 13:01:44.343330  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:44.449752  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:44.446411  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:44.446041  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:44.473503  8507 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:44.473860  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:44.474261  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:44.474577  8432 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:44.437495 11356 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:44.476752  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 138246us
I20260709 13:01:44.453740  8431 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:44.466081  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:44.467516  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 474751us
W20260709 13:01:44.418584  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.479712  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.339573  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:44.463575  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:44.449163  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1748) took 1088 ms. Trace:
I20260709 13:01:44.481846  8435 rpcz_store.cc:276] 0709 13:01:43.360743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.362389 (+  1646us) service_pool.cc:224] Handling call
0709 13:01:43.362638 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.940489 (+577851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.448826 (+508337us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b540026ff54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:44.449057 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327455488}
I20260709 13:01:44.471294  8509 pending_rounds.cc:107] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:01:44.483520  8509 raft_consensus.cc:2889] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:44.462942  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 438046us
I20260709 13:01:44.485343  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:44.486500  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:44.487663  8507 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:44.336652 11393 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:44.447476 11479 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.507808  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:44.508636  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:44.481355  8502 raft_consensus.cc:2376] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8. Re-sending same reply.
I20260709 13:01:44.513535  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:44.515532  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:44.465602 11472 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:44.449631 11223 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:44.536664  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 64815.1us
I20260709 13:01:44.551882  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:44.553534  9068 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.783s (SENT)
I20260709 13:01:44.556727  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:44.563710  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:44.567237  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:44.568048  9097 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:44.569486  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:44.570657  9094 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:44.571040  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:44.571735  9096 raft_consensus.cc:2376] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9. Re-sending same reply.
I20260709 13:01:44.570683  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:44.572515  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:44.573180  9100 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:44.488343 11426 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:44.604517  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:44.607586  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1755) took 1237 ms. Trace:
I20260709 13:01:44.613476  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:44.608225  8427 rpcz_store.cc:276] 0709 13:01:43.370008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.375000 (+  4992us) service_pool.cc:224] Handling call
0709 13:01:43.375299 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.716440 (+341141us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b48002f0358. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:01:43.824521 (+108081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.824558 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.830946 (+  6388us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.030515 (+199569us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:44.030578 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.030680 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.574086 (+543406us) raft_consensus.cc:1685] finished
0709 13:01:44.574115 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.607484 (+ 33369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77017,"raft.queue_time_us":19439,"raft.run_cpu_time_us":3683,"raft.run_wall_time_us":321517,"spinlock_wait_cycles":13160320,"thread_start_us":647930,"threads_started":2,"wal-append.queue_time_us":739399}
I20260709 13:01:44.614531  9098 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:44.611275  9100 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:01:44.577193  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 112974us
I20260709 13:01:44.578354  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:44.526314 11498 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:44.559626 11477 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:01:44.602305 11463 raft_consensus.cc:2764] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:44.582962 11461 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:44.641402  9101 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:01:44.644361  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 136642us
W20260709 13:01:44.639178  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 134032us
W20260709 13:01:44.664374  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.706267  9097 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:44.643603 11336 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:44.674592  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:44.574970 11465 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:01:44.550652 11377 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:44.683634 11422 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.970s	user 0.009s	sys 0.003s
I20260709 13:01:44.669818 11221 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:44.674810 11477 consensus_queue.cc:1243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:01:44.695683 11509 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:01:44.575832 11506 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
W20260709 13:01:44.709618  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 156139us
W20260709 13:01:44.718001  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 218045us
I20260709 13:01:44.606320 11356 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:44.708001 11511 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:44.674106 11502 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:44.728586  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.733696  8506 raft_consensus.cc:2410] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:44.710157 11336 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:44.736678  9068 leader_election.cc:336] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.796s (SENT)
I20260709 13:01:44.739492 11336 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:44.740223 11495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.003s	sys 0.006s
I20260709 13:01:44.734097 11477 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:44.728456 11501 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:44.735929 11502 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:44.758634  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 85612.5us
I20260709 13:01:44.740792 11518 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.749634  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:44.771096 11512 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:44.828019  8547 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:44.830402  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:44.836922  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:44.770309 11495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.003s	sys 0.006s
W20260709 13:01:44.839190  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 195238us
W20260709 13:01:44.770601 11507 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:01:44.841236  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.867496  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.788332 11502 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:44.785778 11309 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:44.840066 11511 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:44.875717 11524 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:01:44.882184 11531 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:44.882429 11506 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:44.836717 11520 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:44.770872 11519 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:01:44.843801 11461 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:44.772692 11515 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.771071 11517 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
W20260709 13:01:44.892704  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.836369 11490 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:01:44.774767 11336 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:44.896693  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:44.849014 11485 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:01:44.898900  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 194243us
I20260709 13:01:44.836751 11518 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:44.899626 11520 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.906276 11461 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:44.910220  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 81610.7us
I20260709 13:01:44.892890 11426 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:44.916252 11515 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:44.927175  8501 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
W20260709 13:01:44.929143  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 101211us
I20260709 13:01:44.893527 11476 consensus_queue.cc:1059] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:44.938136  9102 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:44.951543  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:44.944887  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 48353.9us
I20260709 13:01:44.927551 11506 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:44.957144 11506 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:44.957367 11510 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:44.958051 11506 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:44.951970  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:44.936995 11477 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:44.943431 11524 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:44.953266 11356 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:44.953806 11476 raft_consensus.cc:3055] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:44.954080 11472 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:44.956323 11519 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:44.968382 11518 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:44.969133 11336 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:44.969566  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:44.971180  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:44.972127  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 471) took 1143 ms. Trace:
I20260709 13:01:44.972543  8578 rpcz_store.cc:276] 0709 13:01:43.828347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.828485 (+   138us) service_pool.cc:224] Handling call
0709 13:01:44.971841 (+1143356us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001162d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:44.971977 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313075456}
I20260709 13:01:44.956632  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:44.936800 11530 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.947886 11221 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:44.942682 11520 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:44.949923  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 111755us
I20260709 13:01:44.970307 11461 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.000010  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:45.008937  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 52370.2us
I20260709 13:01:45.012470  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:45.012753  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:45.009555  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:44.962504 11477 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:44.962818 11524 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:44.964046 11498 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:45.017135  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 44616us
I20260709 13:01:44.952378 11485 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:01:44.965839 11476 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:44.973448 11472 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.022840  8476 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:45.024281  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2148) took 1274 ms. Trace:
I20260709 13:01:45.024679  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:45.026830  9102 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:45.027685  8503 rpcz_store.cc:276] 0709 13:01:43.749585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.749798 (+   213us) service_pool.cc:224] Handling call
0709 13:01:45.024086 (+1274288us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b54000d7ad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:45.024218 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98710912}
I20260709 13:01:45.030771  8578 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:44.976291 11519 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:45.033577  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:45.014272 11479 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.033120 11483 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:01:45.038255  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:45.011309 11535 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.035272 11474 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:45.036020  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:45.020231 11477 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:45.035156 11336 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:45.036402 11539 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:01:45.026165 11518 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:01:45.029125 11534 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.027459 11223 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:45.044592 11485 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:45.066608 11472 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:45.053211  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:45.071671 11515 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:45.046981  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 47045.2us
I20260709 13:01:45.072283 11472 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:45.045324 11356 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:01:45.056154  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 839) took 1233 ms. Trace:
I20260709 13:01:45.074572  9099 rpcz_store.cc:276] 0709 13:01:43.822269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.822378 (+   109us) service_pool.cc:224] Handling call
0709 13:01:43.822679 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:43.899773 (+ 77094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.899804 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:43.923318 (+ 23514us) log.cc:844] Serialized 52 byte log entry
0709 13:01:44.935457 (+1012139us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b180019eee0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:01:44.946913 (+ 11456us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:44.947008 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.947110 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.055718 (+108608us) raft_consensus.cc:1685] finished
0709 13:01:45.055753 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.056070 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20712,"raft.queue_time_us":15761,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":11517,"spinlock_wait_cycles":7088000,"thread_start_us":11204,"threads_started":1,"wal-append.queue_time_us":1038507}
I20260709 13:01:45.047876  9101 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:01:45.077411  9102 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:45.084302  8578 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:01:45.086280  8547 leader_election.cc:336] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 2.087s (SENT)
I20260709 13:01:45.019397 11422 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:01:44.999369 11530 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.091578  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:45.093787  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.098608  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45612.9us
I20260709 13:01:45.101289  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:45.069515 11336 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:45.106769  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:45.046707 11479 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.094480  9097 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:01:45.057099 11489 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:45.116528  8547 leader_election.cc:336] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 2.205s (SENT)
I20260709 13:01:45.117849  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:45.118300  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:45.019716 11531 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:01:45.052376 11525 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:45.081110 11463 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.069715 11474 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:45.122557  8579 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:45.044806 11510 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:45.124351  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 101593us
I20260709 13:01:45.080538 11223 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:45.126539  9098 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:45.124509  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:45.149328  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:45.149545  9101 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
I20260709 13:01:45.134766  9095 raft_consensus.cc:2376] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7. Re-sending same reply.
I20260709 13:01:45.125844 11422 consensus_queue.cc:1243] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:45.164074  8582 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:45.120048 11483 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.165752  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:45.172968  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:45.161216  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:45.047449 11476 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.133849 11489 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:45.156563 11223 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:45.184396  8476 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:45.135640 11377 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:45.064714 11519 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.188390 11546 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:45.170562 11525 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:45.170542 11479 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:45.191836  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:45.193112 11531 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:45.194471  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 60902.4us
I20260709 13:01:45.096903 11524 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.202600 11426 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:45.202693 11525 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:45.206470 11474 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.207527 11489 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:45.208854 11489 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.209326  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:45.195538 11479 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:45.217901 11167 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:45.224560 11167 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.218290 11479 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.221597 11462 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:45.193679 11546 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:45.210414 11377 consensus_queue.cc:1243] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:45.215454 11518 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:45.222958 11476 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.218175 11544 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:45.183229 11483 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:45.232719 11462 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:45.258667  8547 leader_election.cc:336] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.799s (SENT)
I20260709 13:01:45.234841 11546 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.264046 11551 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:45.267426 11530 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.268133 11530 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:45.269012  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47890.7us
I20260709 13:01:45.269876  8476 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:45.252408 11377 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.273969  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 64683us
I20260709 13:01:45.281464  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:45.279312  8547 leader_election.cc:336] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 2.050s (SENT)
I20260709 13:01:45.283087  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:45.288461  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 119746us
I20260709 13:01:45.290963 11551 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:45.292937  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:45.302071  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:45.312678  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.328490  8547 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 2.533s (SENT)
I20260709 13:01:45.285017 11530 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:45.286540 11485 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:45.378443  9100 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:45.418821  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.368422 11529 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.441617  9100 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:45.284440 11377 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.365037 11552 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:45.452875  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.289708 11520 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.464452 11550 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.465111 11550 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:45.467240  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 138805us
W20260709 13:01:45.468043  8547 leader_election.cc:336] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 2.767s (SENT)
I20260709 13:01:45.468468  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:45.469743  8547 leader_election.cc:336] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.999s (SENT)
I20260709 13:01:45.472033  8577 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:45.478683  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.433626 11555 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:45.478315  8577 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:45.449981 11530 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:45.489846  8547 leader_election.cc:336] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 2.239s (SENT)
I20260709 13:01:45.448999 11422 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:45.440047 11474 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:45.497944  9094 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:45.500414 11552 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.501863 11501 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:45.503543 11550 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:45.554850  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:45.555718  8580 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:45.438762 11551 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:45.496037 11530 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:45.571365 11530 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:45.572896  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 476170us
I20260709 13:01:45.574291  8503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59086
I20260709 13:01:45.575507  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:45.576759  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:45.576851  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:45.577360  8510 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:45.577648  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:45.518573  8577 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:45.583714  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 309441us
I20260709 13:01:45.485342 11485 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:45.587321  8577 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.551905 11501 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:45.591566  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 82877.4us
I20260709 13:01:45.587308  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 836) took 1771 ms. Trace:
I20260709 13:01:45.579269 11559 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.415469 11462 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.459419 11529 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.595674  9093 rpcz_store.cc:276] 0709 13:01:43.815948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.816053 (+   105us) service_pool.cc:224] Handling call
0709 13:01:43.888050 (+ 71997us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:43.936048 (+ 47998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.936083 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:43.948143 (+ 12060us) log.cc:844] Serialized 52 byte log entry
0709 13:01:44.306045 (+357902us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:44.534005 (+227960us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.554307 (+ 20302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.554390 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.575492 (+1021102us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b18004665a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:01:45.579715 (+  4223us) raft_consensus.cc:1685] finished
0709 13:01:45.587093 (+  7378us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.587249 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18554,"prepare.queue_time_us":333292,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2218,"raft.queue_time_us":47814,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":14262,"spinlock_wait_cycles":15794432,"thread_start_us":388962,"threads_started":2,"wal-append.queue_time_us":574554}
I20260709 13:01:45.553485 11552 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.623579 11556 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.624172 11551 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.626168 11462 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.626487 11510 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:45.627092  8502 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:45.552350 11422 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.640785  8508 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:01:45.616796 11502 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.001s
I20260709 13:01:45.646597  8503 raft_consensus.cc:606] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:01:45.552636 11474 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.628232 11563 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:45.495571 11555 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.658432  8503 raft_consensus.cc:614] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:45.661857  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.658409  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:45.666741  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:45.667976  8502 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
W20260709 13:01:45.658499 11477 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.006s
I20260709 13:01:45.666730  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:45.678483  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 376517us
I20260709 13:01:45.679301  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:45.681749  8508 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:45.682237  8508 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:45.690413  9065 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:45.697089 11571 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.702348 11571 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.665351 11525 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:45.696174 11526 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:01:45.671685 11483 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:45.706874  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 115443us
I20260709 13:01:45.706624  8508 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.634773 11559 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:45.713234  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54383us
I20260709 13:01:45.719377 11167 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:45.719969 11552 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.664372 11502 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.648583 11556 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.692010 11461 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:45.713901 11525 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.727358 11557 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:45.727741 11534 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.004s
I20260709 13:01:45.728662  8508 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:45.750406  8547 leader_election.cc:336] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 2.230s (SENT)
I20260709 13:01:45.765614  8547 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:45.753010  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 51332us
I20260709 13:01:45.729923 11483 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:45.716648 11426 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:45.768776  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:45.698014 11490 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:01:45.773025 11510 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:45.775614 11463 consensus_meta.cc:287] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.000s
I20260709 13:01:45.775842 11167 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:45.764384 11557 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.778512 11474 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.779739 11422 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.755347 11479 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.807883 11479 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.782485 11559 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:45.808729  8504 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:45.783068 11571 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.669750 11563 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.811499 11563 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.759207 11520 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:45.816716 11223 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.002s
I20260709 13:01:45.817200 11223 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.818617 11221 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:45.819047 11221 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:45.819569 11223 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.819980 11221 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:45.821281  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 52594.8us
I20260709 13:01:45.770844 11534 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:45.685971 11477 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.822216  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:45.823138 11567 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:01:45.824020 11477 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.824136  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:45.825357  8578 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:45.777792 11530 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.790724 11426 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.830497 11426 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.790947 11485 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:45.805451 11577 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:45.821415 11221 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.787341 11555 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:45.771212 11483 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:45.793855 11546 consensus_meta.cc:287] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.005s
W20260709 13:01:45.829509  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.803540 11562 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:01:45.809880 11489 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.003s
I20260709 13:01:45.824824 11477 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:45.801836 11463 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.799371 11552 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.825165 11557 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.873196 11582 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:01:45.841356 11530 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.830884 11574 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:45.844449 11501 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.875012 11587 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:01:45.866273 11526 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.875948 11526 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:45.847600 11392 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.848239 11502 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.845487  8577 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:01:45.838608 11483 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.877374  8577 pending_rounds.cc:85] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 7
I20260709 13:01:45.877655  8577 pending_rounds.cc:107] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260709 13:01:45.857486  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 167191us
I20260709 13:01:45.878002  8582 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:45.877890  8577 raft_consensus.cc:2889] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:45.880870  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.860513  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 129452us
I20260709 13:01:45.866521  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:45.856087 11546 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.873626 11477 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:45.850559 11536 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:45.876746 11501 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.902508  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:45.888442 11536 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:45.885591 11555 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.888895 11552 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:45.915206  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:45.917125  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:45.920058  8508 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:01:45.923756  8508 pending_rounds.cc:85] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 6
I20260709 13:01:45.924144  8508 pending_rounds.cc:107] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:01:45.924484  8508 raft_consensus.cc:2889] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:45.925657  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:45.925921 11477 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:45.931432 11546 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:45.942874  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:45.945463  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:45.932520  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:45.959018 11536 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:45.913439 11556 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:45.934561 11555 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:45.979714  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 122580us
I20260709 13:01:45.958015  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:45.980568  9097 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:45.985255  9098 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:45.989224  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:45.990139  8428 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:45.991096  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:45.991755  8426 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:46.001138  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.001974  8426 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:46.001785  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.002846  8429 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:46.002878  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.006438  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:46.007227  8508 raft_consensus.cc:2368] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:01:46.007881  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:46.008709  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:46.009338  8508 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:46.010300  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:46.011260  9068 leader_election.cc:336] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.972s (SENT)
I20260709 13:01:46.011687  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:46.002391  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:46.012825  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 96625.9us
I20260709 13:01:46.013082  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:46.013175  8434 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:46.013650  9101 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:46.014212  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.014760  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.015815  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.016593  8432 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:46.017439  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:46.018546  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:46.019156  9100 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:46.021204  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:46.023099  8434 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:46.024089  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:46.024740  8429 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.027218  9093 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:46.030503  8547 leader_election.cc:400] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:01:46.000732  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:45.920840 11552 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:46.031750  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.059052  8431 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:46.032752  8428 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 4: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:46.071096  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:46.072082  8427 raft_consensus.cc:2376] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5. Re-sending same reply.
I20260709 13:01:46.075692  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:46.076596  9097 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:46.077780  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:46.012193 11393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.478s	user 0.029s	sys 0.035s
I20260709 13:01:46.055097  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.092813  8429 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
W20260709 13:01:46.055500  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 44254.9us
W20260709 13:01:46.093940  9068 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.974s (SENT)
I20260709 13:01:46.094434  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:46.031275  8508 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:46.056016  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.090175  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:46.054051 11559 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:01:45.999214 11546 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.074658  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:46.095402  8433 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:46.096483 11501 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:46.096952 11501 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.097296 11501 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.097573 11336 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.102573  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:46.102502 11546 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.103823  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:46.104460  8510 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
W20260709 13:01:46.104954 11543 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.032s	user 0.009s	sys 0.005s
I20260709 13:01:46.106995 11422 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:46.107427 11422 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.107780 11422 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.107941  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:46.109050 11542 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.914s	user 0.001s	sys 0.000s
I20260709 13:01:46.109476 11581 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:46.065282 11552 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.110734  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:46.111285  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:46.111891  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:46.112260 11586 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:46.112780 11586 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:46.112816  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:46.105100  8430 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:46.116935  9101 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:46.117928  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:46.118535 11574 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:46.031908 11490 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:46.119633 11462 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:46.120064 11462 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.120420 11462 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:46.113775 11586 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.122049 11377 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:46.122210 11463 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:46.109073 11551 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:01:46.124573  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:46.125103  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:46.119179 11574 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:46.125957  9095 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 8. Ops: []
I20260709 13:01:46.107632 11426 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.105278  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:46.142499  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:46.130353  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:46.171418  9093 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 4: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:46.092312 11526 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:46.171847  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:46.134927 11463 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:46.172722 11463 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.173097  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:46.129597  9097 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:46.167029  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55795.4us
I20260709 13:01:46.176796  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:46.133092  8501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1748) took 2106 ms (client timeout 1665 ms). Trace:
W20260709 13:01:46.180493  8501 rpcz_store.cc:269] 0709 13:01:44.026820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.026978 (+   158us) service_pool.cc:224] Handling call
0709 13:01:46.132926 (+2105948us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b540008d9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:46.133026 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015084800}
I20260709 13:01:46.182090  8501 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:01:46.173893  8503 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:46.141896 11356 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.182408  8501 pending_rounds.cc:85] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 5
I20260709 13:01:46.183159  8501 pending_rounds.cc:107] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:01:46.183542  8501 raft_consensus.cc:2889] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:46.182395  9098 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:46.118535  9101 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:46.054782 11591 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:01:46.187139  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:46.191630  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.194447  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:01:46.152227 11515 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 13:01:46.176510 11393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.559s	user 0.030s	sys 0.035s
I20260709 13:01:46.198910  8435 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:46.199657  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:46.200412  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:46.107803 11555 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:46.204682  9097 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:01:46.173122 11463 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.186187 11574 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:46.216214  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 122327us
I20260709 13:01:46.220570 11588 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:46.203855 11377 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:01:46.129022 11501 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:46.198156 11544 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:46.136495 11529 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:46.221767  9101 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:46.206337 11581 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:46.234601 11588 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:46.203521 11553 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:01:46.235611 11588 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.203711 11465 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:46.237951 11465 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.238338 11465 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:46.192955 11356 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.244274 11506 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.244529 11426 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:46.246439 11462 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.248685 11462 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:46.175287 11483 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.252413 11483 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:46.252975 11483 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.253472 11483 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:46.227852 11555 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:46.131960 11422 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.244294  8507 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:46.260979  8501 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:01:46.262735  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:46.266446  8431 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:46.267553  8432 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:46.233846  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:46.268644  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.269452  8431 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:46.200850 11393 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:46.270399  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:46.277588  8428 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:46.272452  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:46.278352  8434 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:46.266501  8507 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:46.274708  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.276515 11221 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.282507  8507 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:46.290910  8432 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:46.293908  8507 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.294178  8427 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:46.246469 11501 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:46.234660 11581 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:46.304762  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.269799 11546 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:46.284886 11530 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.284086 11491 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.314749  8506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1746) took 2367 ms (client timeout 2087 ms). Trace:
W20260709 13:01:46.315148  8506 rpcz_store.cc:269] 0709 13:01:43.947504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.947634 (+   130us) service_pool.cc:224] Handling call
0709 13:01:46.311449 (+2363815us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b540008cad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:46.314684 (+  3235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1690295552}
I20260709 13:01:46.322901  8502 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:01:46.323314  8502 pending_rounds.cc:85] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 4
I20260709 13:01:46.323508  8502 pending_rounds.cc:107] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:01:46.323704  8502 raft_consensus.cc:2889] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:46.289958 11462 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.334846  8507 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:46.310516  8434 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
W20260709 13:01:46.340811  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.310478 11581 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:46.347177  8427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:01:46.351155  8427 raft_consensus.cc:606] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:46.364665  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:46.365532  8506 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.378002  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:46.339751 11546 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.336251 11491 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:46.390630 11491 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:46.392681 11422 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:46.357511 11223 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:46.394093 11491 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.394415 11223 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:46.394765 11491 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.395375 11223 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.398711 11483 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:46.399520 11491 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:46.353324 11526 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:46.404357 11524 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.411837 11525 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:46.329021 11530 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:46.310242 11221 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.420564  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.427269  8584 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:46.429203  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:46.434173  8580 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:46.339396 11462 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:46.436836  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:46.439270  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.440523  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:46.445243  8582 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:46.447883  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:46.448695  8584 raft_consensus.cc:2393] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:46.448513  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:46.449568  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:46.460996  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.503069  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:46.507088  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:46.509512  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:46.512569  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:46.512753  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:46.513945  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:46.514231  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.433480 11392 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.552845  8584 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:46.552232  8576 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:46.576192  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:46.349455 11393 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:46.579282  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:46.576998  9099 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.012s	sys 0.043s
I20260709 13:01:46.353924 11557 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.579990  8577 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:46.428337 11491 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.580739  9099 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.012s	sys 0.043s
I20260709 13:01:46.588192  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.589351  8428 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:01:46.510489 11535 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:01:46.612134  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:46.386765 11552 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:46.619568  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:46.623773  8584 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:46.621731  8580 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:46.630597  8577 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:46.632861  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:46.388047 11546 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:46.649853  9068 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.107s (SENT)
I20260709 13:01:46.546537 11426 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.570509 11483 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.566334 11478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.864s	user 0.023s	sys 0.057s
I20260709 13:01:46.681408  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:46.518424 11463 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.180220 11221 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:46.697062  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 463276us
I20260709 13:01:47.845695 11221 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:46.878275  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:47.846450 11221 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.846927  8429 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:47.848768 11221 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:47.849292 11221 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:47.541486  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 638) took 1968 ms. Trace:
I20260709 13:01:47.851222 11426 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:47.851642  8580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2067) took 1420 ms (client timeout 1769 ms). Trace:
W20260709 13:01:47.852339  8580 rpcz_store.cc:269] 0709 13:01:46.431525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.448225 (+ 16700us) service_pool.cc:224] Handling call
0709 13:01:47.851482 (+1403257us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003df9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:47.851586 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396441472}
I20260709 13:01:47.852880  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1928) took 1592 ms. Trace:
W20260709 13:01:46.972779  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.853296  8426 rpcz_store.cc:276] 0709 13:01:46.260382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.260498 (+   116us) service_pool.cc:224] Handling call
0709 13:01:46.260769 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.576153 (+315384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.576181 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.576686 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.174370 (+597684us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:47.174438 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.174560 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.852697 (+678137us) raft_consensus.cc:1685] finished
0709 13:01:47.852715 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.852826 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23347,"raft.queue_time_us":63534,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8691,"thread_start_us":764682,"threads_started":2,"wal-append.queue_time_us":1208653}
I20260709 13:01:47.855443  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:47.379529  8506 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.994s	user 0.011s	sys 0.000s
I20260709 13:01:47.856026  8426 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
W20260709 13:01:47.099017  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 446271us
I20260709 13:01:47.856629  8576 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:47.826217 11356 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:47.857147  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2072) took 1346 ms. Trace:
I20260709 13:01:47.856999  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:46.996803  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:46.631805 11392 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.857833  8426 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
W20260709 13:01:46.917634  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.858412  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2153) took 1545 ms. Trace:
I20260709 13:01:47.858845  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:47.859004  8505 rpcz_store.cc:276] 0709 13:01:46.313391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.646227 (+332836us) service_pool.cc:224] Handling call
0709 13:01:47.858359 (+1212132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.859452  8426 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:47.860086  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:47.860277 11554 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:47.860852  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2159) took 1462 ms. Trace:
I20260709 13:01:46.755100 11530 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:47.859982 11576 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:47.861227  8505 rpcz_store.cc:276] 0709 13:01:46.398468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.859837 (+1461369us) service_pool.cc:224] Handling call
0709 13:01:47.860799 (+   962us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.675675 11553 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:46.632120 11491 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:47.308620  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 825) took 1359 ms. Trace:
W20260709 13:01:47.156157 11608 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
W20260709 13:01:46.744628 11465 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 13:01:47.707734  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 482) took 2555 ms. Trace:
I20260709 13:01:46.861505  8582 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:47.850675  8509 rpcz_store.cc:276] 0709 13:01:45.572812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.574378 (+  1566us) service_pool.cc:224] Handling call
0709 13:01:45.574764 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.673532 (+ 98768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.673560 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.673600 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:45.673628 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.541110 (+1867482us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b540008edd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:47.541183 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.541390 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226686848}
W20260709 13:01:47.690753  8430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.002s	sys 0.017s
W20260709 13:01:47.888634  8430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.006s	sys 0.017s
I20260709 13:01:47.888672  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:47.889577  8509 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
W20260709 13:01:47.889842  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.890211  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2152) took 1623 ms. Trace:
I20260709 13:01:47.890658  8509 rpcz_store.cc:276] 0709 13:01:46.266916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.888389 (+1621473us) service_pool.cc:224] Handling call
0709 13:01:47.890144 (+  1755us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.891739  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:47.892376  8509 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:47.874424 11563 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.680208 11506 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.894014 11563 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.894481 11506 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.895572 11491 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:47.896121 11491 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.896512 11506 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:47.080029 11462 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:47.896884 11563 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:46.961238 11347 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:47.858234  8576 rpcz_store.cc:276] 0709 13:01:46.510869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.612195 (+101326us) service_pool.cc:224] Handling call
0709 13:01:47.857095 (+1244900us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:47.273564 11611 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:01:47.872761  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:47.068085 11595 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:01:46.776012  8431 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:47.905190  8505 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:47.905855  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2158) took 1514 ms. Trace:
I20260709 13:01:47.906276  8505 rpcz_store.cc:276] 0709 13:01:46.391898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.862118 (+1470220us) service_pool.cc:224] Handling call
0709 13:01:47.905784 (+ 43666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.849741 11221 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:47.863418 11463 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:47.856138  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.047045 11588 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.682520  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:47.913247  8427 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:01:47.913698  8427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1779) took 1299 ms (client timeout 1643 ms). Trace:
I20260709 13:01:47.914287  8584 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
W20260709 13:01:47.914791  8584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2074) took 1403 ms (client timeout 1679 ms). Trace:
I20260709 13:01:47.874903  9097 rpcz_store.cc:276] 0709 13:01:45.948899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.077452 (+128553us) service_pool.cc:224] Handling call
0709 13:01:47.308335 (+1230883us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b54005d4154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:47.308525 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111830272}
I20260709 13:01:46.695930  8434 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:46.612246 11422 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:47.850399 11478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.164s	user 0.034s	sys 0.107s
I20260709 13:01:46.883277  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:47.919106  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:47.604903  8435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 610) took 1616 ms (client timeout 2107 ms). Trace:
I20260709 13:01:47.876708  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2065) took 1445 ms. Trace:
W20260709 13:01:47.919731  8435 rpcz_store.cc:269] 0709 13:01:45.987910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.014489 (+ 26579us) service_pool.cc:224] Handling call
0709 13:01:47.604617 (+1590128us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400126454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:47.604784 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421792128}
I20260709 13:01:47.606472  8433 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:47.920173  8577 rpcz_store.cc:276] 0709 13:01:46.430986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.611859 (+180873us) service_pool.cc:224] Handling call
0709 13:01:47.876647 (+1264788us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.920954  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1783) took 1100 ms. Trace:
I20260709 13:01:46.951821  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 949) took 1874 ms. Trace:
I20260709 13:01:47.549697  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 639) took 1976 ms. Trace:
I20260709 13:01:47.921584  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:47.550812  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1772) took 1561 ms. Trace:
I20260709 13:01:47.877805  8583 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:46.750896  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.922353  8501 rpcz_store.cc:276] 0709 13:01:45.989200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.203514 (+214314us) service_pool.cc:224] Handling call
0709 13:01:46.260758 (+ 57244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.266805 (+  6047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.550559 (+1283754us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b540008c350. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:47.550736 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71566720}
I20260709 13:01:47.922492  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1838) took 1278 ms. Trace:
I20260709 13:01:47.921797  9099 rpcz_store.cc:276] 0709 13:01:45.077303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.078000 (+   697us) service_pool.cc:224] Handling call
0709 13:01:45.095260 (+ 17260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.095461 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:45.095699 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.855294 (+759595us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b1800461b60. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:01:46.950179 (+1094885us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.951328 (+  1149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.951397 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:46.951477 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.951574 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.951741 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10267,"prepare.queue_time_us":151263,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":3316,"raft.queue_time_us":82037,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":17519,"spinlock_wait_cycles":21813632,"thread_start_us":1093107,"threads_started":3,"wal-append.queue_time_us":1104292}
I20260709 13:01:47.921851  8504 rpcz_store.cc:276] 0709 13:01:45.573111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.574982 (+  1871us) service_pool.cc:224] Handling call
0709 13:01:45.575282 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.809204 (+233922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.549345 (+1740141us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b540008d254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:47.549608 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536422656}
I20260709 13:01:47.923822  8577 rpcz_store.cc:276] 0709 13:01:46.644463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.921366 (+1276903us) service_pool.cc:224] Handling call
0709 13:01:47.922442 (+  1076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.924705  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:47.924959  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:47.925143  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2076) took 1413 ms. Trace:
I20260709 13:01:47.925398  8577 rpcz_store.cc:276] 0709 13:01:46.512091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.924500 (+1412409us) service_pool.cc:224] Handling call
0709 13:01:47.925107 (+   607us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:46.699949  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.925947  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:47.860801 11554 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:47.850764 11498 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.612102 11477 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.856097  8506 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:47.879426  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:47.931209  8506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1786) took 1672 ms (client timeout 1964 ms). Trace:
I20260709 13:01:47.887928  8578 rpcz_store.cc:276] 0709 13:01:45.152265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.152449 (+   184us) service_pool.cc:224] Handling call
0709 13:01:45.153000 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.825802 (+672802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.707381 (+1881579us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54001a2f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:47.707646 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1545777024}
I20260709 13:01:47.879431  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:47.931502  8506 rpcz_store.cc:269] 0709 13:01:46.258997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.345140 (+ 86143us) service_pool.cc:224] Handling call
0709 13:01:47.931154 (+1586014us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.931862  8579 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:47.932359  8579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1839) took 1276 ms (client timeout 1635 ms). Trace:
I20260709 13:01:47.932482  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:47.888019  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:47.898677  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1831) took 1476 ms. Trace:
I20260709 13:01:47.883958  8426 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:47.902773  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:47.933193  8582 rpcz_store.cc:276] 0709 13:01:46.422706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.440200 (+ 17494us) service_pool.cc:224] Handling call
0709 13:01:47.898601 (+1458401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.933706  8576 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:01:47.903172  8473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.002s	sys 0.012s
I20260709 13:01:47.861234  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:47.876397 11393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.005s
I20260709 13:01:47.896561 11491 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.908927  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1781) took 1133 ms. Trace:
I20260709 13:01:47.909209  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1925) took 1656 ms. Trace:
I20260709 13:01:47.184252 11336 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:47.877893 11574 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.605s	user 0.011s	sys 0.000s
I20260709 13:01:47.850906 11552 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:47.879212  8429 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:01:47.911428  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 1.26149e+06us
I20260709 13:01:47.944466  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1782) took 1146 ms. Trace:
W20260709 13:01:47.944620  9068 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.149s (SENT)
I20260709 13:01:47.945125  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:47.912001  8575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.011s	sys 0.008s
I20260709 13:01:46.756822 11557 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:47.915241  8584 rpcz_store.cc:269] 0709 13:01:46.511537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.619115 (+107578us) service_pool.cc:224] Handling call
0709 13:01:47.914723 (+1295608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.944912  8429 rpcz_store.cc:276] 0709 13:01:46.798493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.798763 (+   270us) service_pool.cc:224] Handling call
0709 13:01:47.944408 (+1145645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.902374 11553 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.898483 11469 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.861954 11576 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.902273 11531 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.921296  8433 rpcz_store.cc:276] 0709 13:01:46.821077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.583250 (+762173us) service_pool.cc:224] Handling call
0709 13:01:47.605973 (+ 22723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.920700 (+314727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.920882 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.939402 11530 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:47.926764  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:47.853425 11426 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:47.921458 11422 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.927850  8577 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:01:47.927881  8504 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:47.845728 11483 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.929114  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:47.957171  8435 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:47.956806  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2070) took 1524 ms. Trace:
I20260709 13:01:47.957731  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:47.957959  8577 rpcz_store.cc:276] 0709 13:01:46.432312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.925752 (+1493440us) service_pool.cc:224] Handling call
0709 13:01:47.925988 (+   236us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:47.956430 (+ 30442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.956722 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.911110 11356 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:47.930444  8583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2075) took 1418 ms (client timeout 1647 ms). Trace:
I20260709 13:01:47.932417  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:47.897473 11462 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.984797 11275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.004s	sys 0.004s
W20260709 13:01:47.934140  8473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.003s	sys 0.012s
I20260709 13:01:47.959407  8506 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:47.959051  8583 rpcz_store.cc:269] 0709 13:01:46.511814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.548626 (+ 36812us) service_pool.cc:224] Handling call
0709 13:01:47.930390 (+1381764us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.959368  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1782) took 1936 ms. Trace:
I20260709 13:01:47.960880  8504 rpcz_store.cc:276] 0709 13:01:46.022556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.924203 (+1901647us) service_pool.cc:224] Handling call
0709 13:01:47.927735 (+  3532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.956594 (+ 28859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.959310 (+  2716us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.960989 11356 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.962379  8504 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:47.962459 11483 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:47.963086  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1783) took 1940 ms. Trace:
I20260709 13:01:47.963181 11483 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:47.963426 11356 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:47.929854  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2066) took 1498 ms. Trace:
I20260709 13:01:47.965058  8581 rpcz_store.cc:276] 0709 13:01:46.431266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.613814 (+182548us) service_pool.cc:224] Handling call
0709 13:01:47.929792 (+1315978us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:47.932749  8579 rpcz_store.cc:269] 0709 13:01:46.655713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.381063 (+725350us) service_pool.cc:224] Handling call
0709 13:01:47.932311 (+551248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44800}
I20260709 13:01:47.936941  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2071) took 1486 ms. Trace:
W20260709 13:01:47.909039  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.966202 11462 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.967267 11392 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:47.938943  8501 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:47.968108  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:47.902187 11465 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:47.079056  8432 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.014s	sys 0.029s
I20260709 13:01:47.928071 11463 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:47.914075  8427 rpcz_store.cc:269] 0709 13:01:46.614248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.616855 (+  2607us) service_pool.cc:224] Handling call
0709 13:01:47.913645 (+1296790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.983325  8427 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:47.984869  8427 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:47.947039  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:47.945978  8575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.012s	sys 0.008s
I20260709 13:01:47.986608  8429 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:47.937209 11498 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:47.931071 11490 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:47.931450 11478 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:47.940111  8430 rpcz_store.cc:276] 0709 13:01:46.252643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.270978 (+ 18335us) service_pool.cc:224] Handling call
0709 13:01:46.291468 (+ 20490us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:46.618058 (+326590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.618100 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:46.993117 (+375017us) log.cc:844] Serialized 52 byte log entry
0709 13:01:47.888899 (+895782us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.908706 (+ 19807us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.908920 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.908987 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.909024 (+    37us) raft_consensus.cc:1685] finished
0709 13:01:47.909035 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.909149 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21733,"raft.queue_time_us":65558,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":8135,"spinlock_wait_cycles":7010944,"thread_start_us":1146483,"threads_started":2,"wal-append.queue_time_us":835967}
W20260709 13:01:47.939211 11393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.001s	sys 0.005s
I20260709 13:01:48.006403  8506 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:01:47.958520  8433 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:47.967211  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:48.012593  8583 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:48.010164 11392 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.968333 11462 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.013522 11622 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:47.968256  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1778) took 1977 ms. Trace:
I20260709 13:01:48.014199  8501 rpcz_store.cc:276] 0709 13:01:45.990940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.923487 (+1932547us) service_pool.cc:224] Handling call
0709 13:01:47.938547 (+ 15060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.967994 (+ 29447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.968205 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.014309 11622 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.939839  8431 rpcz_store.cc:276] 0709 13:01:46.775164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.775428 (+   264us) service_pool.cc:224] Handling call
0709 13:01:46.775806 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.908601 (+1132795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.908861 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.015288  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.016113  8579 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:48.016299  8431 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:48.016552 11622 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.017028 11622 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:47.948695 11506 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:47.958588  8508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:01:48.017583  8431 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:48.018107  8508 raft_consensus.cc:606] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:48.018543  8508 raft_consensus.cc:614] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:47.970255  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:47.968942  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:47.965840  8576 rpcz_store.cc:276] 0709 13:01:46.450292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.902529 (+1452237us) service_pool.cc:224] Handling call
0709 13:01:47.936885 (+ 34356us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:47.937446  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49493.4us
I20260709 13:01:47.933856  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:47.963496  8504 rpcz_store.cc:276] 0709 13:01:46.028034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.961784 (+1933750us) service_pool.cc:224] Handling call
0709 13:01:47.962080 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.962850 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.963032 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:47.980269  8432 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.470s	user 0.014s	sys 0.065s
I20260709 13:01:47.956229 11531 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:47.964013 11426 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:47.947506 11574 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.981302 11221 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:47.917403  8509 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:01:47.937497 11477 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:47.954309 11530 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.950239 11621 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.953366 11557 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:47.964324 11275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.576s	user 0.007s	sys 0.038s
I20260709 13:01:47.969271 11563 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:47.989176 11526 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:47.971313 11356 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:01:47.954519 11469 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:47.993111 11422 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.074687 11554 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.001585  8435 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:48.013608 11392 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.076457  8435 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:01:47.990700 11581 consensus_meta.cc:287] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.606s	user 0.015s	sys 0.000s
I20260709 13:01:47.918905 11588 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:48.016952  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:47.971158  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:47.966010 11483 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.948375 11616 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:01:48.083523  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1777) took 2092 ms. Trace:
I20260709 13:01:48.083909 11483 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:48.085587 11536 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.086776 11531 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.055862  8431 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:47.995069 11524 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.589s	user 0.015s	sys 0.000s
I20260709 13:01:48.013688  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.020483  8427 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:48.058763  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:48.098228  8583 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:48.059062  8426 raft_consensus.cc:2410] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:48.018359 11478 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.061610  8508 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:48.099313  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:48.099885  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2157) took 1726 ms. Trace:
I20260709 13:01:48.100153  8508 rpcz_store.cc:276] 0709 13:01:46.373425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.061177 (+1687752us) service_pool.cc:224] Handling call
0709 13:01:48.061445 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.099682 (+ 38237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.099841 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.100638 11221 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:48.101981  9094 raft_consensus.cc:2410] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:01:48.102335  8431 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:48.062597  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 655) took 1804 ms. Trace:
I20260709 13:01:47.993153 11465 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.017606 11622 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.108301  8430 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:01:48.108647  8430 pending_rounds.cc:85] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 3
I20260709 13:01:48.108856  8430 pending_rounds.cc:107] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:01:48.109102  8430 raft_consensus.cc:2889] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:48.067895  9098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 818) took 2120 ms (client timeout 2075 ms). Trace:
I20260709 13:01:48.007371 11586 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:01:48.071460  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:48.114430  8584 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:48.087620 11588 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.063194 11530 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:48.114501  8428 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:47.954279 11552 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.081346  8578 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:48.123137  8581 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:48.062937 11553 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:48.136350  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1788) took 1322 ms. Trace:
I20260709 13:01:48.136840  8507 rpcz_store.cc:276] 0709 13:01:46.813705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.106876 (+1293171us) service_pool.cc:224] Handling call
0709 13:01:48.135819 (+ 28943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.135994 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.136017 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.136057 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:48.136083 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.136144 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.136275 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.017746 11506 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.110594 11524 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.110181 11221 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:48.151000 11619 log.cc:927] Time spent T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:01:48.151429  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 239358us
I20260709 13:01:48.152683  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1789) took 1337 ms. Trace:
I20260709 13:01:48.153082  8507 rpcz_store.cc:276] 0709 13:01:46.814870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.137995 (+1323125us) service_pool.cc:224] Handling call
0709 13:01:48.152200 (+ 14205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.152369 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.152393 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.152433 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:48.152472 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.152521 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.152631 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.154120  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:48.083933  8502 rpcz_store.cc:276] 0709 13:01:45.990683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.248644 (+257961us) service_pool.cc:224] Handling call
0709 13:01:46.311577 (+ 62933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.324067 (+ 12490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.083335 (+1759268us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b540008cad0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:48.083464 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143992576}
W20260709 13:01:48.150259  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 205646us
I20260709 13:01:48.088501  8505 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:48.102945  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:48.138856 11223 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:48.158579 11223 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.103400  8509 rpcz_store.cc:276] 0709 13:01:46.258241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.891460 (+1633219us) service_pool.cc:224] Handling call
0709 13:01:48.062529 (+171069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.087320 11581 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:48.110260  9098 rpcz_store.cc:269] 0709 13:01:45.945043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.945183 (+   140us) service_pool.cc:224] Handling call
0709 13:01:48.065098 (+2119915us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b5400544554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:48.065206 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89798528}
W20260709 13:01:48.160087  9068 leader_election.cc:336] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.285s (SENT)
I20260709 13:01:48.072410  8429 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:48.062294 11393 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:48.170578  8583 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:48.170646  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:48.115911 11491 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.156364 11477 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.069062 11557 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.190299  8550 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:48.189248 11563 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:48.191711 11557 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:48.112515 11625 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.192642 11629 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:48.192505 11625 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.193022  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:48.193291 11629 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:48.194190 11465 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:48.194901 11625 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.151770 11392 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.195112 11463 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:48.195304 11629 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:48.095160  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 485) took 2940 ms. Trace:
I20260709 13:01:48.196099 11463 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:48.196532 11463 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:48.196386  8575 rpcz_store.cc:276] 0709 13:01:45.154469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.154612 (+   143us) service_pool.cc:224] Handling call
0709 13:01:45.167846 (+ 13234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.168210 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:45.181373 (+ 13163us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.309889 (+2128516us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18003cec20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:01:47.986586 (+676697us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.987014 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.987205 (+   191us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.987237 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.987317 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.087888 (+100571us) raft_consensus.cc:1685] finished
0709 13:01:48.094916 (+  7028us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.095081 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14467,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":257,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":14494,"spinlock_wait_cycles":6365568,"thread_start_us":676403,"threads_started":1,"wal-append.queue_time_us":2771419}
I20260709 13:01:48.197364 11463 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:48.161242  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.199187  8509 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:01:48.162339  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59462.4us
I20260709 13:01:48.200053  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:48.162909  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.165855  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.201363  8582 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:48.166255  8580 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:01:48.166641  9068 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:48.167117  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:48.073446 11526 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.171285  9099 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:48.081660  8579 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:48.175457  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.178687  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:48.179160 11622 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.179970 11223 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.182283  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:48.170410 11524 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.182982 11576 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.067188 11621 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.159314 11498 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:48.183754 11469 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.183997  9100 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:48.192662 11426 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:48.188894 11581 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.189334 11336 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:48.010851 11490 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.178771  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:48.189254 11393 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:48.247457  9093 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.189318 11552 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:48.212167  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:48.214349  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:48.213915  9102 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:48.211091  8550 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:48.271075  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 60057.7us
I20260709 13:01:48.271723  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:48.272450  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:48.222170  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 62105.4us
I20260709 13:01:48.183260  9095 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:48.225276  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:48.224069  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 955) took 3126 ms. Trace:
I20260709 13:01:48.186897 11530 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:48.228406 11483 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:48.228885  8317 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 09de6eee9632412ebe0a904f65cd2a3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0b9f7467deed4381835a85ffd0e88af6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:48.233018  8510 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:48.220748 11625 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:48.314081  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 452883us
I20260709 13:01:48.227842 11463 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.234248  8578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:01:48.315146  8578 raft_consensus.cc:606] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:48.315533  8578 raft_consensus.cc:614] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:48.236860 11546 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.210199 11531 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.238396  9098 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:48.240200 11524 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.241837  9101 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.213855 11525 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.242389  8576 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:48.219136 11574 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.209491  8503 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:01:48.252730  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:48.224229 11622 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:48.283084  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 341701us
W20260709 13:01:48.327245  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 74624.5us
I20260709 13:01:48.287858  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.329474  8509 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:48.289794 11519 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:48.210685 11517 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.320618 11223 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:48.343060  8576 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:01:48.344509  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.345376  8509 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:48.275774  9096 rpcz_store.cc:276] 0709 13:01:45.092955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.170145 (+ 77190us) service_pool.cc:224] Handling call
0709 13:01:45.182900 (+ 12755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.949788 (+2766888us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b1800387b20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a19337060 00007f1a19337bfb 00007f1a1934264b
0709 13:01:47.949887 (+    99us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.949900 (+    13us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.979818 (+ 29918us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.057900 (+ 78082us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:48.057937 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.058006 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.198823 (+140817us) raft_consensus.cc:1685] finished
0709 13:01:48.198841 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.219448 (+ 20607us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44023,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":3643,"spinlock_wait_cycles":17751936,"thread_start_us":118645,"threads_started":2,"wal-append.queue_time_us":116072}
W20260709 13:01:48.313975  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 101900us
I20260709 13:01:48.319386  8435 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:48.322700  8433 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:48.290802 11627 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:48.322328 11640 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:48.313632 11631 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.331527  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 106170us
I20260709 13:01:48.332343  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:48.354234  8547 leader_election.cc:336] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 3.279s (SENT)
I20260709 13:01:48.354672  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:48.354843 11581 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:48.347187  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:48.355377 11536 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:48.355492 11581 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:48.355791 11552 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.355847 11536 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:48.356472 11536 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.356530 11581 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:48.358063  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:48.360090  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.362040 11552 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:48.362695 11552 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:48.363920 11552 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.368117 11536 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.316337  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:48.321815  8317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 93113.5us
I20260709 13:01:48.290359 11426 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:48.351692  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.350898  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:48.353328  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1775) took 1919 ms. Trace:
W20260709 13:01:48.371830  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 98016.8us
W20260709 13:01:48.377610  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.343406 11223 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:48.339358  9101 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:48.334352 11519 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.335409 11635 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:48.374706  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:48.374754  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 58503.1us
I20260709 13:01:48.372783  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:48.322450 11531 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.352811 11627 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:48.330932 11525 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:48.349661 11517 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.346982 11636 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.168s
I20260709 13:01:48.370715 11631 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:48.520080  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 147386us
I20260709 13:01:48.376792  8432 rpcz_store.cc:276] 0709 13:01:46.434064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.434199 (+   135us) service_pool.cc:224] Handling call
0709 13:01:46.434506 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.434734 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:48.058370 (+1623636us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.352710 (+294340us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.352991 (+   281us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.353043 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:48.353092 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.353170 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.353277 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5887,"prepare.queue_time_us":1444916,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":32107,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":7992,"thread_start_us":1810299,"threads_started":3,"wal-append.queue_time_us":225909}
W20260709 13:01:48.449925  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 84368.8us
W20260709 13:01:48.483520  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 104218us
I20260709 13:01:48.556574  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1780) took 1875 ms. Trace:
I20260709 13:01:48.480768  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1774) took 2059 ms. Trace:
I20260709 13:01:48.557730  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:48.581562  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 308198us
W20260709 13:01:48.596510  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 77860.4us
I20260709 13:01:48.599543  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:48.596611  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.597563  8510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1770) took 2608 ms (client timeout 3279 ms). Trace:
W20260709 13:01:48.602008  8510 rpcz_store.cc:269] 0709 13:01:45.988703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.173941 (+185238us) service_pool.cc:224] Handling call
0709 13:01:48.565742 (+2391801us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54000d93d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:48.597501 (+ 31759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4672074112}
I20260709 13:01:48.598407  8509 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:48.597144  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:48.604954  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:48.588285  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 234109us
I20260709 13:01:48.608062  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:48.609283 11491 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:48.611850  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:48.612389  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:48.612665 11647 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:48.613008  8431 raft_consensus.cc:2376] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8. Re-sending same reply.
I20260709 13:01:48.613143  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:48.369995 11623 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:48.616914  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.617115  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.580330  8434 rpcz_store.cc:276] 0709 13:01:46.432588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.447141 (+ 14553us) service_pool.cc:224] Handling call
0709 13:01:46.447491 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.915557 (+1468066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.480477 (+564920us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54003f1e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:48.480697 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570721664}
I20260709 13:01:48.579244  8428 rpcz_store.cc:276] 0709 13:01:46.680856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.683462 (+  2606us) service_pool.cc:224] Handling call
0709 13:01:46.683795 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.116251 (+1432456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.556273 (+440022us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540023ad54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:48.556487 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3289827072}
I20260709 13:01:48.618400  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:48.619287  8431 raft_consensus.cc:2410] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:01:48.503005 11628 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:01:48.378014 11563 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:48.621493  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.609808 11491 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.413548 11519 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.381997 11506 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.624255  9102 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:48.376791 11640 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:48.479703 11544 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.631924  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:48.673367  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:48.392020 11223 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.634334  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:48.632795 11555 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.635246  8509 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:48.672598 11544 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:48.636358  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:48.636708  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:48.637370  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.511212 11483 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.641357  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:48.641422  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:48.622623 11636 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:01:48.596566 11627 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:48.564882 11635 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:48.645493  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:48.616653 11616 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:48.618745 11477 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:48.723301  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:48.597561 11625 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:48.510206 11641 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:01:48.674350 11639 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:01:48.643646 11347 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:48.731972 11526 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.637068 11491 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.760107 11616 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:48.772853  9095 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:48.772450 11616 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:48.682605  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.633800 11623 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.774824  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.775408  8578 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:48.689177  9100 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:48.776818 11623 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.777042  8510 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:48.382310 11574 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:48.692700  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.614444 11546 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:48.698920  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 97497.4us
I20260709 13:01:48.630281  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.730289  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 654) took 2493 ms. Trace:
I20260709 13:01:48.725373  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2160) took 2325 ms. Trace:
I20260709 13:01:48.786581  8550 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:48.787022  8505 rpcz_store.cc:276] 0709 13:01:46.399918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.920142 (+1520224us) service_pool.cc:224] Handling call
0709 13:01:48.725204 (+805062us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400372dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:48.725315 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357088000}
I20260709 13:01:48.736442  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.759528  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:48.761094  8577 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.734213  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.761734  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:48.762651  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 126366us
W20260709 13:01:48.703488  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 104052us
I20260709 13:01:48.765291 11544 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.703263  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.710436  8398 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:48.770413  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1790) took 1374 ms. Trace:
I20260709 13:01:48.640508 11553 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:01:48.778496  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.694875  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.773790 11616 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.678300 11581 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:48.835862  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 49972.1us
I20260709 13:01:48.835459  8502 raft_consensus.cc:2410] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:01:48.803980  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 63308.4us
I20260709 13:01:48.837596  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:48.839359  9102 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:48.839131  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:48.840339 11623 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:48.840735 11623 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.840736  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:48.728452 11536 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.863588  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:48.860322  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:48.865568  9094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 813) took 2945 ms (client timeout 2090 ms). Trace:
W20260709 13:01:48.866003  9094 rpcz_store.cc:269] 0709 13:01:45.919798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.920004 (+   206us) service_pool.cc:224] Handling call
0709 13:01:48.865390 (+2945386us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b540058c354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:48.865507 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4929810816}
I20260709 13:01:48.843093  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.857602  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.855283  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:48.858511  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 148206us
I20260709 13:01:48.858996  8430 rpcz_store.cc:276] 0709 13:01:47.395774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.058353 (+662579us) service_pool.cc:224] Handling call
0709 13:01:48.107945 (+ 49592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.109789 (+  1844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.770208 (+660419us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b54003a3750. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:48.770349 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99104512}
I20260709 13:01:48.731384 11490 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:48.861284  8580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2078) took 2281 ms (client timeout 2022 ms). Trace:
I20260709 13:01:48.861431  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1773) took 2872 ms. Trace:
I20260709 13:01:48.786811  8504 rpcz_store.cc:276] 0709 13:01:46.236674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.059229 (+1822555us) service_pool.cc:224] Handling call
0709 13:01:48.059799 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.060011 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.060029 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.060320 (+   291us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.341864 (+281544us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:48.341904 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.341970 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.730089 (+388119us) raft_consensus.cc:1685] finished
0709 13:01:48.730109 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.730233 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15266,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":76,"thread_start_us":270434,"threads_started":1,"wal-append.queue_time_us":526298}
I20260709 13:01:48.862128  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1786) took 1768 ms. Trace:
I20260709 13:01:48.868743  8584 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:48.873057  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:48.873446  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.766957 11530 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:48.879558  9099 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.879664  8579 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:48.879077  8503 rpcz_store.cc:276] 0709 13:01:45.989469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.214264 (+224795us) service_pool.cc:224] Handling call
0709 13:01:46.214717 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.326071 (+2111354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.861168 (+535097us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54003c8054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:48.861376 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4562459904}
I20260709 13:01:48.888684  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.889008  8579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:01:48.889308  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.889534  8579 raft_consensus.cc:606] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:48.880698  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:48.767184 11462 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:48.835054 11638 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:01:48.878762  8580 rpcz_store.cc:269] 0709 13:01:46.579668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.853338 (+1273670us) service_pool.cc:224] Handling call
0709 13:01:48.861124 (+1007786us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b540012fcd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:48.861219 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513718528}
I20260709 13:01:48.879251  8427 rpcz_store.cc:276] 0709 13:01:47.093950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.985608 (+891658us) service_pool.cc:224] Handling call
0709 13:01:48.020253 (+ 34645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.097665 (+ 77412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.857965 (+760300us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b5400200150. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:48.862066 (+  4101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78941056}
I20260709 13:01:48.887518  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:48.897822  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:48.908680  8431 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:48.782773 11574 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.901708  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:48.841121 11623 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:48.842751 11581 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.911844  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:48.913893  8503 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:48.914639  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 77483.2us
W20260709 13:01:48.894567 11392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.008s	sys 0.033s
I20260709 13:01:48.896682  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:48.738976 11555 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.905082  8426 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:48.905418  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.905611  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:48.911657  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:48.911844  8584 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:48.918514  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:48.856292 11526 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.920224  8578 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:48.861100 11644 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:48.921631  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:49.016125  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:49.014482  8431 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:48.861938 11621 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:48.927470  8428 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:48.778232 11393 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:49.022486  8435 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:49.026212  8577 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
W20260709 13:01:48.902412  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 270787us
I20260709 13:01:48.879244 11546 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:49.027896  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:48.926385 11392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.008s	sys 0.034s
I20260709 13:01:48.917912 11574 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.028477  8580 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 13:01:48.926342 11586 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 13:01:48.925537  9099 raft_consensus.cc:2410] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:48.878916 11647 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 13:01:49.075855  8502 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:48.733485 11640 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:48.861912 11477 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
W20260709 13:01:49.083832  9093 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.836s	user 0.005s	sys 0.005s
I20260709 13:01:49.085317  9093 raft_consensus.cc:2410] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:48.970618  9102 raft_consensus.cc:2410] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:48.919152 11506 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:49.064731  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:49.087996  9094 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:49.091464  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1787) took 2675 ms. Trace:
I20260709 13:01:48.919001 11581 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.091883  8508 rpcz_store.cc:276] 0709 13:01:46.415995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.100891 (+1684896us) service_pool.cc:224] Handling call
0709 13:01:48.101243 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.111777 (+ 10534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.111807 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.115094 (+  3287us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.331938 (+216844us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:48.331974 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.332036 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.091272 (+759236us) raft_consensus.cc:1685] finished
0709 13:01:49.091291 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.091411 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1035,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":135,"thread_start_us":161249,"threads_started":1,"wal-append.queue_time_us":226257}
I20260709 13:01:49.093479  9102 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:49.028414 11563 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:49.095249  8502 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:49.096642  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:48.918159 11336 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.035041 11546 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.014277 11347 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:01:48.903597 11651 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.237s
I20260709 13:01:49.089414 11426 raft_consensus.cc:2764] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:49.013338 11576 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.149s
I20260709 13:01:49.019685 11536 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:01:49.101763  8508 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:49.155949  8508 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:49.029502 11544 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:01:49.112468  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:49.151667 11477 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:01:49.159942  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:49.160552  9098 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:01:49.113787  9094 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:01:49.113653  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:49.115283  9099 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:49.116191  8507 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:49.103827 11531 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:49.117048 11620 raft_consensus.cc:3055] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:49.059491 11656 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:01:49.118523 11631 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:49.118683 11463 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.799s	user 0.009s	sys 0.002s
I20260709 13:01:49.106890 11546 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:49.120946  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55878 (request call id 16) took 2884 ms. Trace:
I20260709 13:01:49.120338 11574 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:49.123756 11588 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:49.126459 11586 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:49.217923  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:49.226881  9102 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:49.075781 11644 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:49.127578 11478 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:49.129025  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:49.132431  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.134085  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:49.134683  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:49.235697  8584 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:49.236101  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 102139us
I20260709 13:01:49.136313  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:49.100131  9093 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:49.143114  8577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
W20260709 13:01:49.151099  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 310480us
I20260709 13:01:49.162293  9101 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
W20260709 13:01:49.164857  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 258240us
I20260709 13:01:49.166348  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:49.239594  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:49.074177  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 658) took 1146 ms. Trace:
W20260709 13:01:49.173906  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.190375  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 171663us
W20260709 13:01:49.191752  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 99119.5us
I20260709 13:01:49.035264 11635 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:49.138159 11336 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:49.259059  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 130112us
I20260709 13:01:49.260186  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:49.217258  8509 rpcz_store.cc:276] 0709 13:01:46.236989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.119823 (+2882834us) service_pool.cc:224] Handling call
0709 13:01:49.120868 (+  1045us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:49.261706  9102 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:49.166292 11620 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:49.130784 11636 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:49.169443  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:49.223280  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 365945us
I20260709 13:01:49.278359  9094 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:49.277189  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:49.280539  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:49.240152  8577 raft_consensus.cc:606] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:48.912865 11462 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:49.241206  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:49.246178  8475 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.051s (SENT) [suppressed 38 similar messages]
I20260709 13:01:49.288765  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:49.289726  8509 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:49.175176 11576 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:49.175043 11553 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.272817  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:49.231743 11586 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:49.223790 11469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.000s	sys 0.009s
I20260709 13:01:49.282891  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:49.281889  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:49.299269  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:49.300074  9101 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:49.290205  8509 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:49.273594 11588 consensus_queue.cc:1243] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:01:49.290074  8475 leader_election.cc:336] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.135s (SENT)
I20260709 13:01:49.296449  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:49.294860 11576 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:49.291013  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 49913us
I20260709 13:01:49.270192 11625 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:49.277400 11530 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:49.276939 11483 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:49.275132  8584 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:49.249348  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:49.307791  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:49.341848  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:49.303678 11469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.000s	sys 0.010s
I20260709 13:01:49.300810 11629 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:49.334730  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 652) took 3163 ms. Trace:
I20260709 13:01:49.312706  9099 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:01:49.355144  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 65116.5us
I20260709 13:01:49.321842  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1840) took 1355 ms. Trace:
I20260709 13:01:49.355293  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:49.357666  9093 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:49.337076  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:49.358623  8584 raft_consensus.cc:2376] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4. Re-sending same reply.
W20260709 13:01:49.357750  8475 leader_election.cc:336] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.186s (SENT)
I20260709 13:01:49.249993  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:49.359215  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:49.357865  8581 rpcz_store.cc:276] 0709 13:01:47.966482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.966963 (+   481us) service_pool.cc:224] Handling call
0709 13:01:48.082895 (+115932us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ae9c 00007f1a1621aa5b 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:01:48.122731 (+ 39836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.123559 (+   828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.321527 (+1197968us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b5400116cd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:49.321725 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93520896}
W20260709 13:01:49.360144  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 110243us
I20260709 13:01:49.331667  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1937) took 1477 ms. Trace:
I20260709 13:01:49.361632  8433 rpcz_store.cc:276] 0709 13:01:47.854433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.020946 (+166513us) service_pool.cc:224] Handling call
0709 13:01:48.061670 (+ 40724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.347252 (+285582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.331317 (+984065us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54003f0054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:49.331585 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599702784}
I20260709 13:01:49.361022  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:49.357213  8501 rpcz_store.cc:276] 0709 13:01:46.171332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.015060 (+1843728us) service_pool.cc:224] Handling call
0709 13:01:48.015369 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.119877 (+104508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.119921 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.119976 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:48.120010 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.334389 (+1214379us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003728d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:49.334461 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.334650 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239844096}
I20260709 13:01:49.308621  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:49.367794  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 59276.9us
I20260709 13:01:49.369726  9101 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:01:49.370080  8475 leader_election.cc:336] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.455s (SENT)
I20260709 13:01:49.370507  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:49.370121  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:49.374560  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:49.288990 11477 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:01:49.375252  8432 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:01:49.382222  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 102206us
W20260709 13:01:49.312960  8381 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0b9f7467deed4381835a85ffd0e88af6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:49.384255  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:49.384475  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:49.294256 11498 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:01:49.301319 11656 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:01:49.371698 11616 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:49.418488  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:49.418784  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 48756.7us
W20260709 13:01:49.416500  8381 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:01:49.421069  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 51973.7us
I20260709 13:01:49.419556  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:49.258409 11463 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:49.284201 11660 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:01:49.301963 11651 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:01:49.330087 11622 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:49.273741 11563 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:49.246309  8505 rpcz_store.cc:276] 0709 13:01:47.927438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.028910 (+1101472us) service_pool.cc:224] Handling call
0709 13:01:49.073430 (+ 44520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.073682 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.073719 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.073780 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:49.073846 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.073919 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.074094 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:49.367506 11629 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.481770  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:49.658363  8583 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:49.658617  8501 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:49.336071 11483 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:49.304941 11658 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.176s
I20260709 13:01:49.307716 11553 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:49.409655 11469 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:49.491894  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:49.374292 11530 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:49.305557 11663 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 13:01:49.384224 11625 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:49.483443  8381 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:01:49.553649  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 291836us
I20260709 13:01:49.512068  8433 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:49.580821  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 96819.4us
W20260709 13:01:49.580952  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 145133us
I20260709 13:01:49.513214  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:49.512714  8577 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:49.418329 11478 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:49.315148 11347 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.164s
W20260709 13:01:49.639103  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 385543us
W20260709 13:01:49.651620  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 278576us
I20260709 13:01:49.651911  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 497) took 1487 ms. Trace:
I20260709 13:01:49.652777  8579 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:01:49.585376  8503 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.667s	user 0.018s	sys 0.002s
W20260709 13:01:49.514900 11650 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.455s	user 0.001s	sys 0.000s
I20260709 13:01:49.478201 11576 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:49.710052  8576 rpcz_store.cc:276] 0709 13:01:48.164179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.192741 (+ 28562us) service_pool.cc:224] Handling call
0709 13:01:49.593774 (+1401033us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b54003e0b54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:49.651848 (+ 58074us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112027520}
I20260709 13:01:49.710469  8503 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:01:49.716760  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2176) took 1193 ms. Trace:
I20260709 13:01:49.717124  8503 rpcz_store.cc:276] 0709 13:01:48.523149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.911628 (+388479us) service_pool.cc:224] Handling call
0709 13:01:49.716698 (+805070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:49.718298  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:49.719053  8503 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:49.592832 11622 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:49.673610  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 289403us
W20260709 13:01:49.654055 11519 consensus_meta.cc:287] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.951s	user 0.005s	sys 0.005s
I20260709 13:01:49.682591  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:49.681797  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 297362us
I20260709 13:01:49.682845  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:49.732125  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:49.667565 11629 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:49.672044 11483 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:49.701683  9094 raft_consensus.cc:2376] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9. Re-sending same reply.
I20260709 13:01:49.367733 11644 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:49.714169  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1787) took 2543 ms. Trace:
I20260709 13:01:49.748459  8429 rpcz_store.cc:276] 0709 13:01:47.170672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.988985 (+818313us) service_pool.cc:224] Handling call
0709 13:01:47.989293 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.160631 (+171338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.713908 (+1553277us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b540028ffd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:49.714108 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190706048}
I20260709 13:01:49.720080  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:49.750761  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:49.751744  8503 raft_consensus.cc:2410] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:49.683334 11469 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:49.726274  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:49.666883 11465 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:49.737962  8505 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:49.518661 11586 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:49.711035 11530 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:49.754850  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:49.775750  8501 raft_consensus.cc:2376] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8. Re-sending same reply.
I20260709 13:01:49.755602  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:49.778748  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:49.779423  8501 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:49.731333 11625 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:49.724948 11555 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:49.743770 11336 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:49.786731  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:49.714145 11663 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 13:01:49.789740 11673 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:01:49.761317 11469 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:49.764883 11465 consensus_queue.cc:1243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:01:49.783653  8502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.039s	sys 0.017s
I20260709 13:01:49.790361  8501 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:49.775601 11530 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.742635 11519 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:49.709713 11681 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 13:01:49.799371  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 87968.2us
W20260709 13:01:49.938001  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 454500us
W20260709 13:01:49.820724  8502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.039s	sys 0.017s
I20260709 13:01:49.930450  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2089) took 1247 ms. Trace:
I20260709 13:01:49.783905 11462 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:49.943866  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 244882us
W20260709 13:01:49.939294  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 207237us
I20260709 13:01:49.942734  8583 rpcz_store.cc:276] 0709 13:01:48.683371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.683487 (+   116us) service_pool.cc:224] Handling call
0709 13:01:49.651601 (+968114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.658841 (+  7240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.930237 (+271396us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54003e0b50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:49.930390 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2029860224}
I20260709 13:01:49.785768 11536 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:49.929328 11648 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
W20260709 13:01:49.825040 11669 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
I20260709 13:01:49.856032  8503 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:49.945979  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:49.799103 11622 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:49.818621  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2168) took 1636 ms. Trace:
I20260709 13:01:49.800385  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:49.951336  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 225136us
I20260709 13:01:49.974704  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:49.975001  8582 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:49.943092 11636 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:49.955097  8476 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:49.712663 11463 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:49.940795  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 663) took 1662 ms. Trace:
I20260709 13:01:49.999953  8502 rpcz_store.cc:276] 0709 13:01:48.278576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.101835 (+823259us) service_pool.cc:224] Handling call
0709 13:01:49.104764 (+  2929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.104977 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:49.228577 (+123600us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.940454 (+711877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.940511 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:49.940549 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.940627 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.940737 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":250839,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":80,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":14149,"thread_start_us":821774,"threads_started":2}
I20260709 13:01:49.907724 11663 consensus_queue.cc:1243] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:49.967170  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:50.003193  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:01:49.950977 11667 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
I20260709 13:01:49.913925 11662 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:50.005151 11662 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.007493 11662 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:49.906348 11671 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:49.975919  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:49.954337  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:49.978186  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:50.011718 11347 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:50.012356 11347 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:50.014436 11544 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:50.015462 11544 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:50.016014 11544 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:50.016522 11544 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.943996 11683 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:50.020009 11683 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.020684 11683 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:50.023756 11491 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.252s	user 0.010s	sys 0.000s
W20260709 13:01:50.024384 11581 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.919s	user 0.008s	sys 0.001s
I20260709 13:01:50.024299 11491 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.025022 11581 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.025759  8427 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:50.029479 11632 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:01:50.030774 11686 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:01:50.031067 11632 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:50.031944 11632 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:49.961496 11536 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.001734 11553 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:50.052649 11664 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:01:50.055379 11517 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:50.055927 11671 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:50.056826 11671 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:50.057360 11671 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.954860 11530 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:49.995422  8433 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:49.976392 11658 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:49.998948  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 43937.2us
I20260709 13:01:49.956911 11625 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:50.056929 11672 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:01:49.950670 11465 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:01:50.088272  8504 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:01:50.055505  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 77426.7us
W20260709 13:01:50.099938  8578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.021s	sys 0.048s
I20260709 13:01:49.974006  8510 rpcz_store.cc:276] 0709 13:01:48.181837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.603337 (+421500us) service_pool.cc:224] Handling call
0709 13:01:49.818396 (+1215059us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b5400154354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:49.818555 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13150976}
W20260709 13:01:50.102404  8578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.022s	sys 0.049s
I20260709 13:01:50.057768 11671 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.830188 11336 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.160s
W20260709 13:01:50.057834 11679 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:01:50.049229 11627 consensus_meta.cc:287] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.280s	user 0.008s	sys 0.005s
W20260709 13:01:50.058322 11675 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
W20260709 13:01:50.047570 11688 consensus_queue.cc:1175] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dacb523538a14c7cb335ab9c18f4111b" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 7 index: 7 } }
I20260709 13:01:50.092070 11462 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:50.162833  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:50.163546  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1956) took 1263 ms. Trace:
W20260709 13:01:50.063799 11223 consensus_meta.cc:287] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.328s	user 0.010s	sys 0.001s
I20260709 13:01:50.181941  8435 rpcz_store.cc:276] 0709 13:01:48.900307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.032055 (+131748us) service_pool.cc:224] Handling call
0709 13:01:49.032869 (+   814us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.066225 (+ 33356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.066256 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.094291 (+ 28035us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.290948 (+196657us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:49.290983 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.291056 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.163317 (+872261us) raft_consensus.cc:1685] finished
0709 13:01:50.163339 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.163487 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8291,"raft.queue_time_us":27215,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":12637,"thread_start_us":173333,"threads_started":1,"wal-append.queue_time_us":812642}
I20260709 13:01:50.151727 11622 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.076486 11658 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:50.165922 11683 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:50.168143  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 878) took 1537 ms. Trace:
I20260709 13:01:50.168892 11692 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.033629 11557 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:50.032667 11687 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:50.032403 11632 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:50.222219 11462 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:50.223237 11462 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.226388 11683 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:50.226574 11640 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:50.095986 11536 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.228636  8430 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:50.046669 11651 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:50.168243  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 214013us
W20260709 13:01:50.173713 11623 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.158s	user 0.012s	sys 0.000s
I20260709 13:01:50.231465  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:50.065062 11681 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 13:01:50.013583 11347 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.190914  9100 rpcz_store.cc:276] 0709 13:01:48.631057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.776093 (+145036us) service_pool.cc:224] Handling call
0709 13:01:48.776393 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:48.776758 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.776783 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:48.777297 (+   514us) log.cc:844] Serialized 52 byte log entry
0709 13:01:49.223573 (+446276us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:49.308355 (+ 84782us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.308539 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.308605 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.167924 (+859319us) raft_consensus.cc:1685] finished
0709 13:01:50.167943 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.168065 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107022,"prepare.queue_time_us":448328,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":32,"raft.queue_time_us":461598,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":36053,"thread_start_us":530265,"threads_started":2,"wal-append.queue_time_us":567479}
W20260709 13:01:50.180720 11524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.015s	sys 0.022s
W20260709 13:01:50.209362 11677 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.618s	user 0.001s	sys 0.000s
I20260709 13:01:50.210196 11584 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:50.212067 11525 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:50.212850 11657 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.622s	user 0.001s	sys 0.004s
I20260709 13:01:50.214740  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:50.215611  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 874) took 1590 ms. Trace:
I20260709 13:01:50.216362 11691 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.200724 11687 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:50.223129 11632 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:50.268348 11524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.016s	sys 0.022s
W20260709 13:01:50.255795  9095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.014s	sys 0.031s
W20260709 13:01:50.350769  9095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.014s	sys 0.031s
I20260709 13:01:50.258307  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:50.176618 11700 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:50.260851  8547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.009s	sys 0.036s
W20260709 13:01:50.367643  8547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.009s	sys 0.036s
W20260709 13:01:50.368009  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 647049us
W20260709 13:01:50.269667  8507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.010s	sys 0.020s
W20260709 13:01:50.226845 11546 consensus_meta.cc:287] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.980s	user 0.008s	sys 0.003s
W20260709 13:01:50.272161  9096 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.018s	sys 0.030s
I20260709 13:01:50.275156  9068 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:50.226920 11683 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.195557 11658 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.346081 11491 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:50.201198 11557 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:50.345788 11687 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.301501 11526 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:50.308851 11498 raft_consensus.cc:993] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:01:50.310966  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:50.318835 11655 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:50.324255 11620 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.334240  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1841) took 1638 ms. Trace:
I20260709 13:01:50.433156  8582 rpcz_store.cc:276] 0709 13:01:48.695575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.860111 (+164536us) service_pool.cc:224] Handling call
0709 13:01:50.333927 (+1473816us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001a3454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:50.334142 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2550318336}
I20260709 13:01:50.335762  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2177) took 1708 ms. Trace:
I20260709 13:01:50.435027  8504 rpcz_store.cc:276] 0709 13:01:48.627776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.879395 (+251619us) service_pool.cc:224] Handling call
0709 13:01:50.335496 (+1456101us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540008cad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:50.335679 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2716386688}
I20260709 13:01:50.338771 11576 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.339936 11517 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:50.193178  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:50.459219  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 266795us
I20260709 13:01:50.227209 11640 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:50.289273 11686 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:01:50.359274  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44912.1us
I20260709 13:01:50.191165 11223 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.179340 11627 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.269022 11584 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:50.408576 11526 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:50.372648  8507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.011s	sys 0.020s
W20260709 13:01:50.374476  9096 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.019s	sys 0.030s
I20260709 13:01:50.293432 11426 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.426936 11655 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:50.340857 11588 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:50.455188 11517 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:50.378342  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.280658  9097 rpcz_store.cc:276] 0709 13:01:48.625333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.762252 (+136919us) service_pool.cc:224] Handling call
0709 13:01:48.762571 (+   319us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:49.259372 (+496801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.259401 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:49.278774 (+ 19373us) log.cc:844] Serialized 78 byte log entry
0709 13:01:49.710307 (+431533us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:49.737724 (+ 27417us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.990921 (+253197us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.054502 (+ 63581us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.175425 (+120923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.215134 (+ 39709us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54002bc0d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:50.215279 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.215336 (+    57us) raft_consensus.cc:1685] finished
0709 13:01:50.215355 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.215542 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":231333,"prepare.queue_time_us":69471,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":122,"raft.queue_time_us":396087,"raft.run_cpu_time_us":553,"raft.run_wall_time_us":49386,"spinlock_wait_cycles":982969088,"thread_start_us":531405,"threads_started":2,"wal-append.queue_time_us":512910}
I20260709 13:01:50.525667 11710 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:50.526616  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.299084  8508 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.260599 11623 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.384685 11463 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:50.394196  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 119181us
I20260709 13:01:50.350905 11469 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.270862 11651 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.228264 11692 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:50.397989 11483 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.000s
I20260709 13:01:50.398303  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:01:50.401293 11629 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.000s
W20260709 13:01:50.402293 11682 consensus_queue.cc:1175] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ffc86752d264d0c81f68028e6413a91" responder_term: 8 status { last_received { term: 7 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:50.403108  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1785) took 4165 ms. Trace:
I20260709 13:01:50.403329 11698 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:50.403759 11694 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.208s
I20260709 13:01:50.404445 11695 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.224s
I20260709 13:01:50.404280 11557 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.382308 11546 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.406044 11665 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:01:50.377453 11477 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.382532 11683 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:50.386230 11666 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.430866  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 120079us
I20260709 13:01:50.382997 11700 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:50.439491 11687 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.444039 11574 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:50.380553 11660 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:50.444761  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1957) took 1544 ms. Trace:
I20260709 13:01:50.447399 11544 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.410912 11688 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:50.363890  8429 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:50.358716 11699 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.239s
I20260709 13:01:50.494457  8434 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:50.463311 11681 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:50.500862 11676 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:01:50.502553 11711 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:01:50.425431 11697 raft_consensus.cc:1081] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:01:50.502035 11584 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.505074 11586 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:50.509974  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 877) took 1879 ms. Trace:
I20260709 13:01:50.346930 11691 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.463593 11491 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:50.464064 11715 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:50.526268 11519 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:50.359551 11347 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:50.386632  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 410761us
W20260709 13:01:50.652549  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.007s	sys 0.012s
W20260709 13:01:50.636533  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 267765us
I20260709 13:01:50.531574 11517 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.917554 11517 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:50.918004 11691 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:50.920001 11651 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:50.522322 11655 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.921027  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:50.921370 11655 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.922371  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:50.735210 11531 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.923709 11698 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:50.924633 11477 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.924769 11698 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.941097  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:50.665717  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.517062 11701 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.907516 11622 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.003s
I20260709 13:01:50.928079 11584 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:50.930085  8549 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.018s	sys 0.040s
W20260709 13:01:50.959638  8549 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.018s	sys 0.040s
W20260709 13:01:50.959947  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 727677us
I20260709 13:01:50.915310  9095 rpcz_store.cc:276] 0709 13:01:48.630734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.773611 (+142877us) service_pool.cc:224] Handling call
0709 13:01:48.773914 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.034293 (+260379us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:49.281774 (+247481us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.055307 (+773533us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18001b3580. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:01:50.364996 (+309689us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.404150 (+ 39154us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.404659 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.404840 (+   181us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:50.404875 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.404952 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.509662 (+104710us) raft_consensus.cc:1685] finished
0709 13:01:50.509701 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.509891 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117608,"prepare.queue_time_us":312864,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":6910,"raft.queue_time_us":480741,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":25279,"spinlock_wait_cycles":6378880,"thread_start_us":1436782,"threads_started":4,"wal-append.queue_time_us":639369}
I20260709 13:01:50.957832 11715 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:50.456354 11498 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.931720  8509 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.932291  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 668) took 1695 ms. Trace:
I20260709 13:01:50.932093 11660 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.518290 11588 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:50.809737 11717 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:50.527065  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.934257  8426 rpcz_store.cc:276] 0709 13:01:48.900602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.110626 (+210024us) service_pool.cc:224] Handling call
0709 13:01:49.110932 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.133599 (+ 22667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.133640 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.134169 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.227409 (+ 93240us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:49.227453 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.227526 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.208634 (+981108us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:50.444455 (+235821us) raft_consensus.cc:1685] finished
0709 13:01:50.444477 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.444699 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22265,"raft.queue_time_us":23109,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7688,"spinlock_wait_cycles":11633024,"thread_start_us":79423,"threads_started":1,"wal-append.queue_time_us":199739}
I20260709 13:01:50.952976 11681 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.825728 11536 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.004s
I20260709 13:01:50.980815  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:50.936744  8427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.004s	sys 0.004s
W20260709 13:01:50.981647  8427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.004s	sys 0.004s
I20260709 13:01:50.930822 11463 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:50.758927  8431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.006s	sys 0.044s
I20260709 13:01:50.916261  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 875) took 2290 ms. Trace:
I20260709 13:01:50.914546  8508 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.931720  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:51.000531  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 68901us
I20260709 13:01:51.001858  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:51.003150  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:50.914662  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.013s	sys 0.015s
W20260709 13:01:51.003870  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 999293us
I20260709 13:01:51.004451  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:01:50.722541 11530 consensus_meta.cc:287] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
W20260709 13:01:51.007460  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.007956 11691 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.007720 11530 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.008461 11691 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:51.008905 11691 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.010015  8509 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.010190 11718 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.010685 11718 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.011005 11718 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.918118 11692 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.014341 11692 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.014684 11692 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:51.015000 11692 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.015373  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:51.017198 11660 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.018402  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1961) took 1024 ms. Trace:
I20260709 13:01:51.018865 11588 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.018765  8427 rpcz_store.cc:276] 0709 13:01:49.993669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.220923 (+227254us) service_pool.cc:224] Handling call
0709 13:01:50.221326 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.227715 (+  6389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.227748 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.258071 (+ 30323us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.408271 (+150200us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b180002af40. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:01:50.982099 (+573828us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:50.982155 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.982263 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.982331 (+    68us) raft_consensus.cc:1685] finished
0709 13:01:50.982348 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.018345 (+ 35997us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59230,"raft.queue_time_us":79084,"raft.run_cpu_time_us":966,"raft.run_wall_time_us":66266,"spinlock_wait_cycles":30139648,"thread_start_us":573599,"threads_started":1,"wal-append.queue_time_us":641960}
W20260709 13:01:51.020630  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.020936  8427 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:50.947049  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:50.947870  8547 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:50.953418  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.900036 11689 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.513s	user 0.008s	sys 0.003s
I20260709 13:01:50.953630  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:50.920362  8506 rpcz_store.cc:276] 0709 13:01:46.237846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.060508 (+1822662us) service_pool.cc:224] Handling call
0709 13:01:48.734387 (+673879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.734783 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.734820 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.735316 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.155361 (+420045us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:49.155420 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.155526 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.157454 (+1001928us) raft_consensus.cc:1685] finished
0709 13:01:50.157481 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.402729 (+245248us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400372dd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:50.403020 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48380,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":20027,"spinlock_wait_cycles":1532996736,"thread_start_us":293707,"threads_started":1,"wal-append.queue_time_us":687093}
W20260709 13:01:50.949470  8434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 1951) took 2050 ms (client timeout 1864 ms). Trace:
I20260709 13:01:50.958323  8428 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:50.958336  8432 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:01:51.037025  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 83506.9us
W20260709 13:01:51.036895  8434 rpcz_store.cc:269] 0709 13:01:48.898679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.898796 (+   117us) service_pool.cc:224] Handling call
0709 13:01:50.949310 (+2050514us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400001754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:50.949408 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3644685184}
I20260709 13:01:50.914170 11620 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.890512 11644 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.930418 11688 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:50.850416 11656 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:01:50.962149  8549 leader_election.cc:336] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.607s (SENT)
W20260709 13:01:50.953228 11632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.008s	sys 0.017s
I20260709 13:01:50.939968 11525 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:50.966455  8507 rpcz_store.cc:276] 0709 13:01:49.237194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.306797 (+ 69603us) service_pool.cc:224] Handling call
0709 13:01:49.356606 (+ 49809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.356810 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:49.607707 (+250897us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.931876 (+1324169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.931947 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:50.932004 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.932091 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.932231 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4299,"prepare.queue_time_us":123685,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":5377,"raft.queue_time_us":58119,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9372,"thread_start_us":1438481,"threads_started":2}
W20260709 13:01:50.970463  8330 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57098 (request call id 369) took 19050 ms (client timeout 15000 ms). Trace:
I20260709 13:01:50.948526 11555 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:50.927345 11477 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:50.974550  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:50.974594  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:50.935668 11581 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:50.958469 11616 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:50.958184 11698 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:50.980147  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.980064  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:50.527030 11710 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.958806 11708 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:50.983893 11223 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:50.972672 11498 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.958072 11627 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:50.984442 11546 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:50.984645 11705 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:50.985073 11715 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.986827 11623 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:50.943123 11700 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.990639 11557 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.958583 11701 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:50.973105 11356 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.007s	sys 0.003s
W20260709 13:01:50.992458 11576 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.000s
I20260709 13:01:50.992381 11544 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:50.942938 11491 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.943140 11666 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:50.598392 11671 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:50.947719 11654 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:01:50.996826  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:50.997776  9096 rpcz_store.cc:276] 0709 13:01:48.625678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.770999 (+145321us) service_pool.cc:224] Handling call
0709 13:01:48.836099 (+ 65100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.836369 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:49.222820 (+386451us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.915892 (+1693072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.915943 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:50.915992 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.916055 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.916160 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36758,"prepare.queue_time_us":469323,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":329488,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":20044,"thread_start_us":2038945,"threads_started":3,"wal-append.queue_time_us":717842}
I20260709 13:01:51.008231 11687 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:50.951779 11336 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:01:51.019918 11588 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:51.021047  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.943881  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:50.942988 11483 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:51.022053  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 74235.2us
I20260709 13:01:50.943249 11629 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.024796  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:51.026273  8576 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:51.027791  8509 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:01:50.943883  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:50.914829  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1853) took 1779 ms. Trace:
I20260709 13:01:51.028460  8580 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:01:51.029294  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:51.029923  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:51.033114  8431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.007s	sys 0.044s
W20260709 13:01:51.035490  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 88500.7us
I20260709 13:01:51.038676  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2171) took 2856 ms. Trace:
I20260709 13:01:50.923542 11531 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:51.041472  9102 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:50.893751 11640 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.020221 11681 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.202821  8429 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:50.986860  8332 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 2 to 5, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:51.100916  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:51.203797  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:51.204223  8506 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
W20260709 13:01:51.204639  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 242511us
I20260709 13:01:51.096135  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.186484  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:51.205349  8549 leader_election.cc:336] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.632s (SENT)
I20260709 13:01:51.096721  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:51.041481  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1851) took 1913 ms. Trace:
I20260709 13:01:51.064100  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1799) took 1789 ms. Trace:
W20260709 13:01:51.209790  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.061765  8428 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1793) took 1790 ms (client timeout 2248 ms). Trace:
I20260709 13:01:51.108368  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:51.089579  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.206601  8509 pending_rounds.cc:85] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 6
I20260709 13:01:51.214087  8509 pending_rounds.cc:107] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:01:51.214383  8509 raft_consensus.cc:2889] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.042497  8434 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:51.202937  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:51.211463  8426 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:51.209220  8432 rpcz_store.cc:276] 0709 13:01:49.274820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.478988 (+204168us) service_pool.cc:224] Handling call
0709 13:01:49.530798 (+ 51810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.037513 (+1506715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.063802 (+ 26289us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003a4154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:51.064022 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3161280768}
I20260709 13:01:51.215101  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2179) took 1978 ms. Trace:
I20260709 13:01:51.207556  8575 rpcz_store.cc:276] 0709 13:01:49.128040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.132858 (+  4818us) service_pool.cc:224] Handling call
0709 13:01:49.146370 (+ 13512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.146717 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.146746 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.147179 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.373036 (+225857us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:49.373107 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.373209 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.041279 (+1668070us) raft_consensus.cc:1685] finished
0709 13:01:51.041302 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.041429 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2337,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6949,"thread_start_us":224968,"threads_started":1,"wal-append.queue_time_us":1020118}
I20260709 13:01:51.216351  8509 rpcz_store.cc:276] 0709 13:01:49.236339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.289293 (+ 52954us) service_pool.cc:224] Handling call
0709 13:01:49.289588 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.464916 (+1175328us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b540026cb20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192bd06f 00007f1a19335f60 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62
0709 13:01:50.931404 (+466488us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b540026cb20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192bc520 00007f1a19335f70 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62
0709 13:01:51.009730 (+ 78326us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b58007829d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1929b0aa 00007f1a1931d447 00007f1a19335fe7 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4
0709 13:01:51.214888 (+205158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.215052 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2545348480}
I20260709 13:01:51.215412  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1966) took 1174 ms. Trace:
I20260709 13:01:51.211825  8508 rpcz_store.cc:276] 0709 13:01:48.182600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.093580 (+910980us) service_pool.cc:224] Handling call
0709 13:01:49.096375 (+  2795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.298637 (+1202262us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400062d20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192bd06f 00007f1a19335f60 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62
0709 13:01:51.037972 (+739335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.038076 (+   104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.038152 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:51.038229 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.038397 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.038595 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4488,"raft.queue_time_us":4680,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":53029,"spinlock_wait_cycles":347526528}
I20260709 13:01:51.217763  8434 rpcz_store.cc:276] 0709 13:01:50.041258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.038612 (+997354us) service_pool.cc:224] Handling call
0709 13:01:51.042236 (+  3624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.215160 (+172924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.215360 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:51.208294  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:51.203249  8435 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:51.202874  8581 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:51.212778  8428 rpcz_store.cc:269] 0709 13:01:49.271404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.407506 (+136102us) service_pool.cc:224] Handling call
0709 13:01:51.061496 (+1653990us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003a3c54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:51.061686 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2931142912}
I20260709 13:01:51.102283  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.185763  9099 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:51.208420  8503 raft_consensus.cc:2368] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
I20260709 13:01:51.205744  9094 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:51.205816  9095 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:01:51.235188  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.219817  9100 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:51.202906  8579 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:51.247331  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44480.6us
I20260709 13:01:51.202518  8578 rpcz_store.cc:276] 0709 13:01:49.135418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.135531 (+   113us) service_pool.cc:224] Handling call
0709 13:01:49.148387 (+ 12856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.148631 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.148659 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.160754 (+ 12095us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.104186 (+943432us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:50.104236 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.104337 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.914441 (+810104us) raft_consensus.cc:1685] finished
0709 13:01:50.914459 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.914768 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":942997,"threads_started":1,"wal-append.queue_time_us":1250206}
I20260709 13:01:51.250244  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:51.252507  8475 leader_election.cc:336] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.635s (SENT)
W20260709 13:01:51.253520  8475 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.649s (SENT)
I20260709 13:01:51.253935  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:51.041364 11658 consensus_meta.cc:287] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.002s
I20260709 13:01:51.256783  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:51.257071  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:01:51.128860 11722 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:01:51.256439 11622 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.255133  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:51.273934  8435 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:51.295161  9102 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:51.297214  8435 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:51.041148 11651 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:51.055819 11695 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.040709 11574 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:51.040207 11392 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.000s	sys 0.022s
I20260709 13:01:51.282541  8582 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:51.212404 11688 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:51.202049 11728 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:01:51.206838 11632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.011s	sys 0.020s
W20260709 13:01:51.303076  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.208022 11616 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.148991 11469 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:51.055243 11682 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:51.322139  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:51.306999  8504 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:50.980901 11717 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:51.255766 11697 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:51.316802  9098 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:51.255823 11546 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.293435 11576 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.021920 11536 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:51.249014 11655 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.248782 11563 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:51.202095 11462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.010s	sys 0.049s
I20260709 13:01:51.272818 11640 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.325855 11616 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:51.320233 11530 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.256114 11544 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:51.282873 11623 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:51.282382 11627 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.361614  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.362380  9096 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:51.256289 11696 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:51.316236 11392 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.000s	sys 0.023s
I20260709 13:01:51.307315 11519 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:01:51.308619 11695 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:51.309746 11555 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.250247 11656 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:51.294987 11665 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:01:51.303447 11658 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.246201 11644 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.273137 11525 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.333988 11682 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:51.246194 11705 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.323773 11691 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.361347 11627 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.348397 11546 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:51.377807 11531 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:51.379865 11730 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:01:51.380515 11700 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:51.381897 11710 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:51.385272 11683 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.353567 11563 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.390836 11627 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.370945 11695 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.354689 11655 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.399724 11631 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.403787 11631 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.404173 11671 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:51.379909 11629 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.385977 11718 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:51.411660 11682 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.414412 11701 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:51.398108 11666 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:51.416285 11717 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:51.416148 11681 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:51.417369 11691 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.415042 11692 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.422331 11692 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:51.206249  8330 rpcz_store.cc:269] 0709 13:01:31.914569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.914742 (+   173us) service_pool.cc:224] Handling call
0709 13:01:50.965010 (+19050268us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:43.510551 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:43.702488 (+191937us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:43.702544 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:01:43.702571 (+    27us) tablet.cc:662] Decoding operations
0709 13:01:43.704255 (+  1684us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:43.704353 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:43.704382 (+    29us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:01:43.705924 (+  1542us) tablet.cc:701] Row locks acquired
0709 13:01:43.706010 (+    86us) write_op.cc:260] PREPARE: finished
0709 13:01:43.766518 (+ 60508us) write_op.cc:270] Start()
0709 13:01:43.766689 (+   171us) write_op.cc:276] Timestamp: P: 1783602103766440 usec, L: 0
0709 13:01:43.766709 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:43.767605 (+   896us) log.cc:844] Serialized 7904 byte log entry
0709 13:01:44.771566 (+1003961us) op_driver.cc:464] REPLICATION: finished
0709 13:01:44.904912 (+133346us) write_op.cc:301] APPLY: starting
0709 13:01:44.905011 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:44.905472 (+   461us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:44.905621 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:44.908031 (+  2410us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:44.950416 (+ 42385us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:01:44.959471 (+  9055us) write_op.cc:312] APPLY: finished
0709 13:01:45.062502 (+103031us) log.cc:844] Serialized 139 byte log entry
0709 13:01:45.062712 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:45.062882 (+   170us) write_op.cc:454] Released schema lock
0709 13:01:45.062954 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:45.063400 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:45.063443 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3194400,"reported_tablets":34,"spinlock_wait_cycles":863104,"child_traces":[["op",{"apply.queue_time_us":133048,"apply.run_cpu_time_us":5624,"apply.run_wall_time_us":158478,"num_ops":20,"prepare.queue_time_us":101150,"prepare.run_cpu_time_us":42399,"prepare.run_wall_time_us":419170,"raft.queue_time_us":638962,"raft.run_cpu_time_us":74716,"raft.run_wall_time_us":115501,"replication_time_us":1004686,"thread_start_us":966768,"threads_started":4,"wal-append.queue_time_us":179795,"wal-append.run_cpu_time_us":17637,"wal-append.run_wall_time_us":2092283}]]}
I20260709 13:01:51.457574  8332 catalog_manager.cc:5697] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:51.469192  8398 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.005s	sys 0.005s
W20260709 13:01:51.469789  8398 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.006s	sys 0.005s
W20260709 13:01:51.324771  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.470503  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 554943us
I20260709 13:01:51.471382  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1968) took 1242 ms. Trace:
I20260709 13:01:51.472435  8430 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:01:51.474387  8428 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:51.475497  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1805) took 1158 ms. Trace:
I20260709 13:01:51.475739  8426 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:01:51.475935  8428 rpcz_store.cc:276] 0709 13:01:50.316758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.220285 (+903527us) service_pool.cc:224] Handling call
0709 13:01:51.293986 (+ 73701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.475025 (+181039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.475420 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:51.476548  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1802) took 1160 ms. Trace:
I20260709 13:01:51.477020  8426 rpcz_store.cc:276] 0709 13:01:50.315839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.215656 (+899817us) service_pool.cc:224] Handling call
0709 13:01:51.475189 (+259533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.476276 (+  1087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.476490 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:51.310448  8435 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:51.471916  8427 rpcz_store.cc:276] 0709 13:01:50.228850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.040932 (+812082us) service_pool.cc:224] Handling call
0709 13:01:51.041245 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:51.226698 (+185453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.226743 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:51.270110 (+ 43367us) log.cc:844] Serialized 52 byte log entry
0709 13:01:51.470331 (+200221us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:51.470502 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.470650 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.470736 (+    86us) raft_consensus.cc:1685] finished
0709 13:01:51.470782 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.471115 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17624,"raft.queue_time_us":170506,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":27647,"thread_start_us":383677,"threads_started":2,"wal-append.queue_time_us":136749}
I20260709 13:01:51.479525  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1954) took 2579 ms. Trace:
I20260709 13:01:51.480480  8435 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:51.481576  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1964) took 1441 ms. Trace:
W20260709 13:01:51.482801  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 206806us
I20260709 13:01:51.481993  8430 rpcz_store.cc:276] 0709 13:01:50.040392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.272876 (+232484us) service_pool.cc:224] Handling call
0709 13:01:50.273271 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:51.473106 (+1199835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.481217 (+  8111us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540025a3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:51.481476 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2755820928}
W20260709 13:01:51.482825  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.484630  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.485023  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.485349  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.487074  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1803) took 1170 ms. Trace:
I20260709 13:01:51.477691  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:51.487643  8432 rpcz_store.cc:276] 0709 13:01:50.316142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.216149 (+900007us) service_pool.cc:224] Handling call
0709 13:01:51.247064 (+ 30915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.473990 (+226926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.474061 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.474137 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:51.474179 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.486605 (+ 12426us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400125a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:51.486675 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.486886 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520537344}
I20260709 13:01:51.488759  8428 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:01:51.489334  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.479938  8431 rpcz_store.cc:276] 0709 13:01:48.899757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.027384 (+127627us) service_pool.cc:224] Handling call
0709 13:01:49.715953 (+688569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.962638 (+246685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.962688 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.968945 (+  6257us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.206227 (+1237282us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:51.206271 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.206341 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.206381 (+    40us) raft_consensus.cc:1685] finished
0709 13:01:51.206392 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.479003 (+272611us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540028ffd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:51.479311 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15133,"raft.queue_time_us":254947,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":60871,"spinlock_wait_cycles":1573635456,"thread_start_us":1332987,"threads_started":2,"wal-append.queue_time_us":903581}
I20260709 13:01:51.492421  8501 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
W20260709 13:01:51.492879  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.495294  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:51.496323  8501 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:51.497602  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:51.493700  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:51.498498  8501 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.499765  8502 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:51.500881  8507 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:51.503448  8549 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.914s (SENT)
I20260709 13:01:51.505203  8508 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:51.514375  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.519213  8506 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:01:51.519734  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.521484  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:51.524569  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 846) took 2286 ms. Trace:
I20260709 13:01:51.351717  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.525703  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:51.525961  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.345234  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:51.356535  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.348404  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.528825  8509 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:51.344488  9102 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:51.534509  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:51.539273 11347 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.612s	user 0.002s	sys 0.006s
I20260709 13:01:51.323738  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:51.350361 11462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.010s	sys 0.049s
I20260709 13:01:51.565708  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:51.579010  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:51.579619 11683 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.579926 11701 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.581137 11498 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:51.363222 11544 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:51.374723 11555 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.663758  8426 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:01:51.835325  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.586372  8430 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:51.658664  8431 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:51.544457  9093 rpcz_store.cc:276] 0709 13:01:49.237972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.358791 (+120819us) service_pool.cc:224] Handling call
0709 13:01:49.411430 (+ 52639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.700609 (+289179us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:49.781091 (+ 80482us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.208006 (+426915us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b1800392c80. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:01:50.734447 (+526441us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.899649 (+165202us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.899849 (+   200us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:50.899898 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.899996 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.523874 (+623878us) raft_consensus.cc:1685] finished
0709 13:01:51.524016 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.524365 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":199803,"prepare.queue_time_us":68414,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":561231,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":21733,"spinlock_wait_cycles":12552064,"thread_start_us":722596,"threads_started":2,"wal-append.queue_time_us":1239247}
I20260709 13:01:51.722177  9096 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:51.581651  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78513.5us
W20260709 13:01:51.889333  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.889504  8435 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.719849 11581 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.248s
I20260709 13:01:51.890760 11660 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:51.891623 11660 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:51.892124 11581 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:51.892635 11581 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:51.894655  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 315913us
I20260709 13:01:51.674374  8507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59098
I20260709 13:01:51.895665  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:51.720299 11392 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:51.896787 11671 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:51.896971 11392 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:51.897375 11671 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:51.898015 11671 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:51.587805  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.898665 11347 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:51.899145 11347 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.899185  9097 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:51.899636 11347 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:51.900420  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.902714  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.904275  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.905148  9093 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
W20260709 13:01:51.889670  8510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.016s	sys 0.014s
I20260709 13:01:51.906265  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:51.906813  8549 leader_election.cc:336] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.920s (SENT)
W20260709 13:01:51.907182  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.907717  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 143613us
W20260709 13:01:51.908473  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.908663 11336 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.909096 11717 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:51.895932 11658 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.901777  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:51.915755  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.895658  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:51.609370  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.831557 11620 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.736s	user 0.004s	sys 0.008s
I20260709 13:01:51.944368  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:51.898679 11392 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.948297  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:51.948939 11555 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:51.609403  8332 catalog_manager.cc:5697] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 1 to 5, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.951908 11701 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:51.952823 11644 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.953857  9102 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:51.893939 11581 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:51.954651  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.043s	sys 0.042s
W20260709 13:01:51.955643  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 421371us
I20260709 13:01:51.955724  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:51.583652 11656 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:51.953826  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.957986  9101 raft_consensus.cc:2410] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:01:51.959640  8435 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:51.960100 11563 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.586915  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:51.608745  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:51.609134 11586 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:51.976411  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.044s	sys 0.042s
I20260709 13:01:51.719452  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:51.668752 11705 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.671159 11546 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:51.909358 11336 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:51.612211 11491 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:51.662206 11632 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:52.004591  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59046.9us
I20260709 13:01:52.342134  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.129176  9096 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
W20260709 13:01:52.127669  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 137764us
W20260709 13:01:52.308099  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.353561  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 399172us
W20260709 13:01:52.270398  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.349556  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.271534  8501 consensus_meta.cc:287] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.001s
W20260709 13:01:52.355012  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.355398  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.354720  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.118589  9093 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:52.348809  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:52.356310  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.355450  8501 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
W20260709 13:01:52.355854  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.660071 11665 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.040406  8476 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:52.156939  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:52.362336  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1810) took 1069 ms. Trace:
W20260709 13:01:52.366628  8549 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.401s (SENT)
I20260709 13:01:52.367354  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:52.368572  9093 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:01:52.218518 11576 consensus_meta.cc:287] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.800s	user 0.012s	sys 0.002s
W20260709 13:01:52.150761  8581 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.893s	user 0.014s	sys 0.002s
I20260709 13:01:52.362962  8501 rpcz_store.cc:276] 0709 13:01:51.287742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.497114 (+209372us) service_pool.cc:224] Handling call
0709 13:01:52.356974 (+859860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.371910  8431 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
W20260709 13:01:52.218617 11753 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:01:52.148842 11748 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.396s	user 0.006s	sys 0.017s
W20260709 13:01:52.166126 11688 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.001s
I20260709 13:01:52.374274  9093 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:52.350256 11581 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.376720  8581 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:01:52.166380 11557 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.921s	user 0.001s	sys 0.015s
I20260709 13:01:52.379601  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.143222 11483 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.380636  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:52.150672 11666 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:52.038237 11465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.005s	sys 0.006s
W20260709 13:01:52.265156 11584 consensus_meta.cc:287] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.297s	user 0.008s	sys 0.007s
I20260709 13:01:52.261983 11525 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:52.384274 11356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.035s	sys 0.034s
I20260709 13:01:52.384286  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.219259 11694 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.371094 11392 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.407109  9097 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:52.376173 11576 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.218971 11531 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.411755 11531 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.414517 11701 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:52.414814 11627 consensus_meta.cc:287] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.793s	user 0.004s	sys 0.009s
I20260709 13:01:52.406159 11665 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.415243 11627 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.417495 11627 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:52.417724 11665 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:52.418340  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:52.419349 11640 consensus_meta.cc:287] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.062s	user 0.006s	sys 0.012s
W20260709 13:01:52.419689 11356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.035s	sys 0.035s
I20260709 13:01:52.394580 11688 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.156996 11705 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.239s
W20260709 13:01:52.422291 11588 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.175s	user 0.011s	sys 0.007s
I20260709 13:01:52.422550 11688 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.423034 11588 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.423342 11656 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:52.424081 11656 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.424518 11336 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:52.395774 11666 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.425257  8505 raft_consensus.cc:2410] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:52.036881 11586 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.428073 11586 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:52.428704 11586 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:52.429019 11616 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.068s	user 0.006s	sys 0.004s
I20260709 13:01:52.430554 11694 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:52.037266 11745 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.496s	user 0.004s	sys 0.001s
I20260709 13:01:52.037096 11713 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.036689 11519 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.393111  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.444988  8503 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:52.429556 11616 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.447541 11616 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.396334  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1863) took 1367 ms. Trace:
I20260709 13:01:52.448100  8581 rpcz_store.cc:276] 0709 13:01:51.028973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.029071 (+    98us) service_pool.cc:224] Handling call
0709 13:01:52.394113 (+1365042us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.398962 11555 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.449472 11555 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:52.450548 11347 consensus_meta.cc:287] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.005s
I20260709 13:01:52.450853 11586 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:52.450984 11347 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.451759 11555 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:52.399223 11695 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.993s	user 0.014s	sys 0.000s
I20260709 13:01:52.144553 11658 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.255s
I20260709 13:01:52.396445 11725 raft_consensus.cc:2764] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:01:52.453095 11695 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.399900 11682 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.454392  8506 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:52.454263 11682 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.455047  8507 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:52.455425  8507 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:52.456003 11698 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.243s	user 0.013s	sys 0.000s
I20260709 13:01:52.456545 11525 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.425215 11666 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.430969  8575 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:52.457222 11525 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.453112  9093 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:52.400461 11671 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
I20260709 13:01:52.038986  8332 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.423811 11588 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.439090 11531 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.443308  9096 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:52.445515 11749 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:01:52.395169  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.447791 11713 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.456590 11682 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:52.405436  8435 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:52.459473  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 64511.6us
I20260709 13:01:52.388866  9102 raft_consensus.cc:2376] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10. Re-sending same reply.
W20260709 13:01:52.373114  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 1.34317e+06us
I20260709 13:01:52.466756  8398 leader_election.cc:400] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
I20260709 13:01:52.472743  8398 leader_election.cc:403] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:52.476243 11531 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:52.476891 11531 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:52.401746 11632 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.479278 11632 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:52.480645 11555 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:52.482255 11682 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.482844 11682 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.485647 11682 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.486268 11584 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:52.486658 11584 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:52.487576 11584 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.488885 11584 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.476423 11347 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:52.490466  9100 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:52.491125 11681 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.491246 11519 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.491667 11681 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.493835  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:52.497043 11588 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:52.498608 11694 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:52.499810  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.500494 11656 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:52.500768  8581 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:52.501289  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.499782  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:52.502010  8575 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.507066  8507 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.507223 11531 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.508605 11531 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:52.518963  8578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.002s	sys 0.017s
W20260709 13:01:52.520004  8578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.003s	sys 0.018s
W20260709 13:01:52.502094  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.521553  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 139335us
I20260709 13:01:52.522526  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:52.523483 11701 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.524084  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:52.524307 11701 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:52.524817 11701 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:52.525869 11620 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:52.521653 11747 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.525969 11701 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.541215  8504 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:52.533577 11525 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:52.526780 11620 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 13:01:52.542659  8504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1815) took 1249 ms (client timeout 1658 ms). Trace:
W20260709 13:01:52.543079  8504 rpcz_store.cc:269] 0709 13:01:51.292722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.323507 (+ 30785us) service_pool.cc:224] Handling call
0709 13:01:52.542460 (+1218953us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54003732d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:52.542580 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442964352}
I20260709 13:01:52.526690 11705 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 13:01:52.528687 11754 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:01:52.535233  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1811) took 1245 ms. Trace:
I20260709 13:01:52.545766  8506 rpcz_store.cc:276] 0709 13:01:51.289484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.566783 (+277299us) service_pool.cc:224] Handling call
0709 13:01:51.582355 (+ 15572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.454833 (+872478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.534981 (+ 80148us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b5400059bd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:52.535163 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2004932992}
I20260709 13:01:52.532215  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:52.548820 11620 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:52.549727 11620 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:52.550841  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:52.551563  9102 raft_consensus.cc:2376] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5. Re-sending same reply.
I20260709 13:01:52.551241 11620 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.547109 11695 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.554481  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.555699  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.556828  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.559827  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.560635  8579 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:52.561923  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.532789  9096 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:52.564913  8575 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:01:52.566048  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.562599  8579 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:52.568161  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 993) took 1041 ms. Trace:
I20260709 13:01:52.569710  9102 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:01:52.568584  9096 rpcz_store.cc:276] 0709 13:01:51.520924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.360458 (+839534us) service_pool.cc:224] Handling call
0709 13:01:52.562599 (+202141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.470664 11465 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.583029  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:52.469527 11671 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.595883  8581 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.584106  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.597657  8332 catalog_manager.cc:5697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:52.583231 11695 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:52.614564 11695 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.615639 11671 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.616638 11695 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:52.617787  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.618512  9099 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:52.620203  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:52.621032  8579 raft_consensus.cc:2368] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7.
I20260709 13:01:52.623088 11666 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.628005  8578 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:52.630378  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.634914 11526 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.636086 11526 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.638756  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:52.639564  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1858) took 1617 ms. Trace:
I20260709 13:01:52.640251  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.641005  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.641846  8582 raft_consensus.cc:2410] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:52.641754  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:52.642805  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.643050  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:52.643702 11660 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.643925  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:52.644232  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.639716  8578 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:52.644995  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.645314 11536 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.641217  8575 raft_consensus.cc:2410] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:52.651021  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:52.640029  8583 rpcz_store.cc:276] 0709 13:01:51.022227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.022757 (+   530us) service_pool.cc:224] Handling call
0709 13:01:51.023022 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.023359 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.023399 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.023940 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.638884 (+1614944us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b54001e35a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a9090 00007f1a192b66b8 00007f1a1933f92b 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c
0709 13:01:52.638973 (+    89us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:52.639020 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.639113 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.639153 (+    40us) raft_consensus.cc:1685] finished
0709 13:01:52.639164 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.639359 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10506,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":52808,"spinlock_wait_cycles":104371072,"thread_start_us":444218,"threads_started":1,"wal-append.queue_time_us":364848,"wal-append.run_cpu_time_us":2751,"wal-append.run_wall_time_us":1175344}
I20260709 13:01:52.652292  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:52.653015  8549 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.862s (SENT)
I20260709 13:01:52.653481 11747 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
I20260709 13:01:52.646389  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:52.650605  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:52.646538  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.631003 11546 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.668826 11546 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.662732  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.662925 11705 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.664042  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 968) took 1417 ms. Trace:
I20260709 13:01:52.663851  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.663854  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.670923  8575 raft_consensus.cc:2410] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:52.667447 11681 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.670712  9100 rpcz_store.cc:276] 0709 13:01:51.246226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.246501 (+   275us) service_pool.cc:224] Handling call
0709 13:01:52.663766 (+1417265us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400209c54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:52.663943 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584719616}
I20260709 13:01:52.680914  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.665184  9093 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:52.679962  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1970) took 1206 ms. Trace:
I20260709 13:01:52.679049  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:52.684780  8426 rpcz_store.cc:276] 0709 13:01:51.473562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.477878 (+  4316us) service_pool.cc:224] Handling call
0709 13:01:51.490686 (+ 12808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.856672 (+365986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.679720 (+823048us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400021054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:52.679902 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237555456}
I20260709 13:01:52.680029  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:52.678741  8576 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:52.680590  8580 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:52.617813 11465 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.679737 11546 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:52.683586  9102 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:52.671253  8582 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:01:52.679957  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:52.658829  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:52.690276  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:52.689478  8584 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:01:52.696167  9096 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.658352 11491 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.693203  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 55161.8us
I20260709 13:01:52.654737 11666 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:52.698127  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.713086  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.713554  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 673256us
I20260709 13:01:52.716552  9100 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.722591  8577 raft_consensus.cc:2410] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:52.723696  8575 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:52.727811  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:52.712181 11531 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:52.724690 11627 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.747159  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.747725  8430 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:52.755563  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:52.729926  9100 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:01:52.741562  9096 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:52.788501  8581 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:52.748646  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:52.751475  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.736114  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:52.792619  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.799427  8435 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:52.799927  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:52.749627 11752 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 13:01:52.801141  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 995) took 1224 ms. Trace:
I20260709 13:01:52.802760  9095 rpcz_store.cc:276] 0709 13:01:51.643432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.735735 (+1092303us) service_pool.cc:224] Handling call
0709 13:01:52.801057 (+ 65322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:52.809681  8431 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:01:52.810149  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.730594 11392 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.752296 11491 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.716635 11705 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.735550 11336 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:01:52.811530  8428 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:52.812004  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.815162  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.742583 11627 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.813481  8427 raft_consensus.cc:2368] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:01:52.730918 11526 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:01:52.817731  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:52.819145  8433 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 1967) took 2741 ms (client timeout 1735 ms). Trace:
I20260709 13:01:52.819554 11491 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.822849  9100 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:52.813354  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:52.827155  9102 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:52.735383 11640 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:01:52.827618  9096 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:52.827061  8433 rpcz_store.cc:269] 0709 13:01:50.078009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.162532 (+ 84523us) service_pool.cc:224] Handling call
0709 13:01:52.818813 (+2656281us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b54003a2d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:52.818968 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5792264064}
I20260709 13:01:52.811314 11681 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:52.833434  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:52.834900  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 181959us
I20260709 13:01:52.828183 11463 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.839385  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:52.846074  8430 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:52.852808  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.854400  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.856662  9095 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.857903  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.859766 11687 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:52.861549  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.866382  8433 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:52.867406  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.868018  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:52.868688  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:52.868852  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.869293  8433 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.869877  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:52.870733  8431 raft_consensus.cc:2368] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:52.871534  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.872226  8431 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:52.872936  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:52.873135 11631 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:52.879351  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 51149.9us
W20260709 13:01:52.889075  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.873961  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:52.905680  8427 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:01:52.908696  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 120066us
I20260709 13:01:52.850879 11336 consensus_queue.cc:1243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:52.875339 11655 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:52.923216 11705 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:52.916759  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.933595  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.934556  8431 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:52.938745  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.898600 11463 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:52.961637  8474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.027s	sys 0.036s
I20260709 13:01:52.963984  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.964948  9094 raft_consensus.cc:2376] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6. Re-sending same reply.
I20260709 13:01:52.965662  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 988) took 1446 ms. Trace:
I20260709 13:01:52.966339  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:52.967872 11526 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:52.967986  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.968514 11526 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:52.969220  9100 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:52.934551 11465 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:52.970266 11640 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:52.862109 11687 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:52.973240 11687 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:52.973847  9102 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:52.975015  9097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 982) took 1459 ms (client timeout 1697 ms). Trace:
W20260709 13:01:52.975611  9097 rpcz_store.cc:269] 0709 13:01:51.515597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.901446 (+385849us) service_pool.cc:224] Handling call
0709 13:01:52.974797 (+1073351us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400502154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:52.974938 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008746880}
I20260709 13:01:52.977010  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:52.977628  8428 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:52.977957  9097 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:52.980857  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 997) took 1091 ms. Trace:
I20260709 13:01:52.981307  9093 rpcz_store.cc:276] 0709 13:01:51.889745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.473677 (+583932us) service_pool.cc:224] Handling call
0709 13:01:52.664747 (+191070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.684489 (+ 19742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.980626 (+296137us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400209c50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:52.980771 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410063104}
W20260709 13:01:52.978189  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 262551us
I20260709 13:01:52.983085  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:01:52.978518  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 261320us
W20260709 13:01:52.970803  8577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1861) took 1943 ms (client timeout 1906 ms). Trace:
W20260709 13:01:52.968514  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.985518  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.979314  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1814) took 1686 ms. Trace:
W20260709 13:01:52.986320  8474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.030s	sys 0.036s
W20260709 13:01:52.985878  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.978698  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:52.989390  8435 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:52.990803  8433 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:01:52.995430  9102 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:52.996381  8430 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:52.998492  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.016546  8431 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:53.015343  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 669) took 2040 ms. Trace:
I20260709 13:01:53.015060  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:53.005380  9096 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:52.979441  9094 rpcz_store.cc:276] 0709 13:01:51.518852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.963436 (+1444584us) service_pool.cc:224] Handling call
0709 13:01:52.965551 (+  2115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:53.008056  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:53.010006  8427 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:53.018440  8505 rpcz_store.cc:276] 0709 13:01:50.975146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.977979 (+  2833us) service_pool.cc:224] Handling call
0709 13:01:52.984731 (+2006752us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001fe354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:53.015287 (+ 30556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2806227712}
I20260709 13:01:53.011471  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:53.023427  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:52.860265 11681 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:52.984905  8577 rpcz_store.cc:269] 0709 13:01:51.027412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.027568 (+   156us) service_pool.cc:224] Handling call
0709 13:01:52.970516 (+1942948us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54000659d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:52.970699 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3484958080}
W20260709 13:01:53.013249  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.024603  9100 raft_consensus.cc:2410] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:53.023655  8426 raft_consensus.cc:2376] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9. Re-sending same reply.
I20260709 13:01:53.030344  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.031983  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:52.978809 11620 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:52.978789 11531 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:53.039853  8549 leader_election.cc:336] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.639s (SENT)
I20260709 13:01:53.040479  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:53.043094  8428 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:52.969592 11526 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:52.978667 11666 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:01:53.045198  8431 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:01:53.017597 11694 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:53.054800  8550 leader_election.cc:400] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:01:52.986330  8510 rpcz_store.cc:276] 0709 13:01:51.292486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.907338 (+614852us) service_pool.cc:224] Handling call
0709 13:01:51.907840 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.909911 (+  2071us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:52.394363 (+484452us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.973750 (+579387us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18003c1240. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:01:52.973978 (+   228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.979009 (+  5031us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:52.979060 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.979136 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.979232 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3542,"prepare.queue_time_us":621153,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":49,"raft.queue_time_us":261204,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":168,"spinlock_wait_cycles":4670720,"thread_start_us":642049,"threads_started":2,"wal-append.queue_time_us":287433}
I20260709 13:01:53.058537  8550 leader_election.cc:403] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:53.056267  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.065261  8427 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:01:53.065186  8428 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:01:52.979444 11563 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:01:53.072492  8426 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:01:53.074837  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59844.2us
I20260709 13:01:53.052886 11640 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:53.080107  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 49675.2us
I20260709 13:01:53.081051  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1801) took 2765 ms. Trace:
I20260709 13:01:53.075241  8430 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:53.060494 11694 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:53.082230 11694 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:53.083200  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 53251.4us
W20260709 13:01:53.085295  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 54385.5us
I20260709 13:01:53.085449 11465 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:01:53.060616 11620 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.082147  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:53.050527 11682 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:53.085978  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:53.099439  9098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 979) took 1585 ms (client timeout 2039 ms). Trace:
W20260709 13:01:53.099970  9098 rpcz_store.cc:269] 0709 13:01:51.514318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.085572 (+1571254us) service_pool.cc:224] Handling call
0709 13:01:53.099334 (+ 13762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:53.086388  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:53.058205 11336 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:53.088414  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1804) took 2771 ms. Trace:
I20260709 13:01:53.106418  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.093902  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:53.090790  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.093277  8476 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:53.081483  8429 rpcz_store.cc:276] 0709 13:01:50.315530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.206483 (+890953us) service_pool.cc:224] Handling call
0709 13:01:51.206805 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.295988 (+ 89183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.296032 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.470752 (+174720us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.618227 (+147475us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:51.618309 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.080541 (+1462232us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b5400351e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:53.080585 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.080631 (+    46us) raft_consensus.cc:1685] finished
0709 13:01:53.080642 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.080883 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204391680,"thread_start_us":96181,"threads_started":1,"wal-append.queue_time_us":248866}
I20260709 13:01:53.096647  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:53.106040 11576 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.016s	sys 0.020s
I20260709 13:01:53.088506 11695 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:53.089937 11665 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:53.092878 11620 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:53.134680 11563 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:53.159642 11544 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:53.134207  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:53.103992 11336 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.104697  8434 rpcz_store.cc:276] 0709 13:01:50.316458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.219217 (+902759us) service_pool.cc:224] Handling call
0709 13:01:51.246781 (+ 27564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.316533 (+ 69752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.316575 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.478307 (+161732us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.714307 (+236000us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:51.718802 (+  4495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.087912 (+1369110us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b54003a3754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:53.087957 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.088000 (+    43us) raft_consensus.cc:1685] finished
0709 13:01:53.088011 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.088242 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19755,"raft.queue_time_us":25263,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":6091,"spinlock_wait_cycles":113973120,"thread_start_us":205084,"threads_started":1,"wal-append.queue_time_us":489185}
W20260709 13:01:53.125437 11576 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.016s	sys 0.021s
I20260709 13:01:53.107969 11498 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:53.094694 11682 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:53.094112 11660 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:53.138965  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.139473  8400 leader_election.cc:400] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7.
I20260709 13:01:53.141426 11681 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:53.090205 11491 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:01:53.087249 11531 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.146740 11718 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:53.148379  9067 connection.cc:256] RPC call timeout handler was delayed by -1.1418898910000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29760000000000003s for a response
I20260709 13:01:53.118556 11658 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:53.149010  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 57627.6us
W20260709 13:01:53.149223  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.154762 11713 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:53.155591  8502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2183) took 2180 ms (client timeout 1578 ms). Trace:
I20260709 13:01:53.156723 11656 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:53.088021 11627 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:53.171563  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:53.202736  9095 raft_consensus.cc:2410] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:53.203645  8428 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:53.091809 11762 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:01:53.175197  8400 leader_election.cc:403] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:53.161100 11483 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:53.214526  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 92243.4us
I20260709 13:01:53.217393  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:53.136982 11665 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:53.215939  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.222793  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.173815 11336 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:53.170358 11695 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:53.221639  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:53.202307  8502 rpcz_store.cc:269] 0709 13:01:50.974865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.977899 (+  3034us) service_pool.cc:224] Handling call
0709 13:01:53.155347 (+2177448us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54001fed54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:53.155504 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1190290304}
I20260709 13:01:53.226195  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:53.225417  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 98716.9us
I20260709 13:01:53.211412 11658 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.228508  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 992) took 1708 ms. Trace:
I20260709 13:01:53.204192 11656 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:53.257908  9099 rpcz_store.cc:276] 0709 13:01:51.520448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.445478 (+925030us) service_pool.cc:224] Handling call
0709 13:01:52.445811 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.618851 (+173040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.228274 (+609423us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540017a054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:53.228451 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396804480}
I20260709 13:01:53.233667  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.235597  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 978) took 1722 ms. Trace:
I20260709 13:01:53.238552 11519 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:53.202497 11498 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.256474  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:53.228551  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:53.177452 11660 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:53.206634 11682 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:53.229359  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.258111  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.272123  8501 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:53.256037  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:53.261339  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:53.260928  9101 rpcz_store.cc:276] 0709 13:01:51.513728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.525312 (+ 11584us) service_pool.cc:224] Handling call
0709 13:01:53.235305 (+1709993us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540058c354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:53.235516 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836841856}
I20260709 13:01:53.258210  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:53.275022  8505 raft_consensus.cc:2368] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7.
I20260709 13:01:53.219085 11483 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.254932  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.283720  8508 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:53.265583  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:53.263320  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:53.285197  8506 raft_consensus.cc:2410] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:53.219615 11544 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.285422  8503 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:53.287582 11519 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:53.288538 11718 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:53.302893  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 44155.2us
W20260709 13:01:53.304049  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 82529.8us
W20260709 13:01:53.306468  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50516.8us
I20260709 13:01:53.260864 11627 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:53.261691 11546 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7.
I20260709 13:01:53.259945 11658 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.308482 11620 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:53.298470 11483 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.309310  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.309432  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:53.329005  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 203148us
I20260709 13:01:53.355156  8503 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:53.310009  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.310576  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.308641  8510 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:53.342957  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.303855 11544 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.355261  8501 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:53.308660  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:53.353801  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:53.333513  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.282603 11498 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.273919 11356 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:53.274158 11660 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:53.358173 11526 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.358883  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.374164  8428 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:53.348937 11771 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:01:53.310335 11725 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:53.380554  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.383433  9095 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:53.381105  8506 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:53.353166 11465 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:01:53.310113 11762 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:53.342901 11620 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.358083  8509 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:53.396922  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.397709  9098 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:53.402102  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.362815 11627 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:53.342525 11718 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.409932 11725 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:53.410511  8430 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:53.383358  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:53.423386  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.404907 11356 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:53.428356  8505 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:01:53.429148  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.418154 11620 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:53.381795 11665 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.406093 11519 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:01:53.438473 11627 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.439132 11544 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:53.418576 11695 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.413546 11682 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:53.446092 11465 consensus_queue.cc:1175] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6930e07cbba2484ca2bf800a58acdbb0" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:01:53.446167  8504 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:53.446552 11725 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.447527 11718 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:53.448071 11718 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:53.449380 11718 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:53.443265 11694 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:53.451570 11751 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.617s	user 0.010s	sys 0.019s
I20260709 13:01:53.404284 11526 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.452904  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.453778  9095 raft_consensus.cc:2410] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:53.453935 11665 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.454970  9102 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:53.455307  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1974) took 1958 ms. Trace:
W20260709 13:01:53.453084  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.464008  8506 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
W20260709 13:01:53.472527  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.497416  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:53.454244  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:53.461802  8475 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.663s (SENT)
I20260709 13:01:53.505506  8503 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:53.506470  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.505676  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:53.510242 11762 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.510387  9096 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:53.510742  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.507287  9101 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:53.515564  9095 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:01:53.510411  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 48642.6us
I20260709 13:01:53.450603 11356 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:53.453807 11526 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:53.500126  8432 rpcz_store.cc:276] 0709 13:01:51.496455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.496579 (+   124us) service_pool.cc:224] Handling call
0709 13:01:51.497104 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.497886 (+   782us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:51.498431 (+   545us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.619211 (+120780us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.620070 (+   859us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.620250 (+   180us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:51.620303 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.620380 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.451012 (+1830632us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:53.455021 (+  4009us) raft_consensus.cc:1685] finished
0709 13:01:53.455107 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.455251 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":557,"prepare.queue_time_us":44125,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3891,"raft.queue_time_us":117987,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":422,"spinlock_wait_cycles":350836096,"thread_start_us":68586,"threads_started":1,"wal-append.queue_time_us":215726}
I20260709 13:01:53.520144  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.520589  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.528558  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.529287  9100 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:53.530987  8502 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:53.542559  8508 raft_consensus.cc:2368] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:01:53.546041  9099 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:53.546058 11694 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:53.547043 11687 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.549268  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.551345  8508 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:01:53.559468  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 105313us
I20260709 13:01:53.559552 11483 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:53.560767  9068 leader_election.cc:400] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:53.561070  9068 leader_election.cc:403] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:01:53.564467  8475 leader_election.cc:336] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.051s (SENT)
I20260709 13:01:53.566679  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:53.584095  8549 leader_election.cc:336] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.538s (SENT)
I20260709 13:01:53.585883  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:53.589123  8432 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:53.589386  8502 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 13:01:53.589967  8431 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:53.589705  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:53.592084  8508 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:53.600661  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.602536  8509 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:01:53.602659  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.603652  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:53.604341  8509 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:53.605278  8502 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:53.609964  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 48388.7us
W20260709 13:01:53.610843  8475 leader_election.cc:336] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.100s (SENT)
I20260709 13:01:53.611279  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:53.612555 11336 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:53.613096  8475 leader_election.cc:336] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.120s (SENT)
I20260709 13:01:53.585351 11546 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.614207 11759 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.614099 11546 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.616880 11546 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:53.617888  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45774.2us
I20260709 13:01:53.619921  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.648550  8510 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:53.648623  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:53.649081 11791 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:01:53.650655 11790 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:01:53.651459 11483 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:53.652391 11483 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:53.651571  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:53.653465  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:53.627663 11517 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:53.655108 11517 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:53.641096  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.657153  9093 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:53.658059  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.658632  9093 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:53.659546  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.659780  8547 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:53.660156  9093 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:01:53.661125  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.661602  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.662338  8510 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:53.656032 11517 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.662552 11744 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:53.663005 11744 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:53.663084  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.663738  8510 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:53.663918  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.664583  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.665158  8510 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:53.665201  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.665728  8505 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:53.667215  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.667575  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.668064 11627 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:53.653905  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.668536 11627 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:53.668926 11627 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.668975  9097 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:53.669399  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.644248  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.669916  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:53.670087  9099 raft_consensus.cc:2376] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7. Re-sending same reply.
I20260709 13:01:53.670485  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.670751  9097 raft_consensus.cc:2410] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:53.670950  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.644147  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.671548  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:53.663918 11744 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:53.672093 11656 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.672518  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.672720  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.669991  8433 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:01:53.646384 11785 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:01:53.673563  9097 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:53.672663 11744 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:53.674676  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.673563  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.675921  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:53.676751  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.677376  9102 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:01:53.601902  8430 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:53.623222 11681 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 4. Current term is 5.
I20260709 13:01:53.678382  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:53.679195  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:53.622954 11660 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.660657  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:53.654136  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:53.654659 11483 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:53.666055  8426 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:53.700352  8503 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:01:53.666945  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.701215  8502 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
W20260709 13:01:53.667199  8549 leader_election.cc:336] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.697s (SENT)
I20260709 13:01:53.702356  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:53.643302  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:53.642433  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:53.679513 11681 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:53.679939  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.680025  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:53.647887 11787 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:01:53.613729  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:53.686918  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:53.711247  8432 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:01:53.711355  9102 raft_consensus.cc:2376] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7. Re-sending same reply.
I20260709 13:01:53.647493 11336 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:53.671622  9099 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:53.704006  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:53.713375  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 59982.1us
I20260709 13:01:53.701769  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:01:53.708249  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 147603us
I20260709 13:01:53.717581  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.718223  9102 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:53.712611  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:53.712935  8504 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:53.663013 11517 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.715986  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:01:53.723400  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 62879.7us
W20260709 13:01:53.724174  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 57001.4us
I20260709 13:01:53.721295  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:53.722241  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.719262  8509 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:53.725478  8502 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:53.720635  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.704099 11687 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:53.729557  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:53.730118  8549 leader_election.cc:336] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.729s (SENT)
I20260709 13:01:53.730657  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.704356 11483 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.722474 11656 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:53.738631  9094 raft_consensus.cc:2410] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:53.739554  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:53.717445 11705 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:53.746492 11705 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:53.747561 11705 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.748908 11660 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:53.749382  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.750160  9099 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:53.750279  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:53.739329 11483 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:53.750929  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 137849us
I20260709 13:01:53.751494 11692 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:53.725425 11640 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:53.722837 11762 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.732573 11687 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:53.754885  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.755365 11687 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.739212 11658 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.758615  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:53.759245  8426 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.760156 11658 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:53.754406 11640 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.760916 11640 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:53.764863  8507 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:53.765389  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:59098 (request call id 1813) took 2473 ms. Trace:
I20260709 13:01:53.748049  9094 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:53.768515  9100 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:53.768534  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:53.765667  8507 rpcz_store.cc:276] 0709 13:01:51.292190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.621372 (+329182us) service_pool.cc:224] Handling call
0709 13:01:53.763732 (+2142360us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b5400059bd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a19336a3d 00007f1a1e306cd0 00007f1a1788b254 00007f1a1788b1e2 00007f1a1788b111 00007f1a1788b08c 00007f1a1788a342 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:53.765308 (+  1576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284752128}
I20260709 13:01:53.774796  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:53.777207  9102 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:01:53.770809  8427 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.000s	sys 0.022s
I20260709 13:01:53.789016  8508 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
W20260709 13:01:53.821025  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.853889  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 152200us
I20260709 13:01:53.863003  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:53.855291  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.778786  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:53.855517  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:53.859593  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:53.864157  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.863857  8434 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:53.860378  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:53.864930  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.865571  8435 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:53.714494 11498 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:53.860083  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 131166us
W20260709 13:01:53.864135  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 142906us
I20260709 13:01:53.867105  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:53.738469 11544 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:53.872881  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 96855.1us
I20260709 13:01:53.868988  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:53.869607  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 190479us
W20260709 13:01:53.874472  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 125567us
I20260709 13:01:53.874868  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:53.868211  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:53.855268 11563 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:53.766237 11800 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:53.868191 11692 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:53.895949  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 165212us
W20260709 13:01:53.896775  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.897128  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:53.904515  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:53.908347  8426 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:53.911283  8426 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:53.855008 11658 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:01:53.916085  9067 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:53.918464  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:53.912956  8426 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:01:53.920657  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:53.879773 11660 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:53.754920 11762 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.935051  8398 leader_election.cc:400] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7.
I20260709 13:01:53.880079 11681 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:53.937724  8433 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:53.938745  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 213970us
I20260709 13:01:53.941919  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:53.942425  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 43792.2us
I20260709 13:01:53.879741 11620 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:53.949589  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 209165us
I20260709 13:01:53.950434  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1993) took 1036 ms. Trace:
I20260709 13:01:53.950291 11627 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:53.887071 11526 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:01:53.952371  8427 rpcz_store.cc:276] 0709 13:01:52.913574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.069290 (+155716us) service_pool.cc:224] Handling call
0709 13:01:53.095054 (+ 25764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.095275 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:53.095596 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.856221 (+760625us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.950077 (+ 93856us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:53.950128 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:53.950182 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.950248 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.950358 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8688,"prepare.queue_time_us":102072,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":80765,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":33034,"spinlock_wait_cycles":1853824,"thread_start_us":726216,"threads_started":3,"wal-append.queue_time_us":309768}
I20260709 13:01:53.978333  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:53.979048  8579 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:53.935745 11544 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:53.959679  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:53.973495  9093 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:53.932451 11701 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:53.944015 11660 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:54.005012  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 48840.1us
W20260709 13:01:53.995435  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 43890us
I20260709 13:01:54.000480  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.001673 11498 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:54.007637  8398 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:54.009397  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:53.958326 11546 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:54.021445  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:53.945953 11681 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:54.020449  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:54.022346  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.023981  8547 leader_election.cc:400] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:01:54.017704  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.027328  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:54.028288  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:53.979797 11697 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.031464  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:54.032380  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.033138  8583 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:54.033634  8579 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:53.993690 11713 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:53.993230 11807 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:54.008613 11809 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:54.014876 11660 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:54.040844  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 122495us
I20260709 13:01:54.041513  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:54.042200  8584 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:54.044989  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:54.019685 11808 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:54.046217  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 149496us
I20260709 13:01:54.047044  8547 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.052914  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.054071  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.055228  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:54.055931  8575 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.055274  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.061877 11815 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.062706 11815 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.063432 11815 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.063964 11815 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.037760 11713 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:54.040122 11682 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.045572 11701 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:54.081678  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.085330  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:54.089104  8398 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:54.054477 11629 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.091954  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.093557  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:54.097962  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55842.2us
I20260709 13:01:54.069465 11713 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:54.068424 11695 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.114259  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:54.125697  8583 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:54.077883 11812 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.091053 11718 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:54.137467  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 48457.6us
I20260709 13:01:54.100610 11563 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.096967 11658 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.099251 11463 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:54.095971 11544 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.169166  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:54.179540  8575 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
W20260709 13:01:54.181578  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 105550us
I20260709 13:01:54.041281 11692 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.137877 11816 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.168154 11519 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.172132 11655 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.171887 11665 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:54.216998  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 207699us
W20260709 13:01:54.213339  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 43972.2us
I20260709 13:01:54.215605  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:54.182173 11806 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:54.219313  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:54.219914  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 120733us
W20260709 13:01:54.208580  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 142134us
I20260709 13:01:54.232020  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:54.193914 11627 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:54.194731 11463 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.234112 11576 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:54.232791  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:54.185979 11498 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:01:54.226265 11801 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:01:54.247529  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.242748 11576 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:54.243518  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.260056  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.192448 11800 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:54.249780  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:54.230854 11620 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:54.133934 11681 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.236285 11816 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:54.273288  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.232260 11813 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:54.227222 11809 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:01:54.241509 11810 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:54.286944  8475 leader_election.cc:336] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.837s (SENT)
I20260709 13:01:54.295511  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:54.297720  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 65075.8us
I20260709 13:01:54.271961 11463 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:54.303071  8476 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:54.231500 11655 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.273622 11498 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:54.292963 11544 raft_consensus.cc:2764] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:01:54.311244  8583 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:54.275133 11519 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:54.312474  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:54.305699 11806 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:54.282332 11627 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.293021 11816 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:54.325683  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 82256.8us
W20260709 13:01:54.303560 11725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.011s	sys 0.024s
I20260709 13:01:54.314682 11681 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:54.314823 11498 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:54.325012 11517 consensus_meta.cc:287] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.003s
I20260709 13:01:54.318812 11519 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.354236 11498 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:54.332654 11804 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:01:54.312687 11658 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:54.358973  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.341815 11544 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:54.341141 11725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.011s	sys 0.025s
W20260709 13:01:54.362735 11831 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:54.364408 11815 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:54.365139  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 66492us
I20260709 13:01:54.393324  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:54.367460  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.314007 11563 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:01:54.368077  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.394148  8577 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:54.395133  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:54.395324  8577 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:54.314654 11392 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:01:54.385705  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.396521  8575 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:01:54.396723  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.386204  8584 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:54.361445 11718 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.357664 11519 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:54.410606  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.412923  8584 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:54.389091 11544 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.376986 11463 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.416785  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:54.397176  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.387385  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 84403.7us
I20260709 13:01:54.387678 11806 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.398898  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.403589 11655 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:54.404569 11656 consensus_meta.cc:287] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.000s
I20260709 13:01:54.431321 11658 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.431453 11809 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:54.406464 11816 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:54.407001 11799 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.698s	user 0.003s	sys 0.000s
I20260709 13:01:54.371066 11576 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:54.409071 11744 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.000s
I20260709 13:01:54.408973  8582 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:54.423753  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:54.444820  8428 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
W20260709 13:01:54.428555  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 87702.8us
I20260709 13:01:54.421795 11544 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:54.442981 11483 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.002s
I20260709 13:01:54.450788  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.434911  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.439633 11463 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:54.456068  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:54.388119 11800 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:54.441499 11687 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.000s
I20260709 13:01:54.411161 11665 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.447722  8581 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:01:54.448417  8476 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:54.428231 11813 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:54.449122  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:54.515057  8584 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:54.470180  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:54.469280  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.475843  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:54.425279 11701 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:01:54.449414 11658 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.519026  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 70715.1us
W20260709 13:01:54.526917  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 51191us
W20260709 13:01:54.522981  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 280389us
I20260709 13:01:54.458335 11463 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:01:54.553042  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:54.461086 11666 raft_consensus.cc:3055] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:54.558703  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 112503us
W20260709 13:01:54.560925  8549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.020s	sys 0.016s
I20260709 13:01:54.561883  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.515146 11828 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.474731 11655 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:54.581401  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46437.4us
W20260709 13:01:54.577046  8549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.020s	sys 0.016s
I20260709 13:01:54.585713  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:54.574124 11807 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:54.514963 11813 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:54.582625  8398 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:54.457940 11660 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.468426 11483 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.595862  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:54.596498  9102 raft_consensus.cc:2376] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10. Re-sending same reply.
I20260709 13:01:54.559686 11810 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:54.597499  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:54.592710  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 137567us
I20260709 13:01:54.576064 11666 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:54.630302  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:01:54.592569  8549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.686s (SENT) [suppressed 37 similar messages]
I20260709 13:01:54.619954  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:54.632161  9095 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:54.633651  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.634989  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.576095 11840 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:54.621361  8435 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:54.610903 11822 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:54.702709  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.703223  9097 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:01:54.587811 11842 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.519682 11658 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.514199 11687 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.691269  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.694394  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:54.731065  8430 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:54.692744  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:54.693001  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.630980  8427 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:01:54.704128  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.705180  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.734916  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.621464  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:54.737061  9097 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:54.737949  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:54.738149  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:54.712966  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.713210  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.739626  8434 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:54.635989  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.713979  9098 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:54.593315 11813 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:54.726909 11839 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:01:54.727447 11836 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:01:54.729043  8432 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:54.634274 11705 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:54.742707 11786 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 1.296s	user 0.010s	sys 0.005s
I20260709 13:01:54.742648  9093 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:54.597455 11692 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:01:54.778548  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.797250  9097 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:54.799203  8430 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:54.750375  8578 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:54.752735  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.750620  9101 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:54.751451  8435 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:54.761265  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.692203 11840 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.713711 11822 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.745473  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:54.790292  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 320245us
I20260709 13:01:54.801395  9099 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:54.749995  9096 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:54.593746 11828 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:54.804180  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 207705us
I20260709 13:01:54.804723  8428 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:54.742728 11838 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.328s	user 0.000s	sys 0.000s
I20260709 13:01:54.811997  9095 raft_consensus.cc:2410] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:01:54.744805 11563 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:54.816089  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:54.821252  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.807442  9102 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:54.816316  8435 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:54.842792  9098 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:01:54.843864  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.844627  9098 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:54.777173 11744 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:54.782639 11759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.015s
I20260709 13:01:54.841027  9094 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:01:54.789805 11705 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.777109 11809 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:54.847342  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:54.840627  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.846720  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:54.849545 11784 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.291s	user 0.000s	sys 0.007s
I20260709 13:01:54.862918 11660 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:54.864681  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 1996) took 1887 ms. Trace:
I20260709 13:01:54.849818 11819 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:54.817708 11822 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.777325 11629 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:01:54.850927 11762 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:54.850425 11465 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:54.859688  9093 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:54.854645 11841 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:01:54.860852 11853 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:54.861261 11788 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.419s	user 0.000s	sys 0.006s
I20260709 13:01:54.861582 11837 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:01:54.862355 11713 consensus_meta.cc:287] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.004s
I20260709 13:01:54.861735 11809 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.862530  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:54.842306 11563 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.849953 11817 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.853794  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:54.879253 11694 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:54.865883 11819 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.866658 11844 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.880249 11692 raft_consensus.cc:2955] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:54.883042 11687 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:54.865546 11832 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:54.852689 11807 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.861526 11483 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:54.858079 11627 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:01:54.851363 11759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.009s	sys 0.016s
W20260709 13:01:54.881826 11845 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:54.818150 11840 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:54.886549  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45902.3us
I20260709 13:01:54.889977  8430 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:54.961807 11812 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:54.890268  8434 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:54.927258 11713 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.891861 11701 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:54.865135  8429 rpcz_store.cc:276] 0709 13:01:52.976854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.137656 (+160802us) service_pool.cc:224] Handling call
0709 13:01:53.142625 (+  4969us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:53.143013 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.143047 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:53.143594 (+   547us) log.cc:844] Serialized 52 byte log entry
0709 13:01:53.357493 (+213899us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:53.357550 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.357643 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.520424 (+1162781us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:54.864356 (+343932us) raft_consensus.cc:1685] finished
0709 13:01:54.864378 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.864615 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3197,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":141722368,"thread_start_us":213513,"threads_started":1,"wal-append.queue_time_us":277230}
W20260709 13:01:54.898612 11640 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.137s	user 0.012s	sys 0.001s
W20260709 13:01:54.899959 11546 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.873s	user 0.007s	sys 0.003s
W20260709 13:01:54.901364  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.750228 11842 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:54.851595 11744 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.859092 11705 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:54.994976  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:54.885672  8582 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:54.906715  9093 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:01:54.904850  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:54.885355 11336 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:54.904563 11808 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.836s	user 0.008s	sys 0.003s
I20260709 13:01:54.931097  9102 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
I20260709 13:01:54.900007 11658 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:54.955267  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 113093us
W20260709 13:01:54.953902 11848 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:01:54.930724 11563 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:54.911755 11544 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.971328 11832 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:54.970049 11682 consensus_meta.cc:287] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.892s	user 0.009s	sys 0.003s
I20260709 13:01:54.891299  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:54.990011  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:55.009438 11744 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:54.995893  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 374492us
I20260709 13:01:55.040067  8503 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:55.040261  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:54.923960 11853 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:55.018060  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:55.020550  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:55.027734  8502 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:54.993917 11701 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.028544  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:55.043790  8504 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:55.045019  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:55.045461  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:55.046053  9098 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:55.012307 11816 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:55.023670 11627 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.029060 11465 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:55.038255  8510 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 8. Ops: []
W20260709 13:01:55.048098  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 58167.2us
I20260709 13:01:55.069331 11762 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:55.058065 11800 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:55.070456 11800 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.070364 11857 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:55.070966 11800 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:55.073781 11853 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:55.075060  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:55.075883 11660 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:55.048237  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:55.048856  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:55.012750 11336 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:54.999001 11546 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:55.024988 11808 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:54.971774 11817 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:55.023720 11837 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.058854  8400 connection.cc:256] RPC call timeout handler was delayed by -1.0768969769999899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:01:55.085577  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 297137us
I20260709 13:01:55.059727  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:55.087095  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:55.060652 11681 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.000s
W20260709 13:01:55.062664 11806 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.003s
I20260709 13:01:54.998188 11629 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:55.063472 11860 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:55.063848 11816 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:55.064846  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:55.039312 11832 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:55.077140  8506 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:55.077695  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:55.103345  9093 raft_consensus.cc:2376] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8. Re-sending same reply.
I20260709 13:01:55.078415  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:54.968555 11844 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:54.997406 11640 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:55.049007 11798 log.cc:927] Time spent T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.340s	user 0.003s	sys 0.003s
I20260709 13:01:55.082572  8584 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:55.083945  8508 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 13:01:55.085556  9098 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:55.112970  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:55.049137 11701 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:55.049052 11658 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:55.081864 11519 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.001s
I20260709 13:01:55.097460 11860 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:55.099809  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:55.105958  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:55.132622  8430 raft_consensus.cc:2376] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8. Re-sending same reply.
I20260709 13:01:55.134656  8580 raft_consensus.cc:2368] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9.
W20260709 13:01:55.106799  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 514224us
I20260709 13:01:55.080809 11627 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:55.075724 11796 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:01:55.115061  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:55.097863 11806 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:55.119729  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:55.123410  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.095902  9100 raft_consensus.cc:2410] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:55.160830  8584 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:55.150803  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.153002  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:55.133334  9068 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:55.095597 11837 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:55.119208 11498 consensus_meta.cc:287] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.002s
I20260709 13:01:55.134495 11860 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:55.157886 11846 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:01:55.159842  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 60144.9us
I20260709 13:01:55.220902  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:55.214854  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 81605.6us
W20260709 13:01:55.215026  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 62105.5us
I20260709 13:01:55.219090  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:55.222527  9098 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:55.222647  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:55.222572  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:55.115988 11681 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:01:55.111585 11725 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:01:55.233804  9093 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.131245 11687 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:01:55.219738 11824 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:55.151844 11682 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:01:55.134166 11519 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:55.223465 11465 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:55.233304 11531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.789s	user 0.012s	sys 0.009s
I20260709 13:01:55.250075 11713 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:55.234392 11858 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:55.230336 11853 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:55.125946 11336 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:55.258905  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:55.277629  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:55.277881  8584 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:01:55.278704  9098 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:55.247783 11629 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:01:55.289330  9093 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:55.291460  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:55.259424 11531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.815s	user 0.012s	sys 0.010s
I20260709 13:01:55.292372  8584 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:55.219087 11498 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:55.297554 11807 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:55.235392 11620 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:01:55.301167  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:55.294260  8578 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:55.292800 11858 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:55.303617 11498 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:55.304347 11498 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:55.303946 11858 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:55.305580 11640 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:55.306051 11842 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:55.306543  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:55.307426 11866 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:55.308094  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:55.308590 11864 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:01:55.308842  9098 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.259634 11819 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:55.312026  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:55.317121  8582 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:55.274466 11806 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:55.281705 11759 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.281945 11336 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:55.310217 11563 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:55.318775 11863 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:55.239086 11705 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:55.248070 11822 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:55.300071 11824 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:55.342211  8584 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:55.342517 11759 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:55.382650  8434 raft_consensus.cc:2368] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:01:55.368618 11465 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:55.389503  9098 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:55.390046  8582 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:01:55.390653  8582 pending_rounds.cc:85] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 8
I20260709 13:01:55.386101 11863 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.391180  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:55.399632  9094 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:55.353442 11807 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:55.393893  8582 pending_rounds.cc:107] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:55.409709  8582 raft_consensus.cc:2889] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:55.410744  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 188251us
I20260709 13:01:55.403987 11853 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:55.403832 11807 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:55.434701 11824 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:01:55.439114  8431 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:55.426220 11844 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:55.440714 11837 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:55.408447 11817 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:55.441985  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:55.443356 11867 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:01:55.450352  8580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1890) took 1441 ms (client timeout 1906 ms). Trace:
W20260709 13:01:55.450994  8580 rpcz_store.cc:269] 0709 13:01:54.010595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.025883 (+ 15288us) service_pool.cc:224] Handling call
0709 13:01:55.450052 (+1424169us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000659d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:55.450268 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2528120576}
I20260709 13:01:55.452373 11824 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:55.452963 11824 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:55.453902 11824 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:55.454506  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1837) took 1684 ms. Trace:
I20260709 13:01:55.455031  8426 rpcz_store.cc:276] 0709 13:01:53.769851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.938243 (+168392us) service_pool.cc:224] Handling call
0709 13:01:53.984509 (+ 46266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.077766 (+ 93257us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:54.180815 (+103049us) log.cc:844] Serialized 14 byte log entry
0709 13:01:54.454206 (+273391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:54.454284 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:54.454345 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.454232 (+999887us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b5400351e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:55.454290 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.454442 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10479,"prepare.queue_time_us":113865,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":8160,"raft.queue_time_us":12134,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":75,"spinlock_wait_cycles":187026816,"thread_start_us":344218,"threads_started":2,"wal-append.queue_time_us":408724}
I20260709 13:01:55.403689 11863 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:55.762797  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.020s	sys 0.012s
I20260709 13:01:55.464915  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:55.537484  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:55.813483 11817 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:55.814853  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:55.754248 11563 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:55.766940 11744 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.693s	user 0.002s	sys 0.009s
W20260709 13:01:55.816691  8547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.016s	sys 0.039s
W20260709 13:01:55.853840  8547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.016s	sys 0.039s
W20260709 13:01:55.854290  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 767276us
I20260709 13:01:55.434779 11759 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:55.437253 11853 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:01:55.459838 11813 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.618s	user 0.012s	sys 0.000s
I20260709 13:01:56.095669  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2000) took 1501 ms. Trace:
W20260709 13:01:55.818696  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.007s	sys 0.039s
I20260709 13:01:55.509447 11519 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:56.048192 11812 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.055s	user 0.012s	sys 0.000s
I20260709 13:01:56.525969  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1835) took 1508 ms. Trace:
W20260709 13:01:56.452342 11725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.152s	user 0.010s	sys 0.017s
W20260709 13:01:56.081583  8476 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.028s	sys 0.027s
I20260709 13:01:56.535347  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:56.055586 11681 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.007s	sys 0.019s
I20260709 13:01:55.822918  8434 raft_consensus.cc:2368] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
W20260709 13:01:55.814329 11860 consensus_meta.cc:287] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 13:01:55.818638  8426 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:55.815402 11822 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:56.071574  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1019) took 1369 ms. Trace:
I20260709 13:01:55.882901  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:56.558496  8430 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:56.078891  8549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.001s	sys 0.063s
W20260709 13:01:56.559163  8549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.325s	user 0.017s	sys 0.125s
W20260709 13:01:56.559661  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.295735 11862 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.534866  8428 rpcz_store.cc:276] 0709 13:01:54.594137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.595985 (+  1848us) service_pool.cc:224] Handling call
0709 13:01:54.596254 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.819678 (+223424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.095300 (+1275622us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400361fd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:56.095575 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479026944}
W20260709 13:01:56.535377  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.009s	sys 0.044s
W20260709 13:01:56.548591 11725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.289s	user 0.011s	sys 0.019s
W20260709 13:01:55.815780  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.022s	sys 0.013s
W20260709 13:01:56.563395  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.48677e+06us
W20260709 13:01:56.452863 11718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.865s	user 0.013s	sys 0.016s
W20260709 13:01:55.602101 11826 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:01:56.022675 11875 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.584s	user 0.000s	sys 0.001s
W20260709 13:01:56.036857 11840 consensus_meta.cc:287] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.043s	user 0.010s	sys 0.000s
W20260709 13:01:56.078673  8509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.228s	user 0.023s	sys 0.033s
W20260709 13:01:56.006757 11881 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 13:01:56.056599 11692 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.998s	user 0.011s	sys 0.000s
I20260709 13:01:56.546685  8576 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:56.007104 11336 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.001s
W20260709 13:01:56.548594  8476 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.034s	sys 0.098s
W20260709 13:01:56.581656  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 1.35262e+06us
I20260709 13:01:55.833922 11744 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:56.115813 11858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.015s
W20260709 13:01:55.815146 11843 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.012s	sys 0.038s
W20260709 13:01:56.000089 11878 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.541s	user 0.001s	sys 0.000s
W20260709 13:01:56.039726 11701 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.908s	user 0.011s	sys 0.000s
I20260709 13:01:56.296422 11835 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.670121  8430 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
W20260709 13:01:56.452920 11869 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.033s	sys 0.069s
W20260709 13:01:56.089150 11687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.009s	sys 0.006s
I20260709 13:01:55.597184 11806 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.296474 11483 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.079838 11884 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.287809 11842 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.023207 11852 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.326202 11828 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:56.553823  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 660) took 1081 ms. Trace:
I20260709 13:01:56.061781  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:56.550940  9098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.008s	sys 0.023s
W20260709 13:01:56.544597 11660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.467s	user 0.016s	sys 0.014s
I20260709 13:01:56.435726 11863 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:56.557298  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 657) took 1086 ms. Trace:
W20260709 13:01:55.813524 11870 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:01:56.533982 11705 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:56.561331  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.33862e+06us
I20260709 13:01:56.730353  8434 rpcz_store.cc:276] 0709 13:01:55.463325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.463985 (+   660us) service_pool.cc:224] Handling call
0709 13:01:56.549875 (+1085890us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:56.703778 11660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.627s	user 0.017s	sys 0.014s
I20260709 13:01:56.558099  9094 rpcz_store.cc:276] 0709 13:01:54.749398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.049851 (+300453us) service_pool.cc:224] Handling call
0709 13:01:56.071131 (+1021280us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400508054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:56.071360 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716843776}
W20260709 13:01:56.567878  8475 connection.cc:256] RPC call timeout handler was delayed by -1.3959614679999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 13:01:56.549187 11812 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:56.553988 11681 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.292s	user 0.011s	sys 0.030s
W20260709 13:01:56.574992  8509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.724s	user 0.041s	sys 0.094s
I20260709 13:01:56.549675 11887 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.820526 11817 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.558746 11519 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:56.729328 11886 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.570518 11718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.984s	user 0.013s	sys 0.019s
I20260709 13:01:56.580724  8576 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:56.542519 11813 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.565095 11759 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:55.712566 11807 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:56.664727  9065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.034s	sys 0.079s
I20260709 13:01:56.573788 11822 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.588547 11858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.012s	sys 0.018s
W20260709 13:01:56.599915 11843 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.469s	user 0.016s	sys 0.042s
I20260709 13:01:56.755728 11822 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.754501 11886 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:56.057664 11666 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.707605 11852 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.570696 11862 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:56.652697 11336 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.761582  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1021) took 2011 ms. Trace:
I20260709 13:01:56.782439  9094 rpcz_store.cc:276] 0709 13:01:54.750075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.739928 (+1989853us) service_pool.cc:224] Handling call
0709 13:01:56.754717 (+ 14789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.761136 (+  6419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.761163 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:56.761207 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:56.761251 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.761344 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.761507 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:56.587764 11816 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:56.666159 11824 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.018s	sys 0.037s
W20260709 13:01:56.681116  8401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.578s	user 0.005s	sys 0.021s
W20260709 13:01:56.789723  8401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.932s	user 0.005s	sys 0.022s
W20260709 13:01:56.673751 11869 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.044s	sys 0.070s
I20260709 13:01:56.683559 11884 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:56.675607 11687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.398s	user 0.014s	sys 0.016s
I20260709 13:01:56.586889 11840 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:56.702600  9098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.243s	user 0.008s	sys 0.023s
W20260709 13:01:56.725373  8583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1892) took 2669 ms (client timeout 1909 ms). Trace:
W20260709 13:01:56.810601  8583 rpcz_store.cc:269] 0709 13:01:54.032202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.036038 (+  3836us) service_pool.cc:224] Handling call
0709 13:01:56.701621 (+2665583us) spinlock_profiling.cc:243] Waited 79.9 ms on lock 0x7b540009bd54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:56.701790 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183824640}
I20260709 13:01:56.804351 11336 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.702513  9101 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.807403 11546 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:56.812409 11862 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:56.809440 11816 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.812973 11336 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:56.813577 11900 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:01:56.813722  8577 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:56.813412 11816 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.733582  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:56.809291 11807 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:56.814788  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 81307.5us
I20260709 13:01:56.702260  8426 rpcz_store.cc:276] 0709 13:01:55.472473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.817919 (+345446us) service_pool.cc:224] Handling call
0709 13:01:55.818356 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.553549 (+735193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.553763 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:55.809778 11832 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.000s
W20260709 13:01:56.735502  8475 connection.cc:256] RPC call timeout handler was delayed by -1.3689614680000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:01:56.817598  8475 connection.cc:256] RPC call timeout handler was delayed by -1.2984939419999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:01:56.818610  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0986939420000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:01:56.819063  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0959939420000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:01:56.819468  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0959939420000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:01:56.701769 11892 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.674366 11701 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.676218 11835 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:56.734419 11465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.342s	user 0.060s	sys 0.109s
W20260709 13:01:55.817916 11800 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.007s
I20260709 13:01:56.729651 11828 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.689342 11877 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:01:56.701488 11842 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:56.676659 11853 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:56.754361  9065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.034s	sys 0.079s
W20260709 13:01:56.870805  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.736688 11660 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:56.682140 11806 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.688247 11483 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.560592 11860 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:56.830199 11465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.431s	user 0.060s	sys 0.109s
I20260709 13:01:56.759286 11822 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:56.742313 11695 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:56.769687  8576 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:56.798568  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:56.901243  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:56.798838  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:56.902899  8428 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:56.903539  8575 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:56.740870 11890 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.791491 11824 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.019s	sys 0.037s
I20260709 13:01:56.811359 11744 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:56.812186 11546 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:56.734368  8429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.067s	sys 0.112s
I20260709 13:01:56.815531  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:56.922179  8429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.068s	sys 0.112s
W20260709 13:01:56.807734 11878 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:56.827310  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:56.930459  8426 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:56.865491 11862 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.753180 11888 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:01:56.741590 11887 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.803690 11705 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.808712 11863 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:56.756850 11759 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:56.822785 11666 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:56.817381 11812 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:56.739246 11563 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:56.898839  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.002s	sys 0.002s
I20260709 13:01:56.913684  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:56.899281 11687 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.950255  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1837) took 1931 ms. Trace:
I20260709 13:01:56.950320 11687 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.914923  8430 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:56.869104 11858 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.916124  8576 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:01:56.915376 11896 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:01:56.918766  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1887) took 2920 ms. Trace:
I20260709 13:01:56.870918 11886 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:56.924096  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 108630us
W20260709 13:01:56.931492  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 365530us
I20260709 13:01:56.910876 11491 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:56.933017  9101 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:56.910566 11695 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:56.867436 11800 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.824313 11832 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:56.871179 11828 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:56.941249  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:56.943373  8428 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:56.943709  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.002s	sys 0.003s
I20260709 13:01:56.946039 11759 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:56.946247 11806 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:56.941911 11863 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:56.948333 11885 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:01:56.932705 11911 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:56.994588 11627 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:56.994813 11884 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:56.967963 11813 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:56.995230 11627 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:56.995822 11718 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.996301 11718 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:01:56.949054 11895 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:01:56.949649 11899 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:01:56.951774  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:57.003042  8430 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:57.003510  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2208) took 2286 ms. Trace:
W20260709 13:01:56.937507 11810 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.121s	user 0.030s	sys 0.056s
W20260709 13:01:57.005550 11810 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.226s	user 0.031s	sys 0.056s
I20260709 13:01:56.925318 11822 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:57.006649 11863 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:57.006486 11822 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.008929 11905 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:01:56.959744  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0527939419999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 13:01:57.011454 11483 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:56.950739  8501 rpcz_store.cc:276] 0709 13:01:55.018508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.018625 (+   117us) service_pool.cc:224] Handling call
0709 13:01:55.038381 (+ 19756us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:55.055405 (+ 17024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.055454 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:55.077064 (+ 21610us) log.cc:844] Serialized 52 byte log entry
0709 13:01:55.253235 (+176171us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:55.277140 (+ 23905us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.281979 (+  4839us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.282742 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.282806 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.005409 (+722603us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4800220158. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:01:56.949993 (+944584us) raft_consensus.cc:1685] finished
0709 13:01:56.950015 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.950193 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4428,"prepare.queue_time_us":69353,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":80,"raft.queue_time_us":72570,"raft.run_cpu_time_us":22619,"raft.run_wall_time_us":713407,"spinlock_wait_cycles":54913536,"thread_start_us":157926,"threads_started":1,"wal-append.queue_time_us":334593}
I20260709 13:01:56.918965 11890 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:57.012531 11687 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:57.013279  8475 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.691s (SENT)
I20260709 13:01:57.013568 11842 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:56.963529  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:56.943704 11888 consensus_queue.cc:1243] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:57.015883 11840 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:57.016110 11828 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:57.016326  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 659) took 1545 ms. Trace:
W20260709 13:01:56.955858 11901 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:01:57.016733  8429 rpcz_store.cc:276] 0709 13:01:55.471265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.471439 (+   174us) service_pool.cc:224] Handling call
0709 13:01:55.536169 (+ 64730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.536451 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.536493 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.857072 (+320579us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.922715 (+1065643us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:56.922775 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.922888 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.004130 (+ 81242us) raft_consensus.cc:1685] finished
0709 13:01:57.004740 (+   610us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.016267 (+ 11527us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":868699,"threads_started":1,"wal-append.queue_time_us":772235}
I20260709 13:01:56.869534 11892 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.017697 11701 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:56.958817  8579 rpcz_store.cc:276] 0709 13:01:53.998645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.036104 (+ 37459us) service_pool.cc:224] Handling call
0709 13:01:54.048574 (+ 12470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.398255 (+349681us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:54.398283 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.402285 (+  4002us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.586427 (+184142us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:54.586478 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.900133 (+2313655us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400115b54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:56.900182 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.900237 (+    55us) raft_consensus.cc:1685] finished
0709 13:01:56.900254 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.918677 (+ 18423us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29590,"raft.queue_time_us":38944,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":735158016,"thread_start_us":178176,"threads_started":1,"wal-append.queue_time_us":518974,"wal-append.run_cpu_time_us":3940,"wal-append.run_wall_time_us":1423166}
I20260709 13:01:57.018561  8429 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:56.968482 11660 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.019976  8429 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:01:57.020581 11892 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:56.962297 11858 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.021066  8429 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:57.015976  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1017) took 2314 ms. Trace:
I20260709 13:01:57.022766 11858 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:57.023265 11800 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:57.024456  8435 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:56.943118 11705 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:56.935664 11862 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:56.964716 11491 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:56.989542  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:56.989377 11843 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:56.999179  8433 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:56.999544  9096 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:01:56.970378 11824 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:01:57.003903  8509 rpcz_store.cc:276] 0709 13:01:54.717219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.717408 (+   189us) service_pool.cc:224] Handling call
0709 13:01:54.776113 (+ 58705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.789137 (+ 13024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.789169 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.838055 (+ 48886us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.737379 (+1899324us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:56.737414 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.737483 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.003231 (+265748us) raft_consensus.cc:1685] finished
0709 13:01:57.003254 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.003418 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74174,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"thread_start_us":1886320,"threads_started":1,"wal-append.queue_time_us":1853707}
I20260709 13:01:57.015194 11887 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:56.966576  9101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 891) took 1561 ms (client timeout 1991 ms). Trace:
I20260709 13:01:56.974278  8426 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:56.959040 11563 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:57.009548 11905 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.025228 11832 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:57.201607 11860 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:57.204383 11905 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:57.207782 11705 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:57.005856 11810 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:57.209448 11810 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.022997  9098 rpcz_store.cc:276] 0709 13:01:54.701860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.397881 (+696021us) service_pool.cc:224] Handling call
0709 13:01:55.409929 (+ 12048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.418588 (+  8659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.418630 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.432077 (+ 13447us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.810675 (+1378598us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:56.810713 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.810778 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.004213 (+193435us) raft_consensus.cc:1685] finished
0709 13:01:57.004231 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.015891 (+ 11660us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15316,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7886,"thread_start_us":1351412,"threads_started":1,"wal-append.queue_time_us":1274866}
I20260709 13:01:57.113674  8428 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:01:57.033355  8475 leader_election.cc:336] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 1.906s (SENT)
I20260709 13:01:57.215042  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:57.062680  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 99186.6us
W20260709 13:01:57.226387  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.242420 11627 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:57.242970 11627 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:57.243779 11828 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:57.244464 11336 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:57.244386 11828 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.245091 11627 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:57.245059 11336 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.245697 11627 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:57.247138  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.248106 11828 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:57.247922  8583 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:57.249863  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.250192  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.251859  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:57.252425  8578 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:57.201618  9096 pending_rounds.cc:85] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 8
W20260709 13:01:57.253685  9101 rpcz_store.cc:269] 0709 13:01:55.405635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.061405 (+655770us) service_pool.cc:224] Handling call
0709 13:01:56.966495 (+905090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.255005  9096 pending_rounds.cc:107] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:01:57.255360  9096 raft_consensus.cc:2889] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:57.255892  9101 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:01:57.256768  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 925) took 2504 ms. Trace:
I20260709 13:01:57.257184  9101 rpcz_store.cc:276] 0709 13:01:54.752054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.255199 (+2503145us) service_pool.cc:224] Handling call
0709 13:01:57.255605 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.256452 (+   847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.256701 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.252414  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.261174  9098 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:01:57.026316  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2013) took 2131 ms. Trace:
I20260709 13:01:57.262205  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 923) took 2510 ms. Trace:
I20260709 13:01:57.262558  9098 rpcz_store.cc:276] 0709 13:01:54.751509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.226165 (+2474656us) service_pool.cc:224] Handling call
0709 13:01:57.260946 (+ 34781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.261945 (+   999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.262157 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.269273  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1024) took 2518 ms. Trace:
I20260709 13:01:57.284293  9101 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:56.981419 11816 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:57.285490  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 926) took 2533 ms. Trace:
I20260709 13:01:57.285799  9101 rpcz_store.cc:276] 0709 13:01:54.752331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.283772 (+2531441us) service_pool.cc:224] Handling call
0709 13:01:57.284110 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.285244 (+  1134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.285445 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.287730  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 931) took 2534 ms. Trace:
I20260709 13:01:57.288304  9101 rpcz_store.cc:276] 0709 13:01:54.753691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.286686 (+2532995us) service_pool.cc:224] Handling call
0709 13:01:57.287070 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.287319 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.287357 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.287418 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:57.287463 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.287535 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.287664 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.262049  8435 rpcz_store.cc:276] 0709 13:01:54.895316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.903156 (+  7840us) service_pool.cc:224] Handling call
0709 13:01:54.903440 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.024825 (+2121385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.026082 (+  1257us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b5400238f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:57.026241 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4877420800}
W20260709 13:01:57.292956  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.281893  9096 rpcz_store.cc:276] 0709 13:01:54.750942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.993712 (+2242770us) service_pool.cc:224] Handling call
0709 13:01:56.997218 (+  3506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.269041 (+271823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.269218 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.309177  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.310114  8580 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:57.009539 11817 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:57.141024 11800 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:57.247205 11336 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:57.318203  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.317016  8429 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:57.317526  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:57.319898  8579 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:57.318485  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 285161us
W20260709 13:01:57.318174  8581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1879) took 3356 ms (client timeout 2098 ms). Trace:
I20260709 13:01:57.228536 11890 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:57.184653 11892 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:01:57.321456  8581 rpcz_store.cc:269] 0709 13:01:53.962160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.992898 (+ 30738us) service_pool.cc:224] Handling call
0709 13:01:57.317976 (+3325078us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54001176d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:57.318109 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951143168}
W20260709 13:01:57.322592  8475 leader_election.cc:336] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.020s (SENT)
I20260709 13:01:57.112237 11917 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:57.323307  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 932) took 2569 ms. Trace:
I20260709 13:01:57.323932  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.324563  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:57.026826 11886 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.292476  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:57.228155 11860 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.325872  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.329255  8582 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:57.249856 11627 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.329917  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:57.338703  8435 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:57.291950 11887 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:57.365283  9096 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:57.328888  9101 rpcz_store.cc:276] 0709 13:01:54.753966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.289594 (+2535628us) service_pool.cc:224] Handling call
0709 13:01:57.289966 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.322959 (+ 32993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.322990 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.323035 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:57.323081 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.323146 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.323256 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":939,"raft.queue_time_us":24646,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":12129}
W20260709 13:01:57.332190  8475 leader_election.cc:336] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.114s (SENT)
I20260709 13:01:57.346933  8580 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:57.365988  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 876) took 2318 ms. Trace:
I20260709 13:01:57.367038  9096 rpcz_store.cc:276] 0709 13:01:55.047546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.302703 (+2255157us) service_pool.cc:224] Handling call
0709 13:01:57.328665 (+ 25962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.365730 (+ 37065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.365934 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.341885  8429 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:57.330309 11884 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.368889  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 197217us
I20260709 13:01:57.319759 11465 raft_consensus.cc:2764] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:01:57.370215  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:57.234061 11695 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.318650 11800 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:57.394759  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.397853  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:57.364651  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 375134us
W20260709 13:01:57.389649 11909 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:57.405346  8583 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:57.338295 11911 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.417840  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.418267  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:57.418272  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:57.419195  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:57.404449  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:57.335583 11491 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.420276  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:57.476177  8508 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:01:57.477249  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.478618  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:57.477249  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:57.481161  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 65431.2us
I20260709 13:01:57.481304  8503 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 4.
I20260709 13:01:57.482602  8430 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:57.343931 11913 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:57.482720  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:57.427759  8435 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:57.483561  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:57.331796 11886 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.492594  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.494092  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.494971  8502 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:57.480998  8508 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:01:57.500151  8580 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:57.339558 11917 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:57.504269  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 106499us
I20260709 13:01:57.495715  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.339602 11892 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.353355 11890 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:57.486801  8505 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:57.500911  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:57.482791 11843 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.501951  9096 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:57.515583  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:57.506155  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:57.418351 11796 consensus_queue.cc:1059] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
W20260709 13:01:57.508296  8576 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.003s
I20260709 13:01:57.519692  8576 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:01:57.520329  8576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1894) took 3467 ms (client timeout 1586 ms). Trace:
W20260709 13:01:57.520673  8576 rpcz_store.cc:269] 0709 13:01:54.052738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.091092 (+ 38354us) service_pool.cc:224] Handling call
0709 13:01:56.541241 (+2450149us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540008a5a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b6dc0 00007f1a19342e18 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:57.520258 (+979017us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464041728}
I20260709 13:01:57.522115 11851 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:57.526319 11718 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:57.526633 11356 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 8 is higher.
W20260709 13:01:57.527380 11919 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:01:57.508999  8509 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:57.527995 11892 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:57.528877 11922 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:01:57.485178 11491 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:57.530611 11917 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:57.531112 11840 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:57.531535 11840 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.531915 11840 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:57.512682 11465 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:57.490301 11695 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.534230 11465 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.370582 11887 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.547503 11627 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:57.547971 11842 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:57.549705 11718 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:57.513911  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:57.518082  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.493618 11911 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.565512  9101 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:57.550195 11718 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:57.566193  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:57.487596 11800 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.526131 11808 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:57.530476  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:57.521783  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:57.598965  8576 raft_consensus.cc:2376] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8. Re-sending same reply.
W20260709 13:01:57.599005  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 68610.7us
I20260709 13:01:57.497129  8430 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:57.496878  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.600040  8429 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
W20260709 13:01:57.510977 11666 consensus_meta.cc:287] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.002s
I20260709 13:01:57.509466  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:57.538909  8578 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:01:57.538967  8579 raft_consensus.cc:2410] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:01:57.613914  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.497390 11926 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.541538 11862 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:57.543926 11859 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 2.551s	user 0.004s	sys 0.009s
I20260709 13:01:57.514204 11918 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.534686 11465 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.546326 11917 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:57.547068 11892 raft_consensus.cc:3055] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:57.417023 11884 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.368037 11860 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.547545 11692 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:57.498325  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:57.550624  8580 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:57.565606  8502 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:01:57.519178  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:57.549973 11887 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:57.568002  8509 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:57.574419  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:57.555006 11807 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.740s	user 0.007s	sys 0.004s
I20260709 13:01:57.602167  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:57.519891 11843 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:57.614262  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.802999 11824 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.740715  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.800719 11926 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.803839 11824 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.799916  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.804921  8428 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:01:57.638557  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 375958us
I20260709 13:01:57.806375 11824 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:57.799817  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 225406us
I20260709 13:01:57.807090 11806 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.807653 11806 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.808539 11913 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:57.756863  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.809505 11843 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:57.809892  9096 raft_consensus.cc:2376] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11. Re-sending same reply.
I20260709 13:01:57.800729  8429 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:57.809849 11806 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:57.814622  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:57.811547 11824 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.815636 11824 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.816115  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:57.808171  8510 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:57.816900  9096 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:01:57.806411  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.756736  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.818293 11824 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:57.818578  8576 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:01:57.814082  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 213977us
I20260709 13:01:57.821406  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.805802  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:57.823074  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 506) took 3508 ms. Trace:
I20260709 13:01:57.823648  8428 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:57.823477 11913 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:57.824716  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.825856  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.826500 11887 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.811095 11892 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:56.544831  8507 rpcz_store.cc:276] 0709 13:01:55.017925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.018535 (+   610us) service_pool.cc:224] Handling call
0709 13:01:55.018809 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.019042 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:55.041004 (+ 21962us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.094675 (+1053671us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b18004133e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:01:56.525487 (+430812us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:56.525562 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:56.525630 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.525720 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.525892 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19418,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":8557,"raft.run_wall_time_us":3600,"spinlock_wait_cycles":13090176,"thread_start_us":430534,"threads_started":1}
I20260709 13:01:57.827250  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.836884  8428 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:57.811635 11817 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:57.812211 11807 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:57.838474 11807 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.838404 11817 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.640529  8505 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:57.551060 11627 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:57.810551  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:57.825235 11912 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:57.844933 11912 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:57.755640 11718 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.813453  8579 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:57.821995  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.829831 11842 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:57.830205 11890 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.827741 11887 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:57.799811  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 242528us
I20260709 13:01:57.811506  8501 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:57.810904  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:57.817773  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:57.823558  8577 rpcz_store.cc:276] 0709 13:01:54.314911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.396012 (+ 81101us) service_pool.cc:224] Handling call
0709 13:01:56.702925 (+2306913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.814115 (+111190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.821212 (+1007097us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540009bd54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:57.822688 (+  1476us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b540009bd50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:57.822988 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5559003776}
I20260709 13:01:57.834939 11544 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:57.831215  8432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1826) took 4114 ms (client timeout 1819 ms). Trace:
W20260709 13:01:57.874140  8432 rpcz_store.cc:269] 0709 13:01:53.719644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.725540 (+  5896us) service_pool.cc:224] Handling call
0709 13:01:57.831023 (+4105483us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54003a1e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:57.831149 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2202503552}
I20260709 13:01:57.830623  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:57.832219 11892 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.855201 11884 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:57.862555  8576 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:57.875640  9097 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.872545  8580 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:57.608923 11759 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:57.840227 11917 consensus_queue.cc:1243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:57.879628 11842 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.965852 11807 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:57.966887 11544 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:57.968219  8580 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:57.971676 11860 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:58.065057  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 192817us
I20260709 13:01:58.080389  8432 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
W20260709 13:01:58.064942  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 241860us
I20260709 13:01:58.090723  8432 pending_rounds.cc:85] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 8
I20260709 13:01:58.061510  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:58.091032  8432 pending_rounds.cc:107] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:58.091615  8432 raft_consensus.cc:2889] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.091352  9096 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:58.091286  8476 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:57.806382 11926 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:58.098527  8501 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:58.099572  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.100518  8507 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:58.087615  8577 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:57.556124 11840 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:57.976100  8429 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:01:58.089826  8579 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:58.101441  8429 pending_rounds.cc:85] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 5
I20260709 13:01:58.101222  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:58.101733  8429 pending_rounds.cc:107] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:01:58.102013  8429 raft_consensus.cc:2889] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.090962  8428 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:58.102591  8579 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:58.102790  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:58.103662  9095 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:01:58.075909 11695 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.001s
I20260709 13:01:57.878521 11692 consensus_queue.cc:1243] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:58.071360 11718 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.975127 11892 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.087802 11759 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:58.112114  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 301587us
I20260709 13:01:58.113281  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:58.118052  8502 raft_consensus.cc:2368] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:01:58.115290  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:58.063938 11911 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:58.116277  8507 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:58.120697  8507 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:58.121338  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.879446 11890 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:58.124002  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.105664 11926 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.128198  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.125106  8508 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:58.128919  8432 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:01:58.124948  8428 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:01:58.130290  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.095465 11544 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.136215  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.136955  8434 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:58.139235 11887 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:58.132411 11937 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.126850  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.141243 11465 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.142176  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.142236  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.142951  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.185498  8507 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:58.186009  8501 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:58.143576  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:58.144212  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:58.187625  8504 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.144907  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.148042  9065 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:58.148713 11887 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:58.156185 11817 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:58.120272 11759 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.157948  9097 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:58.158154  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.156584 11890 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:58.162894  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:57.879295 11912 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.167835 11842 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:58.169613 11544 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:01:58.174254 11800 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.002s
I20260709 13:01:58.211170 11800 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.212477  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 507) took 3892 ms. Trace:
I20260709 13:01:58.212985  8575 rpcz_store.cc:276] 0709 13:01:54.319805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.397264 (+ 77459us) service_pool.cc:224] Handling call
0709 13:01:56.903297 (+2506033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.904072 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.212223 (+1308151us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b5400115b50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:58.212401 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5762526080}
I20260709 13:01:58.175802  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.214740  8429 raft_consensus.cc:2368] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:01:58.214973  9097 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:01:58.176661  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.177502  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:58.216964  8428 raft_consensus.cc:2368] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:01:58.217134  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.218636  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:58.219476 11807 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:58.219535  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 883) took 3158 ms. Trace:
I20260709 13:01:58.220103 11807 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:58.220064  9098 rpcz_store.cc:276] 0709 13:01:55.061536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.218687 (+3157151us) service_pool.cc:224] Handling call
0709 13:01:58.219008 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.219194 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.219219 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.219259 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:58.219301 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.219354 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.219455 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.221211 11807 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.213663 11800 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:58.157168  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:58.192842  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44892.3us
I20260709 13:01:58.231118  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:58.210613 11912 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.269002  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.225183  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2003) took 3630 ms. Trace:
I20260709 13:01:58.226765  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:58.225605  8504 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:58.208693  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.273557  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.217787  8509 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:01:58.274587  8579 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:58.167858 11840 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:58.268731  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.221916  9098 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:58.267154  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.277892  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.273162  8431 rpcz_store.cc:276] 0709 13:01:54.594999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.595119 (+   120us) service_pool.cc:224] Handling call
0709 13:01:54.630316 (+ 35197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.439654 (+809338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.224959 (+2785305us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54001d3dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:58.225123 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859476736}
I20260709 13:01:58.200076 11911 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.279652  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:58.280990  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.285545  8509 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:01:58.285555  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.286840  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:58.224597 11640 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:58.279698 11806 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:01:58.288008  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.289068 11806 raft_consensus.cc:2764] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:58.289153  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.222190 11810 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:01:58.290266  8504 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:58.291507  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:58.293080  8509 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:58.294065  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:58.294807  8509 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:01:58.295858  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.296327  8429 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:58.297044  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.297860  8432 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:58.298987  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.299876  8432 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:58.300920  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.287864 11640 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:58.304142  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.307651  8432 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:01:58.305840  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:58.299055  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:58.308532  8509 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.308831  8504 raft_consensus.cc:2376] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7. Re-sending same reply.
W20260709 13:01:58.286738 11933 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:01:58.292135 11934 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:01:58.310771  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.311395  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.311746 11465 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:58.314327  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.315027  8508 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:58.315869  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.316524  8508 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:58.319125  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.321688  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.322268  8579 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:58.322623  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:58.323273  8426 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.323994  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.323298  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:58.325886  8579 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:58.327168  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.324617  8429 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:58.330649  8428 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:58.325404  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:58.333072  8509 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:01:58.338001  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.345116  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:58.345798  8434 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.348618 11563 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:58.275914 11824 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:01:58.333681  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:58.356877  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.377609  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:58.309823  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.355273  8434 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:01:58.366683  8426 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:01:58.379343  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.424325  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:58.384791  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.416481  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.594952  8579 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:01:58.379889  8476 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:58.596220  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:01:58.500381  9093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 884) took 3438 ms (client timeout 2152 ms). Trace:
W20260709 13:01:58.596932  9093 rpcz_store.cc:269] 0709 13:01:55.061759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.104066 (+ 42307us) service_pool.cc:224] Handling call
0709 13:01:58.500106 (+3396040us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b5400208fd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:58.500265 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177899904}
I20260709 13:01:58.563486  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.598557  9093 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:58.598995  8577 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:58.599232  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 887) took 3360 ms. Trace:
W20260709 13:01:58.501375  8583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 521) took 1217 ms (client timeout 1557 ms). Trace:
I20260709 13:01:58.599678  9093 rpcz_store.cc:276] 0709 13:01:55.238829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.597921 (+3359092us) service_pool.cc:224] Handling call
0709 13:01:58.598228 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.598994 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.599177 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:58.600188  8583 rpcz_store.cc:269] 0709 13:01:57.284115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.284269 (+   154us) service_pool.cc:224] Handling call
0709 13:01:58.501123 (+1216854us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b54000663d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:58.501293 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197848832}
I20260709 13:01:58.597617  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:01:58.591573  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 468558us
I20260709 13:01:58.602358  8579 raft_consensus.cc:2376] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9. Re-sending same reply.
I20260709 13:01:58.593990  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:58.603245  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:58.322546 11800 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:58.321571 11917 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:58.630008  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:58.350116 11840 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:58.637904  8583 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:58.415392 11762 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.251s
I20260709 13:01:58.626085 11937 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:58.631155 11800 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:58.632664  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 252869us
W20260709 13:01:58.536257 11935 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:01:58.414947 11563 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:58.415565 11913 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:58.693557 11913 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.668773  8578 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:58.632423 11842 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:58.652272  9093 raft_consensus.cc:2955] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:01:58.637931 11938 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:58.679510  8476 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:58.662133 11840 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:58.683593  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 456859us
I20260709 13:01:58.462932 11640 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.669323 11666 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:58.697675  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:58.693186 11563 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.711808  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:58.712611  8583 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:58.714457  8583 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:58.694051 11913 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.713095  8505 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:58.716493 11824 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:58.712661 11807 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:01:58.715576  8583 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.721062  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:58.721253 11884 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:58.724290  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 880) took 3669 ms. Trace:
W20260709 13:01:58.726698 11939 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:01:58.730340 11937 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.756908  8583 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.732587 11563 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.740298  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:58.710484 11840 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.743122  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.763538  8434 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:01:58.745234  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 881) took 3689 ms. Trace:
I20260709 13:01:58.746978  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 882) took 3685 ms. Trace:
I20260709 13:01:58.764478  9097 rpcz_store.cc:276] 0709 13:01:55.061242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.199855 (+3138613us) service_pool.cc:224] Handling call
0709 13:01:58.200285 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.215459 (+ 15174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.746644 (+531185us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b54002f0654. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:58.746905 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33043712}
I20260709 13:01:58.749431 11810 raft_consensus.cc:3055] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:58.770064 11810 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:58.770272  9100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1007) took 4137 ms (client timeout 2999 ms). Trace:
I20260709 13:01:58.696834 11942 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:58.770694  9100 rpcz_store.cc:269] 0709 13:01:54.632966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.633400 (+   434us) service_pool.cc:224] Handling call
0709 13:01:58.770057 (+4136657us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54006121d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:58.770201 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060517120}
I20260709 13:01:58.771158 11942 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:58.772032  9100 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:58.772657  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 939) took 1441 ms. Trace:
I20260709 13:01:58.773015  9100 rpcz_store.cc:276] 0709 13:01:57.331270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.771484 (+1440214us) service_pool.cc:224] Handling call
0709 13:01:58.771817 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.772418 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.772606 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.674893 11917 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:58.774379  9100 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:58.774760  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1852) took 1288 ms. Trace:
I20260709 13:01:58.774930  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 941) took 1430 ms. Trace:
I20260709 13:01:58.775406  9100 rpcz_store.cc:276] 0709 13:01:57.344545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.773727 (+1429182us) service_pool.cc:224] Handling call
0709 13:01:58.774058 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.774702 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.774878 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.738970  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.730372 11822 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:58.754302  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 74886us
I20260709 13:01:58.777742  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:58.760960 11759 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.004s
I20260709 13:01:58.756048  9068 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:58.742383  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.710228 11666 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.764336  9096 rpcz_store.cc:276] 0709 13:01:55.055898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.120653 (+3064755us) service_pool.cc:224] Handling call
0709 13:01:58.134318 (+ 13665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.134824 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.134870 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.149625 (+ 14755us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.565931 (+416306us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:58.565985 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.566089 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.744997 (+178908us) raft_consensus.cc:1685] finished
0709 13:01:58.745017 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.745172 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":648,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":415865,"threads_started":1,"wal-append.queue_time_us":541424}
I20260709 13:01:58.769296 11546 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:58.769433  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2014) took 3747 ms. Trace:
I20260709 13:01:58.772403 11942 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.775527 11917 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:58.756683 11936 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:58.754786  9095 rpcz_store.cc:276] 0709 13:01:55.055336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.109293 (+3053957us) service_pool.cc:224] Handling call
0709 13:01:58.109705 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.109995 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.110064 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.116765 (+  6701us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.627433 (+510668us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:58.627486 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.627570 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.724004 (+ 96434us) raft_consensus.cc:1685] finished
0709 13:01:58.724033 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.724210 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":475991,"threads_started":1,"wal-append.queue_time_us":575132}
I20260709 13:01:58.758529 11824 consensus_queue.cc:1243] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:58.757771 11884 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.799191 11884 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:58.801714 11718 consensus_meta.cc:287] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.001s
I20260709 13:01:58.782207  8432 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:58.752461 11658 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:58.751885  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54292.3us
I20260709 13:01:58.814966  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:58.762349 11934 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:58.749964 11911 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.775259  8503 rpcz_store.cc:276] 0709 13:01:57.485999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.611741 (+125742us) service_pool.cc:224] Handling call
0709 13:01:57.612131 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.612558 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.612592 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.839658 (+227066us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.181302 (+341644us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:58.181364 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.181462 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.774541 (+593079us) raft_consensus.cc:1685] finished
0709 13:01:58.774564 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.774701 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1834,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":162,"thread_start_us":217383,"threads_started":1,"wal-append.queue_time_us":471334}
I20260709 13:01:58.785447  8427 rpcz_store.cc:276] 0709 13:01:55.022179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.229296 (+3207117us) service_pool.cc:224] Handling call
0709 13:01:58.229717 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.230158 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.230203 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.230798 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.670833 (+440035us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:58.670891 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.670986 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.769136 (+ 98150us) raft_consensus.cc:1685] finished
0709 13:01:58.769154 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.769371 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23556,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7100,"thread_start_us":439280,"threads_started":1,"wal-append.queue_time_us":536753}
I20260709 13:01:58.706946 11938 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.794313  9068 leader_election.cc:400] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:01:58.819721  9068 leader_election.cc:400] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:01:58.820219  9068 leader_election.cc:403] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.795534  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:58.784014 11762 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.785436 11666 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.825229  8510 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:01:58.843143  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.843724  8547 connection.cc:256] RPC call timeout handler was delayed by -1.3593233839999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 13:01:58.843994  8503 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:58.844691  8547 connection.cc:256] RPC call timeout handler was delayed by -1.270223384000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
I20260709 13:01:58.845104  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:58.845216  8547 connection.cc:256] RPC call timeout handler was delayed by -1.2198233839999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 13:01:58.845623  8583 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:58.845705  8503 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
W20260709 13:01:58.845758  8547 connection.cc:256] RPC call timeout handler was delayed by -1.1568233840000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
I20260709 13:01:58.846971  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:58.847437  8583 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:58.792865 11936 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.750255 11800 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.847812  8583 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:58.814777 11942 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.813812 11806 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:58.862104  8581 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:01:58.817754 11934 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.786062 11759 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:58.864102  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 886) took 3637 ms. Trace:
I20260709 13:01:58.865352  8583 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.842409 11718 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:58.833900 11888 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:01:58.865952 11806 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.868491  9099 rpcz_store.cc:276] 0709 13:01:55.226808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.292476 (+3065668us) service_pool.cc:224] Handling call
0709 13:01:58.292880 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.293137 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:58.630638 (+337501us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.859726 (+229088us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.863779 (+  4053us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.863827 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:58.863868 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.863931 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.864048 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3319,"prepare.queue_time_us":428765,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":4340,"spinlock_wait_cycles":19447808,"thread_start_us":555884,"threads_started":2}
I20260709 13:01:58.871075 11806 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.873714  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 885) took 3811 ms. Trace:
I20260709 13:01:58.874626  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.875245  8581 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:01:58.876119  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.876602  8581 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:01:58.877265  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.878971  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2131) took 1628 ms. Trace:
I20260709 13:01:58.879387  8584 rpcz_store.cc:276] 0709 13:01:57.250410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.251827 (+  1417us) service_pool.cc:224] Handling call
0709 13:01:57.252084 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.528736 (+276652us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:57.639335 (+110599us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.100433 (+461098us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.100603 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.100642 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:58.100698 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.147037 (+ 46339us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b180036aa20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:01:58.878744 (+731707us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54001a4854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:58.878795 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.878917 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5988,"prepare.queue_time_us":447625,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":3886,"raft.queue_time_us":10324,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6325,"spinlock_wait_cycles":650002688,"thread_start_us":540006,"threads_started":2,"wal-append.queue_time_us":640191}
I20260709 13:01:58.882953 11806 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.885426 11806 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:58.859239 11936 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.890435 11682 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:58.890983 11682 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:58.891907 11682 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.892944 11682 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.895766 11938 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:58.896515 11852 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:58.874208  9098 rpcz_store.cc:276] 0709 13:01:55.061972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.221332 (+3159360us) service_pool.cc:224] Handling call
0709 13:01:58.221659 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.277982 (+ 56323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.873366 (+595384us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5400524520. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b6dc0 00007f1a19342a02 00007f1a1933edd6 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:01:58.873633 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29573888}
I20260709 13:01:58.901902  8576 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:01:58.907564  8576 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:58.909054  8582 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:58.912143 11817 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:58.912743 11817 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:01:58.877357  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:58.965901  9094 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:58.976013  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.868037  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 148060us
W20260709 13:01:59.008984  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.007033  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.994408  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:58.937611  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.010419  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:59.011026  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:59.011042  8579 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:01:59.011706  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:01:58.919929  9102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 927) took 4167 ms (client timeout 2020 ms). Trace:
W20260709 13:01:58.933174  9101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 940) took 1593 ms (client timeout 1860 ms). Trace:
W20260709 13:01:59.013368  9101 rpcz_store.cc:269] 0709 13:01:57.339601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.369902 (+ 30301us) service_pool.cc:224] Handling call
0709 13:01:58.932934 (+1563032us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54000e83d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:58.933090 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374106880}
I20260709 13:01:58.932267  8504 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:58.870007 11934 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.901723 11718 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:01:58.970778  8476 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:59.008294  9094 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:01:59.012465  9102 rpcz_store.cc:269] 0709 13:01:54.752593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.025371 (+272778us) service_pool.cc:224] Handling call
0709 13:01:58.919625 (+3894254us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b540017a054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:58.919830 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5453727616}
W20260709 13:01:59.009793  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.016793  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:01:59.041338 11936 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.868883  8583 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.902786  8584 raft_consensus.cc:1217] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[4.6-10.9]   Dedup: 6.7->[8.8-10.9]
I20260709 13:01:59.026588  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:59.026755  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.027205  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 938) took 1699 ms. Trace:
W20260709 13:01:59.027503  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 902455us
I20260709 13:01:59.028230  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:59.028532  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1911) took 1515 ms. Trace:
W20260709 13:01:59.030153  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 169625us
I20260709 13:01:59.015105 11937 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.031075  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.031102  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:59.032240 11759 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:59.033298  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.034005 11886 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:59.035310  8503 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:59.114728  9065 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.115439  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:59.116258  8503 raft_consensus.cc:2368] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:01:59.115993  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:59.117209  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.023695 11892 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.117630  8547 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:59.020121  8400 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:59.044157  8576 raft_consensus.cc:2376] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8. Re-sending same reply.
I20260709 13:01:59.117796  8503 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
W20260709 13:01:59.118582  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 98608us
I20260709 13:01:59.118973  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:59.119068  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:01:59.119563  8576 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:59.119673  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:01:59.119935  8503 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:59.120374  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:59.120939  8576 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:58.906582 11800 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.126176 11888 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:59.126690  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2006) took 4530 ms. Trace:
I20260709 13:01:59.127048  8433 rpcz_store.cc:276] 0709 13:01:54.595825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.595977 (+   152us) service_pool.cc:224] Handling call
0709 13:01:54.635576 (+ 39599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.214853 (+2579277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.126446 (+1911593us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b5400021054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:59.126604 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5435313536}
W20260709 13:01:59.128918 11958 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:59.129501 11813 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:59.129884 11813 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.130223 11813 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.131168 11808 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:59.131883 11808 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:59.134204 11917 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:58.972425 11835 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:59.136422  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.138002  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.045917 11887 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.138757 11887 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.139196  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:58.917892 11904 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 2.123s	user 0.008s	sys 0.000s
I20260709 13:01:59.140712  9102 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:59.140880 11887 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:59.141353 11887 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.141419  9101 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:59.142828  8501 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:59.124614 11806 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:59.143517  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.143712 11806 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.144184 11806 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.144778  8501 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:59.146458  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:59.147133  9098 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:59.147807 11465 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:59.148377 11465 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.148789 11465 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.149102  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:59.150130  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:59.150903  9101 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:59.151791  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:59.152174  8577 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:59.153169  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:59.047619 11852 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.154155 11852 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.154868  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:59.155480  9099 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.156730 11852 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:59.157675  9065 leader_election.cc:400] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:01:59.159494  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:59.136294 11810 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.122107  8502 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:01:59.171888  8502 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:59.163450  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.133033 11808 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:58.926779 11853 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:59.173846  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:59.174531  9095 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:58.967931 11640 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.047787  9094 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.122546  8507 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:01:59.152688 11884 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:59.166121  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 48581.7us
I20260709 13:01:59.185451  8547 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:59.123729  9097 rpcz_store.cc:276] 0709 13:01:57.327491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.767553 (+1440062us) service_pool.cc:224] Handling call
0709 13:01:58.768018 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.768575 (+   557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.768618 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.769201 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.935730 (+166529us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:58.935775 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.935861 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.027011 (+ 91150us) raft_consensus.cc:1685] finished
0709 13:01:59.027030 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.027149 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1258,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":166114,"threads_started":1,"wal-append.queue_time_us":256051}
I20260709 13:01:59.172147  9065 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.187738  9065 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.189499  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.122515  8580 rpcz_store.cc:276] 0709 13:01:57.512712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.089190 (+576478us) service_pool.cc:224] Handling call
0709 13:01:58.105411 (+ 16221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.105649 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:58.444724 (+339075us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.028185 (+583461us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:59.028233 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:59.028289 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.028349 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.028482 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":352866,"prepare.queue_time_us":41417,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":353661,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":79,"thread_start_us":555346,"threads_started":2,"wal-append.queue_time_us":329866}
I20260709 13:01:59.165728  8582 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:01:59.166297  8584 pending_rounds.cc:85] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 7
I20260709 13:01:59.177115  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:59.191538  8584 pending_rounds.cc:107] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:59.191937  8584 raft_consensus.cc:2889] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:59.177495  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:59.043066 11718 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.184347  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:59.166775  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 135729us
I20260709 13:01:58.913866 11817 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.173236 11666 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:59.198127 11936 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:59.201159  9100 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:59.201622 11934 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.203677 11934 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:59.042392 11546 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:59.191840  9101 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
W20260709 13:01:59.204466  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 287191us
I20260709 13:01:59.204978  8581 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:59.207396  9099 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:01:59.208258  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:59.209076  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:59.209268  9097 raft_consensus.cc:2376] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8. Re-sending same reply.
I20260709 13:01:59.211364  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.214483  8503 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:59.173483 11877 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:59.218318  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 52933us
I20260709 13:01:59.173676 11843 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:59.220672  9065 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.042850 11563 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:59.221669  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:59.179165 11853 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:59.178113 11807 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.227887  9065 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:01:59.229646  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:59.214366 11828 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.204906 11888 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.232772  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.232218  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:59.235306 11563 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:59.235843 11815 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.214442 11546 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.173758 11937 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.230268 11822 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.238286  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.238075 11853 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:59.141810 11887 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.239178  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.219179 11627 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.239859 11807 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.219940 11934 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.226950 11824 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:01:59.226683 11843 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.250344  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:01:59.309979  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 59729us
I20260709 13:01:59.311014  8398 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:59.312254  8398 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:59.227671 11948 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:59.253176  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 131766us
I20260709 13:01:59.255752  8583 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:59.233217 11810 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.239595 11544 raft_consensus.cc:2764] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:01:59.232275 11877 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:01:59.316627 11843 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.309811 11822 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.298596 11888 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.284929  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2221) took 1144 ms. Trace:
I20260709 13:01:59.347610  8504 rpcz_store.cc:276] 0709 13:01:58.140731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.309578 (+168847us) service_pool.cc:224] Handling call
0709 13:01:59.284645 (+975067us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54003732d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:59.284849 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781355776}
I20260709 13:01:59.316896 11853 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.291545  8510 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:59.298695  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 699) took 1162 ms. Trace:
I20260709 13:01:59.348654  8505 rpcz_store.cc:276] 0709 13:01:58.136603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.157774 (+ 21171us) service_pool.cc:224] Handling call
0709 13:01:59.298500 (+1140726us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54003e58d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:01:59.298630 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179182464}
I20260709 13:01:59.223474 11911 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.303766  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:01:59.246546 11546 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:59.315531  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.355223  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.033324 11913 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.322566  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.358623  8507 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:01:59.323587  9102 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:01:59.249778 11835 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.298763 11807 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.318810  8503 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:59.213599  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:01:59.275007  8549 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:59.375818  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 100890us
I20260709 13:01:59.277280 11627 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.340734  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2213) took 1202 ms. Trace:
W20260709 13:01:59.350926 11840 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 13:01:59.379307  8509 rpcz_store.cc:276] 0709 13:01:58.138650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.335353 (+196703us) service_pool.cc:224] Handling call
0709 13:01:58.335654 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.335902 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:58.760483 (+424581us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.012809 (+252326us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.283546 (+270737us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b180028ab00. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:01:59.340153 (+ 56607us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b180028ab00. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:01:59.340332 (+   179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:59.340390 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:59.340448 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.340527 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.340670 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":312036,"prepare.queue_time_us":111851,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":330324,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":17513,"spinlock_wait_cycles":36389632,"thread_start_us":566596,"threads_started":2,"wal-append.queue_time_us":197947}
W20260709 13:01:59.341310  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 125692us
I20260709 13:01:59.238883 11666 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:59.344270  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 373556us
I20260709 13:01:59.346071 11822 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.384930  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:59.385783  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:59.364255  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 136420us
I20260709 13:01:59.322542 11886 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.329926 11808 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.373740  8508 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 11. Ops: []
W20260709 13:01:59.375218  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 161705us
I20260709 13:01:59.382642  8550 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:01:59.388054  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 155340us
I20260709 13:01:59.358795 11942 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:59.347553 11888 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:01:59.399947  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 405633us
I20260709 13:01:59.366592 11884 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:59.417856  8550 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.408418  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.410983  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.403879  9067 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:01:59.364857 11934 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.420737 11934 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.423914 11934 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:59.374228 11948 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.390259 11840 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:59.375155 11687 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:59.470356 11687 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.473297 11687 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:59.383987 11828 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:59.387528 11902 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.474558 11902 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:59.475083 11902 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.479341 11968 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.479952 11968 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:01:59.480446 11968 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:59.482235  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 80528.4us
I20260709 13:01:59.483707 11640 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.384371 11627 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.399200 11892 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.396185 11822 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:59.508033  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 190928us
I20260709 13:01:59.433367 11840 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:59.442312  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 57447us
W20260709 13:01:59.453269 11963 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:01:59.457386 11695 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:59.458931  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 48033.3us
I20260709 13:01:59.459681 11942 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:59.464570 11938 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:59.485239  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 173023us
I20260709 13:01:59.413129 11890 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:59.396025 11964 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.419866 11888 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:59.513581  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.397008 11835 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:01:59.426846 11969 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.529747  8398 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:59.548218  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:01:59.549172  8427 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:59.551157  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:59.553746  8432 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.544979  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:59.560214  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:01:59.566639  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 150169us
I20260709 13:01:59.575273  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:59.576260  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:59.577046  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:01:59.602751  8434 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.536017 11890 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:59.522747 11886 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:59.486424 11948 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.528635 11808 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:01:59.546329 11695 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:01:59.597981  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 180189us
I20260709 13:01:59.532419  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.427544 11877 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:59.539022 11660 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:01:59.684036  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:59.691085  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 158766us
I20260709 13:01:59.692559  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:01:59.683908  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 200776us
I20260709 13:01:59.688975 11828 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:01:59.697045 11973 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:01:59.697809 11666 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:59.785552 11666 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:01:59.786561 11666 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.788198 11627 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.698294 11762 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.700063 11974 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.701133 11695 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.702917  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:59.704720 11886 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:59.808573 11886 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:59.809525 11886 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.810827 11886 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.705049  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:59.813163  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 108209us
I20260709 13:01:59.707269 11843 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.710136 11942 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.690711 11640 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:01:59.675776 11890 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.718883 11937 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:59.723073  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 888) took 4473 ms. Trace:
I20260709 13:01:59.841023  9093 rpcz_store.cc:276] 0709 13:01:55.249330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.600550 (+3351220us) service_pool.cc:224] Handling call
0709 13:01:58.637511 (+ 36961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.637729 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:58.723138 (+ 85409us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.950295 (+227157us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.280645 (+330350us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b180033b5c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:01:59.346067 (+ 65422us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b180033b5c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf 00007f1a19359038
0709 13:01:59.346308 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.363623 (+ 17315us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.722193 (+358570us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b180033b5c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:01:59.722562 (+   369us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.722717 (+   155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:59.722760 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:59.722803 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.722890 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.723006 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":748147,"prepare.queue_time_us":425012,"prepare.run_cpu_time_us":166,"prepare.run_wall_time_us":4834,"raft.queue_time_us":371912,"raft.run_cpu_time_us":520,"raft.run_wall_time_us":27469,"spinlock_wait_cycles":85647872,"thread_start_us":219758,"threads_started":1,"wal-append.queue_time_us":237388}
W20260709 13:01:59.724967  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 316639us
W20260709 13:01:59.846797  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.725673 11934 raft_consensus.cc:2764] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:01:59.725883  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 322061us
W20260709 13:01:59.849532  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 319852us
W20260709 13:01:59.727460  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.728864 11852 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:59.736224 11718 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.508s	user 0.018s	sys 0.000s
W20260709 13:01:59.738580 11813 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.608s	user 0.016s	sys 0.002s
I20260709 13:01:59.853874  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:59.854390 11813 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:59.854964 11974 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:59.855180  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:59.855624 11974 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:01:59.856483  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:01:59.857172 11972 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:59.856825 11974 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.742228 11840 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:59.743893 11948 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:01:59.749187  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.857730 11972 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.687705 11913 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:59.861325 11913 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.861871 11913 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.753156  8434 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:01:59.764031  8501 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:59.766409  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.763872  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2214) took 1625 ms. Trace:
W20260709 13:01:59.776636  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.775580  8432 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:01:59.783869 11828 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.774874 11936 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:01:59.781659 11887 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:59.804920 11546 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:01:59.806493 11806 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.000s
I20260709 13:01:59.883127 11983 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.883230 11806 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.884523  8431 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:01:59.869346 11972 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:01:59.887988  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 185133us
I20260709 13:01:59.889838  9095 raft_consensus.cc:2368] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
I20260709 13:01:59.811930 11902 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.849881  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:01:59.892850  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 126592us
I20260709 13:01:59.894908  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:59.895149  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.726514 11884 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:59.897940  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:59.851533  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 247912us
I20260709 13:01:59.852824  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2156) took 1507 ms. Trace:
I20260709 13:01:59.901485 11817 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.899930  8584 rpcz_store.cc:276] 0709 13:01:58.345527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.902165 (+556638us) service_pool.cc:224] Handling call
0709 13:01:58.902560 (+   395us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:01:59.210091 (+307531us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:59.228081 (+ 17990us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.718616 (+490535us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.850226 (+131610us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:59.850911 (+   685us) log.cc:844] Serialized 52 byte log entry
0709 13:01:59.852459 (+  1548us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:59.852500 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.852570 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.852609 (+    39us) raft_consensus.cc:1685] finished
0709 13:01:59.852622 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.852765 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126825,"prepare.queue_time_us":51615,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":3203,"raft.queue_time_us":281105,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":7215,"thread_start_us":515108,"threads_started":2,"wal-append.queue_time_us":561669}
I20260709 13:01:59.856678 11813 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:01:59.902961 11988 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:59.903856 11979 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:59.781414  9098 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:01:59.866667  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:59.867767  8434 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:59.865073  8508 rpcz_store.cc:276] 0709 13:01:58.138901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.623583 (+484682us) service_pool.cc:224] Handling call
0709 13:01:58.652804 (+ 29221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.401381 (+748577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.763567 (+362186us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54000d8ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:01:59.763805 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657392896}
I20260709 13:01:59.802765 11627 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:59.824294 11759 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.686504 11975 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.179s
I20260709 13:01:59.882158 11936 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:01:59.924785  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:59.925438  9096 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.865262 11892 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:01:59.896086  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:59.988703  9101 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:59.989858  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:01:59.991256  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:01:59.902168  9100 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:59.904032  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:01:59.859928  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 336702us
I20260709 13:01:59.992818  9099 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:01:59.992929  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:59.909205  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:01:59.836113 11563 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:02:00.009315  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:00.010223  9100 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:59.871778 11937 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:01:59.885830 11806 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:01:59.914966  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:01:59.917951  8549 connection.cc:256] RPC call timeout handler was delayed by -3.0523406380000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:01:59.882622 11546 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:59.963555  9097 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:01:59.905114 11356 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:59.854007 11718 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:01:59.897053 11884 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.956820  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:01:59.908476 11972 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:00.008301  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:01:59.915859 11465 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.767s	user 0.012s	sys 0.000s
I20260709 13:01:59.907430 11979 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.908017 11986 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.827533 11968 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:00.029871  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:00.073387  8503 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 4.
I20260709 13:02:00.029851  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:00.074753  9100 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:00.028970  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 119831us
I20260709 13:02:00.029109  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:00.033020  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:00.079361  9099 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:00.046993 11356 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.042887  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:00.041534  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:01:59.988101 11912 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:00.046415  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:00.100502  8507 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:00.009203 11627 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:00.028700 11807 consensus_meta.cc:287] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.631s	user 0.018s	sys 0.001s
I20260709 13:02:00.043718 11937 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:00.059926  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:00.017567 11913 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:01:59.926860 11498 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 13:02:00.066139  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:00.133438  9098 raft_consensus.cc:2376] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6. Re-sending same reply.
I20260709 13:02:00.041182 11759 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.069969  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:00.134476  8505 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.054834 11884 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:00.054795 11813 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:00.045089 11985 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.157003  8505 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:00.113251  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:00.115080  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2023) took 2780 ms. Trace:
W20260709 13:02:00.110301  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 246558us
I20260709 13:02:00.116432 11988 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:00.065055 11964 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.004s
I20260709 13:02:00.170509 11964 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.054561 11972 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:00.170729 11988 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:00.171530 11972 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:00.121742  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 165081us
I20260709 13:02:00.116863  9094 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.071355 11979 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.128607  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 713) took 1088 ms. Trace:
I20260709 13:02:00.191779  8501 rpcz_store.cc:276] 0709 13:01:59.040600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.145592 (+104992us) service_pool.cc:224] Handling call
0709 13:01:59.763766 (+618174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.864507 (+100741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.128393 (+263886us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54000d8ed0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:00.128546 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420980480}
I20260709 13:02:00.130627  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:00.112488  9096 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:02:00.099670 11356 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.163056  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:00.164489 11987 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:02:00.164054 11759 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:00.160830  8435 rpcz_store.cc:276] 0709 13:01:57.334666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.506571 (+171905us) service_pool.cc:224] Handling call
0709 13:01:57.506831 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.564170 (+ 57339us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:57.606860 (+ 42690us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.282830 (+1675970us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b18002f3f20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:01:59.534371 (+251541us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.853262 (+318891us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:59.853316 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:59.853369 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.114855 (+261486us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b54001d47d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:00.114899 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.115028 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9438,"prepare.queue_time_us":311437,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":104,"raft.queue_time_us":169107,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":274,"spinlock_wait_cycles":189769856,"thread_start_us":559434,"threads_started":3,"wal-append.queue_time_us":1914770}
I20260709 13:02:00.174623  8426 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.066924 11989 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:02:00.100221 11908 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:00.070436 11465 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:00.194234  9098 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:00.123870 11627 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:00.133299 11807 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:00.856719  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.209686  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:00.279870  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.255146 11498 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:00.859156 11498 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:00.440466  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.854619 11979 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260709 13:02:00.860248 11979 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:00.860168 11498 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:00.322856 11998 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:02:00.685681  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 282301us
I20260709 13:02:00.862363 11993 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:00.819514 11994 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.327s	user 0.000s	sys 0.000s
W20260709 13:02:00.527976 11853 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.160s	user 0.020s	sys 0.001s
I20260709 13:02:00.863070 11993 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:00.865638  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:00.865667  8509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.009s	sys 0.016s
W20260709 13:02:00.255120  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.866539  8509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.009s	sys 0.017s
I20260709 13:02:00.807281  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:00.323372  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1022) took 5573 ms. Trace:
I20260709 13:02:00.867743  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:00.883433  8584 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:00.884522  8584 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:00.285899  8426 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
W20260709 13:02:00.206840  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 311718us
I20260709 13:02:00.175021 11813 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:00.869274  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:00.242655  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 65099.8us
I20260709 13:02:00.425987  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:00.261024  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 219099us
I20260709 13:02:00.100311  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:00.872064  9100 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:02:00.380353 11991 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:02:00.872526  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:00.873927  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:00.335336 11819 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:02:00.875080  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:00.830292 12000 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.661s	user 0.003s	sys 0.009s
W20260709 13:02:00.532769 11817 consensus_meta.cc:287] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.000s
I20260709 13:02:00.462491  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:00.890376  8549 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:00.317065  8333 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:00.527803 11886 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.001s
I20260709 13:02:00.957355  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:01.072738  8579 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:01.053395  8575 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:00.887856  9094 rpcz_store.cc:276] 0709 13:01:54.750372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.783910 (+2033538us) service_pool.cc:224] Handling call
0709 13:01:56.809974 (+ 26064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.965752 (+2155778us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002443a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b6dc0 00007f1a193411c0 00007f1a19342231 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c
0709 13:01:59.290907 (+325155us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b54002443a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b4a1d 00007f1a1929b1a4 00007f1a1931d447 00007f1a19335fe7 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419
0709 13:02:00.116432 (+825525us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b58004388d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1929b0aa 00007f1a1931d447 00007f1a19335fe7 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4
0709 13:02:00.322609 (+206177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.322662 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:00.322724 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:00.322805 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.323050 (+   245us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.323263 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":108,"spinlock_wait_cycles":1874550144}
I20260709 13:02:00.528275 11759 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:00.452907 11718 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:00.861970 11498 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.959112 11877 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:01.055576  8576 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:01.075388 11969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.250s	user 0.016s	sys 0.015s
I20260709 13:02:00.955855  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:01.059523 11627 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:01.096871  8578 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:00.906176  9093 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.000s	sys 0.005s
I20260709 13:02:01.066074 11817 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.096525 11969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.016s	sys 0.016s
I20260709 13:02:00.958822 11908 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:00.349325 11666 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:01.059156  9102 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:00.898790  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:00.513525 11822 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.985s	user 0.005s	sys 0.007s
W20260709 13:02:00.816754 11356 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 13:02:00.957077  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:01.054502  8577 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:02:00.467365 11888 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.904s	user 0.003s	sys 0.007s
W20260709 13:02:00.721035 11917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.008s	sys 0.008s
W20260709 13:02:00.825269 11978 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.940s	user 0.005s	sys 0.008s
I20260709 13:02:00.956893  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:00.844775 11972 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.000s
I20260709 13:02:00.410640 12003 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.066672  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:01.074714  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:01.297443  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:01.298554  9094 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:02:01.299022  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1033) took 1169 ms. Trace:
I20260709 13:02:01.299401  9094 rpcz_store.cc:276] 0709 13:02:00.129153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.297127 (+1167974us) service_pool.cc:224] Handling call
0709 13:02:01.298955 (+  1828us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.300588  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:01.301446  9094 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:00.894073  9096 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:00.349483 11937 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:00.268390 11843 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:00.572428 11912 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:00.898378 11884 consensus_meta.cc:287] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.002s
I20260709 13:02:01.016093  9098 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:00.467018 11563 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.024932 11852 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.423811 11996 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:01.091218  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 720) took 1168 ms. Trace:
I20260709 13:02:01.042773 11682 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.060461 11813 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.257622 11964 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.817s
I20260709 13:02:01.093042  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:01.056229  8583 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.898953 12008 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:00.469530 11942 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.613s
I20260709 13:02:01.102754  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:01.056596  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:01.081750 11853 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.254428 12002 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.877s
I20260709 13:02:00.899436  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:01.088413 11902 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:01.032989  9068 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.718s (SENT) [suppressed 28 similar messages]
I20260709 13:02:01.162602  8576 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:01.187356  8579 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:02:01.096899 11995 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.248540  8435 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:01.247426 11822 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.162015 11886 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.294166  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 234227us
W20260709 13:02:01.196440 11828 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.012s	sys 0.044s
I20260709 13:02:01.203361  8581 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:01.302430  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1026) took 1192 ms. Trace:
I20260709 13:02:01.309015  8577 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:02:01.305913  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:01.312151  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 242731us
I20260709 13:02:01.114506 11718 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:01.188143 11817 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:01.316417  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 359433us
I20260709 13:02:01.323072  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:01.192421 11627 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.262001 11890 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.374s	user 0.011s	sys 0.002s
W20260709 13:02:01.326628  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 436302us
I20260709 13:02:01.331085  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:01.192163 11936 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:01.145331 11913 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.337011  8509 rpcz_store.cc:276] 0709 13:01:59.922902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.923031 (+   129us) service_pool.cc:224] Handling call
0709 13:01:59.923394 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.120381 (+196987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.120406 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.151446 (+ 31040us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.867077 (+715631us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:00.867128 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.867214 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.090986 (+223772us) raft_consensus.cc:1685] finished
0709 13:02:01.091007 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.091147 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269194,"raft.queue_time_us":200448,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":18327,"thread_start_us":795704,"threads_started":2,"wal-append.queue_time_us":652252}
I20260709 13:02:01.115286 11877 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.115470 12011 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.210s
I20260709 13:02:01.261638 11356 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.344913  8434 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 3.
W20260709 13:02:01.347306  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 439736us
I20260709 13:02:01.320554 11666 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:01.343323 11852 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:01.354533  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 321575us
I20260709 13:02:01.314198 11888 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.363667  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:01.328040 11972 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.321545 12003 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.342486 11563 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.339119 11884 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.352176  8583 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:02:01.365028  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 308472us
I20260709 13:02:01.424870  8581 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:01.423990  9095 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:01.544114  8398 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:01.511415  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.545914  8398 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:01.454931  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.369346  9096 rpcz_store.cc:276] 0709 13:02:00.109805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.806909 (+697104us) service_pool.cc:224] Handling call
0709 13:02:01.302358 (+495449us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.544625  8577 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:02:01.370057  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:01.497078  8426 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1875) took 1951 ms (client timeout 1675 ms). Trace:
W20260709 13:02:01.572296  8426 rpcz_store.cc:269] 0709 13:01:59.546107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.559407 (+ 13300us) service_pool.cc:224] Handling call
0709 13:02:01.496836 (+1937429us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54003a2854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:01.496987 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315817728}
I20260709 13:02:01.342432 12007 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:01.579164  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:01.579604  8577 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:01.580035  8505 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:01.578914  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:01.579284  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:01.581790  8501 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:01.581076  9096 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:01.582826  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1038) took 1052 ms. Trace:
I20260709 13:02:01.583213  9096 rpcz_store.cc:276] 0709 13:02:00.529949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.578670 (+1048721us) service_pool.cc:224] Handling call
0709 13:02:01.582759 (+  4089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.586798  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:01.471091  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1029) took 1360 ms. Trace:
I20260709 13:02:01.585139  8578 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:02:01.593266  9099 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:01.593729  9098 rpcz_store.cc:276] 0709 13:02:00.110525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.865339 (+754814us) service_pool.cc:224] Handling call
0709 13:02:01.470796 (+605457us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540049cd54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:01.471010 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342431104}
W20260709 13:02:01.416054 11978 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:01.611559  9101 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:01.612175  9097 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:01.612308  8575 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:01.466734 12004 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.297s	user 0.002s	sys 0.010s
W20260709 13:02:01.404224 11828 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.017s	sys 0.065s
I20260709 13:02:01.353971 11807 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:01.467402 12010 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
W20260709 13:02:01.529803 11990 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.229s	user 0.000s	sys 0.013s
I20260709 13:02:01.671437  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:01.512028 12038 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:01.610858  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.468498 12023 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:02:01.360752 12022 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.617224  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:01.360381 12025 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.619155  9094 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:01.619078  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:01.628849  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.691753  8400 connection.cc:256] RPC call timeout handler was delayed by -1.4740181589999679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:02:01.692361  8400 connection.cc:256] RPC call timeout handler was delayed by -1.3651181589999624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 13:02:01.692821  8400 connection.cc:256] RPC call timeout handler was delayed by -1.0978181589999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:02:01.693225  8400 connection.cc:256] RPC call timeout handler was delayed by -1.0825181589999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 13:02:01.412355 11917 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.344336 11682 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.441792 11997 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:01.411952 11465 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:01.552561 12033 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.662949  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54207us
I20260709 13:02:01.578871 11913 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.510746 11822 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:01.575351 11938 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.511571 11908 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:01.677484  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:01.676568 12038 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:01.680871  8501 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:01.360152 11853 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.578835 12002 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:01.581122 12007 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:01.580905 12040 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.686107  9096 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:01.690493  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 714) took 2649 ms. Trace:
I20260709 13:02:01.623176 11762 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:01.354573 12008 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.409940 11886 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.601222  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:01.862516  9099 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:01.575301 11890 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.662147 11840 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:01.580760 11718 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.670470 12047 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:01.708632  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:01.675758 11982 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.675992 12011 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.603824 11936 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:02:01.712165  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:01.712219  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:01.613325 11627 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.716854  8576 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:01.881340  8507 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:01.717890  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:01.718721  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 948) took 1825 ms. Trace:
W20260709 13:02:01.883356  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 171258us
I20260709 13:02:01.427599 11912 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.367287 11995 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.686003 12029 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.882639  9093 rpcz_store.cc:276] 0709 13:01:59.893496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.895598 (+  2102us) service_pool.cc:224] Handling call
0709 13:01:59.910343 (+ 14745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.910579 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.910607 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.923372 (+ 12765us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.333109 (+409737us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:01.495724 (+1162615us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b1800445240. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf
0709 13:02:01.495905 (+   181us) log.cc:844] Serialized 14 byte log entry
0709 13:02:01.699352 (+203447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.699454 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.699501 (+    47us) raft_consensus.cc:1685] finished
0709 13:02:01.718515 (+ 19014us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.718665 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":732304,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":281856,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":46179,"spinlock_wait_cycles":7070976,"thread_start_us":1213863,"threads_started":3,"wal-append.queue_time_us":1081118}
I20260709 13:02:01.699656 11964 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:01.753104  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:01.859627 11498 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.768s	user 0.012s	sys 0.000s
I20260709 13:02:01.724557  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:01.857012  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:01.860334  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 136742us
W20260709 13:02:01.820147 12019 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:02:01.720976 11544 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:01.874801  9099 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:01.877044  9096 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:01.868659 12049 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.903198  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1027) took 1793 ms. Trace:
I20260709 13:02:01.903162 12049 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.903829 12003 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:01.905408 11852 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:01.905584 12049 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:01.863909 11762 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.720438 12033 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.780301 11997 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.859768 12002 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.711673 11828 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.682737 11807 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.903704  9099 rpcz_store.cc:276] 0709 13:02:00.110048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.874254 (+1764206us) service_pool.cc:224] Handling call
0709 13:02:01.874593 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.902920 (+ 28327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.903133 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.891750 12046 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:01.878480 11817 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:01.719669 11666 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.726199 12038 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.886184 11356 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:01.860991 12007 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.778306 11938 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.695509 12022 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.968914 12046 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.726888 11813 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.881178 11888 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:01.890574 11908 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:01.875917 11840 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.896785 12029 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.894307 12052 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:01.809911 11822 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.894483 11964 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.029109 11964 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.907408 11995 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:01.907529 11563 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:01.905969 11852 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:01.906788 11886 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:01.909379 11627 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:01.919414 11828 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.915398 11762 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.711751 11917 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.911892 12042 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.883430 12011 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.883311 11982 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.883533 12047 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:01.945092 11997 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:01.963915 11807 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.079977 11813 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.083683 11718 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.097901 11890 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.032976 11822 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.086509 11913 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.089480 12022 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.030699 12052 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.096021 11840 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.114123 12002 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.096060 12029 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.122748 12046 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.127779 12011 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:02.128340 12043 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:02:02.130863 12047 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.088681 12042 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.134661 11822 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.135664 11938 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.137912 11997 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.144040 12052 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:02.146926 11917 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.150841 12033 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.185472 12040 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:01.879693  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 167578us
I20260709 13:02:02.230279  8426 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:02.230624  8434 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:02:02.226902  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.004s	sys 0.006s
W20260709 13:02:02.234962  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.004s	sys 0.006s
W20260709 13:02:02.236472  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.693657  8400 connection.cc:256] RPC call timeout handler was delayed by -1.0645181589999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 13:02:02.238441  8400 connection.cc:256] RPC call timeout handler was delayed by -1.0483181589999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 13:02:01.863760  8506 rpcz_store.cc:276] 0709 13:01:59.041228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.153502 (+112274us) service_pool.cc:224] Handling call
0709 13:01:59.153803 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.355215 (+201412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.355247 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.355779 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.690148 (+334369us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:59.874318 (+184170us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.874519 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.874622 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.699896 (+825274us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b180003e080. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:00.817267 (+117371us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:01.690254 (+872987us) raft_consensus.cc:1685] finished
0709 13:02:01.690279 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.690431 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":262163,"prepare.queue_time_us":185861,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":207705,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":25548,"spinlock_wait_cycles":27965184,"thread_start_us":332795,"threads_started":1,"wal-append.queue_time_us":529523}
I20260709 13:02:02.242280  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:01.885419  8508 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:02.243500  8432 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:02:01.729764  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 182760us
I20260709 13:02:02.245117  8504 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:02.247488  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.247715  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:02.249305  8476 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:01.779965  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 717) took 2617 ms. Trace:
I20260709 13:02:02.250458  8502 rpcz_store.cc:276] 0709 13:01:59.162411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.177693 (+ 15282us) service_pool.cc:224] Handling call
0709 13:01:59.178353 (+   660us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.410839 (+232486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.410872 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.720475 (+309603us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b2c0005c2d8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:01:59.720914 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.085406 (+364492us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:00.085512 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.085611 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.529095 (+1443484us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:01.779689 (+250594us) raft_consensus.cc:1685] finished
0709 13:02:01.779715 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.779881 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":231993,"raft.queue_time_us":239093,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":5453,"spinlock_wait_cycles":35651712,"thread_start_us":364028,"threads_started":1,"wal-append.queue_time_us":471915}
I20260709 13:02:01.897693  8581 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:02.257304  8577 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:02.259078  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1941) took 1308 ms. Trace:
I20260709 13:02:02.259677  8584 rpcz_store.cc:276] 0709 13:02:00.951019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.951204 (+   185us) service_pool.cc:224] Handling call
0709 13:02:00.951703 (+   499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:01.314645 (+362942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.314684 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:01.330315 (+ 15631us) log.cc:844] Serialized 52 byte log entry
0709 13:02:01.613223 (+282908us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:01.613270 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.613335 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.258279 (+644944us) raft_consensus.cc:1685] finished
0709 13:02:02.258330 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.258765 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":164924,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":11811,"thread_start_us":559351,"threads_started":2,"wal-append.queue_time_us":539618}
W20260709 13:02:02.257501  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.259522  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:02.266892  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:02.268524  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:02.269317  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:02.257504  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:02.270526  8576 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:01.697741  9065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.009s	sys 0.030s
W20260709 13:02:02.316016  9065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.010s	sys 0.030s
W20260709 13:02:02.316663  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 1.89061e+06us
I20260709 13:02:01.901968  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:01.912523  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1040) took 1212 ms. Trace:
I20260709 13:02:01.925877  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:02.319006  9093 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:02.319847  9098 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:02:01.921157  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:02.322553  9099 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:02.322700 11938 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:02.323262 11938 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.243580  8433 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:01.916038 11544 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:02.323706 11938 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.325120 12038 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.326439 11544 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.326542 12022 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:01.919893 11682 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:02:02.269352  8578 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:02.271831  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:02.328188  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.297912 11984 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.329490  8427 raft_consensus.cc:2410] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:02.329449 11984 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.299513 12011 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:02:02.303298  9097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 962) took 2391 ms (client timeout 2643 ms). Trace:
W20260709 13:02:02.332767  9097 rpcz_store.cc:269] 0709 13:01:59.908853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.042616 (+133763us) service_pool.cc:224] Handling call
0709 13:02:02.299828 (+2257212us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54006cd254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:02.300181 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3464417536}
I20260709 13:02:02.335493  9097 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:02.338320  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 963) took 2429 ms. Trace:
I20260709 13:02:02.314440 12033 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.339418 12033 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.327165 12022 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:02.338398 11813 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.149699 11807 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.318667  9096 rpcz_store.cc:276] 0709 13:02:00.700518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.583958 (+883440us) service_pool.cc:224] Handling call
0709 13:02:01.912458 (+328500us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.359624  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:02.341130  8578 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
W20260709 13:02:02.347174  9094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1039) took 1739 ms (client timeout 2242 ms). Trace:
I20260709 13:02:02.360980  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:02.348486  9095 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1030) took 2237 ms (client timeout 1514 ms). Trace:
I20260709 13:02:02.356683 11544 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.366741  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:02.366869 11544 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.368376  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:02.368396  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.369597  8432 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:02.370563  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:02.370947  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.371925  8430 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:02.346068 12038 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.374615  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:02.369675  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:02.375414  8502 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.359899  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1034) took 2172 ms. Trace:
I20260709 13:02:02.376566  9097 rpcz_store.cc:276] 0709 13:02:00.187546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.334379 (+2146833us) service_pool.cc:224] Handling call
0709 13:02:02.335046 (+   667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.359549 (+ 24503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.359807 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:02.380771  8475 connection.cc:256] RPC call timeout handler was delayed by -1.2007378949999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 13:02:02.340529  9101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 959) took 2443 ms (client timeout 1698 ms). Trace:
W20260709 13:02:02.381434  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 103706us
I20260709 13:02:02.338979  9100 rpcz_store.cc:276] 0709 13:01:59.909151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.076691 (+167540us) service_pool.cc:224] Handling call
0709 13:02:00.871592 (+794901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.058299 (+186707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.337718 (+1279419us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002bc0d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:02.338056 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270950144}
I20260709 13:02:02.352576  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:02.356407  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:02.385566  8580 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:02.365494  9095 rpcz_store.cc:269] 0709 13:02:00.110759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.130356 (+ 19597us) service_pool.cc:224] Handling call
0709 13:02:02.347890 (+2217534us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400475254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:02.348237 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822991744}
I20260709 13:02:02.364018 12022 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:02.380579  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:02.382622  9101 rpcz_store.cc:269] 0709 13:01:59.897040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.990982 (+ 93942us) service_pool.cc:224] Handling call
0709 13:02:02.340112 (+2349130us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54002b8c54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:02.340332 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3724506880}
I20260709 13:02:02.390619  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:02.365095  9094 rpcz_store.cc:269] 0709 13:02:00.607875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.302007 (+694132us) service_pool.cc:224] Handling call
0709 13:02:02.346646 (+1044639us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b540017acd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:02.346917 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161439104}
I20260709 13:02:02.389261  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:02.394981  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:02.396929  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:02.393114  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:02.402437  8430 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:02.402320 11813 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.403760  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.404884  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.407389  8578 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:02.408154 12007 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.409718  8505 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:02.416152  8427 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.417531 12025 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:02.421164 11544 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:02.418473  9102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1032) took 2289 ms (client timeout 1583 ms). Trace:
I20260709 13:02:02.419247  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:02.420074 12033 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:02.430341  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:02.431389  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:02.502177  8433 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:02.456921  9094 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:02.434669  8508 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.437738  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:02.499392  9095 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:02.423923  9102 rpcz_store.cc:269] 0709 13:02:00.128857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.151211 (+ 22354us) service_pool.cc:224] Handling call
0709 13:02:02.418087 (+2266876us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400508cd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:02.418264 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463363328}
I20260709 13:02:02.431918  9099 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:02.554446  8502 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:02:02.447189  9097 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:02.431694  9096 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:02.437664  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:02.562417  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 908) took 1210 ms. Trace:
I20260709 13:02:02.562789  9095 rpcz_store.cc:276] 0709 13:02:01.343965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.410818 (+1066853us) service_pool.cc:224] Handling call
0709 13:02:02.499011 (+ 88193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.553002 (+ 53991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.554101 (+  1099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.564967  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:02.567909 11762 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.569023  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.561766  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:02.570093  8509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.003s	sys 0.029s
W20260709 13:02:02.570685  8509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.003s	sys 0.029s
I20260709 13:02:02.570595  8430 raft_consensus.cc:2376] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7. Re-sending same reply.
I20260709 13:02:02.572031  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:02.574901 11964 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.545s	user 0.014s	sys 0.003s
I20260709 13:02:02.570219 11884 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.575480 11964 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.576972  8428 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:02.508352 11886 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.449555 11969 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:02.573731 11762 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.582944  8430 raft_consensus.cc:2410] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:02:02.582361  8508 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:02:02.562213  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1041) took 1861 ms. Trace:
I20260709 13:02:02.459132 11984 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.439460  8475 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:02.586805  9096 rpcz_store.cc:276] 0709 13:02:00.700936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.399240 (+1698304us) service_pool.cc:224] Handling call
0709 13:02:02.431393 (+ 32153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.558861 (+127468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.562140 (+  3279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.582546  9093 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:02:02.434341  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:02.519729 12025 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:02.591750  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:02.534135 11828 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.443526 11972 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.447659 11979 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:02.451247 11968 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:02.577911 11964 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.600857  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:02.603008  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.603889  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:02.583469 11969 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:02.608767  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.605288  8506 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:02.609302  8576 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:02.595844 12007 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.607973  8578 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:02.614403  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:02.615567  8503 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:02.617882 11759 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:02.617985 12025 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.619151  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:02.617946 11884 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.621490 11884 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.622485  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2163) took 1311 ms. Trace:
I20260709 13:02:02.587628 11886 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.621500  8430 raft_consensus.cc:2376] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9. Re-sending same reply.
W20260709 13:02:02.625445  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 264612us
I20260709 13:02:02.625133  8501 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:02:02.605857 11982 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:02.624842 12054 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:02:02.622972  8582 rpcz_store.cc:276] 0709 13:02:01.310532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.505386 (+194854us) service_pool.cc:224] Handling call
0709 13:02:01.505822 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:01.522276 (+ 16454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.522320 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:01.522878 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.342208 (+819330us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b180036a6c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:02:02.499792 (+157584us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:02.499860 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.500042 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.621938 (+121896us) raft_consensus.cc:1685] finished
0709 13:02:02.621963 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.622278 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":5749,"spinlock_wait_cycles":12205824,"thread_start_us":45191,"threads_started":1,"wal-append.queue_time_us":1030806}
I20260709 13:02:02.633937  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.634953  8428 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:02.636773  8508 raft_consensus.cc:2410] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:02.643402  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:02.643756  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.645093  8502 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:02.643922  9065 connection.cc:256] RPC call timeout handler was delayed by -1.0466493679999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 13:02:02.648873  8427 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:02.649888 12033 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:02.650513  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.651363  9099 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:02.628145 11938 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:02.643640  8429 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:02.650619 12033 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.656418 12008 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.656690 11993 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:02.657078  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1886) took 1080 ms. Trace:
I20260709 13:02:02.658004  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:02.658255  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2237) took 1080 ms. Trace:
I20260709 13:02:02.658313 12033 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.658672  8507 rpcz_store.cc:276] 0709 13:02:01.577320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.603130 (+ 25810us) service_pool.cc:224] Handling call
0709 13:02:02.657898 (+1054768us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001fe854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:02.658068 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480673536}
I20260709 13:02:02.659276  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.659768 11877 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:02.660094  8430 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:02:02.639201 11972 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.661326  8433 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:02.632433 11917 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:02:02.668530 12060 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:02.638901 12022 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:02.669492  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:02.669005 12060 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:02.648466 11813 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.672348  8427 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
W20260709 13:02:02.675242  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 236017us
I20260709 13:02:02.675199  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:02.673542  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:02.678618  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.681532 12060 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.681757  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.657454  8435 rpcz_store.cc:276] 0709 13:02:01.576929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.577162 (+   233us) service_pool.cc:224] Handling call
0709 13:02:01.590003 (+ 12841us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.232986 (+642983us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:02.233805 (+   819us) log.cc:844] Serialized 14 byte log entry
0709 13:02:02.400028 (+166223us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.409386 (+  9358us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.409547 (+   161us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:02.409577 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.656521 (+246944us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54003f1e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:02.656566 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:02.656610 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:02.656732 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.656891 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71684,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":184906,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":394,"spinlock_wait_cycles":1475667328,"thread_start_us":165583,"threads_started":2,"wal-append.queue_time_us":1444}
I20260709 13:02:02.691702 11969 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:02.678771  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:02.701896  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:02.699174  8431 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:02.673905 11884 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:02.706272  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:02.713601  8504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 724) took 2680 ms (client timeout 1567 ms). Trace:
I20260709 13:02:02.713747  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:02.714345 12062 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.291s	user 0.001s	sys 0.004s
I20260709 13:02:02.717335  8427 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:02.715963  8504 rpcz_store.cc:269] 0709 13:02:00.032777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.041265 (+  8488us) service_pool.cc:224] Handling call
0709 13:02:02.713234 (+2671969us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54003967d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:02.713503 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4928785152}
I20260709 13:02:02.727166  8510 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:02.734747  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:02.766945 12066 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:02:02.797169  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 68827.7us
W20260709 13:02:02.810461  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.811712  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 45712.5us
I20260709 13:02:02.836637  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:02.697055 11972 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:02.847493  9097 raft_consensus.cc:2410] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:02.862527  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 539) took 1154 ms. Trace:
I20260709 13:02:02.863118  8577 rpcz_store.cc:276] 0709 13:02:01.708275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.708383 (+   108us) service_pool.cc:224] Handling call
0709 13:02:02.857721 (+1149338us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54001a4854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:02.862417 (+  4696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882307328}
I20260709 13:02:02.873596  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1884) took 1297 ms. Trace:
I20260709 13:02:02.874223  8426 rpcz_store.cc:276] 0709 13:02:01.576270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.577684 (+  1414us) service_pool.cc:224] Handling call
0709 13:02:01.577970 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.231274 (+653304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.865515 (+634241us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b5400351e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:02.873510 (+  7995us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498284800}
I20260709 13:02:02.881317  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:02.882215  8577 raft_consensus.cc:2376] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7. Re-sending same reply.
I20260709 13:02:02.918162 11762 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:02.919553 11762 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:02.920024 11762 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:02.922693  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:02.923579  8583 raft_consensus.cc:2376] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7. Re-sending same reply.
I20260709 13:02:02.925390 11969 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:02.934065  9094 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:02.915911  9065 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:02.912209  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 72434.6us
I20260709 13:02:02.986159  9095 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:02.987983  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:03.010998  9102 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:02:03.013904 11886 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:02.854535 12007 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.164s
I20260709 13:02:03.016188 12007 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:03.016695 12007 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:02.942157 12060 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.921242 11762 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.077524 12033 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:03.069299  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 216144us
I20260709 13:02:03.078351 12033 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:03.098978 12022 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:03.191701  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:03.192682  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.195308  8582 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:03.193585  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.143245  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.221426  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.153620  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:03.230527  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.142925  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.230679  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:03.234571  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.235244  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:03.235666  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:03.100219 11938 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:03.241539  8507 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:03.239166  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.243953  8502 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:03.244656  8577 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:03.246310  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 577162us
I20260709 13:02:03.246519 12042 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:03.243798  8435 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:02:03.248310 12022 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:03.238005  8508 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:03.240759 11884 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:02:03.252444 12022 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.252949 12022 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.258149 11886 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:03.258983  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.259873  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:03.260201  8435 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:02:03.260809  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.261370  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.261811  8577 raft_consensus.cc:2410] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:03.262604  8584 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:02:03.262878  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.265528  8501 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:03.186546 12007 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:03.277068  8431 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:03.266362  8583 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
W20260709 13:02:03.275419  9099 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.049s	sys 0.091s
W20260709 13:02:03.282140  9099 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.050s	sys 0.091s
I20260709 13:02:03.265108 11993 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:03.285216  8433 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:03.288457  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.291471  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.292318  8435 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:02:03.293062  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.268293 12025 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:03.294154  8504 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:03.294479  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:03.298731  8433 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.303133  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:03.306365  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:03.312107  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:03.308477  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2161) took 1998 ms. Trace:
I20260709 13:02:03.313670 11886 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:03.313491  8579 rpcz_store.cc:276] 0709 13:02:01.309909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.355485 (+ 45576us) service_pool.cc:224] Handling call
0709 13:02:01.355779 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.259097 (+903318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.259163 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.260077 (+   914us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.364301 (+104224us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:02.364337 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.712309 (+347972us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:03.308003 (+595694us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54000cdad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:03.308055 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.308097 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:03.308111 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.308317 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39933,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":328,"spinlock_wait_cycles":1275565184,"thread_start_us":103705,"threads_started":1,"wal-append.queue_time_us":162098}
I20260709 13:02:03.315191  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:03.316171 12025 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:03.316681  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:03.316738 12025 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:03.309247  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1885) took 1732 ms. Trace:
W20260709 13:02:03.318974  8549 connection.cc:256] RPC call timeout handler was delayed by -1.3425225489999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 13:02:03.319495  8434 rpcz_store.cc:276] 0709 13:02:01.576630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.576732 (+   102us) service_pool.cc:224] Handling call
0709 13:02:01.617608 (+ 40876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.231464 (+613856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.289713 (+1058249us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54003629d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:03.309170 (+ 19457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406789504}
I20260709 13:02:03.324646  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.326186 11983 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.326786 11983 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:03.320923 11884 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:03.327687 11884 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:03.328717 11884 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.329380 11983 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:03.330876  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.332211  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:03.332867  8434 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:03.333848  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.344094  8435 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:03.321501 12025 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:03.347419  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.323690 11886 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:03.343789 11884 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.354251  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.355870 12073 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:03.356518  8579 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:03.356575 12073 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.355131 11813 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:03.357563 11813 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:03.357975 11813 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.348851 12033 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.355063 11877 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:03.362453 11877 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.364974 11877 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:03.362479  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45936.6us
I20260709 13:02:03.367031  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:03.370136 11972 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:03.372468  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:03.373056  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:03.373457  8426 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:03.374536  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2243) took 1791 ms. Trace:
I20260709 13:02:03.374924  8505 rpcz_store.cc:276] 0709 13:02:01.583217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.583332 (+   115us) service_pool.cc:224] Handling call
0709 13:02:01.583577 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.410219 (+826642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.374245 (+964026us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b540005b4d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:03.374451 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899082496}
I20260709 13:02:03.376828  8584 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:03.377827 11813 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.378870 11762 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.379825  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2244) took 1796 ms. Trace:
I20260709 13:02:03.372380  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.385272  8579 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:03.383585  8510 rpcz_store.cc:276] 0709 13:02:01.583495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.583909 (+   414us) service_pool.cc:224] Handling call
0709 13:02:02.726764 (+1142855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.787562 (+ 60798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.379649 (+592087us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003967d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:03.379771 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600351488}
I20260709 13:02:03.397137  8433 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:03.403079 11964 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:03.404493  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:03.398702 11877 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.411648  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.411966  8431 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:02:03.418502  8434 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:03.419356  8433 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:03.420989  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:03.427003  8583 raft_consensus.cc:2410] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:03.428623  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:03.431988 12036 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:03.432489 12036 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:03.433497 12036 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:03.434538  8429 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:03.434614 12036 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:03.434778  9068 leader_election.cc:336] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.718s (SENT)
I20260709 13:02:03.436194  8433 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:03.438848  8429 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:03.440140  8429 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:03.441030  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:03.442227  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:03.442349  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:03.442570  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:03.443200  8507 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.443677  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:03.444918  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:03.441807 11969 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.516s	user 0.000s	sys 0.009s
I20260709 13:02:03.442229  8508 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:02:03.448321  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.449100  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 702) took 1045 ms. Trace:
I20260709 13:02:03.449432  8427 rpcz_store.cc:276] 0709 13:02:02.403635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.763499 (+359864us) service_pool.cc:224] Handling call
0709 13:02:03.448181 (+684682us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5800060398. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:02:03.449045 (+   864us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54010112}
I20260709 13:02:03.441107  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.451164  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.451467 12007 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:03.451864  8432 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:03.452310  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1888) took 1016 ms. Trace:
I20260709 13:02:03.452600  8432 rpcz_store.cc:276] 0709 13:02:02.436363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.450877 (+1014514us) service_pool.cc:224] Handling call
0709 13:02:03.452262 (+  1385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.454439  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:03.454813 11853 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:03.455080  9093 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.456182 12073 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:03.427644 11877 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:03.461014 11877 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:03.467284  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 60141.5us
I20260709 13:02:03.467603 11993 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:03.468194 11993 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.468221  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:03.471081 11964 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:03.471619 11964 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:03.472457 11964 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.473078  8430 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:02:03.474427  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.469735  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:03.477305  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.477921  8583 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:03.478574  9093 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:03.479812  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:03.480396  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 51209.1us
I20260709 13:02:03.481599  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.482311  8579 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:03.484754  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.494191  8584 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:03.492753  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:03.495487  8502 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:03.499064  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:03.501776  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 251671us
I20260709 13:02:03.501858  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:03.503087  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:03.506047  9068 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.567s (SENT)
I20260709 13:02:03.494906 11886 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:03.511047 12072 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:02:03.511197  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:03.506989  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:03.514353  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 360875us
I20260709 13:02:03.526922  8583 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:03.539047  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:03.539713  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:03.540226  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 70588.9us
I20260709 13:02:03.515272 12060 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:03.537850  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 121942us
I20260709 13:02:03.540501  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:03.551932  8507 raft_consensus.cc:2410] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:03.556434  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:03.556061  8333 catalog_manager.cc:5697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.546967 11853 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:03.570964  9067 connection.cc:256] RPC call timeout handler was delayed by -1.0680451989999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27320000000000005s for a response
I20260709 13:02:03.575560 11682 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:03.576342 11682 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.580765 12079 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:03.581295 11884 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:03.585381  8400 leader_election.cc:400] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8.
I20260709 13:02:03.585680  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1037) took 3055 ms. Trace:
I20260709 13:02:03.587098  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:03.566478 11813 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:03.589998 12060 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:03.590889 12060 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:03.586302  9098 rpcz_store.cc:276] 0709 13:02:00.529713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.366329 (+1836616us) service_pool.cc:224] Handling call
0709 13:02:02.682294 (+315965us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:02:02.703659 (+ 21365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.841140 (+137481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.841184 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.244820 (+403636us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.323322 (+ 78502us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:03.551464 (+228142us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.567497 (+ 16033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.567577 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.585327 (+ 17750us) raft_consensus.cc:1685] finished
0709 13:02:03.585433 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.585588 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16398,"prepare.queue_time_us":27054,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":38062,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":9544,"spinlock_wait_cycles":21997952,"thread_start_us":279162,"threads_started":2,"wal-append.queue_time_us":165873}
I20260709 13:02:03.592069 12060 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.593495 11682 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:03.553102 11877 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:03.613966  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 49654.1us
W20260709 13:02:03.616379  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 52714.1us
I20260709 13:02:03.622617  8476 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:03.625167  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 140188us
I20260709 13:02:03.628854  9065 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:03.630367  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 89976.6us
I20260709 13:02:03.632750  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:03.615725 11884 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:03.617558 11853 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:03.641603  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 71375.4us
I20260709 13:02:03.638085 12092 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.639693 12064 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:03.636489  8333 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 6, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 6 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.625005 12079 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:03.645871  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:03.640527 11886 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:03.646464 11840 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:03.647101 12077 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:03.647675  9065 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:03.647329 11886 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:03.648406 11989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.129s	user 0.000s	sys 0.009s
W20260709 13:02:03.648767 11989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.000s	sys 0.009s
I20260709 13:02:03.648900 11853 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:03.650709 12078 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:03.647017 11840 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:03.629038 11877 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:03.658692  9065 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:03.673075  8398 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:03.654510 12007 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:03.659456 11840 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:03.680675  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 138540us
I20260709 13:02:03.655947 11972 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:03.641104 12022 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.652508 11964 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:02:03.663173 12042 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:03.680142 12007 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.676666 11682 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:03.689025 11989 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:03.694591 12007 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:03.730334  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 63388.7us
I20260709 13:02:03.721931 11989 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:03.731168 11989 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.731684 11964 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:03.732795 11964 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:03.733546 11964 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:03.733842 11964 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:03.734277 11877 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.735016 12022 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:03.735293 11813 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:03.735742 11813 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:03.736662 11813 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.737918 11813 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.738303  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:03.739627  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:03.741636  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2038) took 1147 ms. Trace:
I20260709 13:02:03.695282 11682 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.693332 12042 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.750967  8435 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 4.
W20260709 13:02:03.679082  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55561.9us
I20260709 13:02:03.684160 11884 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.740628 11762 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:03.691555 12025 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:03.755697  8501 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:03.756245 12022 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:03.758608 11983 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:03.795285  8505 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:02:03.757547 11989 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:03.742230  8426 rpcz_store.cc:276] 0709 13:02:02.594725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.385879 (+791154us) service_pool.cc:224] Handling call
0709 13:02:03.394662 (+  8783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.400619 (+  5957us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:03.546828 (+146209us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.741198 (+194370us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.741273 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:03.741338 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.741421 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.741566 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23968,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":239825,"threads_started":2}
I20260709 13:02:03.754932  8507 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:03.801043  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 60278.4us
I20260709 13:02:03.807579  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2037) took 1254 ms. Trace:
I20260709 13:02:03.805665 12022 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.794486 12042 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.814451  8582 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:03.802958 11762 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:03.809700  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 72215.7us
W20260709 13:02:03.814421  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 220092us
I20260709 13:02:03.794550 11682 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.818275  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:03.734822 11964 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.834455 11666 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:03.836102 11666 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:03.794477 11969 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:02:03.838210  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 147324us
I20260709 13:02:03.838894  8333 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 3 to 6, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 6 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:03.841445  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 182825us
W20260709 13:02:03.851744  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.817466  8428 rpcz_store.cc:276] 0709 13:02:02.560797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.380664 (+819867us) service_pool.cc:224] Handling call
0709 13:02:03.380976 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.381220 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:03.413506 (+ 32286us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.807178 (+393672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.807229 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:03.807271 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.807356 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.807512 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56845,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":26001,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"thread_start_us":406947,"threads_started":3,"wal-append.queue_time_us":121922}
I20260709 13:02:03.861184  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.816013 11972 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:03.821341 12022 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:03.867095  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.867015  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:03.867807  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.822679 11762 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.867108  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:03.905460  8332 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57088 (request call id 359) took 41449 ms (client timeout 15000 ms). Trace:
I20260709 13:02:03.893361  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.905097  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:03.894217  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.892800  8577 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 6: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:03.734900 12079 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:03.909171  9101 raft_consensus.cc:2410] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:03.900427  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:03.905176  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.874899  8584 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:03.906428  8581 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:03.860620 12021 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:03.821956 12073 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:03.908855  8580 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:03.912775  8547 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:03.913586 12006 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:02:03.915974  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.913583  9098 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:02:03.917606  9098 pending_rounds.cc:85] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 7
I20260709 13:02:03.918694  8435 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:03.918761 11972 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.917860  9098 pending_rounds.cc:107] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:02:03.919950  9098 raft_consensus.cc:2889] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:03.922223 12100 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.922748 12100 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.924904 12100 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:03.908146  8576 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
W20260709 13:02:03.929386  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.936271  8426 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:03.943269  9100 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:03.940443  8333 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 7 to 8, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 8 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.867174 11666 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:02:03.950524  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:03.950697  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:03.951949  8435 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:03.916376 11993 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.955196  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:03.959579  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 153429us
I20260709 13:02:03.955523  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:03.960544  8428 raft_consensus.cc:2410] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:02:03.953244 11983 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:03.955273 12090 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.161s	user 0.001s	sys 0.008s
I20260709 13:02:03.961810  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:03.954675  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:03.948037 12096 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.950373 12108 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:03.947790 12021 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:03.975499  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:03.971828  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 103442us
W20260709 13:02:03.963008 12103 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:03.965349 12006 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:03.982753  9100 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:03.962133 11983 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:03.986840 11993 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:03.986450 11983 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:03.987869 11983 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:03.987933 12021 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:03.951423  8333 catalog_manager.cc:5697] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 3, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.998636  8547 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:03.968919 12095 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.975955 12108 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:03.981953 11877 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:02:04.038240  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 175066us
W20260709 13:02:04.086431  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 166766us
I20260709 13:02:03.984439 12006 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.131769  8333 catalog_manager.cc:5697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 3 to 7, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 7 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:02:04.001071 12104 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:02:04.206632  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 253590us
W20260709 13:02:04.210017  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 255826us
W20260709 13:02:04.210374  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 176668us
I20260709 13:02:04.086649 12025 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:04.219700  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 234782us
W20260709 13:02:04.204372 12083 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.511s	user 0.007s	sys 0.004s
W20260709 13:02:04.221938  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 231401us
W20260709 13:02:04.223618  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 133382us
I20260709 13:02:04.224099  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:04.224328  8476 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:04.203301 12006 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:04.219015  9098 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:02:03.991446 12096 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:04.238276  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.239316 12096 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:04.208809 11993 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:04.242187  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:04.243096  9099 raft_consensus.cc:2410] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:02:04.233796  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.234232  8333 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 7, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 7 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:04.237475 11989 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:04.250649  9100 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:04.245177  8333 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:04.269559 12093 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.362s	user 0.000s	sys 0.000s
W20260709 13:02:04.270715 12098 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
W20260709 13:02:03.907790  8332 rpcz_store.cc:269] 0709 13:01:22.456153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.456301 (+   148us) service_pool.cc:224] Handling call
0709 13:02:03.905211 (+41448910us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:53.097032 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:53.097735 (+   703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:53.097792 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:01:53.097813 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:53.098593 (+   780us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:53.098693 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:53.098720 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:01:53.099488 (+   768us) tablet.cc:701] Row locks acquired
0709 13:01:53.099544 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:01:53.099722 (+   178us) write_op.cc:270] Start()
0709 13:01:53.099885 (+   163us) write_op.cc:276] Timestamp: P: 1783602113099649 usec, L: 0
0709 13:01:53.099902 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:01:53.100690 (+   788us) log.cc:844] Serialized 2050 byte log entry
0709 13:01:54.592230 (+1491540us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:01:55.256662 (+664432us) op_driver.cc:464] REPLICATION: finished
0709 13:01:56.684837 (+1428175us) write_op.cc:301] APPLY: starting
0709 13:01:56.684933 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:56.685141 (+   208us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:56.685177 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:56.685956 (+   779us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:56.730886 (+ 44930us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:01:56.734079 (+  3193us) write_op.cc:312] APPLY: finished
0709 13:01:56.757459 (+ 23380us) log.cc:844] Serialized 47 byte log entry
0709 13:01:56.794697 (+ 37238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:56.794803 (+   106us) write_op.cc:454] Released schema lock
0709 13:01:56.794873 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:57.825605 (+1030732us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b1800023680. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:01:57.825726 (+   121us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:57.825754 (+    28us) write_op.cc:454] Released schema lock
0709 13:01:58.915208 (+1089454us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b1800023680. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db
0709 13:01:58.917265 (+  2057us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
Metrics: {"mutex_wait_us":24307,"reported_tablets":38,"spinlock_wait_cycles":1197184,"child_traces":[["op",{"apply.queue_time_us":1404318,"apply.run_cpu_time_us":15515,"apply.run_wall_time_us":119762,"num_ops":5,"prepare.queue_time_us":366204,"prepare.run_cpu_time_us":28797,"prepare.run_wall_time_us":212659,"raft.queue_time_us":285466,"raft.run_cpu_time_us":115724,"raft.run_wall_time_us":1650468,"replication_time_us":2126150,"spinlock_wait_cycles":161004288,"thread_start_us":2048291,"threads_started":5,"wal-append.queue_time_us":313988,"wal-append.run_cpu_time_us":58248,"wal-append.run_wall_time_us":6152108}]]}
W20260709 13:02:04.272647 12109 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:02:04.034376 12088 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.195s
I20260709 13:02:04.298782  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:04.088203 12105 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.199s
I20260709 13:02:04.226109 12118 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 13:02:04.316900  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 92961.3us
I20260709 13:02:04.322216  9098 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:04.329011 12006 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:04.330600  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 86508us
W20260709 13:02:04.331245  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 71743.4us
I20260709 13:02:04.332845  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:04.333426  9095 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:04.089000 12095 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:04.318254  8333 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 3 to 6, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 6 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.343727 12079 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:04.353550 12079 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:04.358940  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 78978.8us
I20260709 13:02:04.360652  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:04.371371  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 155928us
I20260709 13:02:04.373945  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:04.374616  9095 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:04.373826  8333 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 7 to 8, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 8 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:04.378204  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 153947us
W20260709 13:02:04.381392  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.373208 12033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.009s	sys 0.015s
I20260709 13:02:04.370371 11666 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:04.396391  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:04.377733 11884 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.401504  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:04.404639  8547 connection.cc:256] RPC call timeout handler was delayed by -1.0098466979999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 13:02:04.403725  8333 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 6, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 6 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.397903  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:04.391283 12033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.009s	sys 0.016s
I20260709 13:02:04.408255  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:04.408381  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:04.410488  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:04.383931 12096 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.411963  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:04.412983  8504 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:04.398334 12042 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
W20260709 13:02:04.412873  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 95225.7us
I20260709 13:02:04.354535 12079 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:04.412225  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:04.416889  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:04.412911  8333 catalog_manager.cc:5697] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 6, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 6 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:02:04.372051 11969 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:02:04.470569  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 122325us
I20260709 13:02:04.465866  8506 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:04.399526 11666 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:04.472713  8508 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:04.427743 11682 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.006s
I20260709 13:02:04.487231  8510 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:04.487465  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69374.4us
I20260709 13:02:04.487509  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:04.485450 12122 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:02:04.490164 12106 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:02:04.485760 11666 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:04.505153  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:04.477958 12096 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:04.518457  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:04.501713  8333 catalog_manager.cc:5697] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:02:04.464735 12042 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:04.536427  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:04.527308 12007 consensus_meta.cc:287] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.727s	user 0.012s	sys 0.000s
W20260709 13:02:04.531013  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 109935us
I20260709 13:02:04.493381 11682 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:04.542375 12114 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:04.548594 12007 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:04.562565 12121 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:02:04.562614  8333 catalog_manager.cc:5697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.562122 12119 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.564415 12119 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:04.564563  8333 catalog_manager.cc:5697] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 2 to 5, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 5 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.548751 12006 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:04.570598 11840 consensus_meta.cc:287] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.888s	user 0.006s	sys 0.005s
I20260709 13:02:04.570888 12107 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.571033 11840 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:04.571401 12107 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:04.573606 12107 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:04.574980  8333 catalog_manager.cc:5697] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 1 to 4, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 4 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:04.578768 12081 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.984s	user 0.003s	sys 0.007s
I20260709 13:02:04.580060  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 974) took 1879 ms. Trace:
I20260709 13:02:04.580404  9096 rpcz_store.cc:276] 0709 13:02:02.701021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.705523 (+  4502us) service_pool.cc:224] Handling call
0709 13:02:02.763578 (+ 58055us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.841323 (+ 77745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.841360 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.239838 (+398478us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.546208 (+306370us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:03.546265 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.546376 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.578172 (+1031796us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:04.579727 (+  1555us) raft_consensus.cc:1685] finished
0709 13:02:04.579757 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.579998 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47176576,"thread_start_us":267674,"threads_started":1,"wal-append.queue_time_us":334433}
W20260709 13:02:04.586515  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 188692us
W20260709 13:02:04.587441  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.588088 12025 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:04.526412 12129 raft_consensus.cc:2764] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:04.617583  9095 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:04.531865 12064 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:04.722036  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:04.964392  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:04.838909  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.965572  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 557731us
I20260709 13:02:04.798959  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:04.862409  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.967649  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:04.662621  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:04.859910  8549 leader_election.cc:336] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.514s (SENT)
I20260709 13:02:04.968453  8581 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:04.864346  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.968842  8583 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:04.885097  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.724506  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:04.963415  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 412212us
I20260709 13:02:04.971010  8575 raft_consensus.cc:2410] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:04.818450  8510 raft_consensus.cc:2410] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:04.665943  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:04.963968  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2169) took 1125 ms. Trace:
I20260709 13:02:04.974293  8579 rpcz_store.cc:276] 0709 13:02:03.838474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.840210 (+  1736us) service_pool.cc:224] Handling call
0709 13:02:03.840572 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.985048 (+144476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.985079 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.087525 (+102446us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.260448 (+172923us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:04.260480 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.260565 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.566091 (+305526us) raft_consensus.cc:1685] finished
0709 13:02:04.566111 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.963908 (+397797us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111552,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3938,"thread_start_us":179905,"threads_started":2,"wal-append.queue_time_us":112716}
I20260709 13:02:04.976812  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:04.590051 12114 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.744410 12132 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:02:04.986169  8501 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:04.980495  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1945) took 1513 ms. Trace:
I20260709 13:02:04.977559  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:04.815572 11762 consensus_meta.cc:287] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.880s	user 0.008s	sys 0.004s
W20260709 13:02:04.687048 12022 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.000s
I20260709 13:02:04.991173  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:04.573607 12095 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:04.746390 12133 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:02:04.927146 12146 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.815338 11983 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.182s
I20260709 13:02:04.995569  8509 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:04.859862 12105 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.154s
I20260709 13:02:04.750978 12092 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:04.993227  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:04.989862  8580 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
W20260709 13:02:04.798821 11813 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.060s	user 0.007s	sys 0.007s
I20260709 13:02:04.996160  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:04.887750 12096 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:04.992470  8584 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.010372  8507 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:04.885309 12113 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.686981 12117 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.025974  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:05.026364 12117 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.027396  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.028656 12117 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:04.903811 12078 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.012s
I20260709 13:02:04.997643 11762 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.030555  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:04.995018  8582 rpcz_store.cc:276] 0709 13:02:03.466911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.474577 (+  7666us) service_pool.cc:224] Handling call
0709 13:02:03.474900 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.821620 (+346720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.980274 (+1158654us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540009a954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:04.980437 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780409088}
I20260709 13:02:04.998749  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:04.744244 12042 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:04.918516 12025 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:04.974813 12064 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:05.000335  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:04.653143 11989 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:04.992148 12140 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:02:05.004652  8503 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:04.893795 12119 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:04.828987 11666 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:04.986756 12021 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:05.062811  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:04.885192 12111 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.155s
I20260709 13:02:05.009572  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:05.066826  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:05.005820 12022 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:04.957959 12007 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.001928 11964 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.009109 12036 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:05.078634  9068 connection.cc:256] RPC call timeout handler was delayed by -1.2219382359999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:02:05.011595 12123 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:05.013473  8508 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:05.014225 12148 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.015141  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:05.016469  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.058262 11989 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:05.018362  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 188449us
I20260709 13:02:05.019518  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:04.994989 12114 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:05.025272  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:05.025411  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:05.032368  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:05.032367 12078 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.002s	sys 0.012s
I20260709 13:02:05.061625  8579 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:05.110255  8506 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:05.110975  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 91512.4us
I20260709 13:02:05.108614 12139 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:02:05.112385  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:05.068614  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:04.993544 12118 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:05.122169  8428 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:05.074707  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:05.083573  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 120220us
I20260709 13:02:05.090099  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:05.079144  9068 connection.cc:256] RPC call timeout handler was delayed by -1.168572169000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24060000000000004s for a response
I20260709 13:02:05.092531  8510 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:05.021485 12146 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.079128 12140 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:05.093003  8505 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:05.107020 12042 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:05.108242  8578 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:05.108882 12094 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:05.109062  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:05.145704  8509 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.108593 12025 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.110740 12138 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:05.009858 12092 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:05.114233  8502 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:05.116813  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 95489us
I20260709 13:02:04.746980 12108 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:05.145563  9068 leader_election.cc:336] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.950s (SENT)
I20260709 13:02:05.132021  8575 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:05.132076  8501 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:05.061553 12115 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:05.133031  8584 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:05.136876  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:05.142927  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74421us
I20260709 13:02:05.110153 12095 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:02:05.153152  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:05.124009 12139 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:05.115353 12036 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:05.166512  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 58328.7us
I20260709 13:02:05.156373  9067 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:05.156466  8580 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.158516  8508 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:05.154220  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:05.092098 12021 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.159694  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.135694 12140 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:05.161844  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 158007us
I20260709 13:02:05.163373  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.165755 11682 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:05.090268 11813 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:02:05.168622  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.203938 11813 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.060415 12113 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.204491 11813 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.206374 11666 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.206715 12113 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.207280 12146 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.206935 12092 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.207634 12080 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:05.177824 12094 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:02:05.183645 12140 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:05.199793 12095 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:05.211181 12095 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:05.157032 12115 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:05.199963  8503 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:05.199872  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 43606.9us
I20260709 13:02:05.202237  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:05.191673 12151 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:05.160375 11762 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:05.218194  8580 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
W20260709 13:02:05.217324  8549 leader_election.cc:336] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.573s (SENT)
I20260709 13:02:05.219110  8510 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.222291  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.135083 12118 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.183593 11884 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:05.233513  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:05.208315 12092 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.236577  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:05.238266  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.218943 12115 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.239176  8508 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:05.249667  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.214646 11983 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.252729  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:05.253770  8509 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
W20260709 13:02:05.250583  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 57797.6us
I20260709 13:02:05.250727  8503 raft_consensus.cc:2410] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:05.212106 12095 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.259493  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.269771  8509 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:05.250927  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:05.261740  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:05.264289  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:05.265318  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.266896  8427 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:02:05.267774  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.231134 12080 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:02:05.237819 12146 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:02:05.241053 12113 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
W20260709 13:02:05.322131  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 104850us
I20260709 13:02:05.396255  8435 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
W20260709 13:02:05.396977  8549 leader_election.cc:336] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.583s (SENT)
I20260709 13:02:05.270998  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.397356  8434 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.398499  8509 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:05.354183  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:05.363602  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 251261us
I20260709 13:02:05.399277  8503 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.401120  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:05.330803  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.331118  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:05.330516 12152 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:05.341341  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:05.422977  8508 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:05.423620  8509 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:05.431967  8509 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:05.351626 11983 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:05.425035  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 210323us
W20260709 13:02:05.435755  9068 connection.cc:256] RPC call timeout handler was delayed by -1.1013382360000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 13:02:05.436223  9068 connection.cc:256] RPC call timeout handler was delayed by -1.0797581850000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:02:05.436590  9068 connection.cc:256] RPC call timeout handler was delayed by -1.0370606660000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:02:05.252691 12151 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:05.436954  9068 connection.cc:256] RPC call timeout handler was delayed by -1.0137506560000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 13:02:05.330955  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.433362  8510 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:02:05.365880 12159 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.396898 12088 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:05.343461 12111 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.444984  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 43903.6us
I20260709 13:02:05.445259  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:05.450218  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 196225us
I20260709 13:02:05.451401  8427 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:05.421453 12152 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.363847 12095 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:05.361030 11813 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.490250  8429 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
W20260709 13:02:05.494000  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 97054.9us
W20260709 13:02:05.443434 12136 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
W20260709 13:02:05.493165  8581 consensus_meta.cc:287] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.005s
I20260709 13:02:05.440456 11884 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:05.496294  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.497112  8508 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:05.497812  8549 leader_election.cc:336] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.682s (SENT)
I20260709 13:02:05.513862  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.539119  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.513893  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:05.540241  8432 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:05.541059  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.516515 11682 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:05.517551 12154 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:02:05.522635 12118 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:05.496182 12152 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:05.504565 12021 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.489267 12113 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:05.456113 12159 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.360623 12036 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.456489 12162 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:05.490834 12088 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.530339  8503 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:05.489315 12042 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.542623  8581 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:05.542543  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:05.543326  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.608428  8432 raft_consensus.cc:2393] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:05.546258  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 56268.1us
W20260709 13:02:05.608971  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 65971.2us
W20260709 13:02:05.609818  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.571434  9102 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:05.577349  9095 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:05.580502  9099 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:05.579231  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:05.585515  9098 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:05.599488  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 83325.4us
I20260709 13:02:05.540266 12129 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:05.562623 12060 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.569298  8434 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:05.562686 11813 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.566972 12113 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:05.618919 12161 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.002s
I20260709 13:02:05.619195 11813 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:05.619982  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.619776 12113 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.621172 12113 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.621423 11813 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:05.621598 12170 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.576819 11884 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:05.546761 12111 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.622279 12170 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.562608 12094 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:05.623992  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:05.624627  9093 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
W20260709 13:02:05.623097  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 125310us
I20260709 13:02:05.612522  8426 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:05.609519  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:05.615439 12129 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:05.616957  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.617345 11989 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:05.607084 12136 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:05.597800 11877 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:05.618506  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.613160  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:05.617967 12088 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:05.626341  8432 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:05.636149  8434 raft_consensus.cc:2410] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:05.597010 12022 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:05.643018  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:05.643922  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.586943 12159 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.581578 12118 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:02:05.654568  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54314us
I20260709 13:02:05.655792  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:05.629776 12151 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:05.629944 11993 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.668550  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:05.622967 11884 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.655536  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1910) took 1247 ms. Trace:
I20260709 13:02:05.632273 12165 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.676153  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.680186  8434 raft_consensus.cc:2410] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:05.674823  8431 rpcz_store.cc:276] 0709 13:02:04.408034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.408192 (+   158us) service_pool.cc:224] Handling call
0709 13:02:04.465374 (+ 57182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.026931 (+561557us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b18002d2740. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a19337060 00007f1a19337bfb 00007f1a1934264b
0709 13:02:05.027051 (+   120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.027074 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.027595 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.139997 (+112402us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:05.140447 (+   450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.140732 (+   285us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.649296 (+508564us) raft_consensus.cc:1685] finished
0709 13:02:05.649330 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.655451 (+  6121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12045,"raft.queue_time_us":54951,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6193,"spinlock_wait_cycles":674038016,"thread_start_us":164777,"threads_started":2,"wal-append.queue_time_us":173254}
I20260709 13:02:05.681408  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:05.614809 12080 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:02:05.632411 11877 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:05.614939 12042 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.681958  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:05.683841  8431 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.684331  8434 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.642616 11989 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:05.650851 11983 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:05.681759 12145 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.648332 12162 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:05.629817 12060 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:05.694003  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 78694.4us
I20260709 13:02:05.694861 12080 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:05.695011 12042 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:05.696638  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.705149  8503 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:05.692833  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:05.691577 11983 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.683151 11877 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.699541  8426 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:05.678853 12159 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:02:05.702313  8434 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:05.633220 12094 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.714184 12165 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:05.715843 12170 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.717813  8427 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:02:05.720482 12160 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 13:02:05.706864 12080 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:05.722292 12158 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:05.722707 11840 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:05.723042 12115 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.691155 12088 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:05.686787 11993 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.723450  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:05.683950 12129 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.725419 12162 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.667052 12146 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:02:05.726001  8317 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 09de6eee9632412ebe0a904f65cd2a3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0b9f7467deed4381835a85ffd0e88af6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:05.726398  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1873) took 1330 ms. Trace:
I20260709 13:02:05.768883  8505 rpcz_store.cc:276] 0709 13:02:04.395503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.395617 (+   114us) service_pool.cc:224] Handling call
0709 13:02:05.726126 (+1330509us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54000d84d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:05.726318 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588368640}
I20260709 13:02:05.727839  9065 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:05.732721  8509 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:05.733004 12114 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.001s
I20260709 13:02:05.736898 12095 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:02:05.741652 12140 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 13:02:05.742180 12111 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.747401  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1876) took 1351 ms. Trace:
I20260709 13:02:05.752543 12174 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.754220  8435 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:05.748787  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:05.760751  8431 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:05.752526 12148 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:05.764521  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.759140 11983 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:05.773046  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 49690.1us
I20260709 13:02:05.705816 12145 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.780529  8502 rpcz_store.cc:276] 0709 13:02:04.396337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.396513 (+   176us) service_pool.cc:224] Handling call
0709 13:02:05.747168 (+1350655us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54001fc554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:05.747324 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616846208}
I20260709 13:02:05.787878  8426 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:05.789323  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 140423us
I20260709 13:02:05.786489  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:05.792357 12111 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:05.779858  8317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 54071.6us
I20260709 13:02:05.774391 12042 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:05.798013 12158 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:05.799620  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.767264 12088 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:05.801025  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:05.774978 12165 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:05.778266 12170 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:05.808096  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:05.786242 12148 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:05.816078 12174 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:05.816259 11840 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:05.816874 11840 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.811205 12088 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.789844 12095 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.781188 12114 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.838533  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:05.839414  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.811985 12060 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.811152 12165 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:05.831951 12064 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.005s
I20260709 13:02:05.865103 12115 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:05.841701 11762 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:02:05.865221 12165 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.818565 12042 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:05.786867 12140 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.816404 11993 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.832969 12177 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:05.857944 12174 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:05.880460 12180 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:02:05.841105 12123 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:02:05.820068 12080 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.883836  8504 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:05.880826 12174 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:05.890646 11840 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.840179 12119 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:05.894469  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1909) took 1507 ms. Trace:
I20260709 13:02:05.867556 12145 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:05.897315  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 96345.9us
I20260709 13:02:05.896698  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:05.896816  8503 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:05.897749  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:05.908023  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:05.897631  8430 rpcz_store.cc:276] 0709 13:02:04.387124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.387532 (+   408us) service_pool.cc:224] Handling call
0709 13:02:04.388035 (+   503us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:04.403131 (+ 15096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.403160 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:05.046056 (+642896us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b2c00055dc8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:02:05.069549 (+ 23493us) log.cc:844] Serialized 52 byte log entry
0709 13:02:05.236865 (+167316us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:05.258579 (+ 21714us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.366179 (+107600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.366301 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.719691 (+353390us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:05.894239 (+174548us) raft_consensus.cc:1685] finished
0709 13:02:05.894262 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.894410 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6459,"prepare.queue_time_us":32223,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":35569,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":131981,"spinlock_wait_cycles":37346048,"thread_start_us":121167,"threads_started":1,"wal-append.queue_time_us":328417}
I20260709 13:02:05.910336  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:05.905409  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.911919  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 125523us
I20260709 13:02:05.878420 12177 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:05.916350  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.917723  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.874643 12181 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:05.919061  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.919715  8502 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
W20260709 13:02:05.920440  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.921453  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.923344  9068 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:05.924257  8431 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:05.925086  8398 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:05.926266  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.925952  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:05.927129  8508 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:05.898936 12080 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.934337  8502 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:05.877341 12064 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:05.921756 12092 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.001s
I20260709 13:02:05.937500  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.937832  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:05.938251  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.941443  8435 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:05.941515  8429 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:05.932750  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:05.931706 11840 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:05.911758 12165 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.937428 11853 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:05.920527 12158 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:05.942634 12042 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.947906 12140 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.931658 12145 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:05.949651 12145 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:05.950048 12145 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.953940 12099 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.955854  8433 raft_consensus.cc:2410] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:05.955767 12094 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.956434 12152 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.940555 11886 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:05.958424 11886 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.958820 11886 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.920995 11993 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:05.965569  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 216928us
I20260709 13:02:05.922524 12181 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:05.965921  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.922597 12177 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.964967  8550 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:05.968384 12181 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.967201  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:05.973402 12115 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:05.976179 12162 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.925937 12095 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.977279 12158 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:05.977258 12174 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:05.980266  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:05.981015  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:05.980880 11886 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.953845 11983 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:05.983170  8428 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:05.979627 12064 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:05.917647 12119 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:05.936761 12175 consensus_queue.cc:1175] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0b9f7467deed4381835a85ffd0e88af6" responder_term: 9 status { last_received { term: 8 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:02:05.988389  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 65131.2us
I20260709 13:02:05.989800  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:06.045485  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:06.006047 12180 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:06.046149  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 60912.9us
W20260709 13:02:06.046813  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 79678us
I20260709 13:02:06.059001  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:06.046224  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 56549.2us
I20260709 13:02:06.055560  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:06.072402  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.073170  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 140494us
I20260709 13:02:05.986531 12115 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.006839 12108 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.086284  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:06.086702  9068 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:06.005100 12114 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:06.006575 12188 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.095919  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:06.098189  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:06.098585  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:06.103206  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:06.109450  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50542.7us
I20260709 13:02:06.115188  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:06.071576 12153 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:06.056564 12180 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.119230  8583 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:06.091818 12115 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.088649 11989 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.088302 12187 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:06.130754  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.132117  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:06.093974 12140 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.136616 12184 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:06.119901 12042 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:06.135478 12158 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:06.136155 12152 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:06.137084  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 124200us
W20260709 13:02:06.183296  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.006783 12130 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:02:06.138010  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:06.149482  8575 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:06.095642 12006 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:02:06.116125 12123 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:06.151254  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:06.093264 11993 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:06.135643  8580 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:06.193311  9099 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:06.161525  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:06.124279 11853 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:05.926844 12148 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:06.134411 12180 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.176009  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:06.175269  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:06.227862  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:06.228329  9098 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:06.137219  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:06.185019  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:06.138695 11989 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.150805 12140 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:06.192623  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 180181us
I20260709 13:02:06.149609 12153 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:06.173851 12042 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.203414  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:06.236054  8475 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.135s (SENT) [suppressed 53 similar messages]
I20260709 13:02:06.184149 11762 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.229398  8435 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.229367  8508 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
W20260709 13:02:06.233423  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 117982us
I20260709 13:02:06.262238  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:06.234961  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:06.237471  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:06.270773  9100 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.228581  9101 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:06.203984 12188 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:06.202627 11853 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.272287 11853 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.272684  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:06.273684 12164 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:06.274150 12164 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:06.274533 12164 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.274776  9068 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:06.281977  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45949.5us
I20260709 13:02:06.288103  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:06.230857 12123 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:06.292256  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.308868  9100 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:06.311080  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:06.312335 12191 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:06.312945 12191 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:06.315186  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:06.236506 11989 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.237843 12148 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.281325 11853 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:06.263959 12042 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.238534 12140 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.326006  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:06.327875  8580 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:06.328709  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:06.329245  8580 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.330569 12153 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:06.235966 12152 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.321635  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 46941.5us
I20260709 13:02:06.322489  8429 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:06.323616  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 86231.4us
I20260709 13:02:06.333892  8435 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:06.334007  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:06.335457  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:06.178948 12184 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:06.305315 12164 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:06.256800 12105 consensus_queue.cc:1175] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dacb523538a14c7cb335ab9c18f4111b" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:06.267701 11762 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:06.785243  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:06.431972  8575 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:06.405046  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:06.336958  8580 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
W20260709 13:02:06.669042  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 383738us
I20260709 13:02:06.319980 12187 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.796447  8508 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
W20260709 13:02:06.785751  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.340088  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:06.742596  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.804767  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:06.680037  8578 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.009s	sys 0.004s
I20260709 13:02:06.337169 12114 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.550685 12192 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
I20260709 13:02:06.412719 11682 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:06.327235 12189 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 13:02:06.771483 12080 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.832s	user 0.009s	sys 0.002s
W20260709 13:02:06.554915 12196 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260709 13:02:06.326087 12123 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:06.460723  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 125319us
I20260709 13:02:06.848527 12139 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:06.849642  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 743) took 1781 ms. Trace:
W20260709 13:02:06.861881  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.740204 12145 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.790s	user 0.005s	sys 0.004s
W20260709 13:02:06.551331 12193 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.363s	user 0.000s	sys 0.000s
W20260709 13:02:06.730947 12088 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.000s
I20260709 13:02:07.047575 12088 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:06.422904 12099 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:06.551477 12185 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.050403 12099 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:07.050966 12099 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.470638 11983 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:07.054684 11983 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.055249 11983 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.057375 11983 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:06.773332 12107 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.057988 12107 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.059923 12107 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.060982 12107 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.061444 12107 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:06.985518  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 150684us
I20260709 13:02:06.987530  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:07.068262  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:07.068830 12107 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:07.069219  8575 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:06.528239 12119 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.070447 12119 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:07.071508 12036 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:07.005666  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.073639  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.074590  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 750) took 1088 ms. Trace:
I20260709 13:02:07.074961  8508 rpcz_store.cc:276] 0709 13:02:05.986416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.073308 (+1086892us) service_pool.cc:224] Handling call
0709 13:02:07.074528 (+  1220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.075857 12185 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.076243  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.077235  8508 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:07.077661  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1901) took 1096 ms. Trace:
I20260709 13:02:07.008328  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:07.078321  8580 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.085464 12184 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:06.411966 12006 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.582s
I20260709 13:02:07.025982  8509 rpcz_store.cc:276] 0709 13:02:05.067749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.440856 (+373107us) service_pool.cc:224] Handling call
0709 13:02:05.732474 (+291618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.770749 (+ 38275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.849356 (+1078607us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54000d84d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:06.849562 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669811456}
W20260709 13:02:07.039721 12181 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.010s	user 0.010s	sys 0.000s
I20260709 13:02:07.040546  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1898) took 1394 ms. Trace:
I20260709 13:02:07.041554 11813 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:07.042543 12140 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.716s	user 0.009s	sys 0.000s
I20260709 13:02:06.731570 12180 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:06.418570 12191 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:06.775839  8435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:02:07.139061  8435 raft_consensus.cc:606] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:07.044422 12202 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:06.969976 12114 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:06.896759 11682 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:07.025022 12177 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.994s	user 0.010s	sys 0.000s
I20260709 13:02:06.969642  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:07.149617  8584 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.792883 11886 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:07.061455 11989 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.729s	user 0.006s	sys 0.001s
W20260709 13:02:07.064963 12042 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.735s	user 0.006s	sys 0.000s
W20260709 13:02:07.065711 12200 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.316s	user 0.000s	sys 0.005s
I20260709 13:02:07.068291  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:07.087036  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2258) took 2107 ms. Trace:
I20260709 13:02:07.087997  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:07.089037 12159 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:07.089277  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.090225  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1920) took 1408 ms. Trace:
I20260709 13:02:07.220933  8426 rpcz_store.cc:276] 0709 13:02:05.682295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.763714 (+ 81419us) service_pool.cc:224] Handling call
0709 13:02:05.769124 (+  5410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.800092 (+ 30968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.089951 (+1289859us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b540026ff54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:07.090156 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30476672}
I20260709 13:02:06.808521 12165 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.092061  8510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 735) took 2064 ms (client timeout 1917 ms). Trace:
I20260709 13:02:07.094568  8501 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:07.096447  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.224546  8510 rpcz_store.cc:269] 0709 13:02:05.027421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.201886 (+174465us) service_pool.cc:224] Handling call
0709 13:02:07.091879 (+1889993us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b540033a254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:07.091995 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5030784}
W20260709 13:02:07.225492  8549 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.242s (SENT)
I20260709 13:02:07.217491  8506 rpcz_store.cc:276] 0709 13:02:04.979972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.980664 (+   692us) service_pool.cc:224] Handling call
0709 13:02:05.001001 (+ 20337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.110715 (+109714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.086744 (+1976029us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400372dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:07.086942 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250797312}
I20260709 13:02:07.225960  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:07.224925  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 156693us
I20260709 13:02:07.096290 11762 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:07.096993  8580 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:07.149662 11682 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.078011  8508 rpcz_store.cc:276] 0709 13:02:05.980751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.075920 (+1095169us) service_pool.cc:224] Handling call
0709 13:02:07.077604 (+  1684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:06.427666 11993 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.104866 12145 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.107347  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1897) took 1461 ms. Trace:
I20260709 13:02:07.108148 12099 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.109665 12164 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.114390  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:07.116839  8432 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.042s	sys 0.072s
W20260709 13:02:07.119735  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 98255.1us
W20260709 13:02:07.292098  8432 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.168s	user 0.043s	sys 0.072s
I20260709 13:02:07.292603  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:07.121874  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:06.802592 12152 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.127141  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:07.025362 11853 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.214648 12177 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.220502 12159 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:07.307684  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 193358us
I20260709 13:02:07.036515 12080 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.131000  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:07.120373 12021 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:07.164984  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.128298 11813 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:07.132747 12079 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:07.223120  8507 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:02:07.223589  8504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1883) took 2705 ms (client timeout 2013 ms). Trace:
I20260709 13:02:07.227244  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:07.340575  8504 rpcz_store.cc:269] 0709 13:02:04.518355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.518490 (+   135us) service_pool.cc:224] Handling call
0709 13:02:07.222723 (+2704233us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003c5854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:07.223520 (+   797us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3094374656}
W20260709 13:02:07.341051  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 113913us
I20260709 13:02:07.140048 12088 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:07.344493  8475 connection.cc:256] RPC call timeout handler was delayed by -1.2737180859999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:02:07.345456  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:07.345757  8475 connection.cc:256] RPC call timeout handler was delayed by -1.2404180859999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 13:02:07.235503  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1903) took 1144 ms. Trace:
W20260709 13:02:07.346215  8475 connection.cc:256] RPC call timeout handler was delayed by -1.2323180860000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:02:07.236699  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:07.099747 12129 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.139065 12140 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.224869 12176 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:07.365077 12176 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:07.239902 12165 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.365996 12176 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.366674 12140 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:07.367069 12176 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.367278 12165 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.367823 11813 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.369397 11813 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.250629  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:07.253517  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 468356us
I20260709 13:02:07.369858 12180 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.370311  8575 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.370060 12021 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.370608  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:07.256529  8584 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:07.220310 12042 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.371953 12130 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:07.257309 12025 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:07.372483 12130 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:07.257676  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:07.253943 12174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.005s	sys 0.012s
I20260709 13:02:07.373697  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2198) took 1045 ms. Trace:
I20260709 13:02:07.258662  8429 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:07.384114  8584 rpcz_store.cc:276] 0709 13:02:06.328428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.805322 (+476894us) service_pool.cc:224] Handling call
0709 13:02:07.373641 (+568319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.259656  8430 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:07.130307 12181 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.264681  8505 rpcz_store.cc:276] 0709 13:02:05.645941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.770317 (+124376us) service_pool.cc:224] Handling call
0709 13:02:05.782400 (+ 12083us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:05.809338 (+ 26938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.809387 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:05.832693 (+ 23306us) log.cc:844] Serialized 52 byte log entry
0709 13:02:05.896832 (+ 64139us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:05.914485 (+ 17653us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.915010 (+   525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.915085 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.107088 (+1192003us) raft_consensus.cc:1685] finished
0709 13:02:07.107115 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.107277 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22585,"prepare.queue_time_us":17449,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":5563,"raft.queue_time_us":21886,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":9465,"thread_start_us":57204,"threads_started":1,"wal-append.queue_time_us":95398}
I20260709 13:02:07.266844  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.294257  8509 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:07.124678  8503 rpcz_store.cc:276] 0709 13:02:05.646269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.791367 (+145098us) service_pool.cc:224] Handling call
0709 13:02:05.791704 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.909706 (+118002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.040206 (+1130500us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540033b654. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:07.040464 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241285504}
I20260709 13:02:07.025735 12139 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:07.240774 12202 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:07.310273  9098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.008s	sys 0.016s
I20260709 13:02:07.314679  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:07.263015 12188 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:07.387948  9098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.008s	sys 0.016s
I20260709 13:02:07.216267 11989 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:07.329263  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.388761  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1904) took 1297 ms. Trace:
I20260709 13:02:07.389216  8509 rpcz_store.cc:276] 0709 13:02:06.091758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.121559 (+1029801us) service_pool.cc:224] Handling call
0709 13:02:07.388688 (+267129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:07.346679  8475 connection.cc:256] RPC call timeout handler was delayed by -1.127018086000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
I20260709 13:02:07.346378  8502 rpcz_store.cc:276] 0709 13:02:06.091407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.089005 (+997598us) service_pool.cc:224] Handling call
0709 13:02:07.235439 (+146434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.346216  8435 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:02:07.309759 12148 consensus_meta.cc:287] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.986s	user 0.008s	sys 0.003s
I20260709 13:02:07.353660  8576 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:07.354332  8434 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:07.354809  8428 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 707) took 2067 ms (client timeout 2684 ms). Trace:
W20260709 13:02:07.394862  8428 rpcz_store.cc:269] 0709 13:02:05.260362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.260539 (+   177us) service_pool.cc:224] Handling call
0709 13:02:07.327726 (+2067187us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400290ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:07.327879 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241551744}
I20260709 13:02:07.397938  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1895) took 1752 ms. Trace:
W20260709 13:02:07.403944  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.404506  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:07.357817 12108 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.263s	user 0.009s	sys 0.002s
I20260709 13:02:07.360810 12159 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.364039 12145 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:07.324278 12079 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:07.373867 12174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.006s	sys 0.012s
I20260709 13:02:07.254647  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 935) took 1070 ms. Trace:
I20260709 13:02:07.416930  9095 rpcz_store.cc:276] 0709 13:02:06.184256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.184411 (+   155us) service_pool.cc:224] Handling call
0709 13:02:06.194883 (+ 10472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.195131 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:06.422956 (+227825us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.254294 (+831338us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.254352 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:07.254402 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.254475 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.254595 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":527159,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":192247,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":17317,"thread_start_us":1013217,"threads_started":3,"wal-append.queue_time_us":675119}
W20260709 13:02:07.418329  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 103713us
I20260709 13:02:07.419379  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:07.419865  8577 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:07.373404 12130 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.374352  9102 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:07.387948 12153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.001s	sys 0.018s
I20260709 13:02:07.357868 12119 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:07.347349 12185 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:02:07.285503 12198 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:02:07.377146  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.378204  8575 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:07.379226 12099 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:07.380734 12177 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.381669  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.373310  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1905) took 1281 ms. Trace:
I20260709 13:02:07.310645 11884 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:07.310469 12184 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.264165 12036 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.391937  8506 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:07.385808  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.008s	sys 0.034s
W20260709 13:02:07.443941  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.009s	sys 0.034s
I20260709 13:02:07.422772 12113 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.444535  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.10442e+06us
I20260709 13:02:07.426546 12215 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.373230 12042 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:07.398362  8501 rpcz_store.cc:276] 0709 13:02:05.645270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.721756 (+ 76486us) service_pool.cc:224] Handling call
0709 13:02:07.094324 (+1372568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.239390 (+145066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.397755 (+158365us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540033a250. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:07.397882 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3155505408}
I20260709 13:02:07.409497  8581 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:07.411737  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2185) took 1304 ms. Trace:
I20260709 13:02:07.421113  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:07.374876  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2186) took 1267 ms. Trace:
W20260709 13:02:07.424162  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 162210us
I20260709 13:02:07.424562  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:07.423776  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:07.407397 12115 consensus_meta.cc:287] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.256s	user 0.010s	sys 0.002s
I20260709 13:02:07.445802  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:07.404553  8547 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:07.430017  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.462826  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.453339  8429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:02:07.463891  8429 raft_consensus.cc:606] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:07.464233  8429 raft_consensus.cc:614] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:07.430008 12080 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:07.459542 12036 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.465723 12080 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:07.466212 12080 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.467161 11989 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.467463 12036 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:07.444136 12139 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.468312  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.442787 12174 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:07.468883 12181 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.469031 12113 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:07.469470  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48422.8us
I20260709 13:02:07.469774 12184 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:07.470201 12152 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.470329 12184 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:07.453722 12115 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.471379 12184 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.430373  8508 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:07.472731 12115 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.472920  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2277) took 1509 ms. Trace:
I20260709 13:02:07.473316  8508 rpcz_store.cc:276] 0709 13:02:05.963935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.376857 (+1412922us) service_pool.cc:224] Handling call
0709 13:02:07.472867 (+ 96010us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.409425 11762 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:02:07.474273  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.445647 12223 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:07.475289  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:07.475486 12223 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.476281  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.438853  8504 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.477020  9099 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:07.477110  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.477633 12223 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.409673 11840 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:02:07.477903  9094 raft_consensus.cc:2410] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:07.478787  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.429756 12220 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:07.479341  9094 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:07.479513 12158 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:07.479952  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.480297  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.481106  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.481207 12158 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:07.481783  9101 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:07.438838  8510 rpcz_store.cc:276] 0709 13:02:06.092056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.225508 (+1133452us) service_pool.cc:224] Handling call
0709 13:02:07.373233 (+147725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.409029 12202 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:07.482484  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:07.483234 12202 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.446859  8579 rpcz_store.cc:276] 0709 13:02:06.107489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.107628 (+   139us) service_pool.cc:224] Handling call
0709 13:02:06.124016 (+ 16388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.136053 (+ 12037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.136086 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.136568 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.258883 (+122315us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:06.258945 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.259046 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.374687 (+1115641us) raft_consensus.cc:1685] finished
0709 13:02:07.374705 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.374824 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4068,"raft.queue_time_us":12847,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":30539,"spinlock_wait_cycles":18304,"thread_start_us":121872,"threads_started":1,"wal-append.queue_time_us":612844}
I20260709 13:02:07.468971  8501 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:07.485471  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.427728 12119 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:07.486631  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.487170  8501 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.486750 12119 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.487972 12119 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:07.474327  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.489341  8475 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:07.489478 11840 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.490043 11840 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.469010 12174 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:02:07.490993  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 70460.7us
W20260709 13:02:07.491468  8577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 574) took 2810 ms (client timeout 2223 ms). Trace:
I20260709 13:02:07.491351 12174 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.491710  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:07.492040 11840 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:07.490188  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.492533 12174 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.492928  9100 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:07.493500  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 939) took 1259 ms. Trace:
I20260709 13:02:07.493781  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.482514  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.494482 12221 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.494776  8510 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.429975 12187 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:07.446581  8578 rpcz_store.cc:276] 0709 13:02:06.106905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.107048 (+   143us) service_pool.cc:224] Handling call
0709 13:02:06.124263 (+ 17215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.124493 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:06.807433 (+682940us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.411001 (+603568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.411071 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:07.411138 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.411222 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.411666 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105069,"prepare.queue_time_us":509688,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":72,"raft.queue_time_us":116355,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5031,"thread_start_us":1133886,"threads_started":2,"wal-append.queue_time_us":618585}
I20260709 13:02:07.477937  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.474407 11762 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:07.474813  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.498142  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:07.491890  8577 rpcz_store.cc:269] 0709 13:02:04.681317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.682827 (+  1510us) service_pool.cc:224] Handling call
0709 13:02:07.491247 (+2808420us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b54001a2f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:07.491365 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5644700544}
W20260709 13:02:07.426713 12153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.002s	sys 0.018s
I20260709 13:02:07.475567  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.523279  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.524530  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.493847  9098 rpcz_store.cc:276] 0709 13:02:06.234338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.234463 (+   125us) service_pool.cc:224] Handling call
0709 13:02:06.268910 (+ 34447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.273856 (+  4946us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:06.562911 (+289055us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.420508 (+857597us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.420577 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:07.420636 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.481348 (+ 60712us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b180009f880. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:07.493308 (+ 11960us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b5400551754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:07.493350 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.493454 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31922,"prepare.queue_time_us":462177,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":41744,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8315,"spinlock_wait_cycles":44132992,"thread_start_us":1113383,"threads_started":2,"wal-append.queue_time_us":882001}
W20260709 13:02:07.497668  9068 leader_election.cc:336] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.684s (SENT)
I20260709 13:02:07.528332  8502 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:07.525708  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:07.515508  8549 leader_election.cc:336] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.513s (SENT)
I20260709 13:02:07.530048  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:07.504030  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.531145  8549 leader_election.cc:336] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.608s (SENT)
W20260709 13:02:07.509058  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 104559us
I20260709 13:02:07.622314  8426 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:07.622324  9098 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:07.547210  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49188.5us
I20260709 13:02:07.525952 12025 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:07.459818 12114 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.460342 12159 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.528646 12158 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:07.533699  8501 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:07.598047  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:07.609052  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.640527  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2071) took 1717 ms. Trace:
I20260709 13:02:07.610057  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:07.615355  8577 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:07.495906 12176 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.618646  8510 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:07.555154 12221 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:07.619730  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.620698  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:07.512494 12152 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.648816  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:07.494215 12042 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:07.535082  8504 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:07.654918  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2278) took 1687 ms. Trace:
I20260709 13:02:07.656081  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.656368  8504 rpcz_store.cc:276] 0709 13:02:05.967490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.381391 (+1413901us) service_pool.cc:224] Handling call
0709 13:02:07.654847 (+273456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.626040  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:07.640091 12036 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.657372  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:07.657487 12036 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.658619  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:07.659381  8430 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:07.660260 12036 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.641966 12088 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.661015 12088 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.663136 12088 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:07.663288 12194 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.663911  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:07.663862 12194 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.665357  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:07.657850  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:07.666769  9099 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:07.667929 11877 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.671161  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.671833  8509 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:07.672307  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1899) took 1692 ms. Trace:
I20260709 13:02:07.672576  8509 rpcz_store.cc:276] 0709 13:02:05.980238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.670919 (+1690681us) service_pool.cc:224] Handling call
0709 13:02:07.672249 (+  1330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.672704 11682 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.673537  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.665755  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.640287 12165 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.675047  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.675653  8505 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 5.
I20260709 13:02:07.627233  9093 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:07.624338  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:07.677304  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53030.2us
I20260709 13:02:07.677981  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:07.657269  8579 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:02:07.499665  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:07.679149  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 179523us
I20260709 13:02:07.526844 11762 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:07.626691  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:07.679821  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:07.680565  8509 raft_consensus.cc:2410] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:07.665867  8577 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.523555 12006 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:07.599330 12223 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:07.689381  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:07.637166  8476 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:07.690497  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53414.2us
I20260709 13:02:07.642340  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2180) took 1544 ms. Trace:
I20260709 13:02:07.644866  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 936) took 1450 ms. Trace:
I20260709 13:02:07.693059  9102 rpcz_store.cc:276] 0709 13:02:06.187899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.188038 (+   139us) service_pool.cc:224] Handling call
0709 13:02:07.637799 (+1449761us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54006685d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:07.637923 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2559433472}
I20260709 13:02:07.645042  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2263) took 2649 ms. Trace:
I20260709 13:02:07.694231  8507 rpcz_store.cc:276] 0709 13:02:04.996652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.011066 (+ 14414us) service_pool.cc:224] Handling call
0709 13:02:07.222896 (+2211830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.341715 (+118819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.644858 (+303143us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54003c5850. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:07.644987 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5085318400}
I20260709 13:02:07.549152 12181 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:07.550923  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:07.647612  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.649664  8584 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:07.651408  8575 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:07.697239  8508 raft_consensus.cc:2410] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:07.651979  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.629109 12025 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.653697  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:07.624368  8506 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:07.549875  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:07.655889  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:07.516137 12177 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 13:02:07.548069  9101 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:07.744004  8509 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:07.681406  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:07.513723 12187 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:07.656772  8510 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
W20260709 13:02:07.687376  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 156240us
I20260709 13:02:07.687573  8426 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:07.792834 12221 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.640920  8434 rpcz_store.cc:276] 0709 13:02:05.923370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.923495 (+   125us) service_pool.cc:224] Handling call
0709 13:02:05.926256 (+  2761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.394529 (+1468273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.640305 (+245776us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003f2354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:07.640474 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3283605376}
I20260709 13:02:07.698100  9098 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:07.674854 12165 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.745240  8580 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:07.745059  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2272) took 1844 ms. Trace:
I20260709 13:02:07.692168  8581 rpcz_store.cc:276] 0709 13:02:06.098233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.098349 (+   116us) service_pool.cc:224] Handling call
0709 13:02:07.642142 (+1543793us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400066dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:07.642286 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3013055360}
I20260709 13:02:07.745689  8502 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:07.747049  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 57744.8us
I20260709 13:02:07.750159 12022 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:07.745183  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 63840.1us
I20260709 13:02:07.787117  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2274) took 1886 ms. Trace:
I20260709 13:02:07.843070  8506 rpcz_store.cc:276] 0709 13:02:05.901267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.786309 (+1885042us) service_pool.cc:224] Handling call
0709 13:02:07.786636 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.786799 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.786824 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.786862 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:07.786901 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.786958 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.787064 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.795195  8579 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:07.844966  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:07.787617  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:07.845656  8581 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:07.846012  9093 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.688319 12006 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:07.804881  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:07.789752  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:07.787359  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2271) took 1887 ms. Trace:
W20260709 13:02:07.820672  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.824401  8501 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:07.847965  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1906) took 1755 ms. Trace:
I20260709 13:02:07.848321  8501 rpcz_store.cc:276] 0709 13:02:06.092337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.786869 (+1694532us) service_pool.cc:224] Handling call
0709 13:02:07.824158 (+ 37289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.847749 (+ 23591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.847913 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.698772 12114 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:07.689291  8550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.012s	sys 0.043s
W20260709 13:02:07.850847  8550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.012s	sys 0.043s
I20260709 13:02:07.651805 12176 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:07.688820 12153 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:07.656190 12158 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:07.836150  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:07.747406  8505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:02:07.833950  8504 rpcz_store.cc:276] 0709 13:02:05.900451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.697712 (+1797261us) service_pool.cc:224] Handling call
0709 13:02:07.698085 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.744761 (+ 46676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.744786 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.744827 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:07.744863 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.744920 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.745013 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.823614 12088 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:07.841958  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.792963 12042 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:07.787878 11886 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:07.849188  8509 rpcz_store.cc:276] 0709 13:02:05.899630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.689207 (+1789577us) service_pool.cc:224] Handling call
0709 13:02:07.699272 (+ 10065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.787092 (+ 87820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.787307 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.802567  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:07.823304 12187 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.753047 12140 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:07.750430 11840 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:07.844940  9099 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:07.884472  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:07.885087  9099 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.777823 12025 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.699139 11969 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:07.744959 12036 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:07.689904 12223 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:07.656757 12152 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.857662  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.857895  8510 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:07.786211 12198 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
W20260709 13:02:07.838732  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.861482  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:07.861768  8398 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:07.866567 12153 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:07.870112 11813 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:07.867311 12216 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.560s	user 0.000s	sys 0.004s
W20260709 13:02:07.899187  8549 leader_election.cc:336] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.690s (SENT)
I20260709 13:02:07.870435 12181 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:07.877738  8504 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:07.891351  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.869750 11993 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.894047  9098 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:07.866725 12210 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:07.898010  8502 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:07.901849  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:07.873790  9102 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:07.906502  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44807us
I20260709 13:02:07.879849 12042 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.885720 12140 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.895110 12223 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.845736 12221 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.923797 12181 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.936421 12181 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:07.898319 12088 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:07.978367  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:07.979682  9098 raft_consensus.cc:2410] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:07.885901 11886 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:07.911935  9099 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
W20260709 13:02:07.954877  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.988924  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.919317  9093 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
W20260709 13:02:07.989482  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.989733  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.990779  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:07.990289  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:07.974711  8431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.017s	sys 0.039s
I20260709 13:02:07.889475 12036 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.911054 11884 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:07.992350  8431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.017s	sys 0.040s
I20260709 13:02:07.927237 12210 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:07.930904 12140 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:08.030857  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:07.906553 12226 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:07.917392 12231 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:08.035033  9099 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.042695 11989 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.044414  8434 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:07.939711 12129 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:08.053555  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.938526 11682 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:07.975899 11813 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:07.929821 12207 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
W20260709 13:02:08.058497  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.058384  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:08.115870 12174 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.003s
I20260709 13:02:07.998561 12036 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.927919 11993 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:08.127437  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 228274us
I20260709 13:02:08.124330  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:08.046833 12210 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.928948 12006 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:08.153896  9100 raft_consensus.cc:2410] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:08.158313  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:08.109917  9099 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:08.159178  8434 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:08.157284  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 311060us
W20260709 13:02:08.178594  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 252371us
I20260709 13:02:08.180372  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:08.181391  9098 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
W20260709 13:02:08.129249 12191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.005s	sys 0.020s
I20260709 13:02:08.128834 12129 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:08.168171 12228 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.364s	user 0.001s	sys 0.001s
I20260709 13:02:08.030133 11884 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:08.153999 12148 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:08.220332  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:08.248338  9099 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:08.099313 11989 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:08.193689 12080 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.004s
W20260709 13:02:08.230146  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.231199  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:08.255635  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:08.231701  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:08.257596  9098 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
W20260709 13:02:08.232334  8577 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 13:02:08.259261  8577 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:08.155700 12231 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:08.281162  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:08.281755 12240 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 13:02:08.283149 12237 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
I20260709 13:02:08.283070  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:08.283990  8430 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:08.284668 12224 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.374s	user 0.000s	sys 0.001s
W20260709 13:02:08.281225 12211 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.540s	user 0.000s	sys 0.021s
I20260709 13:02:08.285563 12139 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.287663 12194 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:08.288412 12194 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.288901  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 931) took 2160 ms. Trace:
I20260709 13:02:08.289520  9096 rpcz_store.cc:276] 0709 13:02:06.128344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.137702 (+  9358us) service_pool.cc:224] Handling call
0709 13:02:06.179824 (+ 42122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.187299 (+  7475us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:06.306671 (+119372us) log.cc:844] Serialized 14 byte log entry
0709 13:02:06.321578 (+ 14907us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.322057 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.322183 (+   126us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:06.322216 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.322280 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.274767 (+1952487us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:08.288529 (+ 13762us) raft_consensus.cc:1685] finished
0709 13:02:08.288659 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.288826 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10472,"prepare.queue_time_us":293326,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":21665,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":82782,"spinlock_wait_cycles":2392832,"thread_start_us":119223,"threads_started":2,"wal-append.queue_time_us":424551}
I20260709 13:02:08.292426  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:08.293558  9096 raft_consensus.cc:2410] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:08.297122  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 717) took 2761 ms. Trace:
I20260709 13:02:08.297592  8432 rpcz_store.cc:276] 0709 13:02:05.535396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.647682 (+112286us) service_pool.cc:224] Handling call
0709 13:02:05.957722 (+310040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.031471 (+ 73749us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:07.295361 (+1263890us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.752032 (+456671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.786442 (+ 34410us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:07.786489 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.786566 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.296922 (+510356us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54003a1e50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:08.297035 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138152,"prepare.queue_time_us":258159,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":8060,"raft.queue_time_us":73580,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":60311,"spinlock_wait_cycles":649705728,"thread_start_us":1567986,"threads_started":2,"wal-append.queue_time_us":722970}
I20260709 13:02:08.299253  8575 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:08.299902  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:08.301482  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:08.302201  8581 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 4.
I20260709 13:02:08.303179  8426 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:08.304486  8426 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:08.306149  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:08.306874  9101 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:02:08.307771  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:08.308406  9101 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:08.309361  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:08.249352 11813 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:08.309988  9101 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:08.313753  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1928) took 1062 ms. Trace:
I20260709 13:02:08.323454  8431 rpcz_store.cc:276] 0709 13:02:07.251420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.251527 (+   107us) service_pool.cc:224] Handling call
0709 13:02:07.260215 (+  8688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.299186 (+ 38971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.299232 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.311275 (+ 12043us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.992849 (+681574us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:07.992890 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.992957 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.313497 (+320540us) raft_consensus.cc:1685] finished
0709 13:02:08.313518 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.313671 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24602,"raft.queue_time_us":39238,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9094,"thread_start_us":634575,"threads_started":1,"wal-append.queue_time_us":910677}
I20260709 13:02:08.314431  8426 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:02:08.314738  9068 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:08.320878  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:08.301189  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:08.328346  8575 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:02:08.329291  8584 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:08.214594 11969 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:02:08.029424 12158 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:08.104995 12226 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:08.217649 12006 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:08.253861  8549 leader_election.cc:336] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.916s (SENT)
I20260709 13:02:08.260787  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:08.231379 11877 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.563s	user 0.013s	sys 0.000s
I20260709 13:02:08.159705 12088 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:08.248432 12176 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:08.122761 12153 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:08.301189  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:08.194119 12191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.009s	sys 0.020s
I20260709 13:02:08.270450  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:08.229305 12230 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.151s
W20260709 13:02:08.198138 12184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.013s	sys 0.014s
W20260709 13:02:08.952112  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 624165us
I20260709 13:02:08.954615  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:08.334206 12079 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:08.334714 12188 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:08.754374  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1053) took 1283 ms. Trace:
I20260709 13:02:08.953298  8428 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:02:08.521067  8434 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:08.313158  8430 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:08.539160  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1057) took 1066 ms. Trace:
I20260709 13:02:08.533651  9095 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:08.970525  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1071) took 1074 ms. Trace:
I20260709 13:02:08.970983  9095 rpcz_store.cc:276] 0709 13:02:07.896400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.532821 (+636421us) service_pool.cc:224] Handling call
0709 13:02:08.533319 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.970171 (+436852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.970454 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:08.376380  8583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2190) took 2217 ms (client timeout 1729 ms). Trace:
I20260709 13:02:08.454902  9101 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:08.969691  9100 rpcz_store.cc:276] 0709 13:02:07.472453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.493565 (+ 21112us) service_pool.cc:224] Handling call
0709 13:02:08.538846 (+1045281us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b540017a054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:08.539068 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471689984}
I20260709 13:02:08.976522  9100 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:02:08.377475  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1907) took 2284 ms. Trace:
W20260709 13:02:09.005483 12036 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.850s	user 0.008s	sys 0.000s
I20260709 13:02:09.009946 12036 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:08.544293  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.961283  9099 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
W20260709 13:02:08.439049  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 117120us
I20260709 13:02:08.457320  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 749) took 2492 ms. Trace:
W20260709 13:02:08.957748  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 726582us
W20260709 13:02:08.274425 12232 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
W20260709 13:02:08.972312  8583 rpcz_store.cc:269] 0709 13:02:06.158560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.159435 (+   875us) service_pool.cc:224] Handling call
0709 13:02:08.376034 (+2216599us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540009a954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:08.376264 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3698945792}
W20260709 13:02:08.903012  9102 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.981s	user 0.010s	sys 0.001s
I20260709 13:02:08.978520  8582 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:02:08.978721 12079 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.978881 11682 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:09.074358  9099 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:09.074534 11682 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.075989  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:09.077396 11682 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:02:08.966878  9097 rpcz_store.cc:276] 0709 13:02:07.471436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.475389 (+  3953us) service_pool.cc:224] Handling call
0709 13:02:07.475671 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.475929 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.475959 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.476410 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.932786 (+456376us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:08.412146 (+479360us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.413429 (+  1283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.413532 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.712296 (+298764us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b180046b820. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:08.753898 (+ 41602us) raft_consensus.cc:1685] finished
0709 13:02:08.754056 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.754277 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4341,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":35568,"spinlock_wait_cycles":37583232,"thread_start_us":879240,"threads_started":2,"wal-append.queue_time_us":984898}
I20260709 13:02:09.033694 12042 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:08.980820 12226 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:08.334518 12244 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:08.311208 12222 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.933s	user 0.002s	sys 0.000s
I20260709 13:02:08.317793 12021 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:08.982597  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1067) took 1294 ms. Trace:
W20260709 13:02:08.985327 12159 consensus_meta.cc:287] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.343s	user 0.010s	sys 0.000s
I20260709 13:02:08.973929 12215 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.334208 12115 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.652s
W20260709 13:02:08.989116 12210 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.771s	user 0.003s	sys 0.003s
I20260709 13:02:08.288877 12194 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:08.994308 12223 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.017s	user 0.002s	sys 0.007s
W20260709 13:02:08.994349  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 740368us
I20260709 13:02:08.998654 11993 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:08.999346 12176 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:09.005679  8510 rpcz_store.cc:276] 0709 13:02:06.092621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.834426 (+1741805us) service_pool.cc:224] Handling call
0709 13:02:07.855566 (+ 21140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.893843 (+ 38277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.377144 (+483301us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b54001fe854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:08.377395 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4922240}
W20260709 13:02:08.673485  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.011814 12025 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.112s	user 0.011s	sys 0.000s
I20260709 13:02:08.935432  9098 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:09.019438  8427 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:09.021647  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.180873  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.181334  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.273366 12165 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:09.172063 12138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.001s	sys 0.015s
W20260709 13:02:08.725817 12119 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.237s	user 0.011s	sys 0.001s
W20260709 13:02:08.959389 12184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.308s	user 0.021s	sys 0.016s
W20260709 13:02:09.032164  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.666155 12078 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:09.192049 12078 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:09.192327  8333 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57104 (request call id 382) took 25843 ms (client timeout 15000 ms). Trace:
I20260709 13:02:09.193195 12078 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:09.193982 11682 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.194517 11682 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:08.266853 12080 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.055124  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:08.517834 12231 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:09.058650  8582 pending_rounds.cc:85] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 4
I20260709 13:02:09.198724  8582 pending_rounds.cc:107] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:02:09.199025  8582 raft_consensus.cc:2889] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:09.199433  8582 pending_rounds.cc:107] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:09.199721  8582 raft_consensus.cc:2889] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:09.059103  9102 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
W20260709 13:02:09.200826  9102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 942) took 1652 ms (client timeout 2182 ms). Trace:
W20260709 13:02:09.201332  9102 rpcz_store.cc:269] 0709 13:02:07.548945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.744145 (+195200us) service_pool.cc:224] Handling call
0709 13:02:09.200762 (+1456617us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.459817 12152 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:09.065603  8507 rpcz_store.cc:276] 0709 13:02:05.965128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.786756 (+1821628us) service_pool.cc:224] Handling call
0709 13:02:07.824229 (+ 37473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.824455 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.824485 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.829368 (+  4883us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.158530 (+329162us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:08.158584 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.158678 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.457051 (+298373us) raft_consensus.cc:1685] finished
0709 13:02:08.457078 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.457249 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8064,"thread_start_us":281507,"threads_started":1,"wal-append.queue_time_us":597368}
I20260709 13:02:09.057904  8322 maintenance_manager.cc:419] P 9ac2f5f0926d4b9294bfce4452124031: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033335
I20260709 13:02:09.068804 11989 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:08.969125 11884 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:09.086486  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:08.975603 12221 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:09.032660 12140 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.948s	user 0.007s	sys 0.004s
W20260709 13:02:09.086642  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 45759us
I20260709 13:02:09.216951  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:09.102469  8550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.029s	sys 0.013s
I20260709 13:02:09.105788  9101 rpcz_store.cc:276] 0709 13:02:07.688672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.454326 (+765654us) service_pool.cc:224] Handling call
0709 13:02:08.454704 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.982325 (+527621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.982540 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:09.134522  8401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.029s	sys 0.072s
W20260709 13:02:09.106315  8399 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.030s	sys 0.116s
W20260709 13:02:09.217984  8550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.029s	sys 0.013s
W20260709 13:02:09.218304  8399 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.313s	user 0.031s	sys 0.116s
W20260709 13:02:09.140937  8506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.037s	sys 0.087s
W20260709 13:02:09.218791  8506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.037s	sys 0.087s
W20260709 13:02:09.218521  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 1.03688e+06us
I20260709 13:02:09.219794  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2279) took 2076 ms. Trace:
I20260709 13:02:09.220259  8506 rpcz_store.cc:276] 0709 13:02:07.143563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.844968 (+701405us) service_pool.cc:224] Handling call
0709 13:02:07.861740 (+ 16772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.861999 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:08.232912 (+370913us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.219336 (+986424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.219410 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:09.219477 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.219568 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.219721 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":592368,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"thread_start_us":1356521,"threads_started":2}
W20260709 13:02:08.992079 12187 consensus_meta.cc:287] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.104s	user 0.008s	sys 0.001s
W20260709 13:02:09.169986  8579 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.006s	sys 0.017s
W20260709 13:02:09.228080  8579 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.007s	sys 0.017s
I20260709 13:02:09.170564  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:09.229241  9099 raft_consensus.cc:2376] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12. Re-sending same reply.
I20260709 13:02:09.048296 12207 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:09.238461 12207 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.241032 12207 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:09.181222  8549 leader_election.cc:336] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.020s (SENT)
I20260709 13:02:09.241802  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:08.418286 12235 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
W20260709 13:02:09.182157  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.670651 11762 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.183964  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1066) took 1532 ms. Trace:
I20260709 13:02:09.243959  9098 rpcz_store.cc:276] 0709 13:02:07.651410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.467572 (+816162us) service_pool.cc:224] Handling call
0709 13:02:08.935153 (+467581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.183594 (+248441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.183887 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:08.532184 12238 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 13:02:09.255141 12187 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.175150 12215 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:08.551530 12113 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:09.196372  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 141335us
I20260709 13:02:09.444695 12215 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:09.444898  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:09.447981  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:09.056193  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:09.449177  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 393025us
I20260709 13:02:09.449867  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:09.205686  9096 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:09.194873 12078 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:09.218400  8401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.029s	sys 0.072s
I20260709 13:02:09.221438  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:09.484042  9097 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:09.235343  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2070) took 3312 ms. Trace:
I20260709 13:02:09.267057  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:09.485263  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:09.177211 12210 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.187718 12025 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.225626 12140 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:09.179338 12223 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.209913 12111 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.332253  8331 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:09.204107 11886 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:09.485987  8510 raft_consensus.cc:2410] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:09.486853  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:09.501475  9097 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:09.502709  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:09.504029  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:09.504902  9097 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:09.484741  8427 rpcz_store.cc:276] 0709 13:02:05.923093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.923219 (+   126us) service_pool.cc:224] Handling call
0709 13:02:07.327969 (+1404750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.183327 (+1855358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.234545 (+ 51218us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b5400290ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:09.235098 (+   553us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400290ed0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:09.235259 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7087610112}
I20260709 13:02:09.488090 12210 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:09.491565  8429 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:09.510325  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2077) took 1520 ms. Trace:
I20260709 13:02:09.510728  8429 rpcz_store.cc:276] 0709 13:02:07.990425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.990556 (+   131us) service_pool.cc:224] Handling call
0709 13:02:09.509957 (+1519401us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400361fd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:09.510236 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3449254272}
I20260709 13:02:09.493557 12223 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:09.493781  8435 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:09.514083  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 723) took 1880 ms. Trace:
I20260709 13:02:09.514506  8435 rpcz_store.cc:276] 0709 13:02:07.633461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.745022 (+111561us) service_pool.cc:224] Handling call
0709 13:02:07.835432 (+ 90410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.513049 (+1677617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.513772 (+   723us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54003a3254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:09.513994 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3813161856}
I20260709 13:02:09.494293 12111 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:09.520153 12111 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:09.490073 12025 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:09.498579  8331 catalog_manager.cc:5697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.367754  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1968) took 2561 ms. Trace:
I20260709 13:02:09.398167 11989 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.528591 11989 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:09.399708  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:09.531033  9099 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:09.400842  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:09.532191  9101 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:09.402843  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:09.533694  9098 raft_consensus.cc:2410] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:09.403790  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:09.534802  9095 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:09.405611  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:09.408504  9093 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:09.291417  9094 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:09.338250 11993 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:09.416092 12176 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:09.417464  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 200582us
W20260709 13:02:09.541841  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.542510 12115 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:09.542925 11886 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:09.543344 11886 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.420009 12080 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:09.422344  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 247067us
I20260709 13:02:09.425072 12187 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:09.426846 11682 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:09.210975 12165 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.435822  8505 raft_consensus.cc:606] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:09.551249  8505 raft_consensus.cc:614] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:08.722244 12129 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.451846  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 944) took 1842 ms. Trace:
I20260709 13:02:09.552011  9096 rpcz_store.cc:276] 0709 13:02:07.609202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.294854 (+685652us) service_pool.cc:224] Handling call
0709 13:02:08.299454 (+  4600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.450950 (+1151496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.451592 (+   642us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b540017acd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:09.451777 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083461888}
I20260709 13:02:09.454782 12119 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:09.455533  8475 connection.cc:256] RPC call timeout handler was delayed by -1.951618653999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 13:02:09.455539 12036 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:09.456400 12207 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:09.458196  8583 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:09.458104  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:09.594323  8580 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:09.459591  8576 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:09.190095 12138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.002s	sys 0.016s
I20260709 13:02:09.461355  8584 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:09.460166 12194 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:09.462469  8581 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:09.463964  8578 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:02:09.543718 11886 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.637179  8578 pending_rounds.cc:85] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 3
I20260709 13:02:09.637844  8578 pending_rounds.cc:107] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:02:09.638285  8578 raft_consensus.cc:2889] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:09.474256 12006 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:09.527120  8582 rpcz_store.cc:276] 0709 13:02:06.806270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.324916 (+518646us) service_pool.cc:224] Handling call
0709 13:02:07.362450 (+ 37534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.200308 (+1837858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.367365 (+167057us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54000659d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:09.367659 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3705294592}
W20260709 13:02:09.539103  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 91241.4us
I20260709 13:02:09.643065  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:09.549752 12191 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:09.554647  9094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1056) took 2082 ms (client timeout 1682 ms). Trace:
I20260709 13:02:09.555964  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:09.525290  8331 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 5 to 7, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 7 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.505820  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:09.460507  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:09.560256  8475 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.698s (SENT)
W20260709 13:02:09.635798  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.302s	user 0.043s	sys 0.044s
I20260709 13:02:09.631119  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:09.469480 11762 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:09.559576 12230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.020s	sys 0.045s
W20260709 13:02:09.695573  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.362s	user 0.043s	sys 0.052s
I20260709 13:02:09.696830  8577 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:09.560024 12119 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:09.697350  9094 rpcz_store.cc:269] 0709 13:02:07.472227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.480052 (+  7825us) service_pool.cc:224] Handling call
0709 13:02:09.554356 (+2074304us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54004d44d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:09.554550 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4013537152}
W20260709 13:02:09.550326 11969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.030s	sys 0.034s
W20260709 13:02:09.705391  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 1.37147e+06us
I20260709 13:02:09.559347 12210 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:09.698243  8473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.014s	sys 0.076s
W20260709 13:02:09.707470  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.705811  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.052s	sys 0.159s
I20260709 13:02:09.706081  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:09.548646 12176 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:09.695278 12188 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.027s	sys 0.055s
I20260709 13:02:09.543623 12250 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.151s
W20260709 13:02:09.740737  8473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.014s	sys 0.076s
W20260709 13:02:09.713856  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 157974us
W20260709 13:02:09.742656  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 182404us
I20260709 13:02:09.744197 12207 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:09.726215 12113 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:09.748143  8474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.028s	sys 0.070s
W20260709 13:02:09.748618  8474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.362s	user 0.029s	sys 0.070s
W20260709 13:02:09.749413  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.750883  8547 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:09.738674 12080 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.752285 12080 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.756875 12079 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:09.757375 12079 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:09.760710 12113 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.761328 12113 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.761598  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:09.761802 12113 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.763921  8547 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:09.764986 12159 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.765393 12159 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.765805 12159 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.726223 12249 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.766467 12249 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.766839 12249 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.645767 12006 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.768009  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:09.768654  8510 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
W20260709 13:02:09.696316 12230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.027s	sys 0.045s
I20260709 13:02:09.769395 12250 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:09.706130 11813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.391s	user 0.055s	sys 0.046s
I20260709 13:02:09.720165 12119 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:09.770392 11813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.457s	user 0.055s	sys 0.047s
I20260709 13:02:09.779640 12244 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.780148 12244 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:09.781262  8510 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:09.776782 12198 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.782521 12198 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:09.783427 11989 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:09.727826  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.052s	sys 0.159s
I20260709 13:02:09.766578  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:09.784608 12198 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:09.768151 12006 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:09.721227  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60466 (request call id 20) took 2188 ms. Trace:
I20260709 13:02:09.765518  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:09.629384  9093 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
W20260709 13:02:09.698082 12123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.405s	user 0.022s	sys 0.081s
W20260709 13:02:09.740608 12188 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.027s	sys 0.059s
I20260709 13:02:09.591558 12025 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.153s
I20260709 13:02:09.638124 12187 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:09.646813 11993 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:09.739415  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.724200 11969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.031s	sys 0.039s
I20260709 13:02:09.783250  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:09.785228  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:09.786963  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:09.881429  8508 raft_consensus.cc:2368] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9.
W20260709 13:02:09.818195  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.825280  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.595517 12111 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 13:02:09.777058 12230 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.788123  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:09.788774  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:09.852591  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 87150.8us
I20260709 13:02:09.890295  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:09.890836  9093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 951) took 2279 ms (client timeout 2244 ms). Trace:
W20260709 13:02:09.853945  8433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.015s	sys 0.094s
W20260709 13:02:09.894824  8433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.340s	user 0.016s	sys 0.094s
I20260709 13:02:09.895506  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1925) took 2645 ms. Trace:
I20260709 13:02:09.850561  8505 rpcz_store.cc:276] 0709 13:02:07.516501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.676266 (+159765us) service_pool.cc:224] Handling call
0709 13:02:09.704475 (+2028209us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54003c5d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a19339853 00007f1a1e30760a 00007f1a1788d7d4 00007f1a1788d762 00007f1a1788d691 00007f1a1788d60c 00007f1a1788c8c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:09.704644 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3624150784}
W20260709 13:02:09.896245 12060 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.561s	user 0.049s	sys 0.063s
W20260709 13:02:09.891381  9093 rpcz_store.cc:269] 0709 13:02:07.611067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.054857 (+443790us) service_pool.cc:224] Handling call
0709 13:02:09.890605 (+1835748us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400500854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:09.890748 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2529135872}
W20260709 13:02:09.857220  9100 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.007s	sys 0.020s
I20260709 13:02:09.875432  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:09.902588  9100 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.007s	sys 0.021s
W20260709 13:02:09.883491  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.903613  8503 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:09.853192 12140 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:09.912617  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:09.887681  8506 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
W20260709 13:02:09.853163 12123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.560s	user 0.022s	sys 0.081s
I20260709 13:02:09.852583  8331 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 3 to 4, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 4 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.710439 12191 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:09.898258  8504 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:09.898145  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:09.192881  8333 rpcz_store.cc:269] 0709 13:01:43.348818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.362178 (+ 13360us) service_pool.cc:224] Handling call
0709 13:01:43.580582 (+218404us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5400020710. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621b0b2 00007f1a1f194a89 00007f1a1f12cda6 00007f1a1f0fe088 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc
0709 13:02:09.192233 (+25611651us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:04.928114 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:04.928876 (+   762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:04.928929 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:02:04.928953 (+    24us) tablet.cc:662] Decoding operations
0709 13:02:04.935243 (+  6290us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:04.935357 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:04.935406 (+    49us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:02:04.941668 (+  6262us) tablet.cc:701] Row locks acquired
0709 13:02:04.941738 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:02:04.942012 (+   274us) write_op.cc:270] Start()
0709 13:02:04.942258 (+   246us) write_op.cc:276] Timestamp: P: 1783602124941919 usec, L: 0
0709 13:02:04.942299 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:02:04.943323 (+  1024us) log.cc:844] Serialized 6634 byte log entry
0709 13:02:05.598410 (+655087us) op_driver.cc:464] REPLICATION: finished
0709 13:02:05.816016 (+217606us) write_op.cc:301] APPLY: starting
0709 13:02:05.816123 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:05.896258 (+ 80135us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:05.938892 (+ 42634us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:05.945066 (+  6174us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:05.945473 (+   407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:02:05.945515 (+    42us) write_op.cc:312] APPLY: finished
0709 13:02:05.946003 (+   488us) log.cc:844] Serialized 119 byte log entry
0709 13:02:06.013187 (+ 67184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.055133 (+ 41946us) write_op.cc:454] Released schema lock
0709 13:02:06.084143 (+ 29010us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:06.131728 (+ 47585us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.137535 (+  5807us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3605093,"reported_tablets":42,"spinlock_wait_cycles":28984064,"child_traces":[["op",{"apply.queue_time_us":212385,"apply.run_cpu_time_us":5439,"apply.run_wall_time_us":280321,"num_ops":17,"prepare.queue_time_us":263704,"prepare.run_cpu_time_us":18857,"prepare.run_wall_time_us":81817,"raft.queue_time_us":320967,"raft.run_cpu_time_us":33352,"raft.run_wall_time_us":206138,"replication_time_us":635155,"thread_start_us":584821,"threads_started":4,"wal-append.queue_time_us":122959,"wal-append.run_cpu_time_us":15737,"wal-append.run_wall_time_us":1896460}]]}
I20260709 13:02:09.895825  8433 rpcz_store.cc:276] 0709 13:02:07.250427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.253464 (+  3037us) service_pool.cc:224] Handling call
0709 13:02:07.303443 (+ 49979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.303704 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:07.453721 (+150017us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.861688 (+407967us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.528407 (+666719us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b1800463060. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:08.554408 (+ 26001us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b1800463060. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:02:09.895160 (+1340752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.895211 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:09.895258 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.895324 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.895453 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34017,"prepare.queue_time_us":104268,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":72,"raft.queue_time_us":54677,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":16321,"spinlock_wait_cycles":44136192,"thread_start_us":1877727,"threads_started":3,"wal-append.queue_time_us":579723,"wal-append.run_cpu_time_us":5072,"wal-append.run_wall_time_us":1374535}
I20260709 13:02:09.886642 12198 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.882380 12244 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:09.886067 11993 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:09.905766 12060 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.570s	user 0.050s	sys 0.064s
I20260709 13:02:09.885257 12187 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:09.955014  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 409395us
I20260709 13:02:09.957705  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:09.986187  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:09.959874  8435 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:09.963224  8427 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:09.974040  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:09.989379  8510 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.897012 12036 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:09.786479 12210 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:09.980667  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 312207us
I20260709 13:02:09.982513  8331 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 5 to 8, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 8 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.901753 11969 consensus_queue.cc:1243] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:09.903781 12266 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:09.992426  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:10.000941  8331 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 6 to 7, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 7 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:10.005546  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 262012us
I20260709 13:02:09.876605 12079 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:09.980023 12265 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.913188 12230 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:09.975477 11682 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:02:10.033732  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.037521  8549 connection.cc:256] RPC call timeout handler was delayed by -1.3931252119999726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 13:02:10.038084  8549 connection.cc:256] RPC call timeout handler was delayed by -1.0655252119999545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260709 13:02:10.009675 12263 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:10.040861  8331 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 6 to 8, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 8 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:10.011579 12266 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:10.066618 12176 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:10.066905 12266 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:09.976311 12198 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:10.071612 12198 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:10.072844 12078 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.001s
I20260709 13:02:10.004339 12036 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.025521 12080 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:10.077137 12036 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:10.059703 12079 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.063885 12210 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:10.065182 12191 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:10.065498 11877 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:10.125360  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:10.080838 12230 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:10.086676 12256 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:10.026501 12265 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:10.093885  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 366105us
I20260709 13:02:10.057546 12226 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:10.127085 12165 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
W20260709 13:02:10.120731  8475 connection.cc:256] RPC call timeout handler was delayed by -1.8571186539999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 13:02:10.050268 12263 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.133749 11877 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:10.155071  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:10.156082  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:10.180645  9093 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 11 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:10.157013  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:10.181421  9097 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.158252  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:10.163636  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:10.010915 12257 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.190169  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:10.199090  8398 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:10.164289 12265 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.164678 12226 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:10.207996  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:10.208998  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:10.209864  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:10.235620  8508 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.211057  8510 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:10.236299  8502 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:10.234810  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:10.237938  8505 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:10.213116  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.238164  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:10.238898  8427 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:10.239496  8430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:02:10.239612  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:10.240091  8430 raft_consensus.cc:606] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:10.240417  8507 raft_consensus.cc:2410] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:10.240424  8430 raft_consensus.cc:614] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:10.241705  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:10.246556  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:10.214082  8475 connection.cc:256] RPC call timeout handler was delayed by -1.675318653999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
I20260709 13:02:10.211310  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:10.169103 12165 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.126484 12159 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.189857 12263 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:10.229216  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:10.264273  8501 raft_consensus.cc:2410] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:10.229935  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:10.265374  8503 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.248723  8435 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:10.248819  8475 connection.cc:256] RPC call timeout handler was delayed by -1.6303186539999501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
I20260709 13:02:10.198385 12191 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:10.244032  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:10.267653  8475 connection.cc:256] RPC call timeout handler was delayed by -1.6132186539999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
I20260709 13:02:10.219978  8331 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 3 to 7, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 7 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.214946 12036 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:10.261595  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:10.244882 11886 consensus_meta.cc:287] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:02:10.271047  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:10.271216  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:10.283015  8434 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:10.283213  8427 raft_consensus.cc:2410] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:10.231963 12250 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:10.274490  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.287011  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.287595  8475 connection.cc:256] RPC call timeout handler was delayed by -1.5745186539999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 13:02:10.288087  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0903186539999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2643s for a response
I20260709 13:02:10.277911  8508 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:10.288394  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:10.288987  8433 raft_consensus.cc:2376] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8. Re-sending same reply.
I20260709 13:02:10.245796 12257 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.288100  8428 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:10.279206  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:10.281083  8430 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:10.306862  8426 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:02:10.307082  8475 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.692s (SENT)
I20260709 13:02:10.307495  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:10.313441  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 400877us
I20260709 13:02:10.320498  8503 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
W20260709 13:02:10.322373  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.323978  8505 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:10.320282  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:10.348462  8435 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:10.325496  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:10.328162  8398 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:10.332113  8579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.054s	user 0.007s	sys 0.026s
W20260709 13:02:10.351519  8579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.008s	sys 0.026s
W20260709 13:02:10.353615  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.355043  9065 leader_election.cc:400] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9.
I20260709 13:02:10.355700  9065 leader_election.cc:403] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:10.290771 12250 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.390190  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2212) took 2090 ms. Trace:
I20260709 13:02:10.358569  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:10.289939 11813 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:10.393546  8400 connection.cc:256] RPC call timeout handler was delayed by -1.4658478960000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:02:10.393613  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 65522.4us
I20260709 13:02:10.436172  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:10.390925  8579 rpcz_store.cc:276] 0709 13:02:08.299556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.299666 (+   110us) service_pool.cc:224] Handling call
0709 13:02:08.299910 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.300122 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:09.228681 (+928559us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.389637 (+1160956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:10.389711 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:10.389778 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.389895 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.390104 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37285,"prepare.queue_time_us":1452402,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":2051064,"threads_started":2}
I20260709 13:02:10.355069 12191 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:10.245636 12113 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.313442 12244 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.406013  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 98948.1us
I20260709 13:02:10.394819 12250 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:10.405809  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53320.7us
I20260709 13:02:10.448704  9065 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:10.409849  8575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.015s	sys 0.023s
W20260709 13:02:10.451128  8575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.015s	sys 0.023s
I20260709 13:02:10.425197  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:10.430459  8331 catalog_manager.cc:5697] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 3 to 4, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 4 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:10.286633 11886 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:10.303889 12210 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:02:10.437007  8400 connection.cc:256] RPC call timeout handler was delayed by -1.1798658640000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3009s for a response
I20260709 13:02:10.424264 12138 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:10.394382 12259 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:10.330180 12006 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.394001 12152 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.445909 12272 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.356253 11762 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
I20260709 13:02:10.457018  8432 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:10.503676  8429 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:02:10.397735 11993 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:10.462991  8400 connection.cc:256] RPC call timeout handler was delayed by -1.1118735860000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 13:02:10.442099  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:10.504971  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 62983.2us
I20260709 13:02:10.507866 12129 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:10.508539 12129 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:10.511221  8505 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:10.513638  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:10.514068  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:10.516305  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:10.328299 12226 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.466379  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:10.318981 12257 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.432776 12187 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:10.356797 12119 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:10.396217 12231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.013s	sys 0.035s
W20260709 13:02:10.471949  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.476591  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:10.568205 12231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.013s	sys 0.036s
I20260709 13:02:10.436048 12080 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9.
W20260709 13:02:10.568760  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.446662  8475 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.993s (SENT)
I20260709 13:02:10.569461  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:10.570683  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 124030us
W20260709 13:02:10.571841  8475 leader_election.cc:336] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.062s (SENT)
I20260709 13:02:10.572464 11886 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:10.572800 11762 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.485240  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 955) took 2188 ms. Trace:
I20260709 13:02:10.546463 12274 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:10.449807 12275 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:10.575210 12274 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:10.575436 12275 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:10.576226 12274 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.576635 12275 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.480046 11682 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:02:10.499905  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:10.578692 11682 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:10.579135 11682 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:10.470122 12188 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:10.579686 12188 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:10.580222 12188 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.580016 11682 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.581209 11682 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.521025  8433 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:10.521732  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:10.521754  8426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:02:10.583981  8426 raft_consensus.cc:606] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:10.584466  8426 raft_consensus.cc:614] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:10.448750 12230 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:02:10.444686 11813 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:10.555279  8428 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:10.558344 12006 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:10.529063 12115 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.447664 12252 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
W20260709 13:02:10.589778 12278 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.359s	user 0.001s	sys 0.001s
I20260709 13:02:10.566543  8507 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:02:10.611020  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 399740us
I20260709 13:02:10.509438 12129 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:10.396190 12025 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:02:10.573704 12159 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:10.493124  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.512621 12210 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.512908 12272 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.473469 12138 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.574215  9100 rpcz_store.cc:276] 0709 13:02:08.296893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.004863 (+707970us) service_pool.cc:224] Handling call
0709 13:02:09.184524 (+179661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.184974 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:09.902972 (+717998us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.409621 (+506649us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:10.409682 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:10.409741 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.409811 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.485052 (+ 75241us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540058c350. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:10.485175 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11258,"prepare.queue_time_us":130784,"prepare.run_cpu_time_us":2372,"prepare.run_wall_time_us":112126,"raft.queue_time_us":41832,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":10894,"spinlock_wait_cycles":411851008,"thread_start_us":1196213,"threads_started":2,"wal-append.queue_time_us":625743}
W20260709 13:02:10.583237  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 61583.1us
I20260709 13:02:10.631636  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:10.633075  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:10.587988  8475 leader_election.cc:336] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.105s (SENT)
W20260709 13:02:10.529562 12277 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:02:10.520324 12207 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.459416 12244 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.554291 12158 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:02:10.565531 12113 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:10.567477 12119 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:10.615679  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:10.676832  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 61222.2us
I20260709 13:02:10.599531 12281 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:10.620970  9068 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.009s	sys 0.006s
W20260709 13:02:10.689219  9068 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.009s	sys 0.007s
W20260709 13:02:10.689949  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 712508us
W20260709 13:02:10.621380  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.005s	sys 0.019s
I20260709 13:02:10.604153 12231 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.695513  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 449345us
I20260709 13:02:10.635915  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:10.546726 11993 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:02:10.648031  8476 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:10.698477  8549 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.514s (SENT)
W20260709 13:02:10.698939  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 50940.3us
I20260709 13:02:10.551662 12280 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
W20260709 13:02:10.621022 12249 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.854s	user 0.011s	sys 0.000s
I20260709 13:02:10.596141 12165 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:10.711588  8549 leader_election.cc:336] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.037s (SENT)
W20260709 13:02:10.686827  9097 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 13:02:10.712308  9097 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:10.594937 12191 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:10.626190 12266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.012s
I20260709 13:02:10.637871 12138 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:10.620471 12215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.016s
I20260709 13:02:10.707682  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:10.708132  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:10.755448  8584 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.710476  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:10.755851  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:10.678325  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:10.692751  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.005s	sys 0.020s
I20260709 13:02:10.713904  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:10.650396 12036 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:10.716493  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:10.765426  8579 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:10.672237 12080 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.720037  8508 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:10.647390 12115 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:10.705364 12021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.026s	sys 0.110s
I20260709 13:02:10.724922  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:10.728483  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 206379us
I20260709 13:02:10.709169  8583 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:02:10.756630  8582 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:10.757279  8578 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:10.672616 12207 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.694337 12187 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.769626  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:10.835057  8581 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:02:10.836253  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:10.772907  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:10.672398 12153 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:02:10.772475 12119 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:02:10.755069 12215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.004s	sys 0.016s
I20260709 13:02:10.776224 12080 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:10.776624 12021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.026s	sys 0.111s
W20260709 13:02:10.817860  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 106271us
I20260709 13:02:10.817972 12115 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:10.818267 12301 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.819100  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:10.809950  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 221978us
I20260709 13:02:10.861222  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:10.712925 12006 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.717381 12113 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.712575 12198 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:10.873215  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:10.762872  8577 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:10.825330  8584 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
W20260709 13:02:10.888918  9067 connection.cc:256] RPC call timeout handler was delayed by -3.9697619259999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
I20260709 13:02:10.889321  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:10.889967  8584 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.837718  8576 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:10.890924  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:10.724563 12266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.007s	sys 0.013s
I20260709 13:02:10.770103 12036 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:10.849618  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 204915us
I20260709 13:02:10.905700  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:10.773563 12281 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:10.831166  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:10.869731  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 168897us
I20260709 13:02:10.724563 12123 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:02:10.874508  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:10.719739 12249 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.915165  9102 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:10.913936  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:10.915680 12249 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:10.862192  8549 leader_election.cc:336] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.188s (SENT)
I20260709 13:02:10.916433  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:10.916551  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:10.917037  9102 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:02:10.917448  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55282.6us
I20260709 13:02:10.886409 12006 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:10.918068  8549 leader_election.cc:336] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.224s (SENT)
I20260709 13:02:10.918249  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:10.918476  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:10.918821  9101 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.919269 12006 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:10.793813  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 115518us
I20260709 13:02:10.920083  8550 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:10.829176 11993 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:10.920780 11993 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.921167 11993 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.910961 12036 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.713285 12231 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.926192  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:10.926453  9095 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:10.927109  8431 raft_consensus.cc:2368] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:02:10.927990 12231 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:10.874085  8475 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.135s (SENT)
I20260709 13:02:10.928728  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:10.929836  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55794.6us
I20260709 13:02:10.930660  8581 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:10.820230 12284 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.891583  8580 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:10.897985  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:10.931325 12284 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.908993  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:10.911486  8583 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:10.928547 12281 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:10.930593  8475 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.643s (SENT)
I20260709 13:02:10.773900 12159 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:02:10.970323  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:10.835270 12288 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.933724  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:10.886111 12198 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.969769  8584 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
W20260709 13:02:10.935822  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.914237  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:10.992957  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:10.967929  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47900.4us
I20260709 13:02:10.993613  8584 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:10.825479 12252 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.002458 12252 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.002805 11877 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.003504 12080 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:11.004058 12080 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:11.004657 12230 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:11.004885 12252 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:10.887099 12215 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.991478 12266 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:10.974732  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:10.977800  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:11.006855  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 76294.6us
W20260709 13:02:10.978196  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.893592  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:10.935243  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.010264  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.010710  9099 raft_consensus.cc:2368] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11.
I20260709 13:02:11.011459  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:10.851250 12187 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:10.914238  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:10.914582  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.053777  9094 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:10.997258 12295 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:02:10.998342 12159 consensus_queue.cc:1243] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:10.975134 12280 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:11.000809  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1935) took 1040 ms. Trace:
I20260709 13:02:10.931341 12119 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:11.057678  8429 rpcz_store.cc:276] 0709 13:02:09.960968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.961180 (+   212us) service_pool.cc:224] Handling call
0709 13:02:09.961555 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.504138 (+542583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.000558 (+496420us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b540028ffd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:11.000750 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246144896}
I20260709 13:02:11.001236 12281 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:11.001837 11813 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:11.059491  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.064690  9099 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:11.062250  9102 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:11.069459  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:11.069732  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 75563us
I20260709 13:02:10.914144 12257 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:10.991457 12198 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.070161  8584 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.074822  9100 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:11.095003  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.067417  9093 raft_consensus.cc:2368] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9.
I20260709 13:02:11.092712  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.004063 11877 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.976284 12300 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:11.094218  8577 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:11.096719  8583 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:11.057528 12259 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:11.013558 12266 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:10.975359 12308 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.164s
I20260709 13:02:11.101011  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.072470 12165 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:11.065254  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:11.112840  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 203898us
I20260709 13:02:11.056910 12088 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.103461  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.117297  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.005709 12215 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:11.097803 12293 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.482s	user 0.000s	sys 0.001s
I20260709 13:02:11.099373  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:11.095920 12257 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:11.123915  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.131999  9100 raft_consensus.cc:2368] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10.
I20260709 13:02:11.132875  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:10.886583 12301 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:11.135963  8584 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:11.134733  9101 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:11.137368  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.107401 12140 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:11.130784 12297 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 13:02:11.134572  8549 leader_election.cc:336] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.793s (SENT)
I20260709 13:02:11.138175  9100 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:02:11.140043  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.142454  8547 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:11.143704  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:11.119590 12272 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:11.103650 12115 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.138217  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.145541  8582 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
W20260709 13:02:11.178369  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 64696.3us
I20260709 13:02:11.182230  9094 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:11.156394  9098 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:02:11.173267  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:11.106259 12252 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:02:11.131167 12088 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:11.372438 12138 consensus_meta.cc:287] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.000s
W20260709 13:02:11.171228 12291 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:11.147203 12187 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:11.379416  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:11.373116  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:11.317961  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 218649us
I20260709 13:02:11.380538  9100 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:02:11.365578 12198 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:11.381336  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.139911 12210 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:11.147387 12111 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:11.382217  8429 raft_consensus.cc:2410] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:02:11.162879 12292 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.265s	user 0.000s	sys 0.000s
I20260709 13:02:11.382493 12111 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:11.380672  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1988) took 1919 ms. Trace:
I20260709 13:02:11.382920 12111 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.383168 12198 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:11.379310 12138 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:11.383015  8575 rpcz_store.cc:276] 0709 13:02:09.461026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.461129 (+   103us) service_pool.cc:224] Handling call
0709 13:02:09.461387 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.787212 (+325825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.787253 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.787807 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.451534 (+663727us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:10.451574 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.513163 (+ 61589us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54003df9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:10.513206 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.380402 (+867196us) raft_consensus.cc:1685] finished
0709 13:02:11.380419 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.380618 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748619136,"thread_start_us":554165,"threads_started":1,"wal-append.queue_time_us":1107130}
I20260709 13:02:11.384402  8430 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:11.384972  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:11.385243 12088 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:11.385577  8575 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:11.385998 12138 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:11.162424 12290 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
I20260709 13:02:11.381210 12187 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:11.145349 12300 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.318902 12165 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.142980 12244 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:11.386569  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:11.387392 12300 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:11.388321  8575 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:11.388546  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.145134 12266 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:11.390184  9068 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.603s (SENT) [suppressed 29 similar messages]
I20260709 13:02:11.282085 12302 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:11.387154 12187 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.214066  9101 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:11.152428 12250 consensus_meta.cc:287] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.679s	user 0.004s	sys 0.004s
I20260709 13:02:11.392398  9101 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:02:11.170511 12296 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 13:02:11.392681 12187 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:11.306831  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2093) took 1059 ms. Trace:
I20260709 13:02:11.146510 12301 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:11.273577  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 131177us
I20260709 13:02:11.394004  9094 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:11.394654  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:11.147754 12286 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:11.395395 12301 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:11.180881 12309 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.256s
I20260709 13:02:11.300328  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:11.396503  9098 pending_rounds.cc:85] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 8
I20260709 13:02:11.396708  8580 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:11.155756 12215 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:11.167335 12036 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:11.400386  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.400928  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.397895  8580 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:11.401849 12036 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:11.402004  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:11.402113  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:11.403117  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.403411  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:11.163416 12299 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:02:11.297317  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 288304us
I20260709 13:02:11.215363  9102 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:02:11.214787  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 80220.1us
I20260709 13:02:11.409215  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:11.410213  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.410887  9102 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.161285 12060 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:11.393525  8431 rpcz_store.cc:276] 0709 13:02:10.247480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.247614 (+   134us) service_pool.cc:224] Handling call
0709 13:02:11.306533 (+1058919us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400126e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:11.306723 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456230656}
I20260709 13:02:11.398478  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.398890  8547 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:11.423312  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.425173  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 493263us
I20260709 13:02:11.427173  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:11.156493 12188 consensus_meta.cc:287] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 13:02:11.399807  8434 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:11.432269  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.415665  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.433965  8426 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:11.416906  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:11.282564 12283 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
W20260709 13:02:11.148983 12263 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.863s	user 0.008s	sys 0.000s
I20260709 13:02:11.435429 12263 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.438410  9096 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:11.438983  9102 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:11.439383 12263 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:11.432235 12078 raft_consensus.cc:2764] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:11.440412  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.441118  8580 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:11.441716 12309 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:11.426860  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.000s	sys 0.011s
I20260709 13:02:11.397253  9098 pending_rounds.cc:107] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:02:11.443222  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.443555  9098 raft_consensus.cc:2889] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.443883  8432 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:11.389848 12300 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:11.428659  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:11.447510 12153 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:02:11.449424 12113 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.000s
I20260709 13:02:11.152128 11993 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:11.443252  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.000s	sys 0.011s
W20260709 13:02:11.450655 12310 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:11.449872 12113 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:11.454510  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.147151 12288 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.309s
I20260709 13:02:11.455617  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.456228  8433 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:11.456749 12188 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.457324  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:11.452312 11993 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:11.456676 11969 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:11.459077 11969 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:11.459199 12188 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:11.459659 12268 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.561s	user 0.002s	sys 0.000s
I20260709 13:02:11.460122 12198 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:02:11.459996 11969 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.461210  8578 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:11.461604  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:11.462396  8504 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:11.464134  8579 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:11.465416  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:11.433200 12302 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:11.449725  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:11.466715  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:11.467147 12079 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.341s	user 0.011s	sys 0.000s
I20260709 13:02:11.487751  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:11.392719 12250 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.432346  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.442216  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:11.491695  8580 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:11.492678  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:11.446748 12078 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:11.492774  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.469648 12244 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:11.469660  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.470247 12111 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:11.490016 12021 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.227681 12231 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:11.499460  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:11.500154  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:11.500602  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:11.501242  8503 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:11.502239  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:11.502913  8510 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.474547  9099 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:11.506315  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.429173  8431 pending_rounds.cc:85] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 6
I20260709 13:02:11.506744  8431 pending_rounds.cc:107] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:02:11.507098  8431 raft_consensus.cc:2889] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.472569 11969 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.459831 12188 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:11.481922  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:11.481359  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.386157 12284 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:11.484746  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:11.463704 12265 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.218s	user 0.009s	sys 0.001s
I20260709 13:02:11.442680 12312 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.467756  8501 raft_consensus.cc:2410] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:11.493647  8580 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.419883 12060 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:11.500731  8502 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.455659  9097 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:11.477116 12210 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:02:11.833101  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 1948) took 1365 ms. Trace:
I20260709 13:02:11.778620  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:11.837236  8430 rpcz_store.cc:276] 0709 13:02:10.467820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.476352 (+  8532us) service_pool.cc:224] Handling call
0709 13:02:11.832821 (+1356469us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b5400127d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:11.833017 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875723136}
I20260709 13:02:11.654760  8547 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:11.581950  8550 leader_election.cc:336] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.523s (SENT)
I20260709 13:02:11.668395  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:11.839742  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 257825us
I20260709 13:02:11.573545  8510 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:02:11.840312  8575 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:11.693615  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:11.692981  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2302) took 1435 ms. Trace:
I20260709 13:02:11.838044  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:11.843101  8507 rpcz_store.cc:276] 0709 13:02:10.257405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.271494 (+ 14089us) service_pool.cc:224] Handling call
0709 13:02:10.306351 (+ 34857us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.621144 (+314793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.692656 (+1071512us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400153954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:11.692903 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597539072}
I20260709 13:02:11.589960  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:11.567718  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 68598.7us
I20260709 13:02:11.754067  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.846135  9098 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:11.590531  8583 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.668675  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:11.847554  8576 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:11.841907  8428 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.848768  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:11.849455  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 194781us
I20260709 13:02:11.567289  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.599917  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.510653  8433 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:11.845233  8584 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:11.830677  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 183141us
I20260709 13:02:11.841292  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:11.852921  8510 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
W20260709 13:02:11.853397  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.853863  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:11.854310  8549 leader_election.cc:336] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.831s (SENT)
I20260709 13:02:11.569582  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:11.655580  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 761) took 1340 ms. Trace:
I20260709 13:02:11.710489  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:11.640547  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.844460  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.554680  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:11.886574  8504 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.887866  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:11.888960  8503 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:11.679380  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:11.843755  8506 raft_consensus.cc:2410] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:11.769529  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:11.881798  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:11.868556  8508 rpcz_store.cc:276] 0709 13:02:10.315026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.315219 (+   193us) service_pool.cc:224] Handling call
0709 13:02:11.655330 (+1340111us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54001fc054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:11.655498 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":751539456}
W20260709 13:02:11.837922  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 59431.6us
I20260709 13:02:11.849334  8576 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:11.893890  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:11.895148  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:11.896289  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:11.895853  8576 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:11.896615  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.884223  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.887925  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.890198  8581 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.854288  8547 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:11.882431  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:11.899483  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 45275.4us
W20260709 13:02:11.736960 12287 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:02:11.897264  8430 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:11.909545  8502 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:11.910320  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.900858  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:11.911369  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:11.753496 12325 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.920866  9101 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:11.902207  8506 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:02:11.675161 12269 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.056s	user 0.000s	sys 0.006s
W20260709 13:02:11.905352  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.905742  8505 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:11.896893  8426 raft_consensus.cc:2376] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8. Re-sending same reply.
I20260709 13:02:11.579423 12302 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:11.906975  8503 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:11.830900 12275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.004s	sys 0.019s
I20260709 13:02:11.883076 12284 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.512609 11682 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.914s	user 0.012s	sys 0.002s
W20260709 13:02:11.962664 12327 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:02:11.963925  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 998) took 1063 ms. Trace:
I20260709 13:02:11.901546  9099 raft_consensus.cc:2368] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:02:11.912115  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:11.928293 12318 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:11.966001  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.966270 12159 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:11.966475 12318 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.966714 12159 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:11.965690  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53638.5us
I20260709 13:02:11.966939 12318 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.967011  9093 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:11.968472  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1001) took 1066 ms. Trace:
I20260709 13:02:11.495671 12244 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:11.968776  9093 rpcz_store.cc:276] 0709 13:02:10.902452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.117032 (+214580us) service_pool.cc:224] Handling call
0709 13:02:11.968323 (+851291us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b540007b054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:11.968418 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952233216}
I20260709 13:02:11.969467 12159 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:11.969939  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.971002  9093 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:11.971923  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.753800 12282 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.973158  9096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 961) took 1848 ms (client timeout 2006 ms). Trace:
I20260709 13:02:11.972867 12282 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.974308 12025 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:11.975188 12025 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:11.975085 12302 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.976259 12025 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:11.977064 12266 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:11.755741 12036 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.977464 12266 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:11.977896 12036 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.938730 12325 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:11.877949 12312 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:11.978884  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.979524  9094 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:11.980046 12036 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:11.807770 12250 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:11.980288 12325 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:11.638942 12198 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.283s
I20260709 13:02:11.692796 12263 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.235s
I20260709 13:02:11.926750  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:12.002674  8579 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.003373  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.928014  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:11.757193  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:11.656854 12226 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.923842  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.893499 12281 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:11.881477 12313 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:11.911917  8430 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:11.728979 12187 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:12.028133  8430 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:12.030186  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:11.960681  8504 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:11.931402 12078 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:02:11.949335 12275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.005s	sys 0.019s
I20260709 13:02:11.964287  9100 rpcz_store.cc:276] 0709 13:02:10.900570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.389612 (+489042us) service_pool.cc:224] Handling call
0709 13:02:11.389921 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.390262 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.390287 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.390676 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.482417 (+ 91741us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.482474 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.482560 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.963697 (+481137us) raft_consensus.cc:1685] finished
0709 13:02:11.963716 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.963866 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":91335,"threads_started":1,"wal-append.queue_time_us":344933}
I20260709 13:02:11.975215 12282 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:11.762691 12298 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:11.966755  9099 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:11.678490 12207 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:11.757633 12261 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.908272 12301 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:11.980356  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.982561  9093 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:11.919342  8584 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 5.
I20260709 13:02:11.955026  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:12.067348  8507 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:12.068374  8507 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:11.986980  8428 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
W20260709 13:02:11.973555  9096 rpcz_store.cc:269] 0709 13:02:10.124493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.124961 (+   468us) service_pool.cc:224] Handling call
0709 13:02:11.972984 (+1848023us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400560ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:11.973102 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2885448576}
I20260709 13:02:11.993430  8509 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:02:12.071424  8509 pending_rounds.cc:85] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 5
I20260709 13:02:12.071671  8509 pending_rounds.cc:107] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:12.071906  8509 raft_consensus.cc:2889] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.761232 12176 raft_consensus.cc:3055] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:11.997679  8581 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:12.082290  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:12.082953  8428 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:12.083839  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:12.084863  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:12.000744  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:12.085994  8433 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.008188  8550 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:12.005864  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:12.009460  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 308092us
I20260709 13:02:12.088066  8434 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:12.089293  8434 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:12.041548 12111 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:11.506894 12021 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:12.104063  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 95944.8us
I20260709 13:02:12.094352  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:12.105087  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:12.105557  8584 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:12.106161  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:12.013672  8505 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:12.113336  8428 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:02:12.114045  8428 pending_rounds.cc:85] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 8
I20260709 13:02:12.114423  8428 pending_rounds.cc:107] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:02:12.114815  8428 raft_consensus.cc:2889] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:12.116629  8428 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:02:11.931996 12165 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.017776  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:12.018010  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:12.124182  8398 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:12.022863  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:12.131054  9102 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.131229  9093 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:12.132576  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.132056  8433 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:12.133601  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:12.024111  9095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.002s	sys 0.021s
W20260709 13:02:12.134600  9095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.003s	sys 0.022s
I20260709 13:02:12.032734 12187 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:12.030989  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:12.140594  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 122881us
I20260709 13:02:12.026489  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:12.141487  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:12.032413  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:11.948150  8580 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:12.035197 11682 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:12.035290  8504 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:11.969099 12244 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:11.877472 12265 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:12.036410  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:12.037597  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 1995) took 1320 ms. Trace:
I20260709 13:02:12.144573  8503 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:12.144961  8582 rpcz_store.cc:276] 0709 13:02:10.717186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.838119 (+120933us) service_pool.cc:224] Handling call
0709 13:02:12.037412 (+1199293us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400349254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:12.037537 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590573312}
I20260709 13:02:12.007186 12250 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.925228 12317 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.098s
W20260709 13:02:12.045542  8429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.010s	sys 0.014s
W20260709 13:02:12.156965  8429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.010s	sys 0.015s
I20260709 13:02:12.040624  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:12.047008  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:12.056049  9067 connection.cc:256] RPC call timeout handler was delayed by -1.0588608109999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:02:12.158070  9067 connection.cc:256] RPC call timeout handler was delayed by -1.0030608110000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 13:02:12.058971  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.023885 12210 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:12.002566 12312 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:12.072253  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.189800  9094 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:12.190321  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:12.190572  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:12.191004  9094 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 5. Current term is 6. Ops: [4.7-5.8]
I20260709 13:02:12.192073  9094 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:12.192238  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2220) took 1436 ms. Trace:
I20260709 13:02:12.193186  9094 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:02:12.077626  9099 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:12.078404  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:12.195344  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.195724  9101 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:12.196777  9101 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:12.033813 12313 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:12.010627  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:12.197897  8426 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.092442  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:12.198529  8581 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:12.094300  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.199865  9096 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:12.149489 11682 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:12.094496 12307 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:12.097862  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:12.200913 11682 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:12.202134 11682 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.203078 12313 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:12.143347 12111 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:02:11.994405 12284 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:12.117105  8434 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:12.014202  8435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.009s	sys 0.029s
W20260709 13:02:12.299180  8435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.010s	sys 0.029s
W20260709 13:02:12.123240  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 240847us
I20260709 13:02:12.137424  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:11.991534 12215 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:12.152209 12315 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:12.079974 12176 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:12.151295  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:12.330047  8580 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:12.141698  8506 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.144634  8430 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:02:12.152786  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 121832us
I20260709 13:02:12.143230  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.086580 12301 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:12.188612  9097 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:02:12.359192  9097 pending_rounds.cc:85] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 5
I20260709 13:02:12.359496  9097 pending_rounds.cc:107] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:02:12.359740  9097 raft_consensus.cc:2889] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:12.138586 12152 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:12.138406 12280 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:12.055047 12298 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:12.126534 12322 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.069272 12261 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:12.040931 12266 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:12.206358  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 108641us
I20260709 13:02:12.371308  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:12.278420  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.251766  8426 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:12.192687  8584 rpcz_store.cc:276] 0709 13:02:10.755738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.191414 (+1435676us) service_pool.cc:224] Handling call
0709 13:02:12.191709 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.191889 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.191931 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.191978 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:12.192017 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.192077 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.192181 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:12.285912  9102 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:12.138885 12274 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:12.288796  8502 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:12.288321  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 147619us
I20260709 13:02:12.138702 12252 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:12.297673  8575 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:12.300792  9065 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:12.393078  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 92374.4us
I20260709 13:02:12.282197 12210 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:12.138919  8505 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:12.308809  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2216) took 1584 ms. Trace:
I20260709 13:02:12.402863  8577 rpcz_store.cc:276] 0709 13:02:10.724738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.446203 (+721465us) service_pool.cc:224] Handling call
0709 13:02:11.446995 (+   792us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.493957 (+ 46962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.493999 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.682876 (+188877us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b2c0003d068. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:02:11.683453 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.012745 (+329292us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:12.281352 (+268607us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.281801 (+   449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.281912 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.281969 (+    57us) raft_consensus.cc:1685] finished
0709 13:02:12.308593 (+ 26624us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.308749 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195429,"raft.queue_time_us":46785,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":80366,"spinlock_wait_cycles":4427520,"thread_start_us":591241,"threads_started":2,"wal-append.queue_time_us":402755}
I20260709 13:02:12.336704  8429 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:12.332854  9095 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:12.364522  9099 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:12.387142  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:12.138846 12165 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:12.251413 12078 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:12.156240 12140 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.214s
I20260709 13:02:12.394120  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:12.184911 12231 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:12.390569  8550 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:12.329242 12315 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:12.426088  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 284670us
I20260709 13:02:12.426465  8433 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:12.426855  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:12.186193 12250 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:12.442480 12152 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:12.446915 12152 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:12.447773  8575 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:12.448479  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 592) took 1518 ms. Trace:
I20260709 13:02:12.448799  8575 rpcz_store.cc:276] 0709 13:02:10.930241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.447255 (+1517014us) service_pool.cc:224] Handling call
0709 13:02:12.447590 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.448208 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.448423 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:12.450225  8583 consensus_meta.cc:287] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.002s
I20260709 13:02:12.393083 12325 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:12.450404  8581 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:12.398788 12252 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.450619  8583 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:12.429131  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:12.307675 12320 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
W20260709 13:02:12.458361  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67877.7us
W20260709 13:02:12.487298  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 58255us
I20260709 13:02:12.488050  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:12.490124  8506 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:12.399292 12342 raft_consensus.cc:2764] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:12.487596  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:12.424366 12336 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:02:12.435868  8502 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:12.510339  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:12.420717 12078 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:12.429279 12312 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:12.430521 12315 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:12.432384  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:12.499197  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:12.481295 12159 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.000s
W20260709 13:02:12.478860 12318 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 13:02:12.421032 12280 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:12.546111  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 113795us
I20260709 13:02:12.485005 12261 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:12.467990 12284 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:12.466048 12231 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:12.498014 12115 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:12.560925  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 228602us
W20260709 13:02:12.544543  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 45438.1us
I20260709 13:02:12.482918 12187 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:12.466950 12265 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:12.495025  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2226) took 1046 ms. Trace:
W20260709 13:02:12.570628  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 386370us
I20260709 13:02:12.570716  8575 rpcz_store.cc:276] 0709 13:02:11.407504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.449591 (+1042087us) service_pool.cc:224] Handling call
0709 13:02:12.449891 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.453173 (+  3282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.453211 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.453274 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:12.453336 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.453419 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.453561 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:12.450318 12317 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:12.572551  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:12.572804  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:12.573460  9102 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.573603  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:12.574525  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.574764  9097 raft_consensus.cc:2368] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9.
I20260709 13:02:12.419718 12036 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:12.509231 12025 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:12.492925 12252 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.514067 12307 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:12.392818 12207 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.159s
I20260709 13:02:12.516789 12078 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.470249 12301 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:12.549998 12342 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:12.545437 12176 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:12.565750  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.492303 12198 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:02:12.545514 12313 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:12.443452 12322 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:12.573396  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:12.596280  9093 raft_consensus.cc:2376] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8. Re-sending same reply.
I20260709 13:02:12.576231  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:12.576416  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.521838 12111 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:02:12.578251  9095 raft_consensus.cc:2368] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11.
I20260709 13:02:12.580114  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:12.458714 12210 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:12.588440  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.606678  9101 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 5: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:12.589000  9102 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:12.552712  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:12.608258  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 55679.3us
I20260709 13:02:12.609241  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:12.589098  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:12.577877 12317 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.610662  9100 raft_consensus.cc:2376] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9. Re-sending same reply.
I20260709 13:02:12.545296 12159 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:12.563160 12115 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:12.549722 12318 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:12.615579  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.615650  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:12.571878 12231 raft_consensus.cc:697] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:12.611462  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:12.581588 11969 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.000s
I20260709 13:02:12.600440  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.603613  9096 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:12.618185 12284 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:12.616456  9094 raft_consensus.cc:2376] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10. Re-sending same reply.
I20260709 13:02:12.606303 12176 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.636083  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.637004  9101 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:12.622939  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.628461  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.620262  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.638876  9100 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:12.631211  9095 raft_consensus.cc:2368] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8.
I20260709 13:02:12.640674  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:12.619143 12187 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:12.617012 12317 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.619163 12342 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:12.618811 12313 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:12.618884 12115 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:12.634227 12210 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.646647 12312 raft_consensus.cc:2764] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:12.670697 12318 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:12.653769 12187 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.673408 12187 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:12.621326 12280 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:12.678742 12250 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:12.708492 12244 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
I20260709 13:02:12.741919 12244 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:12.729269 12313 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:12.762522 12252 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:12.817440  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.935328  9100 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:12.936730  8584 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:12.937469 12252 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:12.822885  8510 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:12.587106  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.593756  8579 consensus_meta.cc:287] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.000s
I20260709 13:02:12.846962  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2221) took 2090 ms. Trace:
I20260709 13:02:12.852006  8575 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:12.853391  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 209270us
W20260709 13:02:12.739871 12226 consensus_meta.cc:287] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.001s
I20260709 13:02:12.740464 12231 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:12.763737 12244 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:12.753517 12315 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:12.765400 12317 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:12.924043  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:12.926700 11682 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:12.929219 12342 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:12.931481  9095 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:02:12.937563  9100 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:12.563951  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 191223us
I20260709 13:02:12.983634  9102 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:02:13.489337  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.203722  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.386467  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 591) took 2456 ms. Trace:
I20260709 13:02:13.387494  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2308) took 1383 ms. Trace:
W20260709 13:02:13.246213  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 109352us
I20260709 13:02:13.200464  8508 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:13.080169  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.210390  8507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.002s	sys 0.009s
I20260709 13:02:13.183547  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2109) took 1127 ms. Trace:
I20260709 13:02:13.614933  8510 rpcz_store.cc:276] 0709 13:02:12.004337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.004594 (+   257us) service_pool.cc:224] Handling call
0709 13:02:12.004928 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.962785 (+957857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.387112 (+424327us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b5400154354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:13.387369 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879463808}
I20260709 13:02:13.628674  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:13.630101  8502 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:12.974226  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:13.639722  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1026) took 1060 ms. Trace:
I20260709 13:02:13.640995 12355 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:13.640314  9094 rpcz_store.cc:276] 0709 13:02:12.579177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.630085 (+ 50908us) service_pool.cc:224] Handling call
0709 13:02:12.630450 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.630708 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:12.854640 (+223932us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.298613 (+443973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.325991 (+ 27378us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:13.574009 (+248018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.622566 (+ 48557us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.639557 (+ 16991us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58839,"prepare.queue_time_us":311045,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":112288,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":15875,"thread_start_us":204361,"threads_started":1}
I20260709 13:02:13.641795 12355 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.204630 11877 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.644522 12355 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:13.644399 11877 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.647074 11877 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:13.648278 12252 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:13.700830 11886 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:13.701231 12252 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.701627 11886 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:13.702735  8583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 590) took 2772 ms (client timeout 1909 ms). Trace:
I20260709 13:02:13.703685 12252 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:13.703315  8583 rpcz_store.cc:269] 0709 13:02:10.929601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.172953 (+243352us) service_pool.cc:224] Handling call
0709 13:02:13.702175 (+2529222us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540009ae54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:13.702417 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423745408}
I20260709 13:02:13.706614  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:13.708894  8578 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:13.709508 12078 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.113s	user 0.003s	sys 0.015s
I20260709 13:02:13.675464  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:13.663182  8579 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:13.215140 12191 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:13.680560  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.208750 12021 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:13.114871 11813 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:13.515359 12298 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.682374  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:13.682904  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2317) took 1611 ms. Trace:
I20260709 13:02:13.683388  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2222) took 2918 ms. Trace:
I20260709 13:02:13.719689 12275 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:13.684942 12060 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:13.721432 12060 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.723241 12266 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:13.382174 12325 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:13.725714 12325 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:13.726229 12078 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.675609  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1116) took 1692 ms. Trace:
I20260709 13:02:13.726960 12325 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.728036 12298 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.693894  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2108) took 1770 ms. Trace:
I20260709 13:02:13.718266  8507 rpcz_store.cc:276] 0709 13:02:12.072012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.072666 (+   654us) service_pool.cc:224] Handling call
0709 13:02:12.072987 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.073189 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.073211 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.505248 (+432037us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b2c0005c2d8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:02:12.515282 (+ 10034us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.682271 (+1166989us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:13.682362 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.682476 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.682539 (+    63us) raft_consensus.cc:1685] finished
0709 13:02:13.682549 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.682843 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17472256,"thread_start_us":1111654,"threads_started":1,"wal-append.queue_time_us":437509}
I20260709 13:02:13.728763  8428 rpcz_store.cc:276] 0709 13:02:11.923348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.115929 (+192581us) service_pool.cc:224] Handling call
0709 13:02:12.116313 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.129701 (+ 13388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.693116 (+1563415us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b5400251820. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b6dc0 00007f1a19342a02 00007f1a1933edd6 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:02:13.693671 (+   555us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14130944}
I20260709 13:02:13.719362  8581 rpcz_store.cc:276] 0709 13:02:10.765233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.199131 (+1433898us) service_pool.cc:224] Handling call
0709 13:02:12.450154 (+251023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.488563 (+ 38409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.683075 (+1194512us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400155750. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:13.683246 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576510848}
I20260709 13:02:13.732028  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2228) took 2298 ms. Trace:
I20260709 13:02:13.732348  8581 rpcz_store.cc:276] 0709 13:02:11.434149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.730766 (+2296617us) service_pool.cc:224] Handling call
0709 13:02:13.731247 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.731642 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.731668 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.731729 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:13.731763 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.731820 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.731950 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.672686  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:13.727681  9098 rpcz_store.cc:276] 0709 13:02:11.982979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.196171 (+213192us) service_pool.cc:224] Handling call
0709 13:02:12.196446 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.196840 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:12.306766 (+109926us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.926629 (+619863us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.927783 (+  1154us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.928007 (+   224us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:13.006537 (+ 78530us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.674562 (+668025us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400595220. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192ba733 00007f1a1933fdbf 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c
0709 13:02:13.674645 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.674864 (+   219us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.675057 (+   193us) raft_consensus.cc:1685] finished
0709 13:02:13.675081 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.675321 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13717,"prepare.queue_time_us":334472,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":38038,"raft.queue_time_us":9983,"raft.run_cpu_time_us":562,"raft.run_wall_time_us":42225,"spinlock_wait_cycles":247626496,"thread_start_us":579881,"threads_started":2,"wal-append.queue_time_us":569902}
I20260709 13:02:13.735826  8580 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:13.381187 12324 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:13.144009 12159 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:13.700342  9096 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:13.612102  8582 rpcz_store.cc:276] 0709 13:02:10.756019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.191535 (+1435516us) service_pool.cc:224] Handling call
0709 13:02:12.191821 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.192013 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.192036 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.192486 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.548588 (+356102us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:12.548640 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.548758 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.846165 (+297407us) raft_consensus.cc:1685] finished
0709 13:02:12.846227 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.846667 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":355709,"threads_started":1,"wal-append.queue_time_us":460044}
I20260709 13:02:13.703773 11886 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:13.652724  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1927) took 2016 ms. Trace:
I20260709 13:02:13.708535  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:13.656517  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:13.668841  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.627490  8433 rpcz_store.cc:276] 0709 13:02:11.954377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.133448 (+179071us) service_pool.cc:224] Handling call
0709 13:02:12.133680 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.426813 (+293133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.081396 (+654583us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54003f2d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:13.081961 (+   565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672571776}
I20260709 13:02:13.380131 12322 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:13.614410  8584 rpcz_store.cc:276] 0709 13:02:10.929946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.429164 (+1499218us) service_pool.cc:224] Handling call
0709 13:02:12.459625 (+ 30461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.937288 (+477663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.386084 (+448796us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54000663d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:13.386384 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095970176}
W20260709 13:02:13.633898 12115 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.959s	user 0.010s	sys 0.001s
I20260709 13:02:13.720027  8510 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.720893 12275 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.726688 11813 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.728135 12325 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:13.684134 12343 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:13.686446 12306 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.689178 12165 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:13.736486  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 1999) took 2224 ms. Trace:
W20260709 13:02:13.385291 12333 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.056s	user 0.000s	sys 0.001s
I20260709 13:02:13.726256 12312 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:13.780118  8580 rpcz_store.cc:276] 0709 13:02:11.511954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.735097 (+2223143us) service_pool.cc:224] Handling call
0709 13:02:13.735559 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.736218 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.736435 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.758910 12324 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:13.738447  8577 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:13.745404  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2233) took 2273 ms. Trace:
W20260709 13:02:13.756986  8579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2235) took 2284 ms (client timeout 2998 ms). Trace:
I20260709 13:02:13.760942  8509 rpcz_store.cc:276] 0709 13:02:11.636380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.636588 (+   208us) service_pool.cc:224] Handling call
0709 13:02:11.637023 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.072308 (+435285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.652179 (+1579871us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400059bd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:13.652540 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790861056}
I20260709 13:02:12.983434 12187 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.714351 12191 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:13.768567  8502 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.732365 12078 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:13.781591  8434 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:13.781946 12079 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:13.783918  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.770779 12322 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.786046  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:13.787465  8581 rpcz_store.cc:276] 0709 13:02:11.471557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.733359 (+2261802us) service_pool.cc:224] Handling call
0709 13:02:13.733823 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.744988 (+ 11165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.745015 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.745075 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:13.745125 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.745191 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.745318 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:13.787999  8579 rpcz_store.cc:269] 0709 13:02:11.472125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.894952 (+422827us) service_pool.cc:224] Handling call
0709 13:02:13.756877 (+1861925us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.772109 12115 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:13.786688 12312 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:13.791025  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 739) took 2383 ms. Trace:
I20260709 13:02:13.798311  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:13.782847 12230 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.772102 11886 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.794413 12079 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:13.782238 12300 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:13.811902  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:13.812353  9093 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:13.822233 12275 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:13.822000 12079 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.821857 12230 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.823354 12079 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:13.814841  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:13.812511 12312 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.825151 12187 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:13.825201 12312 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.815472  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:13.799345  8431 rpcz_store.cc:276] 0709 13:02:11.402975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.428629 (+ 25654us) service_pool.cc:224] Handling call
0709 13:02:11.428969 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.507740 (+ 78771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.507804 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.553965 (+ 46161us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.993402 (+439437us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:12.006039 (+ 12637us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.038550 (+ 32511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.038625 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.384164 (+1345539us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:13.786087 (+401923us) raft_consensus.cc:1685] finished
0709 13:02:13.786201 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.786384 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35317,"prepare.queue_time_us":9970,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":32548,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":19690,"spinlock_wait_cycles":126632192,"thread_start_us":439066,"threads_started":1,"wal-append.queue_time_us":584468}
I20260709 13:02:13.813588 12300 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:13.831763  8509 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:13.819981 12317 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:13.838398  8510 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:13.809836 12306 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:13.836930 12302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.703s	user 0.054s	sys 0.097s
I20260709 13:02:13.847185  8580 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:02:13.851962  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2007) took 2033 ms. Trace:
I20260709 13:02:13.852572  8580 rpcz_store.cc:276] 0709 13:02:11.818791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.801236 (+1982445us) service_pool.cc:224] Handling call
0709 13:02:13.838615 (+ 37379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.851527 (+ 12912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.851854 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.847335  8509 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:13.852192 12367 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:13.852725 12187 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:13.854993  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 179708us
I20260709 13:02:13.852725 12300 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:13.854455 12210 consensus_meta.cc:287] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.137s	user 0.007s	sys 0.013s
I20260709 13:02:13.836771 11682 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.856477  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:13.851140 12302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.788s	user 0.055s	sys 0.098s
I20260709 13:02:13.855513 12187 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:13.864013  8510 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:02:13.829936 12322 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.857863 12317 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:13.867180  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:13.847802 11886 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.858063 12370 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.876984  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2227) took 2458 ms. Trace:
I20260709 13:02:13.874315  8549 leader_election.cc:400] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:02:13.878711  8549 leader_election.cc:403] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:13.878463  8575 rpcz_store.cc:276] 0709 13:02:11.418625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.571769 (+1153144us) service_pool.cc:224] Handling call
0709 13:02:12.572055 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.664807 (+1092752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.866050 (+201243us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b540018c254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:13.876936 (+ 10886us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642081536}
I20260709 13:02:13.882833  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 978) took 1962 ms. Trace:
I20260709 13:02:13.883347  9099 rpcz_store.cc:276] 0709 13:02:11.920094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.194447 (+274353us) service_pool.cc:224] Handling call
0709 13:02:12.194685 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.408766 (+214081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.882341 (+1473575us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54005b63d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:13.882647 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389549440}
W20260709 13:02:13.883857  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 88071.3us
I20260709 13:02:13.886490  8435 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:13.886669 11813 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:13.888518  8508 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:13.843317 12078 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:02:13.889628  8509 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:13.892817  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:13.892385 12230 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:13.892505 12176 consensus_meta.cc:287] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.203s	user 0.019s	sys 0.000s
I20260709 13:02:13.874181 11682 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.910140  8579 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:13.911995  8507 raft_consensus.cc:2410] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:13.911626  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2237) took 1991 ms. Trace:
I20260709 13:02:13.914070  8579 rpcz_store.cc:276] 0709 13:02:11.919656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.806894 (+1887238us) service_pool.cc:224] Handling call
0709 13:02:13.849050 (+ 42156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.911270 (+ 62220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.911513 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:13.918388  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.919066 12364 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:02:13.862092 12324 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:13.895437 12115 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:13.921144  9093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1021) took 1334 ms (client timeout 1668 ms). Trace:
I20260709 13:02:13.895085 12230 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
W20260709 13:02:13.930229  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.927624  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:13.924507  9093 rpcz_store.cc:269] 0709 13:02:12.577953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.600102 (+ 22149us) service_pool.cc:224] Handling call
0709 13:02:13.902928 (+1302826us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54005b6b54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:13.912356 (+  9428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2703608576}
I20260709 13:02:13.929772  8580 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:13.931559  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2238) took 2011 ms. Trace:
I20260709 13:02:13.931815  8580 rpcz_store.cc:276] 0709 13:02:11.920142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.866329 (+1946187us) service_pool.cc:224] Handling call
0709 13:02:13.894206 (+ 27877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.931358 (+ 37152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.931518 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.927510  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:13.903782 12370 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:13.985553  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.922492 11682 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:13.932675 12306 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:13.985564  8575 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:13.891312 12342 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.003366  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 601) took 1974 ms. Trace:
I20260709 13:02:14.003934  8575 rpcz_store.cc:276] 0709 13:02:12.029288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.904626 (+1875338us) service_pool.cc:224] Handling call
0709 13:02:13.974015 (+ 69389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.002963 (+ 28948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.003282 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:14.006489  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 174242us
I20260709 13:02:14.006649  8502 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
W20260709 13:02:14.009157  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.005731  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:13.922832 12191 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.030362  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.028908  8509 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:02:14.037004  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2236) took 2107 ms. Trace:
I20260709 13:02:14.019462 12324 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.043870  8503 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:14.024456 12176 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:14.048354  8507 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:14.052100  8502 raft_consensus.cc:2410] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:14.039214 11682 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:14.037528  8581 rpcz_store.cc:276] 0709 13:02:11.919343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.799681 (+1880338us) service_pool.cc:224] Handling call
0709 13:02:13.830838 (+ 31157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.831375 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:13.865320 (+ 33945us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.026546 (+161226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.026622 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:14.026697 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.026778 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.026915 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15541,"prepare.queue_time_us":59190,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":482,"raft.queue_time_us":4221,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":10712,"thread_start_us":184173,"threads_started":2}
I20260709 13:02:14.051450 12191 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:14.058072  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 152523us
I20260709 13:02:14.051288 12078 raft_consensus.cc:2764] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:14.043794 12315 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:14.089025  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2217) took 3334 ms. Trace:
I20260709 13:02:14.061311  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:14.061329 12226 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.062749  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2112) took 2055 ms. Trace:
I20260709 13:02:14.063534 12373 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:14.094347  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 98785.5us
I20260709 13:02:14.073343 12379 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.074535  8577 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:14.075196  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2114) took 1562 ms. Trace:
I20260709 13:02:14.074939 12176 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.051667 12266 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.079038  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 183492us
I20260709 13:02:14.081308  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 1964) took 1941 ms. Trace:
W20260709 13:02:14.092523  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.064955  8503 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:02:14.089531  8578 rpcz_store.cc:276] 0709 13:02:10.754884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.462917 (+708033us) service_pool.cc:224] Handling call
0709 13:02:13.708180 (+2245263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.709588 (+  1408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.088764 (+379176us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b540009ae50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:14.088915 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5162050944}
I20260709 13:02:14.099262 12159 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.091689  8429 rpcz_store.cc:276] 0709 13:02:12.007580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.287507 (+279927us) service_pool.cc:224] Handling call
0709 13:02:12.336247 (+ 48740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.407899 (+ 71652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.062309 (+1654410us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b5400238f50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:14.062567 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111046912}
I20260709 13:02:14.111219  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2009) took 2020 ms. Trace:
I20260709 13:02:14.111654  8575 rpcz_store.cc:276] 0709 13:02:12.090898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.004929 (+1914031us) service_pool.cc:224] Handling call
0709 13:02:14.052372 (+ 47443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.107613 (+ 55241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.107633 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.110953 (+  3320us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:14.111004 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.111078 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.111159 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:14.101045  8434 rpcz_store.cc:276] 0709 13:02:12.139796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.330570 (+190774us) service_pool.cc:224] Handling call
0709 13:02:12.330858 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.803193 (+1472335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.080944 (+277751us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540025a8d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:14.081246 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3301022080}
I20260709 13:02:14.090611 12322 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.117112  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:14.118094 12176 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:14.099412 12379 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.096079 11682 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:14.119218  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2006) took 2306 ms. Trace:
I20260709 13:02:14.120431 11682 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.119812  8582 rpcz_store.cc:276] 0709 13:02:11.812998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.771241 (+1958243us) service_pool.cc:224] Handling call
0709 13:02:13.804634 (+ 33393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:13.856830 (+ 52196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.856869 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:13.875448 (+ 18579us) log.cc:844] Serialized 52 byte log entry
0709 13:02:13.991171 (+115723us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:13.991228 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.991330 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.118931 (+127601us) raft_consensus.cc:1685] finished
0709 13:02:14.118958 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.119122 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4857,"raft.queue_time_us":18047,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":3840,"thread_start_us":80464,"threads_started":1,"wal-append.queue_time_us":168882}
I20260709 13:02:14.096153 12373 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:14.119342  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 241125us
I20260709 13:02:14.099491 12226 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.097072  8427 rpcz_store.cc:276] 0709 13:02:12.512264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.512721 (+   457us) service_pool.cc:224] Handling call
0709 13:02:12.515520 (+  2799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.823025 (+307505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.823091 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.824853 (+  1762us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.611507 (+786654us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:13.611554 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.074597 (+463043us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54003a2854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:14.074643 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.074686 (+    43us) raft_consensus.cc:1685] finished
0709 13:02:14.074701 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.075002 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111372,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":204,"spinlock_wait_cycles":705061120,"thread_start_us":117578,"threads_started":1,"wal-append.queue_time_us":911693}
I20260709 13:02:14.118832  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:14.125660 12298 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.140017  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2005) took 2327 ms. Trace:
I20260709 13:02:14.139887 12176 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:14.140153 12298 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.141614  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:14.140513  8584 rpcz_store.cc:276] 0709 13:02:11.812758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.771766 (+1959008us) service_pool.cc:224] Handling call
0709 13:02:13.813888 (+ 42122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.869112 (+ 55224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.869131 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.891113 (+ 21982us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.990765 (+ 99652us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:14.029737 (+ 38972us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.047860 (+ 18123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.047939 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.139769 (+ 91830us) raft_consensus.cc:1685] finished
0709 13:02:14.139790 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.139958 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59523,"prepare.queue_time_us":38714,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":5878,"raft.queue_time_us":30360,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":12039,"thread_start_us":67486,"threads_started":1,"wal-append.queue_time_us":150185}
I20260709 13:02:14.143126 12138 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:14.142798 12298 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:14.143713 12138 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:14.107116 11886 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.144846 12138 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:14.145431  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 89138.4us
I20260709 13:02:14.146359  8549 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:14.146770 12317 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:14.148654  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:14.127916 12373 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.127417 12266 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.149195 12317 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:14.151084 12266 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.151763 12266 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.151490 12317 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:14.128350  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.133225 12315 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:02:14.126435  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:14.138352 12312 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.127494  8508 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:14.148480 12306 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:14.129550 12159 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.142836 12311 consensus_queue.cc:1059] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:14.156656  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.166774  8503 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:14.168022 12159 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.159703 12312 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:14.169003 12312 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.169029 12343 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:14.169863 12343 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.172232 12343 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:14.172922 12159 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:14.173599 12159 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.163275 12176 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.175951 12159 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.176118  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.176816  8503 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:14.176846  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1027) took 1597 ms. Trace:
I20260709 13:02:14.177250  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.178098  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.178471  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:14.178702  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:14.152182 12266 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:14.180069 12266 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.180140  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:14.177302  9101 rpcz_store.cc:276] 0709 13:02:12.579404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.651947 (+ 72543us) service_pool.cc:224] Handling call
0709 13:02:12.930900 (+278953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.931896 (+   996us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:13.254300 (+322404us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.046906 (+792606us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.090539 (+ 43633us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.090723 (+   184us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:14.091028 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.091385 (+   357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.091520 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.176520 (+ 85000us) raft_consensus.cc:1685] finished
0709 13:02:14.176538 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.176673 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71976,"prepare.queue_time_us":128281,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":87,"raft.queue_time_us":2216,"raft.run_cpu_time_us":461,"raft.run_wall_time_us":15249,"thread_start_us":679128,"threads_started":2,"wal-append.queue_time_us":786029}
I20260709 13:02:14.181504 12386 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:14.182618 12386 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:14.182649 12372 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:14.183199 12386 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:14.183393 12372 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:14.183743  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.183840 12372 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.184265 12386 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.185724 12386 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.186508  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:14.189955  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 75081.4us
I20260709 13:02:14.196353  8507 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:14.197309  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 408772us
W20260709 13:02:14.202276  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 289065us
I20260709 13:02:14.204584  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:14.223222 12263 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:14.223265 12021 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 13:02:14.223930  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 105255us
I20260709 13:02:14.225086  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:14.205761 12355 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:14.220532  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.230809 11813 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.231222  8434 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:14.231673  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:14.232548  8431 raft_consensus.cc:2410] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:14.234181 12275 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:14.229396  8510 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:02:14.244037  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.215751 12379 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:14.241300  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:14.239082  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:14.223941 12263 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:14.228312 12355 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.251379  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:14.231249 11813 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.229084 11877 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:14.244617  8549 connection.cc:256] RPC call timeout handler was delayed by -1.6038220870000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
I20260709 13:02:14.250743 12306 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:02:14.256743  9101 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:14.257711  9095 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:14.271663  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:14.272318  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 149235us
I20260709 13:02:14.251940 12312 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.273077 12343 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:14.273931  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:14.272239  8398 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:14.274968 12343 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:14.267772  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:14.227927 11886 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:02:14.269451  8435 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:14.291834  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:14.263722 12355 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:14.247435 12187 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:02:14.304352  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:14.270890 11813 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.313735  8428 raft_consensus.cc:2376] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9. Re-sending same reply.
I20260709 13:02:14.314523 12312 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:02:14.315645  8433 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:14.316385  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2008) took 2226 ms. Trace:
I20260709 13:02:14.317266  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:14.317682 12383 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:14.318132 12375 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:14.318269 12383 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.320192 12375 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.320489 12383 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.320784 12375 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.322165  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2218) took 3508 ms. Trace:
I20260709 13:02:14.322633  8576 rpcz_store.cc:276] 0709 13:02:10.755204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.930301 (+1175097us) service_pool.cc:224] Handling call
0709 13:02:11.930683 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.053434 (+2122751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.056260 (+  2826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.056300 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:14.056349 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.251373 (+195024us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b54000cd5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:14.251440 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.263441 (+ 12001us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54473,"raft.queue_time_us":32562,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":9172,"spinlock_wait_cycles":4762341632}
I20260709 13:02:14.323611  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2010) took 2232 ms. Trace:
I20260709 13:02:14.324409  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:14.283449 12379 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:14.316445  8584 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:02:14.327155  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 64285.2us
I20260709 13:02:14.267518 12311 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.331521  9093 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:14.329468  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:14.333894  9102 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:14.341982  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:14.342175 12383 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:14.343397 12079 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:14.343353 12398 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:14.344066 12079 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:14.345185  8549 connection.cc:256] RPC call timeout handler was delayed by -1.5633220870000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 13:02:14.345746  8549 connection.cc:256] RPC call timeout handler was delayed by -1.4741124820000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:02:14.346201  8549 connection.cc:256] RPC call timeout handler was delayed by -1.2482124820000422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 13:02:14.346606  8549 connection.cc:256] RPC call timeout handler was delayed by -1.2401124820000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 13:02:14.347007  8549 connection.cc:256] RPC call timeout handler was delayed by -1.2132220870000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24870000000000003s for a response
W20260709 13:02:14.347373  8549 connection.cc:256] RPC call timeout handler was delayed by -1.0603618940000388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
I20260709 13:02:14.347450 12226 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:14.348472 12226 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:14.349386  8549 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.651s (SENT)
I20260709 13:02:14.328737 12159 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.311214 12275 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:02:14.323972  8583 rpcz_store.cc:276] 0709 13:02:12.091197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.037996 (+1946799us) service_pool.cc:224] Handling call
0709 13:02:14.075686 (+ 37690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.100068 (+ 24382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.100101 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.121194 (+ 21093us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.219064 (+ 97870us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:14.219103 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.219172 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.323405 (+104233us) raft_consensus.cc:1685] finished
0709 13:02:14.323425 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.323556 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31274,"raft.queue_time_us":30433,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9434,"thread_start_us":97474,"threads_started":1,"wal-append.queue_time_us":126260}
I20260709 13:02:14.331416  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:14.352900 12389 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:02:14.352962 12275 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:14.357872  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:14.358666  8581 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:14.359030  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:14.359763  9101 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:14.359886  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:14.328866 12317 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:14.316916  8579 rpcz_store.cc:276] 0709 13:02:12.090560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.933185 (+1842625us) service_pool.cc:224] Handling call
0709 13:02:14.026262 (+ 93077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.126131 (+ 99869us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:14.126163 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.126755 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.227530 (+100775us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:14.227578 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.227643 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.316191 (+ 88548us) raft_consensus.cc:1685] finished
0709 13:02:14.316209 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.316329 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26189,"raft.queue_time_us":43631,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":100194,"threads_started":1,"wal-append.queue_time_us":187559}
I20260709 13:02:14.362219  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:14.331370 12379 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:14.339274 12021 raft_consensus.cc:2764] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:14.371623 12263 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:14.372433 12387 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:02:14.338675 12315 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.375032 12375 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.352535 12226 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:14.378203  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 142796us
I20260709 13:02:14.398972  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:14.376694  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:14.410285  8580 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:14.378505  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:14.356000 11877 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.412367 11877 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.412240  9094 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:14.375689 12379 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:14.415580  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 55783.4us
I20260709 13:02:14.409518  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:14.334669 11682 consensus_queue.cc:1059] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 13:02:14.403146  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 178251us
I20260709 13:02:14.367017 12383 raft_consensus.cc:2764] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:02:14.418085  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 135911us
I20260709 13:02:14.420480  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:14.375605 12317 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:14.422637  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 87708.8us
I20260709 13:02:14.425415  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:14.426120  8578 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:14.426863  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.422367  9096 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:14.339346 12311 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.436147 12315 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.440443  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.486178  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:14.486732  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50374.8us
W20260709 13:02:14.505585  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.480069  8508 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 12 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:14.408993 11886 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:14.437937  8476 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:14.524376  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:14.428539 12230 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:14.371666 12079 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.528240  8510 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:14.527536  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:14.527990  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:14.532951  9096 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:14.537079  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.425559 12372 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:14.541430  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 103551us
I20260709 13:02:14.549115  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:14.552071 12311 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:14.551549 12226 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.556025  8476 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:14.557113 12383 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:14.530012 11886 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:14.558732 11886 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.559515  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.560235  8506 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:14.560312  8510 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:14.560417  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.561007  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.561570  8502 raft_consensus.cc:2410] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:02:14.561877  8509 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:14.563200  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.563899  8509 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:14.560127 11886 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:14.568996  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:14.592006  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69674.5us
I20260709 13:02:14.535714 12343 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:14.594622  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 45577.9us
I20260709 13:02:14.595618 12312 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:14.597350  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:14.598752  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 248189us
I20260709 13:02:14.540225 12230 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:14.591785 12021 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:14.603098  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.614969  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:14.606761 12396 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.165s	user 0.001s	sys 0.001s
I20260709 13:02:14.617447  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:14.619164  8549 leader_election.cc:336] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.845s (SENT)
I20260709 13:02:14.591204 12078 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:02:14.606887 12252 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.634379 12252 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.635372 12266 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.623441 12079 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:14.601715 12343 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.641188 12261 raft_consensus.cc:3055] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:14.641685 12261 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:14.608690 12317 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.642670 12261 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:14.614739 12191 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 13:02:14.625947 12244 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:14.627252 12400 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:14.627590  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.628782 12231 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:14.630940 12315 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.617581 12402 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:02:14.667429  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.693858  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 45533.9us
I20260709 13:02:14.637399 12373 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.613435 12298 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:02:14.712237 12383 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:14.712059  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 102174us
I20260709 13:02:14.718604 12021 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:14.725045  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 115075us
I20260709 13:02:14.693554 12244 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.641913 12343 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:14.729257  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.704481 12261 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.738166  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:14.723541 12231 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.727488 11682 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:14.722990 11877 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.740993 12244 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.746228 12231 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.767863 12407 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.806669 12407 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:14.768767 12403 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:02:14.753786 12230 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.810168 12407 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:14.773092  8549 leader_election.cc:336] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.096s (SENT)
W20260709 13:02:14.774148  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.746809 11682 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.776690  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:14.781594 12138 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:14.785919 12191 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.790582  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.791260 12376 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:14.797314  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:14.798713 12409 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:02:14.751760 12311 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:14.799495  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.759186 12386 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.009s
I20260709 13:02:14.766335 12399 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.809573 11813 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.744439 12315 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:14.813678  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:14.870591  8506 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.800832 12373 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.839501 12311 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.878844  8507 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:14.879348  8507 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:14.815515  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.830689 12021 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.774571 12372 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:14.838646  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:14.839926  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 284554us
W20260709 13:02:14.883602  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 127779us
I20260709 13:02:14.837797  8504 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:14.835089 12376 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.841307 12191 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.849114 12370 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:14.852844  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.860833 12413 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.853682 12298 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:02:14.861990 12187 raft_consensus.cc:3055] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:14.895630 12187 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:14.865931 12266 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.755506 12355 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.896581 12187 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.879554 12311 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:14.880256  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.879171  8501 raft_consensus.cc:2376] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8. Re-sending same reply.
I20260709 13:02:14.890792  8508 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:14.894567 12312 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.894531 12413 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.832008 11682 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.909473 12312 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:14.920357 12312 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.921361  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:14.922966  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:14.924840 11813 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.926595 12405 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.897881 12187 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.927035 12405 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:14.927438 12405 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.890574  8507 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.881635 12399 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.919564 12413 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:14.923014 12370 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:14.914341  8509 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:14.897991 12355 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:14.976986 12370 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:14.977627 12370 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:14.978507  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:14.979192  8427 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:14.947901 12373 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:14.980135 12373 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:14.981107 12373 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.982407 12373 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.937454 11682 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.984390 11682 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:14.929960 12231 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:14.977015  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:14.988018  8428 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:14.988267 12231 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:14.990787 12424 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:02:14.941560  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49704.8us
I20260709 13:02:14.886579 12376 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:14.909386  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:14.967130  8506 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:02:14.974211  8507 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:14.974886  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 201812us
I20260709 13:02:14.939888 12191 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:14.976873 12420 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:14.887734 12078 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.939694  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.001025  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.014952  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:15.000896  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:14.915766 12230 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:15.016855  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:15.017803  8506 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:15.021166  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 95131.8us
I20260709 13:02:15.022184  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:15.025671  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.030220  8549 leader_election.cc:336] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.098s (SENT)
I20260709 13:02:15.030897  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:15.034711 12399 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:15.037794 12410 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:02:15.012622 12231 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:02:15.020404 12078 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:14.975330 12312 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.039709  8428 raft_consensus.cc:2410] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:15.041123  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:15.042575  8427 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:15.012638 12420 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:15.051554  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:15.055397  8502 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:15.051676  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:15.052875  8508 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:02:15.022909 12416 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:15.054241  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:14.913208 12383 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:15.056564  8508 pending_rounds.cc:85] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 3
I20260709 13:02:15.057613  8506 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:15.060066  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:15.062598  8428 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:15.062990  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:15.049438 12191 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:15.100857  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.061944  8508 pending_rounds.cc:107] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:02:15.102340  8508 raft_consensus.cc:2889] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.102433  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:15.103063  8506 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:15.106756  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:15.107388  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:15.108206 12413 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:15.108330  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 85166.9us
I20260709 13:02:15.109141  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:15.109581 12261 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:15.110147  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:15.110383  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:15.111093  8431 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:15.111274 12261 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:15.111542  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 88346.7us
W20260709 13:02:15.111701  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 60135.8us
I20260709 13:02:15.111907 12261 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.112490  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:15.113389  8549 leader_election.cc:336] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.877s (SENT)
I20260709 13:02:15.113976  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:15.115912  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.107432  8428 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:15.144322  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:15.042110 12244 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:15.100051 12379 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.663s	user 0.002s	sys 0.011s
W20260709 13:02:15.168624  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48482.1us
W20260709 13:02:15.172714  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 63632.2us
I20260709 13:02:15.119062 12386 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:15.114218 12261 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:15.184332  8502 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:15.186045  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:15.186867  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:15.119119 12398 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:15.122426 12416 raft_consensus.cc:697] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:15.196353  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:15.103309 12191 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:15.185932 12231 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.192276 12187 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:15.187666 12342 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:15.191751 12230 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:15.224401  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:15.226619  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:15.235046 12421 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:15.239003  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:15.240273  8502 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:15.241425  8433 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:15.183020 12411 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.263685  8426 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
W20260709 13:02:15.253886  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 67328.5us
I20260709 13:02:15.193892 12386 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:15.258939  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 145581us
I20260709 13:02:15.222908 12244 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:15.250731 12266 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:15.268853  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:15.186879 12379 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.265111  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:15.221411 12399 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:15.221163 12398 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:15.256045 12261 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.280668  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:15.286692  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:15.261242 12187 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:15.261709 12342 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.204180 12311 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:15.304610  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:15.291769  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.276087 12226 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:15.278169 12386 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.270699 11877 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:15.296969  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:15.291254 12266 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:15.201285 12420 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:15.268893 12231 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:15.297945  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:15.291132 12230 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:15.285316 12373 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:15.277786 12411 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:15.314664  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.411356  8427 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:15.440200  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 156987us
W20260709 13:02:15.456193  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 153634us
I20260709 13:02:15.439719  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:15.307298 12298 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:15.367200  8549 leader_election.cc:336] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 3.033s (SENT)
I20260709 13:02:15.460825  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:15.459661  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 161780us
I20260709 13:02:15.457857  8507 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:15.299252 11813 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:15.297204 12187 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.469192  8507 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:15.302783 12342 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.367177 12312 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:15.411911 12306 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:15.328892 12226 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:15.415323 12383 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.471711 11813 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:15.474140  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 304278us
I20260709 13:02:15.454386 12373 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.364426 12343 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:15.467789 12298 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.467546 12230 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:15.398506 11877 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:15.499539  8580 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:15.296654 12261 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.468798 12399 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:15.475633 12159 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:15.510267  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.509276  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2252) took 1089 ms. Trace:
I20260709 13:02:15.511322  8580 rpcz_store.cc:276] 0709 13:02:14.419935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.480296 (+1060361us) service_pool.cc:224] Handling call
0709 13:02:15.499204 (+ 18908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.508917 (+  9713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.509201 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:15.513002  8507 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:02:15.311100  8431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60906
I20260709 13:02:15.500233 12226 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:15.521812  8581 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:15.525451  8507 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:15.505347 12373 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:15.508350 12298 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.502210 11813 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.482105 11886 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:02:15.526487  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 64412.9us
I20260709 13:02:15.327775 12416 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.533033  8503 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:02:15.530526  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.531497  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:15.513387 12230 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.495788 12400 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:02:15.535701  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:15.530102 12429 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:02:15.540932  8583 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:15.474035 12398 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.524231 12315 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:02:15.546758  8507 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:02:15.540115 12431 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:02:15.533277 12444 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.568192 12379 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:15.530340 12343 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.571801 12187 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.549646 12311 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:15.511137 12383 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:15.551373 12440 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:02:15.501956 12266 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.553306 12449 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.554363 12452 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:15.558465 12451 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:15.559799 12261 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:15.560230  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1001) took 1122 ms. Trace:
I20260709 13:02:15.561592 12312 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.543532 12447 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:02:15.562819 11877 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:15.573526 12399 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:15.550676 12437 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:02:15.580857  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.592702  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 260543us
W20260709 13:02:15.625825  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.605360  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:15.626670  8507 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:15.608052 12298 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:15.611622  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 102015us
W20260709 13:02:15.602617 12370 consensus_meta.cc:287] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.005s
I20260709 13:02:15.614634  9096 rpcz_store.cc:276] 0709 13:02:14.437461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.552502 (+115041us) service_pool.cc:224] Handling call
0709 13:02:14.552893 (+   391us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:14.733992 (+181099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.734068 (+    76us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:14.813735 (+ 79667us) log.cc:844] Serialized 78 byte log entry
0709 13:02:15.022908 (+209173us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:15.022945 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.023009 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.559990 (+536981us) raft_consensus.cc:1685] finished
0709 13:02:15.560009 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.560171 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38496,"raft.queue_time_us":179656,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6549,"thread_start_us":265565,"threads_started":2,"wal-append.queue_time_us":263616}
I20260709 13:02:15.639189 12400 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:15.640961  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:15.641027 12261 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:15.642004 12311 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.642459  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:15.644083  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:15.647817  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:15.649860  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.637044 11877 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.660665  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:15.623337 12312 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.636837 12411 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:15.649857 12261 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:15.668421 12457 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:15.635586 12370 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.660904 12231 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:15.663271 12115 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:15.694808 12419 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.864s	user 0.004s	sys 0.000s
I20260709 13:02:15.695765 12370 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:15.696614  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1949) took 1128 ms. Trace:
I20260709 13:02:15.697053  8510 rpcz_store.cc:276] 0709 13:02:14.568593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.568727 (+   134us) service_pool.cc:224] Handling call
0709 13:02:15.696396 (+1127669us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54003c5d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:15.696528 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657512320}
W20260709 13:02:15.697742 12446 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:02:15.671905 12191 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:15.610860 12449 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:15.701367 12435 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:02:15.604382 12444 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.668466  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:15.741837  8508 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
W20260709 13:02:15.748747  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 47022.2us
I20260709 13:02:15.751541  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 999) took 1341 ms. Trace:
I20260709 13:02:15.762806 12373 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.752077  9094 rpcz_store.cc:276] 0709 13:02:14.410258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.417136 (+  6878us) service_pool.cc:224] Handling call
0709 13:02:14.439697 (+ 22561us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:14.594476 (+154779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.594506 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:14.618928 (+ 24422us) log.cc:844] Serialized 52 byte log entry
0709 13:02:14.766278 (+147350us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:14.833279 (+ 67001us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.837209 (+  3930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.837297 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.572246 (+734949us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:15.706130 (+133884us) raft_consensus.cc:1685] finished
0709 13:02:15.751246 (+ 45116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.751456 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100375,"prepare.queue_time_us":67495,"prepare.run_wall_time_us":23377,"raft.queue_time_us":130529,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6247,"spinlock_wait_cycles":20891648,"thread_start_us":85292,"threads_started":2,"wal-append.queue_time_us":125451}
I20260709 13:02:15.765571  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:15.669269 12261 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.671089 12462 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.671867 12457 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:15.796499  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 135025us
I20260709 13:02:15.756222 12191 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:15.844636  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.845207  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.847594  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.848196  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.852415  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 320979us
I20260709 13:02:15.764575 12447 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:02:15.864153 12463 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.864614  8582 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:15.797640 12261 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.816836 12452 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:15.866186 12373 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:15.866873  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:15.796203 12298 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:15.824189 12138 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:02:15.867636  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:15.926060  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:15.885246  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:15.874836  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:15.938392  8431 raft_consensus.cc:606] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Received request to transfer leadership
I20260709 13:02:15.939023  8431 raft_consensus.cc:614] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:15.922598  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:15.920383 12252 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:15.875290  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:15.953768  8579 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.820261 12451 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:15.940985  8584 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:02:15.919691 12454 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:02:15.920506 12456 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:15.823930 12457 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:15.874396 12250 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.002s	sys 0.018s
I20260709 13:02:15.823068 12343 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:15.941813 12386 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.506s	user 0.013s	sys 0.006s
W20260709 13:02:15.891371 12376 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.862s	user 0.012s	sys 0.010s
I20260709 13:02:15.902489 12312 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:15.956554 12405 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.960s	user 0.014s	sys 0.010s
I20260709 13:02:15.882588 11813 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:15.940987 12400 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.001626  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:15.890659 12231 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:15.886044 12187 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:15.916393 12449 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:15.989069 12250 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.005s	sys 0.022s
I20260709 13:02:15.821125 12462 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:15.988159  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:15.919480 12441 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.233s
I20260709 13:02:15.902139 12191 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:02:15.862679 12383 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:16.010083  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:15.898485 12275 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:02:16.016942  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:15.919571 12342 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:16.069507  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.086743  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.070504  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.017895 12470 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:02:16.005010 12473 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:16.065204 12230 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.009s
I20260709 13:02:15.961717 12451 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:16.111440 12461 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.111598 12383 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.111726  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:16.112011 12461 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.113121 12444 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:16.113462 12451 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:16.088689  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.094866 12466 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:02:16.095414 11813 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:16.071784 12231 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:16.098207 12414 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.099220 12471 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:16.102428 12441 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:16.103360 12412 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.335s	user 0.000s	sys 0.006s
W20260709 13:02:16.105191  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.007090 12386 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.112141 12383 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:16.080292  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 322345us
I20260709 13:02:16.110998  8579 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:15.978348 12452 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:15.956871 12463 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.062868 12405 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.079900 12465 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:16.130996  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:16.010809 12376 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:16.132076  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:16.142589  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:16.147682  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2122) took 1039 ms. Trace:
W20260709 13:02:16.148609  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 108092us
I20260709 13:02:16.149694  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:16.089315 12266 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:16.157256  8427 rpcz_store.cc:276] 0709 13:02:15.108293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.111890 (+  3597us) service_pool.cc:224] Handling call
0709 13:02:15.112178 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.466406 (+354228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.147358 (+680952us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54003a3754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:16.147604 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642554752}
I20260709 13:02:16.159722  8428 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:02:16.153322  8398 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:16.127291 12441 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:16.153513  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:16.164510  8582 raft_consensus.cc:2368] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 10. Current term is 11.
I20260709 13:02:16.114532 12474 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:16.155840 12465 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.165534  8578 raft_consensus.cc:2376] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7. Re-sending same reply.
I20260709 13:02:16.143846 12311 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.111619 12230 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:16.147652 12461 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:16.175482  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:16.176162  8502 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:16.176529  8510 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:02:16.173254  8509 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:16.179363  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:16.180222  8503 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:16.181113  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:16.181375  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:16.182502  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:16.181790  8579 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:16.187711  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:16.189771  8583 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:16.169431 12191 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:16.116641 12473 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.190495  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:16.133297 12414 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:16.213435  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:16.214516  8428 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:16.215379  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:16.223939 12476 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.224193  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:16.225139  8435 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:16.224728 12476 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:16.226696  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:16.227439 12476 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:16.185225 12474 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.230229  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:16.232280 12474 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:16.233865 12405 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:16.239341 12465 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:16.240180 12463 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:16.240919 12441 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.242328 12441 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:16.242763 12383 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:16.243480 12473 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:16.244697 12226 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.003s
I20260709 13:02:16.244951 12342 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:16.245146 12226 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:16.246192 12231 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:16.246604  8580 raft_consensus.cc:2410] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:16.246851 12414 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:16.193470 12191 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.247496 12226 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:16.247596 12191 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:16.175570 12266 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.251936 12266 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:16.208004 12461 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:02:16.253679 12275 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:16.255820 12376 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:16.143452 12471 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.262967  8503 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
W20260709 13:02:16.265659  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46281.3us
I20260709 13:02:16.272442  8579 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
W20260709 13:02:16.237903 11877 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.573s	user 0.004s	sys 0.012s
I20260709 13:02:16.265126  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:16.268519 12474 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:02:16.264448 12478 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.276358  8502 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:16.277835  8505 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:16.285624  8576 raft_consensus.cc:2410] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:16.244946 12386 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:16.278990  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:16.262674 12444 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.291320  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:16.293295 12473 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:16.294015 12473 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:16.296072  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:16.298851  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:16.220489 12455 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:02:16.268025 12477 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:02:16.255841 12275 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:02:16.310271  9094 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:02:16.314102  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:16.301239  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:16.314805  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:16.300376  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:16.393440  8502 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:16.356878  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:16.318931  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:16.311550  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:16.295224 12473 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:16.888440  8432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.010s	sys 0.035s
I20260709 13:02:16.474686  8434 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:16.959147  8432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.011s	sys 0.036s
I20260709 13:02:16.477208 12191 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:16.595274  9068 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.177s (SENT) [suppressed 18 similar messages]
W20260709 13:02:16.814774  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 450072us
I20260709 13:02:16.961920  8433 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 12. Ops: []
I20260709 13:02:16.962260  8503 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
W20260709 13:02:16.478003  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.963112  8549 leader_election.cc:336] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.857s (SENT)
I20260709 13:02:16.963610  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:16.478219  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 102513us
I20260709 13:02:16.965106  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:16.966094  8579 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:16.658818 12405 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.967176 12405 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.599608  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:16.541886  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.970301  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.970549  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:16.971947  9096 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:16.309387 12342 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:16.774036  8507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.028s	sys 0.028s
W20260709 13:02:16.973016  8501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.024s	sys 0.029s
W20260709 13:02:16.973567  8501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.024s	sys 0.029s
I20260709 13:02:16.973899  9094 pending_rounds.cc:85] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 6
I20260709 13:02:16.974375  9094 pending_rounds.cc:107] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:02:16.974742  9094 raft_consensus.cc:2889] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:16.309299 12230 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:16.639154 12397 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:16.973052  8507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.032s	sys 0.028s
I20260709 13:02:16.977873 12397 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.658608  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:16.980584 12397 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:16.637502  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:16.981062  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:16.981891  9101 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:16.982398  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:16.983320  8430 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:16.959867  9097 raft_consensus.cc:2376] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11. Re-sending same reply.
I20260709 13:02:16.960410  9099 raft_consensus.cc:2410] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:02:16.972849 12342 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.994554  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:16.971477  8575 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:17.000962  9093 raft_consensus.cc:2410] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:16.316121 12452 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:16.313633 12479 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:02:16.374814 11877 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.815084 12455 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.290951 12474 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:16.322727 12471 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:16.341166 12462 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:16.295397 12476 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:17.020943  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.031255  9093 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:17.023036  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:16.318674 12457 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:17.031808  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:17.032377  9099 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.035463  9097 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:16.319802 12261 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:16.316684 12444 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.039069  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.044242  8579 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:17.040220  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 444945us
I20260709 13:02:17.040220  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.021588 12230 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.046983  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 756862us
I20260709 13:02:17.048530  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:17.034888 11877 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:17.048952 12497 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.049459 12379 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:17.049965 12379 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:17.049546 12497 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.050997 11877 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:17.050854 12379 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.052102 12379 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.054006 11886 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.055852 12497 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:17.057842  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.060612  8577 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:17.057333  8579 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:17.062873  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.063572  8579 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.025166 12474 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:17.062889  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.066391  9099 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:17.037732 12452 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:17.067024  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.067757  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:17.071341  9097 raft_consensus.cc:2376] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11. Re-sending same reply.
W20260709 13:02:17.072623  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 109516us
I20260709 13:02:17.042335 12471 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.040201 12476 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:17.044809 12477 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:17.081341  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.083102  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:17.062768 12191 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:17.085096  9099 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.085891  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.086838  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.033344 12455 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.087942  8575 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:17.067462 12474 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:17.089913  8549 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.924s (SENT)
I20260709 13:02:17.098855  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:17.090353  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.091125  8577 raft_consensus.cc:2410] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:17.101233  9099 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:17.101790  9097 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:17.103068  8577 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:17.066519 12230 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.103926  8579 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:02:17.107302  8579 pending_rounds.cc:85] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 7
I20260709 13:02:17.107777  8579 pending_rounds.cc:107] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:02:17.108088  8579 raft_consensus.cc:2889] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:17.108608  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.109328  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.109961  9099 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:17.110674  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:17.114456  8549 leader_election.cc:336] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.925s (SENT)
I20260709 13:02:17.115447  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.115976  9097 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:17.084036 12471 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:17.105012 12478 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.120658  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2020) took 1258 ms. Trace:
I20260709 13:02:17.122908  8576 rpcz_store.cc:276] 0709 13:02:15.862516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.862777 (+   261us) service_pool.cc:224] Handling call
0709 13:02:17.120474 (+1257697us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540028d054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:17.120605 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799515520}
I20260709 13:02:17.124343  8576 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:17.120764  8575 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:17.125001  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.123749 12230 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.127687  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.129504  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:17.130805 12342 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:17.130873  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.131124  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:17.132051  9099 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:17.118628 12397 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.138994  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:17.146363  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:17.151260  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.134871 12441 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.152706 12441 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.128998 12386 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.155444 12386 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.158488  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2343) took 1948 ms. Trace:
I20260709 13:02:17.159047 12405 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:17.164777  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:17.166893  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:17.123759 12261 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.165647  9093 raft_consensus.cc:2376] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8. Re-sending same reply.
I20260709 13:02:17.159075  8505 rpcz_store.cc:276] 0709 13:02:15.210090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.210960 (+   870us) service_pool.cc:224] Handling call
0709 13:02:15.211410 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.278402 (+1066992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.158113 (+879711us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54000d93d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:17.158399 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220834560}
I20260709 13:02:17.176916  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.132308 12476 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.179476  9099 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:17.180454  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:17.184296  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.141923 12342 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:17.183916 12226 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:02:17.188840  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.189647  9093 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:17.174302 12386 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:17.221095  8426 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:17.179276 12230 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.223291  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.183992 12464 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:17.225011  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.225899  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.226629  8426 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:17.225250  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 176812us
I20260709 13:02:17.147541 12397 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:17.228206  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44480.1us
I20260709 13:02:17.226910  8429 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:17.232285  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.233721  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.234900  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.236028  9093 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:17.191608 12457 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:17.240144  8426 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:17.238303  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.241814  9099 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:17.248276  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.251390  9097 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:17.192265 12342 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.253211  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:17.268831  9093 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:17.277333  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.280726  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:17.306978  9099 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:17.308403  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.309404  9099 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:17.332917 12455 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.237027 12261 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:02:17.333264  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.424094  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.424470  8429 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:17.429116  8426 raft_consensus.cc:2410] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:17.431550 12471 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:17.364357 12490 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:02:17.435510  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2359) took 1263 ms. Trace:
W20260709 13:02:17.435874  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 204842us
I20260709 13:02:17.436190  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2266) took 1186 ms. Trace:
I20260709 13:02:17.435969  8507 rpcz_store.cc:276] 0709 13:02:16.172144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.172311 (+   167us) service_pool.cc:224] Handling call
0709 13:02:16.172699 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.178362 (+  5663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.178394 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:16.178955 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.978880 (+799925us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:16.978936 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.979022 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.435283 (+456261us) raft_consensus.cc:1685] finished
0709 13:02:17.435304 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.435436 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":180,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":8920,"thread_start_us":725864,"threads_started":1,"wal-append.queue_time_us":883007}
I20260709 13:02:17.436546  8575 rpcz_store.cc:276] 0709 13:02:16.249904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.126817 (+876913us) service_pool.cc:224] Handling call
0709 13:02:17.127148 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:17.137031 (+  9883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.137066 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:17.148145 (+ 11079us) log.cc:844] Serialized 52 byte log entry
0709 13:02:17.239994 (+ 91849us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:17.288198 (+ 48204us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.435935 (+147737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.436012 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.436049 (+    37us) raft_consensus.cc:1685] finished
0709 13:02:17.436057 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.436148 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25003,"prepare.queue_time_us":23421,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":147385,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":10690,"thread_start_us":116347,"threads_started":2,"wal-append.queue_time_us":114954}
W20260709 13:02:17.325475 12493 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 13:02:17.382431  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.439797  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2134) took 1264 ms. Trace:
W20260709 13:02:17.440255  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.440234  8432 rpcz_store.cc:276] 0709 13:02:16.175022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.175147 (+   125us) service_pool.cc:224] Handling call
0709 13:02:16.193133 (+ 17986us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:16.221433 (+ 28300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.221484 (+    51us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:16.256003 (+ 34519us) log.cc:844] Serialized 78 byte log entry
0709 13:02:16.959725 (+703722us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:16.959763 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.959840 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.439582 (+479742us) raft_consensus.cc:1685] finished
0709 13:02:17.439599 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.439715 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8462,"raft.queue_time_us":17708,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":703246,"threads_started":1,"wal-append.queue_time_us":814343}
I20260709 13:02:17.436868  9067 leader_election.cc:400] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 10. Current term is 11.
I20260709 13:02:17.444988  9067 leader_election.cc:403] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:17.445770  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:17.415273 12503 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:02:17.449143  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:17.318284 12473 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:17.450745  9099 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.451412  8429 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:02:17.442354 12494 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 13:02:17.454164  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:17.454622  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.454994  8426 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:17.454382  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:17.410235 12342 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:17.446950 12508 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:02:17.458621  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:17.456255  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:17.459372  8432 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.459836  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:17.461112 11886 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:17.461179 12477 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:17.462611 11886 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:17.463063 11886 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:17.466212 12473 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:17.467280 12473 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.467629  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.472996  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.474221 12471 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:17.475059 12420 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:17.475251 12471 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:17.476835 12471 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:17.452688 12500 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:02:17.478559 12226 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:17.478984 12226 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.479373 12226 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:17.481374  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.482378  9097 raft_consensus.cc:2410] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:02:17.483366  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.470763 12317 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:02:17.457782 12497 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.484107 12317 consensus_queue.cc:1243] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:02:17.484601 12506 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:02:17.484391 12497 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.487301  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:17.488241  8427 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:17.488866  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2364) took 1199 ms. Trace:
I20260709 13:02:17.491016  9097 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:02:17.487612 12434 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 2.074s	user 0.014s	sys 0.012s
I20260709 13:02:17.492093  8432 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:17.495642  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2135) took 1316 ms. Trace:
I20260709 13:02:17.496210  8427 rpcz_store.cc:276] 0709 13:02:16.178772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.486938 (+1308166us) service_pool.cc:224] Handling call
0709 13:02:17.495557 (+  8619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.478196 12379 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:17.489315  8506 rpcz_store.cc:276] 0709 13:02:16.289927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.337366 (+ 47439us) service_pool.cc:224] Handling call
0709 13:02:16.337912 (+   546us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:16.338521 (+   609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.338561 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:16.339373 (+   812us) log.cc:844] Serialized 52 byte log entry
0709 13:02:16.466573 (+127200us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:16.466631 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.466728 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.488572 (+1021844us) raft_consensus.cc:1685] finished
0709 13:02:17.488600 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.488796 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2335,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":126656,"threads_started":1,"wal-append.queue_time_us":748240}
I20260709 13:02:17.493608  9093 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:17.506912  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.507736  9098 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:17.509935  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:17.510205  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.510609  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:17.513288  9099 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:17.513883  9097 raft_consensus.cc:2410] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:17.515435  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.518450  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.520115  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.520882  8427 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:17.502622 12457 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:02:17.500509 12504 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 10. Current term is 11.
I20260709 13:02:16.906375  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:17.523658 12397 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:17.524019 12078 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:17.552145 12509 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.114s	user 0.001s	sys 0.001s
I20260709 13:02:17.521996  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.552448  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2262) took 1355 ms. Trace:
I20260709 13:02:17.552834  8427 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:17.552937  8578 rpcz_store.cc:276] 0709 13:02:16.197268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.104206 (+906938us) service_pool.cc:224] Handling call
0709 13:02:17.111772 (+  7566us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:17.112157 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.112184 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:17.123174 (+ 10990us) log.cc:844] Serialized 52 byte log entry
0709 13:02:17.280228 (+157054us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:17.280265 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.280330 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.484037 (+203707us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:17.552144 (+ 68107us) raft_consensus.cc:1685] finished
0709 13:02:17.552165 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.552393 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":3563,"spinlock_wait_cycles":38349184,"thread_start_us":137054,"threads_started":1,"wal-append.queue_time_us":298263}
I20260709 13:02:17.554318  8427 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:17.554718  9095 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:17.555426  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1003) took 1080 ms. Trace:
I20260709 13:02:17.526055  9093 raft_consensus.cc:2376] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11. Re-sending same reply.
I20260709 13:02:17.558988  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.559578  9093 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:17.560356  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.561357  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.562420  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 610) took 1323 ms. Trace:
I20260709 13:02:17.562814  8577 rpcz_store.cc:276] 0709 13:02:16.239492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.109489 (+869997us) service_pool.cc:224] Handling call
0709 13:02:17.113374 (+  3885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.116778 (+  3404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.116818 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.120159 (+  3341us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.280163 (+160004us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:17.280209 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.280289 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.551561 (+271272us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:17.562130 (+ 10569us) raft_consensus.cc:1685] finished
0709 13:02:17.562150 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.562367 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1035,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5497,"spinlock_wait_cycles":18066688,"thread_start_us":141036,"threads_started":1,"wal-append.queue_time_us":308320}
I20260709 13:02:17.564816  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.565281  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:17.565620  9101 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:17.566169  9098 raft_consensus.cc:2410] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:17.566658  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.567011  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.566737 12474 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.567423  9101 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:17.552557  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:17.568316  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.535836 12441 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:17.538903 12399 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.570278  9098 raft_consensus.cc:2410] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:17.570585 12399 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.571094  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.571655  9098 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 6.
I20260709 13:02:17.572425  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:17.572597 12399 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:17.536659  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.573110  9098 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:17.573541  9096 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:17.573814  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.574363  9098 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:17.577391  9102 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:17.578092  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1002) took 1103 ms. Trace:
W20260709 13:02:17.542976  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.540840  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:17.580940  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.581591  8575 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:17.544528  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2014) took 1697 ms. Trace:
I20260709 13:02:17.582235  8577 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:02:17.582162  8580 rpcz_store.cc:276] 0709 13:02:15.846607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.846706 (+    99us) service_pool.cc:224] Handling call
0709 13:02:17.544341 (+1697635us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b540009a454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:17.544470 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716525312}
I20260709 13:02:17.555768  9095 rpcz_store.cc:276] 0709 13:02:16.475475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.598956 (+123481us) service_pool.cc:224] Handling call
0709 13:02:17.554424 (+955468us) spinlock_profiling.cc:243] Waited 915 us on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aeee 0000000000375939 00007f1a1e28e1e0 00007f1a1e3570c4 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:02:17.554563 (+   139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.555190 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.555371 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126976}
I20260709 13:02:17.542204  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60906 (request call id 0) took 2235 ms. Trace:
I20260709 13:02:17.583715  8431 rpcz_store.cc:276] 0709 13:02:15.306518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.310884 (+  4366us) service_pool.cc:224] Handling call
0709 13:02:17.541965 (+2231081us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400127354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a19339853 00007f1a1e30760a 00007f1a1788d7d4 00007f1a1788d762 00007f1a1788d691 00007f1a1788d60c 00007f1a1788c8c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:17.542110 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968975104}
I20260709 13:02:17.578416  9102 rpcz_store.cc:276] 0709 13:02:16.475110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.599158 (+124048us) service_pool.cc:224] Handling call
0709 13:02:17.569690 (+970532us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:02:17.569880 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.577826 (+  7946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.578038 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52730624}
I20260709 13:02:17.549726  8506 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [7.6-9.7]
W20260709 13:02:17.550565  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 43793.1us
I20260709 13:02:17.524794  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.561854  9093 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:17.587146  9097 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:17.587208  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 126746us
W20260709 13:02:17.527611  8475 connection.cc:256] RPC call timeout handler was delayed by -2.2557556220000379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:02:17.588137  8475 connection.cc:256] RPC call timeout handler was delayed by -2.2197556220000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 13:02:17.588311  8475 connection.cc:256] RPC call timeout handler was delayed by -2.2035556220000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 13:02:17.588479  8475 connection.cc:256] RPC call timeout handler was delayed by -2.1676640539999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:02:17.588622  8475 connection.cc:256] RPC call timeout handler was delayed by -2.1594556219999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 13:02:17.588765  8475 connection.cc:256] RPC call timeout handler was delayed by -2.1513556220000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:02:17.588923  8475 connection.cc:256] RPC call timeout handler was delayed by -2.1090556220000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 13:02:17.589075  8475 connection.cc:256] RPC call timeout handler was delayed by -2.1027556220000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260709 13:02:17.589215  8475 connection.cc:256] RPC call timeout handler was delayed by -2.0973556220000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 13:02:17.589354  8475 connection.cc:256] RPC call timeout handler was delayed by -2.04605562200004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 13:02:17.589684  8475 connection.cc:256] RPC call timeout handler was delayed by -1.8822556220000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:02:17.528098  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.597029  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.546105  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.550136  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.543666  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2115) took 2589 ms. Trace:
I20260709 13:02:17.599265  8434 rpcz_store.cc:276] 0709 13:02:14.954478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.954662 (+   184us) service_pool.cc:224] Handling call
0709 13:02:14.974457 (+ 19795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.959407 (+1984950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.543426 (+584019us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400290ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:17.543606 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3413408640}
I20260709 13:02:17.569151  9101 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 12 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:17.601105  9098 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:17.601840  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1008) took 1001 ms. Trace:
W20260709 13:02:17.589896  8475 connection.cc:256] RPC call timeout handler was delayed by -1.8255556220000244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:02:17.602968  8475 connection.cc:256] RPC call timeout handler was delayed by -1.7733556219999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 13:02:17.603384  8475 connection.cc:256] RPC call timeout handler was delayed by -1.4945750640000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 13:02:17.603421  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:17.603821  8475 connection.cc:256] RPC call timeout handler was delayed by -1.1417750640000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 13:02:17.604249  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0884556220000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2925s for a response
I20260709 13:02:17.604794  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:17.605746 12311 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.607735  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:17.602238  9098 rpcz_store.cc:276] 0709 13:02:16.600803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.600650 (+999847us) service_pool.cc:224] Handling call
0709 13:02:17.600936 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.601619 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.601789 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.608536  8507 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:17.586087  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:17.614342  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.614429  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:17.615053  8578 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:17.615799  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:17.616775  9099 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:17.598589  9094 raft_consensus.cc:2376] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11. Re-sending same reply.
I20260709 13:02:17.617627  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:17.613207  8505 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:17.529207 12306 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:17.619503  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.670888  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.671700  8580 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:17.672864  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.673599  8577 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:17.673693  8434 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:17.674378  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.674758  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1128) took 1030 ms. Trace:
W20260709 13:02:17.672439  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 58161.8us
I20260709 13:02:17.675271  9094 rpcz_store.cc:276] 0709 13:02:16.644830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.976051 (+331221us) service_pool.cc:224] Handling call
0709 13:02:17.549961 (+573910us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:02:17.674677 (+124716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43176192}
I20260709 13:02:17.675773  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:17.528262 12425 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.569130 12474 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.674279  8510 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:17.548461 12079 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:17.678764  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:17.679832  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.680680  9095 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:17.539933 12407 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:17.550535 12355 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.576910 12322 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.619302 11813 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:02:17.612685 12386 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:17.679942  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:17.596805 12420 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:17.703506  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.704617  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.733108  8427 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:02:17.686461  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:17.707808  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1009) took 1035 ms. Trace:
I20260709 13:02:17.734431  9095 rpcz_store.cc:276] 0709 13:02:16.672421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.618697 (+946276us) service_pool.cc:224] Handling call
0709 13:02:17.680520 (+ 61823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.707225 (+ 26705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.707754 (+   529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.708148  8507 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:17.708282  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.736935  8575 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:17.708705  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 122276us
I20260709 13:02:17.708863  9094 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:02:17.738334  9094 pending_rounds.cc:85] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 5
I20260709 13:02:17.738632  9094 pending_rounds.cc:107] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:02:17.738797  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.738865  9094 raft_consensus.cc:2889] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:17.613005 12165 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:17.671341 12191 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.707598  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:17.678982 12263 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:17.546236 12226 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.714205  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.747210  8577 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:17.714745  9099 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:02:17.747609  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 67763us
I20260709 13:02:17.712303 12079 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.749846  9094 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:17.718111 12322 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:17.678869 12306 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:17.754695  9094 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 10. Ops: []
I20260709 13:02:17.755936  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.718928 12355 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:17.730866  8475 leader_election.cc:336] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.628s (SENT)
I20260709 13:02:17.733664  8580 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:17.679286 12399 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:02:17.748430  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:17.746235 12165 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.752791  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.753207  9095 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:17.753963  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.765677  8577 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:17.765758  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:17.766382  8427 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:17.717216 12407 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.757995  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:17.769819  8430 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:17.742993 12397 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:17.540057 12379 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:17.712688 12425 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.772608  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.773239  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.755445 12315 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:17.772863  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:17.776156  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 100460us
I20260709 13:02:17.777441  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:17.780642  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:17.741813 12420 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:17.757990 12263 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:17.781756  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:17.788636  9095 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260709 13:02:17.790509  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78036.9us
I20260709 13:02:17.791337  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.791970  8577 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.750159 12191 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:17.770794 12165 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:17.774417 12275 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.773532 12464 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.777987 12474 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:17.805393  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:17.814566  8475 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.686s (SENT)
I20260709 13:02:17.815266  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:17.816267 12078 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:17.816836  8475 leader_election.cc:336] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.735s (SENT)
W20260709 13:02:17.819308  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78858.6us
W20260709 13:02:17.820021  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.820276  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:17.795123 12397 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:17.826933  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:17.798123 12441 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.780069 12379 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.807987 12342 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.833873  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.831580  8549 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:17.845089  8475 leader_election.cc:336] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.744s (SENT)
I20260709 13:02:17.845598  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:17.847047  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:17.832242  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:17.835253  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:17.828629 12478 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:17.829213 12397 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:17.779273 12306 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.854072 11813 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:17.832607 12457 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.855065 12516 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:02:17.855886 12517 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:02:17.858685 12355 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.858220 12263 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.859746 12226 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.860440 12497 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.831635 12522 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:17.849161 12078 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:17.832676 12266 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:17.863515  8577 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:17.878593 12191 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:17.878682 12407 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:17.880004 12420 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:17.882308 12226 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:17.882855 12425 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.873844 12342 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:17.871989 12457 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.882887 12226 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:17.887753 12226 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.888794 12457 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.874413 12522 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.890472 12379 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:17.890640 12522 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.893196  8580 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:17.853546  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:17.848968 12230 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:17.854915 12519 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:02:17.864476 12079 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.843895 12275 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:02:17.861413 12397 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:17.903191  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:17.905594 11886 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.906886 11886 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.913651 12191 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:17.914197 12191 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.914583 12191 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.916738 12275 consensus_queue.cc:1243] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:17.876606 12266 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:17.918284 12266 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.896749  8578 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:17.845590 12525 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:02:17.875025 12306 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.833599 12464 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.945327  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.945513  8575 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:17.947531  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.947786  8578 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.948313  8577 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:17.950867  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.895133  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:17.966135  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.969758  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:17.970592  8581 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:17.972613 12472 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:17.973001 12472 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:17.966114  8475 leader_election.cc:336] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.791s (SENT)
I20260709 13:02:17.975502  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:17.975610  8583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2012) took 2129 ms (client timeout 1688 ms). Trace:
I20260709 13:02:17.976111  8432 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:02:17.976431  8583 rpcz_store.cc:269] 0709 13:02:15.845992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.851714 (+  5722us) service_pool.cc:224] Handling call
0709 13:02:17.975426 (+2123712us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400283054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:17.975550 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580827008}
I20260709 13:02:17.977396  8577 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:17.968820  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 73777.5us
I20260709 13:02:17.974610 12275 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:17.981130  8426 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:17.981396 12275 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:17.982056 12165 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:17.982372 12275 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:17.983455  8426 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:17.984167 12165 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:17.984803  8429 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:17.985301  8435 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:17.985826  8435 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:17.987035  8434 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:02:17.987529  8434 pending_rounds.cc:85] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 9
I20260709 13:02:17.987779  8434 pending_rounds.cc:107] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:02:17.988005  8434 raft_consensus.cc:2889] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:17.988776  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.990465  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:17.991107  8507 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:17.991247  8510 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:17.995544  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:17.996289  8575 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
W20260709 13:02:18.000355  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.000916  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.005625  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:18.005048  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:18.013607  8578 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:18.014386  8583 raft_consensus.cc:2410] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:18.016004  8507 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:18.016255  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 203815us
I20260709 13:02:18.015174  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:18.018424 12441 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:18.019342  8577 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:18.020085  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:18.020251  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:18.020855 12399 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:18.021317  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:18.021713  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:18.021879  8577 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:18.022713  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:18.022852  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:18.024089  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:18.024757  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:18.025440  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:18.025905  8577 raft_consensus.cc:2410] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:02:17.985381 12078 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.026894  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:18.025871  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:18.027920  8578 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:17.986469 12079 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:18.005194 12425 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:18.030282  8577 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:18.030733  9098 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:18.030114  8578 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:02:18.033289  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:18.027038  8435 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:18.057986  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 108966us
I20260709 13:02:18.027047 12420 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:18.120715  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:18.076155  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.165544  8508 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:18.070405  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:18.083055  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:18.071144  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:18.077441  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:18.166368  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 133116us
I20260709 13:02:18.168434  8430 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:18.101377  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:18.074288  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.077970  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.075774  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.070550  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:18.168216  8428 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
W20260709 13:02:18.029924 12505 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.604s	user 0.004s	sys 0.001s
I20260709 13:02:18.067735  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:18.077003  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.171509  8506 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:18.167797  8510 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:18.171223  8427 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:18.026546 11682 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:18.058918  8578 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:18.173981  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 326944us
W20260709 13:02:18.032224 12476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.012s	sys 0.001s
I20260709 13:02:18.176640  8501 raft_consensus.cc:2368] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11.
I20260709 13:02:18.034139 12078 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:18.182564 12530 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:02:18.181900  8435 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.183982 12078 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:18.029273 12306 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:18.192139  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.177980  8578 pending_rounds.cc:85] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 5
I20260709 13:02:18.032492 12441 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:18.195632  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2264) took 1987 ms. Trace:
I20260709 13:02:18.185345  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.181051  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:18.193020  8578 pending_rounds.cc:107] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:02:18.202405  8578 raft_consensus.cc:2889] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:18.203135  8507 raft_consensus.cc:2410] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:18.194981  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:18.173350 11886 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:18.196072  8579 rpcz_store.cc:276] 0709 13:02:16.208543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.106455 (+897912us) service_pool.cc:224] Handling call
0709 13:02:17.107106 (+   651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.108566 (+  1460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.108584 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.108875 (+   291us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.242924 (+134049us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:17.242961 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.243038 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.946352 (+703314us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:18.185293 (+238941us) raft_consensus.cc:1685] finished
0709 13:02:18.185314 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.195560 (+ 10246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38669696,"thread_start_us":133796,"threads_started":1,"wal-append.queue_time_us":317012}
I20260709 13:02:18.196197  8509 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:18.203547  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:18.207645  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:18.208645  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:18.180858 12476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.013s	sys 0.001s
I20260709 13:02:18.059070 12425 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:18.235603  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.075891 12397 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.126793 12191 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:18.235385  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:18.237617  8507 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:18.192165 11682 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:18.176730 12250 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:02:18.064746 12079 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.239342  8579 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:18.204730 11886 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.243906  8507 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:18.206418 12275 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:18.210276 12226 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:18.237152 12159 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.253230  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.254050  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:18.244756  8475 leader_election.cc:336] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.861s (SENT)
I20260709 13:02:18.255438  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:18.212105 12441 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:18.247609  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.256698  8503 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:18.213826 12230 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:18.212425 12457 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:18.209615 12464 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:18.259994  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.260636  8506 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
W20260709 13:02:18.260893 12535 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:18.252339  8476 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:18.245743 11886 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.327505  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1127) took 1683 ms. Trace:
I20260709 13:02:18.450111  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:18.273819  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:18.271427  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 58303.8us
W20260709 13:02:18.458727  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 218468us
I20260709 13:02:18.352301  8577 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:18.353056  8435 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 13:02:18.459105  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 206825us
W20260709 13:02:18.413000  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.274101 12355 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.355350 12191 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:18.269791 12476 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:18.353740  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1006) took 1877 ms. Trace:
I20260709 13:02:18.464035  9093 rpcz_store.cc:276] 0709 13:02:16.644520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.617607 (+973087us) service_pool.cc:224] Handling call
0709 13:02:17.617896 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.767562 (+149666us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:17.807636 (+ 40074us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.325857 (+518221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.325929 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:18.325996 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.327258 (+  1262us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.327428 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10881,"prepare.queue_time_us":40066,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":49825,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":11877,"thread_start_us":581380,"threads_started":3,"wal-append.queue_time_us":625787}
I20260709 13:02:18.579298  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:18.580883  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:18.420985 12538 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:02:18.576946  9096 rpcz_store.cc:276] 0709 13:02:16.476540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.574117 (+1097577us) service_pool.cc:224] Handling call
0709 13:02:17.574403 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.574770 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:17.749108 (+174338us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.019706 (+270598us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.020236 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.020359 (+   123us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:18.212499 (+192140us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.212709 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.212778 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.353528 (+140750us) raft_consensus.cc:1685] finished
0709 13:02:18.353549 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.353688 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9512,"prepare.queue_time_us":263989,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":2968,"raft.queue_time_us":749,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":26291,"spinlock_wait_cycles":4472192,"thread_start_us":579773,"threads_started":3,"wal-append.queue_time_us":360888}
I20260709 13:02:18.586345  9096 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:02:18.473106  8435 pending_rounds.cc:85] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 5
W20260709 13:02:18.497452  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.311528 12078 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:18.347087 12522 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:18.353885 12537 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:02:18.559402  8577 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:18.559351 12444 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:18.348327 12397 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:18.348604 12399 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.466382  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:18.593340  8435 pending_rounds.cc:107] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:02:18.636817  8435 raft_consensus.cc:2889] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:18.637348  8435 pending_rounds.cc:107] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:02:18.637864  8435 raft_consensus.cc:2889] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:18.351963 12079 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:18.608785  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:18.640367  8475 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.043s (SENT)
I20260709 13:02:18.640877  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:18.639058 12444 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:18.637243  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 170977us
I20260709 13:02:18.609164  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:18.642975 12355 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.643586  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:18.643797  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:18.639050  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2138) took 2440 ms. Trace:
I20260709 13:02:18.612576  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1016) took 1160 ms. Trace:
W20260709 13:02:18.642329  8475 leader_election.cc:336] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.106s (SENT)
I20260709 13:02:18.640614  9093 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:02:18.645005  9096 rpcz_store.cc:276] 0709 13:02:17.426987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.585635 (+1158648us) service_pool.cc:224] Handling call
0709 13:02:18.585998 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.586832 (+   834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.587068 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:18.646138  8475 leader_election.cc:336] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.164s (SENT)
I20260709 13:02:18.346800 12266 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.641726 12444 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.576992 12476 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:18.353224 12531 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:02:18.647776  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:18.644845  8435 rpcz_store.cc:276] 0709 13:02:16.199195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.239985 (+ 40790us) service_pool.cc:224] Handling call
0709 13:02:16.240268 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.985193 (+1744925us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400440d20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b6dc0 00007f1a193411c0 00007f1a19342231 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c
0709 13:02:18.638755 (+653562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.638980 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965482880}
I20260709 13:02:18.609370 12078 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.652241  9095 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:18.652976  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:18.352661 12441 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.424372 11682 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:18.662355 12274 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:02:18.635367 12483 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:18.669497  8583 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:18.640249 12542 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:18.639160 12420 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:02:18.664218 12230 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:18.676815  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:18.681748  8578 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:18.682971  8578 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.683030 12522 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:18.672852 12159 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:02:18.684615 12266 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:18.685249 12544 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:02:18.678530 12230 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:18.686141 12230 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:18.688293 12478 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.835s	user 0.013s	sys 0.000s
I20260709 13:02:18.688803 12478 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:18.689435  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 781) took 1019 ms. Trace:
I20260709 13:02:18.666934 12078 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.689883  8434 rpcz_store.cc:276] 0709 13:02:17.670370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.748809 (+ 78439us) service_pool.cc:224] Handling call
0709 13:02:17.759206 (+ 10397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.006101 (+246895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.689207 (+683106us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540023ad54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:18.689377 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500981632}
I20260709 13:02:18.667991 12355 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:18.668774 12471 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.696456 12444 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:18.671607 12540 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:02:18.698289  8432 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:18.670979 12464 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:02:18.699337 12474 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.654109 12079 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:02:18.711330 12079 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:18.711724 12079 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:18.712543 12079 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.713676 12079 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.674273 12542 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:18.714371 12542 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.699848 12474 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.710094 12476 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.721645  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.728128  8502 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:18.730432  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.731411  8502 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:18.736893  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1018) took 1308 ms. Trace:
I20260709 13:02:18.737500  9093 rpcz_store.cc:276] 0709 13:02:17.428449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.646256 (+1217807us) service_pool.cc:224] Handling call
0709 13:02:18.646589 (+   333us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:18.646990 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.647032 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:18.662817 (+ 15785us) log.cc:844] Serialized 78 byte log entry
0709 13:02:18.721371 (+ 58554us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:18.721405 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.721466 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.736574 (+ 15108us) raft_consensus.cc:1685] finished
0709 13:02:18.736602 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.736819 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":674,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7813,"thread_start_us":43099,"threads_started":1,"wal-append.queue_time_us":63361}
W20260709 13:02:18.750782  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 104659us
I20260709 13:02:18.697201 12355 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:18.755781  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.753275  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1036) took 1683 ms. Trace:
I20260709 13:02:18.754751  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:18.752354  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:18.674376 12483 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:18.756397  9094 rpcz_store.cc:276] 0709 13:02:17.070244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.757644 (+687400us) service_pool.cc:224] Handling call
0709 13:02:17.772566 (+ 14922us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.779371 (+  6805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.779406 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.783947 (+  4541us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.006919 (+222972us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:18.023998 (+ 17079us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.024188 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.024258 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.753012 (+728754us) raft_consensus.cc:1685] finished
0709 13:02:18.753039 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.753201 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1616,"prepare.queue_time_us":17436,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":7439,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":15806,"thread_start_us":184036,"threads_started":1,"wal-append.queue_time_us":326954}
I20260709 13:02:18.765854  8510 raft_consensus.cc:2410] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:18.756819 12355 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.856938  9093 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:18.861297  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.852684 12474 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.863055 12542 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.863817 12474 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:18.856937 12476 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.850289  8507 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:02:18.866943  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.852530  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.846958  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.867858  8501 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:18.844357  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:18.777102  8475 leader_election.cc:336] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.185s (SENT)
I20260709 13:02:18.868324  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:18.870548  8506 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:18.872586  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.872855  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.873383  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.873737  8501 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:18.874092  8507 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 5.
I20260709 13:02:18.868242  9065 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:18.872025  8578 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:18.878989  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:18.877681  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:18.881609  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:18.883857 11682 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:18.883978  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:18.883538  8507 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:18.887171  8578 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:18.887202  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:18.888103  8501 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.886096  9065 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:18.869514 12471 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:18.850963 12379 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:02:18.898190  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:18.898757  8584 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.893668  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:18.900270  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:18.883498 12504 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.901713 11682 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:18.807204 12078 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:18.903025  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 125952us
I20260709 13:02:18.887161 12441 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.834363 11886 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.899755 12522 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:18.899377 12471 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.911855  9102 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:18.913821  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.902055 12397 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:02:18.915432  9097 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:18.917433  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1020) took 1487 ms. Trace:
I20260709 13:02:18.923290  8506 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
W20260709 13:02:18.928478  8475 leader_election.cc:336] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.925s (SENT)
I20260709 13:02:18.928027  9093 rpcz_store.cc:276] 0709 13:02:17.429606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.739733 (+1310127us) service_pool.cc:224] Handling call
0709 13:02:18.740487 (+   754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.861290 (+120803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.917126 (+ 55836us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54005014d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:18.917355 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267364096}
I20260709 13:02:18.925115  8502 raft_consensus.cc:2368] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:02:18.925843  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1022) took 1489 ms. Trace:
I20260709 13:02:18.929064  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:18.929317  9102 rpcz_store.cc:276] 0709 13:02:17.435123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.911348 (+1476225us) service_pool.cc:224] Handling call
0709 13:02:18.911682 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.924266 (+ 12584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.924456 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.892338 12230 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.930160  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1151) took 1458 ms. Trace:
I20260709 13:02:18.931694  9097 rpcz_store.cc:276] 0709 13:02:17.472060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.914777 (+1442717us) service_pool.cc:224] Handling call
0709 13:02:18.915112 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.927891 (+ 12779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.930105 (+  2214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.935487  9093 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:02:18.922766 12522 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.935855  9093 pending_rounds.cc:85] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 9
I20260709 13:02:18.938946  9093 pending_rounds.cc:107] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:02:18.939239  9093 raft_consensus.cc:2889] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:18.939131  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1154) took 1466 ms. Trace:
I20260709 13:02:18.939961  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1153) took 1467 ms. Trace:
I20260709 13:02:18.939682  9102 rpcz_store.cc:276] 0709 13:02:17.472566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.930113 (+1457547us) service_pool.cc:224] Handling call
0709 13:02:18.938665 (+  8552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.938826 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.938851 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.938889 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:18.938917 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.938968 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.939077 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.940444  9093 rpcz_store.cc:276] 0709 13:02:17.472393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.929308 (+1456915us) service_pool.cc:224] Handling call
0709 13:02:18.929592 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.939752 (+ 10160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.939917 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.943351  9093 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:18.943845  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1025) took 1043 ms. Trace:
I20260709 13:02:18.944092  9093 rpcz_store.cc:276] 0709 13:02:17.900918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.942930 (+1042012us) service_pool.cc:224] Handling call
0709 13:02:18.943214 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.943689 (+   475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.943810 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.946012 12542 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:18.947324 12471 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:18.923869 12355 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:18.951576  9093 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:18.935101 12552 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:18.941655 12522 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.961374 12483 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:18.978916  8475 leader_election.cc:336] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 3.328s (SENT)
I20260709 13:02:18.952267 11886 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:18.982419  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.978217  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:18.984959  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.988987 12474 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.989195 12078 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:18.989604 12474 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:18.990756 12230 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:18.990849 12468 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.991677 12474 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:18.993449 12317 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:18.993568  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:18.993884 12317 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:18.994308  8427 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:18.994740 12317 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:18.996030 12472 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:18.997148 12472 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.997833  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2267) took 2729 ms. Trace:
I20260709 13:02:19.005908  8508 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:19.006507  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 782) took 1335 ms. Trace:
I20260709 13:02:19.006877  8429 rpcz_store.cc:276] 0709 13:02:17.670672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.759549 (+ 88877us) service_pool.cc:224] Handling call
0709 13:02:17.759833 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.993706 (+233873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.006298 (+1012592us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54003f0554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:19.006449 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516891904}
I20260709 13:02:19.003330  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1028) took 1015 ms. Trace:
I20260709 13:02:18.988355  9065 leader_election.cc:400] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:02:19.007841  9095 rpcz_store.cc:276] 0709 13:02:17.988023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.204949 (+216926us) service_pool.cc:224] Handling call
0709 13:02:19.002675 (+797726us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400544554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:19.003163 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939296128}
I20260709 13:02:19.008354  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 621) took 1332 ms. Trace:
I20260709 13:02:19.008757  8580 rpcz_store.cc:276] 0709 13:02:17.676102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.822908 (+146806us) service_pool.cc:224] Handling call
0709 13:02:19.008184 (+1185276us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b5400066dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:19.008303 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112612096}
I20260709 13:02:19.007984  9065 leader_election.cc:403] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:18.991431 12468 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.009895  8578 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:18.998216  8582 rpcz_store.cc:276] 0709 13:02:16.268155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.163355 (+895200us) service_pool.cc:224] Handling call
0709 13:02:17.163825 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.239073 (+1075248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.239100 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.242002 (+  2902us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.473656 (+231654us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b180001c600. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:02:18.632189 (+158533us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:18.632253 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.997543 (+365290us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400115154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:18.997588 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.997630 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:18.997642 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.997776 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21776,"raft.queue_time_us":31872,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13089,"spinlock_wait_cycles":2431664640,"thread_start_us":158291,"threads_started":1,"wal-append.queue_time_us":416406}
I20260709 13:02:19.013942  8584 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
W20260709 13:02:19.014184  9100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1005) took 2510 ms (client timeout 1528 ms). Trace:
I20260709 13:02:19.016340  8501 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:19.017233  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:19.018060  9101 raft_consensus.cc:2410] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:19.017740 12542 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:19.019002  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:19.015455  9100 rpcz_store.cc:269] 0709 13:02:16.476166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.476318 (+   152us) service_pool.cc:224] Handling call
0709 13:02:18.963335 (+2487017us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5800117098. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:02:18.986167 (+ 22832us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54052224}
I20260709 13:02:19.016608  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:19.020351 12483 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:02:19.021608 12397 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.023768 12379 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:19.024677 12522 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.026396  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2131) took 2852 ms. Trace:
I20260709 13:02:19.026758  8433 rpcz_store.cc:276] 0709 13:02:16.174087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.174229 (+   142us) service_pool.cc:224] Handling call
0709 13:02:16.186585 (+ 12356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.962391 (+775806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.026188 (+2063797us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54003a2854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:19.026342 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1782626560}
I20260709 13:02:19.027202 12468 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:19.027482 12522 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:19.028317  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:19.021673  9093 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:19.031073  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:19.031718  8509 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.034087 12397 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
W20260709 13:02:19.037513  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.038731  8509 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:19.039454 12372 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:19.042243 12379 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:19.042689  9101 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:19.043256 12379 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:19.043639 12379 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:19.044610  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:19.045266  8580 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:19.044978 12379 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.046164  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:19.046649 12379 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:19.048087  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.046746  8580 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:19.048574  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:19.049118  9101 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.042735  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:19.050585  8582 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.051857  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:19.058333 12311 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:19.061236  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2337) took 4267 ms. Trace:
I20260709 13:02:19.061923 12459 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:19.063117  9098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1027) took 1161 ms (client timeout 1528 ms). Trace:
I20260709 13:02:19.061650  8504 rpcz_store.cc:276] 0709 13:02:14.793853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.910214 (+116361us) service_pool.cc:224] Handling call
0709 13:02:14.947457 (+ 37243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.948041 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:14.948404 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.034516 (+ 86112us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b4800220158. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:02:15.260711 (+226195us) log.cc:844] Serialized 14 byte log entry
0709 13:02:15.263687 (+  2976us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:15.285805 (+ 22118us) log.cc:844] Serialized 26 byte log entry
0709 13:02:15.285943 (+   138us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:15.285990 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.286077 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.114194 (+1828117us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b180003dde0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1
0709 13:02:19.059210 (+1945016us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b180003dde0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:19.061011 (+  1801us) raft_consensus.cc:1685] finished
0709 13:02:19.061035 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.061162 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64905,"prepare.queue_time_us":64812,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":47780,"raft.run_cpu_time_us":1061,"raft.run_wall_time_us":75373,"spinlock_wait_cycles":186360064,"thread_start_us":277648,"threads_started":2,"wal-append.queue_time_us":116770}
W20260709 13:02:19.063516  9098 rpcz_store.cc:269] 0709 13:02:17.901451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.902917 (+  1466us) service_pool.cc:224] Handling call
0709 13:02:19.062951 (+1160034us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000e83d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:19.063061 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265396608}
I20260709 13:02:19.061256  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:19.064540  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:19.065174 12230 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:19.065600 12230 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.066591  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1032) took 2048 ms. Trace:
I20260709 13:02:19.065868  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:19.068236  8580 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:19.069784  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:19.067818  9099 rpcz_store.cc:276] 0709 13:02:17.018595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.748395 (+729800us) service_pool.cc:224] Handling call
0709 13:02:17.763312 (+ 14917us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:17.785517 (+ 22205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.785573 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:18.834435 (+1048862us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b2c000913e8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:02:18.835017 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 13:02:18.905286 (+ 70269us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:18.919343 (+ 14057us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.919706 (+   363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.919800 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.066287 (+146487us) raft_consensus.cc:1685] finished
0709 13:02:19.066404 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.066542 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3951,"prepare.queue_time_us":3571,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":6661,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":13539,"spinlock_wait_cycles":12481280,"thread_start_us":69865,"threads_started":1,"wal-append.queue_time_us":113863}
I20260709 13:02:19.080160  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:19.081152  9093 raft_consensus.cc:2410] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:19.082738  9101 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:19.064440 12311 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:19.085575  9101 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:19.086145  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:19.063915 12459 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:19.066274 12542 consensus_queue.cc:1059] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:02:19.100574  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:19.121938  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:19.065970 12230 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:19.087666  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 132604us
W20260709 13:02:19.131206  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.139673  9098 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
W20260709 13:02:19.109346 12507 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.695s	user 0.006s	sys 0.000s
I20260709 13:02:19.134402  8433 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.141160  9098 pending_rounds.cc:85] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 7
I20260709 13:02:19.055222 12483 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:19.086778 12311 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:19.085115 11886 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:02:19.131954 12459 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:19.142419  9098 pending_rounds.cc:107] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:02:19.080348 12399 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:19.099916 12476 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:19.076732 12468 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:02:19.114979 12457 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:19.182497  9098 raft_consensus.cc:2889] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:19.166185  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 65701.9us
I20260709 13:02:19.183495  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:19.142669 12355 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:19.197096  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:19.197985 12311 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:19.173645 12472 raft_consensus.cc:3055] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:19.184662 12476 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.184477 12457 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:19.199669 12560 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:02:19.196291 12250 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:19.223057 12311 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.223340 12459 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.210165 12115 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:19.230192  8582 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:19.220340 12455 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:19.219705 12472 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:19.196046 12399 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.221532 12476 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:19.253186  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2265) took 3003 ms. Trace:
I20260709 13:02:19.253607  8576 rpcz_store.cc:276] 0709 13:02:16.249547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.125053 (+875506us) service_pool.cc:224] Handling call
0709 13:02:17.129041 (+  3988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.129242 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.129264 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.138636 (+  9372us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.231171 (+ 92535us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:17.245470 (+ 14299us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.245804 (+   334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.245926 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.525517 (+279591us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b180035ae80. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:19.099601 (+1574084us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:19.252965 (+153364us) raft_consensus.cc:1685] finished
0709 13:02:19.252986 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.253131 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32040,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":51,"raft.queue_time_us":4868,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":12734,"spinlock_wait_cycles":46260864,"thread_start_us":83047,"threads_started":1,"wal-append.queue_time_us":116902}
W20260709 13:02:19.256606  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0948937229999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:02:19.257092  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0948937229999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:02:19.257375  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0327937229999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:02:19.257642  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0300937229999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:02:19.257903  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0300937229999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:02:19.258265  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0228937229999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 13:02:19.258527  8475 connection.cc:256] RPC call timeout handler was delayed by -1.010293723000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:02:19.260795  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.237442 12115 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.262068  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:19.195080 12483 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.237380 12250 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:19.242607 12455 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.267697  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:19.272691 12542 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:19.274310  8507 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 7: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:19.274760  9098 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:19.283164  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:19.267592 12564 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:02:19.286119  8433 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
W20260709 13:02:19.289000  8398 connection.cc:256] RPC call timeout handler was delayed by -1.3499408850000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 13:02:19.280860  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:19.297441  8398 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:19.299203  8509 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:19.264134 12115 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:19.302645  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.266957 12459 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:19.304344  8505 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:02:19.304368  9067 leader_election.cc:336] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 1.724s (SENT)
I20260709 13:02:19.304541  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:19.305482  8502 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:19.308599  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.312278  8431 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:19.309544  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2023) took 1540 ms. Trace:
I20260709 13:02:19.274139 12455 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.312949  8579 rpcz_store.cc:276] 0709 13:02:17.769612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.243791 (+474179us) service_pool.cc:224] Handling call
0709 13:02:18.258270 (+ 14479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.262608 (+  4338us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:18.306697 (+ 44089us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.032420 (+725723us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b180009e3e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:02:19.100414 (+ 67994us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.100830 (+   416us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.110243 (+  9413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.110289 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.110450 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.309314 (+198864us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b5400116cd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:19.309369 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.309475 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10103,"prepare.queue_time_us":52787,"prepare.run_cpu_time_us":7577,"prepare.run_wall_time_us":91850,"raft.queue_time_us":9200,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":254,"spinlock_wait_cycles":17528832,"thread_start_us":67385,"threads_started":1,"wal-append.queue_time_us":821667}
I20260709 13:02:19.314968  8426 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:19.308480  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.315743  8434 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:19.316278  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:19.283068 12542 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.318529  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:19.320300  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:19.321795  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:19.321923  8509 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.322606  8432 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:19.320515  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:19.323490  8505 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:19.324648  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:19.325242  8504 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:19.290277 12468 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:19.328996  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:19.330596  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:19.306278 12079 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:19.309819 12402 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.341223  8507 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:02:19.329735  8434 raft_consensus.cc:2376] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10. Re-sending same reply.
I20260709 13:02:19.342365  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:19.313252 12552 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:19.342697  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:19.343717  8509 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:19.324961 12542 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:19.382510  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.382964  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 185944us
I20260709 13:02:19.339648 12079 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:19.383167 12402 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.315294 12078 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:02:19.328341 12522 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:19.385247  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.357785  8504 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.395757  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:19.396510  8506 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
W20260709 13:02:19.390650  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.356799 12566 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:02:19.406013  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 97491.2us
I20260709 13:02:19.381296 12355 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:19.393836 12543 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:19.409190  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:19.410291  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:19.411204  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.413877  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:19.414201  8434 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.393692 12079 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.408799  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.426009  8581 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:19.398363 12402 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.427683  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:19.413131 12565 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:02:19.357501 12468 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.428907  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.430754  8576 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:19.408002 12545 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:19.432431  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74152.1us
I20260709 13:02:19.434852  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:19.320994 12472 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.444641  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:19.447958 12471 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.448606 12471 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:19.345361 12250 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:19.450886  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 630) took 1660 ms. Trace:
I20260709 13:02:19.441917 12545 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:19.435292 12552 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:19.408367 12191 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:02:19.478610 12230 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.461301  8583 rpcz_store.cc:276] 0709 13:02:17.790405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.023861 (+233456us) service_pool.cc:224] Handling call
0709 13:02:19.450676 (+1426815us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b540028c8d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:19.450818 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482601344}
I20260709 13:02:19.461018  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.460752  8577 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:19.462391  8434 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:19.460407  8504 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:19.461378 12078 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:19.509274 12274 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:02:19.461933 12583 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:19.516758  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:19.517611  8504 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
W20260709 13:02:19.519070  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 58140.5us
I20260709 13:02:19.519753  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:19.526276  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.503649 12399 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:19.531550  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:19.507730 12322 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:19.518538 12552 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:19.570748  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:19.572741  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 84293.5us
I20260709 13:02:19.577500  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.581406 12420 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:19.582306  8321 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.372s	user 0.013s	sys 0.012s
W20260709 13:02:19.583084 12573 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:02:19.563828 12477 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:19.573875 12322 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:19.531201 12483 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:19.554971 12078 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:19.559171 12355 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:19.589854  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:19.604992  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 173328us
W20260709 13:02:19.609334  8400 leader_election.cc:336] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.528s (SENT)
I20260709 13:02:19.609869  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:19.611440  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:19.612947 12522 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:19.613559 12522 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:19.614735 12522 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:19.588542 12570 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
W20260709 13:02:19.630723  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 368696us
I20260709 13:02:19.589840 12477 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:19.596473 12322 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:19.637167 12567 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:02:19.530560 12545 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.605978 12078 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.643040 12355 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:19.661890 12576 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:02:19.643903 12552 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:19.645349 11886 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:19.467864 12540 consensus_queue.cc:1175] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6930e07cbba2484ca2bf800a58acdbb0" responder_term: 9 status { last_received { term: 4 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: [8.6-8.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:19.667553 12355 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:19.668358 12578 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:19.668874 12578 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:19.669767 12578 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.674460 12552 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:19.675050 12552 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:19.677019 12601 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:19.600756 12079 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.697697 12079 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:19.663228 12078 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:19.702255 12468 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:19.658116 12322 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.689141 12455 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.694317 12477 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.695631 12230 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:19.633142 12483 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:02:19.698628 12079 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:19.673448 12476 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:19.733300  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 105848us
W20260709 13:02:19.744529  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.744652  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 154842us
W20260709 13:02:19.778156  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.790583  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 134725us
I20260709 13:02:19.794230  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.796321  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.797039  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.797847  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:19.799454  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 207778us
I20260709 13:02:19.739152 12115 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:19.806860  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.759660  8431 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:19.666565 12420 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:02:19.813138  8432 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:19.820669  8381 auto_rebalancer.cc:893] Removing replace marker failed: Replica dacb523538a14c7cb335ab9c18f4111b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:02:19.821122  8381 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:02:19.821391  8381 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:02:19.793262  8380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.BulkChangeConfig -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 118868us
W20260709 13:02:19.822255  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.823434  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:19.823446  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.824544 12311 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:19.824735  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.825075 12311 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:19.826082 12468 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:02:19.826886 12599 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:19.827183 12311 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:19.827286 12599 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:19.829085  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:19.828228 12599 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.838359 12322 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:19.839200 12599 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.839637 12476 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:19.828730 12552 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.842876 12552 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:19.777850 12477 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.790582 12578 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.799445 12471 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:19.853658  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 250674us
I20260709 13:02:19.663103 12402 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:19.777774 12598 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:19.817462 12379 consensus_meta.cc:287] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.770s	user 0.009s	sys 0.004s
I20260709 13:02:19.869222  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:19.759704 12545 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.870577  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:19.875222  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.885161  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.804116 12584 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:02:19.848726 12476 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.923578  8427 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:19.903950  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:19.932089  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 133921us
W20260709 13:02:19.910171 12542 consensus_meta.cc:287] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.002s
I20260709 13:02:19.932245  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:19.894142 12471 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:19.962212  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.965173  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.853154 12420 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:02:19.974968  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:19.898089 12468 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:02:19.897886 12467 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:02:19.970655 12542 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:19.982689 12322 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:19.923413 12598 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:19.935982 12191 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:19.968622 12263 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.000838  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 131683us
I20260709 13:02:20.015807  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:19.986941 12317 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.939276 12476 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.018685  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:20.019534  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 56822.5us
W20260709 13:02:19.987892 12590 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:20.057014 12402 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:19.998344 12115 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:19.983570 12616 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:02:19.984292 12420 consensus_queue.cc:1243] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:02:19.989876 12592 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:20.097342  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.070333  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:20.112862  8576 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:19.977056 12230 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:02:20.078166  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 142865us
W20260709 13:02:20.062801 12603 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:19.983793 12471 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:02:20.085366  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.086128  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.193523  8583 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.057914 12402 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:20.087095  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 68565.7us
I20260709 13:02:20.106320  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.197712  8435 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:20.199023  8547 leader_election.cc:400] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11.
I20260709 13:02:20.199440  8547 leader_election.cc:403] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:20.200649  8576 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:20.201310  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.176807 12425 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:20.005303 12459 consensus_meta.cc:287] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.688s	user 0.016s	sys 0.000s
I20260709 13:02:20.112912  9093 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.071116  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.113739 12620 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:20.100126 12588 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.114395 12625 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.115375 12372 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.115674 12542 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:20.117062 12472 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.119791 12600 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.120085  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2293) took 1076 ms. Trace:
I20260709 13:02:20.121048  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1170) took 1100 ms. Trace:
I20260709 13:02:20.221881  8580 rpcz_store.cc:276] 0709 13:02:19.043920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.079775 (+ 35855us) service_pool.cc:224] Handling call
0709 13:02:19.080074 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.290694 (+210620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.290712 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.290740 (+    28us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:19.290805 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.119828 (+829023us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000672d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:20.119874 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.120029 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483913088}
I20260709 13:02:20.120555 12611 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.078598 12522 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:20.122546  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.210660 12464 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.022536 12263 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.132498  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2027) took 2349 ms. Trace:
I20260709 13:02:20.100391 12597 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.102595 12598 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.093889 12604 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:20.138634  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:20.098259 12612 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:20.022589 12455 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:20.139719 12457 consensus_meta.cc:287] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.904s	user 0.004s	sys 0.008s
I20260709 13:02:20.177727  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.018612 12078 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:20.239586  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.241176 12078 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:20.183549  8579 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:20.184298  8510 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:20.178273 12623 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:20.245565  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:20.246438  8427 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:20.129980  8321 maintenance_manager.cc:643] P 9ac2f5f0926d4b9294bfce4452124031: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.684s	user 0.210s	sys 0.157s Metrics: {"bytes_written":29965,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":204477,"dirs.run_cpu_time_us":453,"dirs.run_wall_time_us":6853,"drs_written":1,"lbm_read_time_us":482,"lbm_reads_lt_1ms":4,"lbm_write_time_us":614403,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":6,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":22226304,"thread_start_us":436257,"threads_started":2,"update_count":9,"wal-append.queue_time_us":299870}
I20260709 13:02:20.176509 12191 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:20.205569 12274 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.207284 12471 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11.
I20260709 13:02:20.248026 12274 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.214279  8503 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:02:20.258563  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.266803  9093 raft_consensus.cc:2410] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:20.219165 12588 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:20.273180  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 60265.1us
I20260709 13:02:20.218116  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.274550  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.215322  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1021) took 2780 ms. Trace:
I20260709 13:02:20.207705 12476 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:20.208518 12402 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:20.228672  8577 rpcz_store.cc:276] 0709 13:02:17.783608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.614129 (+830521us) service_pool.cc:224] Handling call
0709 13:02:19.451739 (+837610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.504516 (+ 52777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.132278 (+627762us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b540028c8d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:20.132433 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925431168}
I20260709 13:02:20.221982  9095 rpcz_store.cc:276] 0709 13:02:19.020307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.030677 (+ 10370us) service_pool.cc:224] Handling call
0709 13:02:19.030971 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.031305 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:19.143348 (+112043us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.574950 (+431602us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.575507 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.575659 (+   152us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.575692 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.575765 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.120826 (+545061us) raft_consensus.cc:1685] finished
0709 13:02:20.120851 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.120990 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110380,"prepare.queue_time_us":123545,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":1931,"raft.queue_time_us":8617,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7175,"thread_start_us":431081,"threads_started":1,"wal-append.queue_time_us":662738}
I20260709 13:02:20.234100  9096 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:20.234705  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 112273us
I20260709 13:02:20.219257 12411 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:20.226459 12611 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:20.185709 12595 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:20.270293 12379 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.269719  8583 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:20.237793 12578 raft_consensus.cc:2764] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:02:20.218849  8426 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:20.277566  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.286849  8432 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:20.220743 12372 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.229734 12542 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:02:20.279608  8579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:02:20.292289  8579 raft_consensus.cc:606] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:20.292725  8579 raft_consensus.cc:614] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:20.236508 12522 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.248386 12191 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.289731  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.290603  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:20.237849 12625 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:02:20.283650 12611 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.275440  9094 rpcz_store.cc:276] 0709 13:02:17.434610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.771053 (+1336443us) service_pool.cc:224] Handling call
0709 13:02:18.855616 (+ 84563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.855876 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:18.856182 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.118410 (+1262228us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b1800424b40. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:02:20.214969 (+ 96559us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.215023 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:20.215069 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.215149 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.215270 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14682,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":243,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5034,"spinlock_wait_cycles":8209152,"thread_start_us":96127,"threads_started":1,"wal-append.queue_time_us":1416928}
I20260709 13:02:20.301491  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:20.291426 12425 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.267967 12457 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.311199  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.311899  8509 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:20.293315 12604 raft_consensus.cc:2764] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:20.309187  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.310415  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.318004  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.319487  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:20.312879  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2373) took 1030 ms. Trace:
I20260709 13:02:20.320904  8507 rpcz_store.cc:276] 0709 13:02:19.282453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.282575 (+   122us) service_pool.cc:224] Handling call
0709 13:02:19.340905 (+ 58330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.382094 (+ 41189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.312646 (+930552us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b540005b4d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:20.312808 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133360384}
I20260709 13:02:20.322191  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:20.313553  8510 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:20.303320 12633 raft_consensus.cc:2764] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:20.314996  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:20.326483  8583 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:20.327195  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.328526  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.329294  8583 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:20.330067  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:20.330504  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 43592.4us
I20260709 13:02:20.331056 12471 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.331811  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.331568 12471 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.332890  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:20.330083  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.333828 12420 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.334427 12420 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:20.307314 12545 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:20.335116 12545 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:20.335556 12545 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.334851 12420 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.291563 12379 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.340421  8432 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:20.336373  8583 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:20.351652  8547 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.291997 12504 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:02:20.305745 12230 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.360369  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.364817  8583 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:20.362319  8547 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:20.369125  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:20.370136  8547 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:20.370283  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:20.370895  8434 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:20.372943  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:20.371857 12402 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.374459  8427 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:20.342360 12609 raft_consensus.cc:2764] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:20.384707  8580 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:20.386116  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.374303 12620 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:20.362986 12464 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:20.394896  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.398473  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.398782  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:20.366137 12542 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.403797  8430 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:20.400290  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:20.409577  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.375736 12522 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:20.380620 12612 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.374495 12634 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.375561 12372 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:20.363294 12078 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:20.374666 12623 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:20.374812 12355 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:02:20.391248 12552 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:20.403417 12379 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:20.402697 12464 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.432245  8322 maintenance_manager.cc:419] P 9ac2f5f0926d4b9294bfce4452124031: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10446 bytes on disk
I20260709 13:02:20.428854  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:20.431110  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.434170  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.374584 12616 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:02:20.441606  8583 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:20.442844  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.444828  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.432271 12464 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:20.451478 12411 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:20.452056  8582 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:20.438258 12620 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.452033 12411 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.458133 12606 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:20.458271  8321 maintenance_manager.cc:643] P 9ac2f5f0926d4b9294bfce4452124031: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.025s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":382,"lbm_reads_lt_1ms":4}
I20260709 13:02:20.459599 12605 raft_consensus.cc:3055] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:20.460069 12605 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:20.458657 12606 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:20.467976  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.461040 12605 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.464046 12600 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:20.438537 12552 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.428025 12522 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:20.470644  8579 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:20.469383 12263 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:20.475348 12411 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:20.478462  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.480326 12411 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:20.485517  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.474187 12522 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.486569 12522 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.490284  8577 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:02:20.501659  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 795) took 1091 ms. Trace:
I20260709 13:02:20.502115  8431 rpcz_store.cc:276] 0709 13:02:19.409866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.410007 (+   141us) service_pool.cc:224] Handling call
0709 13:02:20.501427 (+1091420us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54003f0a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:20.501569 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794739072}
I20260709 13:02:20.471350 12600 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:20.504115 12600 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.505440  8579 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 10. Ops: []
W20260709 13:02:20.506314 12569 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.283s	user 0.000s	sys 0.013s
I20260709 13:02:20.506443 12605 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.507735  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1175) took 1448 ms. Trace:
I20260709 13:02:20.508136  9099 rpcz_store.cc:276] 0709 13:02:19.059020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.087611 (+ 28591us) service_pool.cc:224] Handling call
0709 13:02:19.114744 (+ 27133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.122476 (+  7732us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:19.122518 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.128418 (+  5900us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.169468 (+ 41050us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:19.169526 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.169633 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.505737 (+1336104us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:20.507424 (+  1687us) raft_consensus.cc:1685] finished
0709 13:02:20.507447 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.507673 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2557,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":4519680,"thread_start_us":3912,"threads_started":1,"wal-append.queue_time_us":78923}
I20260709 13:02:20.510403 12606 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.511811 12606 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:20.513202  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.446700 12588 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:20.490628  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.512966 12464 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.514533  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:20.521351  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.492664 12552 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:20.505673 12600 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.523849 12191 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.526684  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.534466  8501 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:20.501207 12545 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.535567  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:20.541594  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 141376us
I20260709 13:02:20.542126  8501 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:20.542258  9065 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.543995  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.545212  8501 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:20.546600  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:20.544057  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:20.549463  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:20.551283  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:20.552883  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:20.553020  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:20.553442  8430 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.548807  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:20.551671  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:20.555438  8501 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 12: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:20.555748  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.556514  8582 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:20.556823  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:20.557714  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.558964  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:20.557761  8501 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:20.540400 12588 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.563969  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:20.572515  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:20.564929  8398 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:20.557225 12372 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.549311 12459 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.585697 12626 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:02:20.533370 12191 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.554826 12574 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.587109  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2152) took 1284 ms. Trace:
I20260709 13:02:20.592892  8501 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:20.564554 12467 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:20.617974  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:20.540398 12611 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.631132  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.632350  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:20.633092  8501 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:20.574648 12311 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:20.565130 12477 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.621212  8433 rpcz_store.cc:276] 0709 13:02:19.302300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.302408 (+   108us) service_pool.cc:224] Handling call
0709 13:02:19.302644 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.470475 (+167831us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:19.514996 (+ 44521us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.579463 (+ 64467us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.579576 (+   113us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.579662 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.586886 (+1007224us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400238f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:20.586931 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.587057 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39864,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2572,"raft.queue_time_us":26010,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12706,"spinlock_wait_cycles":386772736,"thread_start_us":63384,"threads_started":2,"wal-append.queue_time_us":599901}
I20260709 13:02:20.562712 12628 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:20.603538 12250 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:20.655278 12250 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:20.656385 12250 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.623803 12165 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.659693 12609 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:20.660064 12165 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.660378 12609 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.638602  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.662561  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2288) took 1793 ms. Trace:
I20260709 13:02:20.662935  8578 rpcz_store.cc:276] 0709 13:02:18.869273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.891904 (+ 22631us) service_pool.cc:224] Handling call
0709 13:02:19.009592 (+117688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.014953 (+  5361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.662368 (+1647415us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400066dd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:20.662504 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270032256}
I20260709 13:02:20.664649 12624 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.665205 12624 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.668478 12191 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:20.669086 12191 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:20.670243  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 141835us
W20260709 13:02:20.670835 12568 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.402s	user 0.006s	sys 0.000s
I20260709 13:02:20.630945 12574 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.642624  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:20.672748 12574 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:20.673241 12574 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:20.673358  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.591076 12372 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:20.673759  8398 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:20.659762 12322 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:20.675002 12322 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.675809 12624 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:20.677870 12575 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:20.678375 12575 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:20.679308 12611 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:20.679270 12575 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.680320 12575 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.629046 12468 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:02:20.681632  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.682395  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.682736  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:20.683305  8582 raft_consensus.cc:2376] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8. Re-sending same reply.
I20260709 13:02:20.645592 12420 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.684197  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.685407 12420 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:20.645043  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.686616  8505 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:20.686507  8575 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.643661 12630 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.690614  8577 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:20.687544  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:20.649011  8430 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:20.670493 12355 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:20.653286 12464 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:20.682422  8579 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:20.685318  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.694636  8576 raft_consensus.cc:2410] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 13:02:20.695055  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 143825us
I20260709 13:02:20.673646 12574 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.695474  8505 raft_consensus.cc:2368] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12.
I20260709 13:02:20.674167 12372 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.696924  8578 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:20.677616 12322 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:20.702397  9067 connection.cc:256] RPC call timeout handler was delayed by -1.0537849399999573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
I20260709 13:02:20.704823  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.734292  8584 raft_consensus.cc:2410] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:20.647504 12467 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:20.706825  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:20.707027 12578 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:20.707468 12626 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:20.716986  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.750254 12626 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:20.750645 12626 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:20.750792  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.751109  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2383) took 1300 ms. Trace:
I20260709 13:02:20.751374  8508 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:20.691047 12630 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.751466  8502 rpcz_store.cc:276] 0709 13:02:19.450989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.462791 (+ 11802us) service_pool.cc:224] Handling call
0709 13:02:19.469170 (+  6379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.513249 (+ 44079us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:19.513592 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.803761 (+290169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.803812 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:19.803866 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.750899 (+947033us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b540033b654. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:20.750940 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.751059 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":653,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":26698,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10507,"spinlock_wait_cycles":100717312,"thread_start_us":289473,"threads_started":2,"wal-append.queue_time_us":342683}
I20260709 13:02:20.752729 12630 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.751466 12626 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:20.695636 12646 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:02:20.754606  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.736776 12355 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:02:20.755366  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 799) took 1342 ms. Trace:
I20260709 13:02:20.695777 12311 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:20.755757  8426 rpcz_store.cc:276] 0709 13:02:19.413349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.565063 (+151714us) service_pool.cc:224] Handling call
0709 13:02:19.574239 (+  9176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.285953 (+711714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.755138 (+469185us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b540025a3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:20.755289 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481621248}
I20260709 13:02:20.756294 12311 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.756950 12649 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.757479 12649 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.718981  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.759176  8578 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:20.723695  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:20.760013  8503 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:20.761068  8503 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:20.762137  8503 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:20.727106 12372 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:20.728652  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.764060  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:20.764329  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.764717  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:20.729388  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.767808  8582 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:20.729344  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.730839  8547 leader_election.cc:400] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12.
I20260709 13:02:20.769304  8547 leader_election.cc:403] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:20.733151  8575 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:20.705514 12165 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:20.737291  8505 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:20.690732 12411 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.739099  8581 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:20.739202  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:20.728880 12420 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:20.775450  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44735.3us
I20260709 13:02:20.693401 12628 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:20.742890  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.742519 12467 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.694681 12624 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.744459  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.746248 12274 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:20.800936  9100 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:20.748713  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:20.749346  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.801590  8584 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:20.782480  8398 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:20.802570  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:20.803531  9093 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:20.767036  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.739755  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:20.772831  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 43559.8us
I20260709 13:02:20.699087 12574 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.575918 12588 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:20.754675 12626 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:20.777077  9099 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:20.772229 12411 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.780143  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.780153  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:20.799168  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.926100  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.747076  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.836278  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:20.771262 12397 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.854784  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:20.855010  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.857072  8430 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 10. Ops: []
I20260709 13:02:20.777005  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:20.917999  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 366785us
I20260709 13:02:20.775702 12420 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:20.923413  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 141009us
I20260709 13:02:20.774288 12552 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:20.777854 12455 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.921358  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 793) took 1513 ms. Trace:
I20260709 13:02:20.760425 12522 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:20.984229  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 148078us
I20260709 13:02:20.963860  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:20.962461  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.778187 12620 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12.
I20260709 13:02:20.804646 12631 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:21.019403  9095 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:21.020440  9100 raft_consensus.cc:2376] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10. Re-sending same reply.
I20260709 13:02:21.038848  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:21.039899  8435 rpcz_store.cc:276] 0709 13:02:19.407956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.408145 (+   189us) service_pool.cc:224] Handling call
0709 13:02:19.408471 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.198291 (+789820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.921112 (+722821us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b540037fad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:20.921298 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814035712}
I20260709 13:02:20.962456 12411 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:21.083681  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:20.827912 12600 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.215s
I20260709 13:02:21.014657 12578 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:21.077831 12577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.648s	user 0.010s	sys 0.018s
I20260709 13:02:21.014343 12634 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:21.015076 12078 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:21.016078 12464 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:21.041668 12613 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:02:20.984952 12263 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:21.114499  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49833.3us
I20260709 13:02:21.294829  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:21.031567 12545 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:20.985231 12599 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:21.038062 12455 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.236335  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:21.236624  9096 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:21.244578  9099 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:21.326661  9094 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
W20260709 13:02:21.231325 12577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.828s	user 0.011s	sys 0.022s
I20260709 13:02:21.090854 12609 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:21.181214 12631 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.187772 12552 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.130s
W20260709 13:02:21.365998  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 375960us
I20260709 13:02:21.050475 12605 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.255s
I20260709 13:02:21.336697  9096 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:21.261715 12568 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:02:21.364573  8509 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:21.337932 12578 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:21.378657  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:21.378856 12650 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.379393 12650 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.380112  8509 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:21.381151 12577 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:21.381651 12616 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:21.381942 12651 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.368661 12311 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:21.366792 12606 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.002s
I20260709 13:02:21.382819 12651 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.382105 12616 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:21.320721 12599 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.035964 12397 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.335623 12455 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:21.366041 12631 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.264901 12078 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.401127  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1159) took 3927 ms. Trace:
I20260709 13:02:21.381668 12577 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:21.402498  9093 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:21.256983 12420 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.321791 12263 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.408989  9097 rpcz_store.cc:276] 0709 13:02:17.473351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.934738 (+1461387us) service_pool.cc:224] Handling call
0709 13:02:18.935065 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.936548 (+  1483us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:19.139107 (+202559us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b180044f740. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf 00007f1a19359038
0709 13:02:19.139349 (+   242us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.670170 (+1530821us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:21.030456 (+360286us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180044f740. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a
0709 13:02:21.032442 (+  1986us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.033055 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.033254 (+   199us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:21.033302 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.033388 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.400888 (+367500us) raft_consensus.cc:1685] finished
0709 13:02:21.400908 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.401047 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18712,"prepare.queue_time_us":205022,"prepare.run_cpu_time_us":1844,"prepare.run_wall_time_us":9318,"raft.queue_time_us":3149,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":3655,"spinlock_wait_cycles":36145536,"thread_start_us":45951,"threads_started":1,"wal-append.queue_time_us":81880}
I20260709 13:02:21.417129 12577 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.418772 12650 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:21.426107  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 649094us
I20260709 13:02:21.427917  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:21.246665 12628 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:21.300835 12634 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.322055 12464 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.440342  8509 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:21.404366 12599 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:21.446717  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.447682  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.449580  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.421828 12600 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.409149 12657 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:02:21.473346  8505 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.003s
I20260709 13:02:21.478456  8505 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:21.428984 12420 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.460337 12577 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:21.475245 12650 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.444576 12474 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:21.479338  8503 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:21.457216 12552 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.457407 12311 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:21.530175  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.530448 12311 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:21.532776 12311 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:21.495613  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.064s	sys 0.107s
I20260709 13:02:21.460752 12441 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:21.461943 12399 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:21.480372 12588 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:21.483774 12522 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:21.439528 12616 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.471921 12600 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:21.574075 12574 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.002s
I20260709 13:02:21.468184 12372 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:21.470417 12649 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:21.511664 12078 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:21.512317 12397 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:21.491171 12578 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:21.514119 12474 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.575815 12600 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:21.575639 12578 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.576937 12474 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:21.519244 12661 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:21.577732 12661 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.578301 12578 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:21.579783 12661 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:21.520920 12502 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:21.521377 12651 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:21.524585 12652 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:21.525256  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2304) took 1448 ms. Trace:
I20260709 13:02:21.616320  8575 rpcz_store.cc:276] 0709 13:02:20.076921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.077051 (+   130us) service_pool.cc:224] Handling call
0709 13:02:21.525051 (+1448000us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54000659d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:21.525188 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134756224}
W20260709 13:02:21.526896 12626 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.004s
I20260709 13:02:21.529522 11886 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:21.534785  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.064s	sys 0.107s
I20260709 13:02:21.544696  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:21.540398 12552 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:21.566093 12655 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:02:21.552079 12441 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.571679 12616 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:21.541638 12601 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:21.507033 12575 consensus_meta.cc:287] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.826s	user 0.007s	sys 0.005s
I20260709 13:02:21.574887 12574 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:21.667928 12649 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:02:21.706131 12504 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:21.707087 12574 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:21.679078 12600 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:21.708271 12600 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:21.709496 12600 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:21.664494 12455 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:21.706960 12504 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.708304  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1024) took 4218 ms. Trace:
W20260709 13:02:21.730374  9066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.005s
W20260709 13:02:21.730826  9066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.004s	sys 0.006s
W20260709 13:02:21.732755  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.733852  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 305984us
W20260709 13:02:21.720041  9065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.004s	sys 0.004s
W20260709 13:02:21.734579  9065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.004s	sys 0.004s
W20260709 13:02:21.671758  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 127211us
W20260709 13:02:21.737587  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 747125us
I20260709 13:02:21.740022  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:21.743645  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:21.734908  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:21.803990 12677 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:21.805341 12411 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
I20260709 13:02:21.805974 12411 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:21.807247  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 63710.7us
I20260709 13:02:21.808311 12552 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:21.685614 12601 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.726972  9102 rpcz_store.cc:276] 0709 13:02:17.489871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.940732 (+1450861us) service_pool.cc:224] Handling call
0709 13:02:18.951793 (+ 11061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.952065 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:19.597399 (+645334us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.747563 (+150164us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.792095 (+ 44532us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.725294 (+933199us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b18004320a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:21.380416 (+655122us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b18004320a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:21.523512 (+143096us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b18004320a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:02:21.705786 (+182274us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.705862 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:21.705939 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.708038 (+  2099us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.708226 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":341688,"prepare.queue_time_us":1267162,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":20868,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":47431,"spinlock_wait_cycles":193656192,"thread_start_us":721852,"threads_started":3,"wal-append.queue_time_us":295727,"wal-append.run_cpu_time_us":2307,"wal-append.run_wall_time_us":1117254}
W20260709 13:02:21.810498  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 75727.4us
I20260709 13:02:21.811813  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:21.822804  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:21.795979 12464 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:21.811722 12630 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.059s	user 0.013s	sys 0.000s
I20260709 13:02:21.811913 12263 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:21.815518 12397 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:21.811232 12665 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:21.825029 12522 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:21.863389 12677 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:21.971545  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 148846us
I20260709 13:02:21.972414  9067 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:21.972503 12627 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:21.973702 12522 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:21.985278 12441 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:21.989405 12646 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:21.990127 12649 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:21.989563  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:21.971903 12631 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 13:02:21.993551  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1059) took 1219 ms. Trace:
I20260709 13:02:21.984802 12627 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.994458 12399 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:21.969272 12411 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:21.995386 12673 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:21.996815  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:21.993948  9096 rpcz_store.cc:276] 0709 13:02:20.775176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.385263 (+610087us) service_pool.cc:224] Handling call
0709 13:02:21.385625 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.385880 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:21.730156 (+344276us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.993219 (+263063us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.993269 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:21.993313 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.993378 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.993486 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11932,"prepare.queue_time_us":418609,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":12040,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":594638,"threads_started":2}
I20260709 13:02:22.002352  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1053) took 1235 ms. Trace:
I20260709 13:02:21.981314 12656 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.008690  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:21.990998 12677 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.961155 12630 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:21.984270 12263 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:21.969849 12397 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.010847 12622 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:22.023401 12601 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.028018 12455 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:22.007215 12473 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:22.037204  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:22.037771 12473 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:22.038983 12473 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:22.040942 12646 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:22.041891 12582 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:22.042573 12582 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:22.043820 12582 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.045328 12582 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:22.045637 12599 consensus_meta.cc:287] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.000s
I20260709 13:02:22.006767 12634 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.035874 12263 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.055507  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:21.999044 12631 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:22.055775 12646 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:22.069227 12631 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:22.042312 12622 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:22.071815  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:22.024196 12656 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.079959  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:22.069948 12646 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.072831 12441 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:02:22.034126 12677 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.072386 12599 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:22.090157 12676 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.103s	user 0.001s	sys 0.001s
W20260709 13:02:22.098332 12675 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:02:22.091900 12630 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:22.105377 12263 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:22.095289 12622 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.112494 12665 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:22.109288 12656 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:22.114691 12397 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:22.111616 12420 consensus_meta.cc:287] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.000s
I20260709 13:02:22.112001 12399 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:22.118927 12677 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:22.123906 12599 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.157238  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1990) took 1690 ms. Trace:
I20260709 13:02:22.157619  8508 rpcz_store.cc:276] 0709 13:02:20.467028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.752016 (+284988us) service_pool.cc:224] Handling call
0709 13:02:20.752290 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.760979 (+  8689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.761024 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.771511 (+ 10487us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.363946 (+592435us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:21.364071 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.364267 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.157019 (+792752us) raft_consensus.cc:1685] finished
0709 13:02:22.157040 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.157177 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8309,"raft.queue_time_us":18046,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":1906,"thread_start_us":397959,"threads_started":1,"wal-append.queue_time_us":661842}
W20260709 13:02:22.190634 12684 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.113s	user 0.003s	sys 0.000s
W20260709 13:02:22.255339  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.258618  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.258618 12420 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.258998  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2391) took 1680 ms. Trace:
I20260709 13:02:22.260334  8503 rpcz_store.cc:276] 0709 13:02:20.578421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.763482 (+185061us) service_pool.cc:224] Handling call
0709 13:02:21.479112 (+715630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.491341 (+ 12229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.258776 (+767435us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400059bd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:22.258935 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645071744}
W20260709 13:02:22.259557  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.259647 12674 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.259444 12420 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.261816 12674 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:22.262476 12471 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.263422 12420 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.263999 12674 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:22.269032  8508 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:22.272544  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.273168  8504 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:22.274691  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:22.275418  8504 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:22.279358  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.280274  8504 raft_consensus.cc:2410] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:22.281522  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.282526  8504 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
W20260709 13:02:22.284293 12668 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.292s	user 0.000s	sys 0.002s
W20260709 13:02:22.289829  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.041s	sys 0.045s
W20260709 13:02:22.292649  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.042s	sys 0.045s
W20260709 13:02:22.293021  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 833810us
I20260709 13:02:22.293954 12583 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:22.304728 12591 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.305383 12591 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.307891 12591 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:22.311568  9093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1050) took 1543 ms (client timeout 1832 ms). Trace:
W20260709 13:02:22.312021  9093 rpcz_store.cc:269] 0709 13:02:20.767868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.854750 (+ 86882us) service_pool.cc:224] Handling call
0709 13:02:22.311355 (+1456605us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54006685d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:22.311505 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878524672}
I20260709 13:02:22.318087 12471 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.318192 12597 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:22.319002 12471 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:22.319120 12597 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:22.320045  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.008s	sys 0.003s
W20260709 13:02:22.320398  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.008s	sys 0.003s
W20260709 13:02:22.320955  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.02613e+06us
I20260709 13:02:22.321470 12597 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:22.321553 12471 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:22.322105 12597 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.322629 12597 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.321745  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:22.325090 12597 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.326952  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.327147 12471 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.327664  8578 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:22.327739 12471 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.329401  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.330176  8578 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:22.331789  8578 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:22.332252 12471 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.332715 12591 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.333259 12591 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.333544 12545 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:22.333658 12598 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:22.334581 12545 raft_consensus.cc:3055] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:22.334969 12545 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:22.335862  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:22.336822 12591 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.337733 12402 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.338233 12402 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:22.339114 12653 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.877s	user 0.003s	sys 0.000s
I20260709 13:02:22.339226  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:22.339854  9093 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.339973  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:22.340776  9100 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:22.341902  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.342973 12459 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:22.343438 12459 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:22.344120  8507 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.023s	sys 0.017s
W20260709 13:02:22.344489  8507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.024s	sys 0.018s
W20260709 13:02:22.346109  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.573s	user 0.013s	sys 0.027s
I20260709 13:02:22.345794 12624 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:22.346895 12624 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.348050  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1991) took 1880 ms. Trace:
I20260709 13:02:22.348997  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.349206 12624 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.349700  8578 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
W20260709 13:02:22.346524  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.573s	user 0.013s	sys 0.027s
W20260709 13:02:22.350769  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 1.57742e+06us
I20260709 13:02:22.350843  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:22.351450  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.352113  8580 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:22.353076  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.353628  8433 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:02:22.353722  8584 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:22.353971 12399 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:22.355233  8433 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:22.356072  8426 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:22.356933  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:22.356837 12399 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:22.357532  8508 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.357707  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:22.357970 12372 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:22.358397 12372 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:22.358426  8431 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:22.358891 12457 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.359301 12372 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.360296 12372 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.361510  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:22.362435  8435 raft_consensus.cc:2410] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:22.363343  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.363982  8503 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:22.366360  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.348515  8502 rpcz_store.cc:276] 0709 13:02:20.467392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.753140 (+285748us) service_pool.cc:224] Handling call
0709 13:02:20.753402 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.763265 (+  9863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.763292 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.776144 (+ 12852us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.408052 (+631908us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:21.408090 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.408158 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.347791 (+939633us) raft_consensus.cc:1685] finished
0709 13:02:22.347814 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.347985 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9460,"raft.queue_time_us":18870,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":6457,"thread_start_us":442920,"threads_started":1,"wal-append.queue_time_us":964256}
W20260709 13:02:22.370782  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.375535  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:22.376667  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.368208  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2002) took 1641 ms. Trace:
I20260709 13:02:22.377017  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:22.002811  9099 rpcz_store.cc:276] 0709 13:02:20.767036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.327114 (+560078us) service_pool.cc:224] Handling call
0709 13:02:21.327474 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.327722 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:21.713678 (+385956us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.001564 (+287886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.001643 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:22.001694 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.002171 (+   477us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.002293 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42915,"prepare.queue_time_us":476491,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":43139,"thread_start_us":594290,"threads_started":2}
I20260709 13:02:22.377784  9100 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:22.377322  8430 rpcz_store.cc:276] 0709 13:02:20.726745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.726900 (+   155us) service_pool.cc:224] Handling call
0709 13:02:20.727202 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.013472 (+286270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.367977 (+1354505us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400001754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:22.368150 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298087680}
I20260709 13:02:22.377676  9098 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:22.379073 12545 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.380577 12545 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.381565  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:22.382401  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.382733  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:22.384168 12677 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:22.384776 12528 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.386224 12622 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:22.382455  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.390457  8577 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:22.345309 12459 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.395406 12522 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:22.384124  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:22.395845  9098 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:22.396122  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:22.396493  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:22.396778  9100 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:22.397396  9067 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:22.398198 12622 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:22.398605 12622 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.398947 12622 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:22.340134 12402 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.399716 12483 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:22.400281 12483 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.401849 12504 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:22.402284 12399 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:22.402544 12504 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:22.402776 12399 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.402925  8550 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:22.403070 12504 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.403591 12504 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.403855 12483 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.404551 12600 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:22.403246 12399 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:22.405390 12600 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:22.406709  8506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.377s	user 0.000s	sys 0.015s
I20260709 13:02:22.406788 12600 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:22.407403  8506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.378s	user 0.000s	sys 0.016s
I20260709 13:02:22.407840 12601 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:22.407987 12634 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:22.408300 12601 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.408560 12634 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:22.408877 12601 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.409502 12634 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:22.410678 12634 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.407846 12600 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:22.412361 12600 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:22.413134 12600 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:22.414218 12600 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:22.415937 12528 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:22.417485  9100 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:02:22.420311  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:22.420979  9102 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.422133  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:22.422731  9099 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:22.425115 12191 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:22.425490 12191 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:22.397785 12677 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.426396  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:22.426579  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:22.426313 12191 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.427310  8433 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:22.427497 12191 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.427261  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:22.428392  8431 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:22.431174 12674 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:22.432013 12674 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:22.406703  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:22.434875 12674 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:22.435638  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:22.435842  9102 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:22.436197  8431 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.436276  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.438164  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:22.438755  8435 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:22.448989  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:22.451819  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.463310  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:22.468844  8430 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:22.477867  8329 catalog_manager.cc:5697] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 4 to 7, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 7 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:22.464596 12692 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:02:22.469684  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:22.471061  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:22.487366  8503 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.488178  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:22.471331  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.486644  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:22.491035  8509 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.493157  8431 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:22.494863  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.496131  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.496773  8502 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:22.486685  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:22.502456  8504 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.507432  8503 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:22.501742  8508 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:22.508507  8509 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:22.512540  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.513691  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.513739  8508 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:22.514555  8509 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:22.515096  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.517117  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.518428  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.519344  8508 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:22.520236  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.520469 12402 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.526199 12402 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:22.523874  8503 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:22.529125  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.529865  8503 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:22.453485  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.525556 12700 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.524832  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2396) took 1781 ms. Trace:
I20260709 13:02:22.532081  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.417689 12601 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.681576  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:22.704058  8399 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.524s	user 0.005s	sys 0.009s
W20260709 13:02:22.553035  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.600951  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:24.769753 12629 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:24.770303 12629 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.770753 12629 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:24.771153  8399 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.591s	user 0.009s	sys 0.009s
W20260709 13:02:24.772569  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.740829  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.808903  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.809429  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.678576 12611 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.271529 12611 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:24.151013 12716 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.162920 12717 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:24.163105 12718 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.239182 12719 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:25.273496 12717 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.274426 12719 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.276217 12717 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:24.243016 12720 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:24.245565 12721 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:25.273576 12718 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:24.248363 12722 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.644264 12723 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.277370 12720 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.278381 12723 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.279335 12718 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.276852 12719 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:25.280155 12720 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.280687 12723 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:24.804584 12726 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:24.806589 12725 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:25.273363 12716 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.281694 12725 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.282186 12722 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.283957 12725 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:24.818424 12727 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:25.284513 12716 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.284631 12722 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.281541 12726 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.285095 12727 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.285205 12611 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.286966 12611 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.825224 12728 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.287598 12726 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:25.287973  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.287632 12727 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.288364 12728 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.277426 12721 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.291574 12728 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:24.837580 12730 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:24.858982 12731 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.298048 12730 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.298483 12731 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:24.859519 12729 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.299746 12729 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.300982 12731 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.301234 12730 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:24.870045 12732 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:25.302011 12729 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.302464 12732 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.304847 12732 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:24.833195  8329 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:02:24.835156  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 2.23389e+06us
I20260709 13:02:25.331239  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:25.332424  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:25.333178 12729 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.333869 12729 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.334370 12729 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:24.733572  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 2.05172e+06us
I20260709 13:02:25.340353 12733 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:22.545931  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.364450  8430 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
W20260709 13:02:25.365084  8430 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 814) took 2819 ms (client timeout 2622 ms). Trace:
I20260709 13:02:22.635262  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:22.556252  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:22.547900  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:22.577981  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.372346  8435 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:25.373000  8431 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
W20260709 13:02:25.373106  8435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 817) took 2826 ms (client timeout 1720 ms). Trace:
W20260709 13:02:25.373591  8431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 821) took 2825 ms (client timeout 1554 ms). Trace:
W20260709 13:02:25.373986  8431 rpcz_store.cc:269] 0709 13:02:22.547799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.566458 (+ 18659us) service_pool.cc:224] Handling call
0709 13:02:25.373494 (+2807036us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:22.636583  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 809) took 2064 ms. Trace:
I20260709 13:02:22.546208  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:22.827322  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.380229  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.380779  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.381618 12732 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.382373 12732 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:22.582428  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.386224 12730 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:25.386938 12730 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.387323  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:24.332211  8476 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.690s (SENT) [suppressed 29 similar messages]
I20260709 13:02:22.548895  8504 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
W20260709 13:02:25.392611  8504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2407) took 2920 ms (client timeout 1759 ms). Trace:
W20260709 13:02:25.392988  8504 rpcz_store.cc:269] 0709 13:02:22.471799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.486494 (+ 14695us) service_pool.cc:224] Handling call
0709 13:02:25.392364 (+2905870us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:22.603861  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 1989) took 2251 ms. Trace:
I20260709 13:02:22.730815  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:25.396076  8505 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.395148  8501 rpcz_store.cc:276] 0709 13:02:20.352943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.662667 (+309724us) service_pool.cc:224] Handling call
0709 13:02:20.662998 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.663332 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.663362 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.663869 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.959331 (+295462us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:20.959390 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.959464 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.603654 (+1644190us) raft_consensus.cc:1685] finished
0709 13:02:22.603673 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.603805 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3036,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"thread_start_us":295006,"threads_started":1,"wal-append.queue_time_us":740001,"wal-append.run_cpu_time_us":30824,"wal-append.run_wall_time_us":3217996}
W20260709 13:02:25.397511  8501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2414) took 2713 ms (client timeout 1774 ms). Trace:
I20260709 13:02:22.560671  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:22.538610  8507 rpcz_store.cc:276] 0709 13:02:20.692854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.179323 (+486469us) service_pool.cc:224] Handling call
0709 13:02:21.179663 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:21.207588 (+ 27925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.207630 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:21.253493 (+ 45863us) log.cc:844] Serialized 52 byte log entry
0709 13:02:22.283722 (+1030229us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:22.344861 (+ 61139us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:22.473163 (+128302us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.473513 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.473680 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.473748 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.473864 (+   116us) raft_consensus.cc:1685] finished
0709 13:02:22.473878 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.473990 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27434,"prepare.queue_time_us":26266,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":135482,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":29379,"spinlock_wait_cycles":19793792,"thread_start_us":1102657,"threads_started":2,"wal-append.queue_time_us":489588}
W20260709 13:02:25.403798  8507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 851) took 2640 ms (client timeout 1997 ms). Trace:
I20260709 13:02:22.520900  8508 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:22.542253  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:22.563817  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:22.557381  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 81071.1us
I20260709 13:02:25.410996  8503 raft_consensus.cc:2410] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:22.581897  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:25.412444  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 1.08028e+06us
W20260709 13:02:24.643954  9068 connection.cc:256] RPC call timeout handler was delayed by -1.5736452959999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260709 13:02:25.416630  9068 connection.cc:256] RPC call timeout handler was delayed by -1.5559448789999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 13:02:25.417172  9068 connection.cc:256] RPC call timeout handler was delayed by -1.4728452960000595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 13:02:25.417477  9068 connection.cc:256] RPC call timeout handler was delayed by -1.4404452960000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 13:02:25.417760  9068 connection.cc:256] RPC call timeout handler was delayed by -1.3787452010000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
W20260709 13:02:24.250355  9093 consensus_meta.cc:287] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.910s	user 0.026s	sys 0.019s
I20260709 13:02:25.419117 12731 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.419447  9093 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
W20260709 13:02:25.420118  9093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1062) took 3081 ms (client timeout 1586 ms). Trace:
I20260709 13:02:25.419726 12731 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:25.420444  9093 rpcz_store.cc:269] 0709 13:02:22.338827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.338971 (+   144us) service_pool.cc:224] Handling call
0709 13:02:25.420023 (+3081052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.421444 12722 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:22.534389  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:25.423444  8577 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:25.423986  8577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2322) took 2889 ms (client timeout 2210 ms). Trace:
W20260709 13:02:25.424355  8577 rpcz_store.cc:269] 0709 13:02:22.533993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.534124 (+   131us) service_pool.cc:224] Handling call
0709 13:02:25.423808 (+2889684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:22.536144  8583 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:02:22.609118  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 85208.3us
I20260709 13:02:25.427543  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2324) took 2892 ms. Trace:
I20260709 13:02:25.428333  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:25.428603 12728 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:22.533793  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45674.2us
I20260709 13:02:25.427994  8583 rpcz_store.cc:276] 0709 13:02:22.535461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.535566 (+   105us) service_pool.cc:224] Handling call
0709 13:02:22.535805 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.426956 (+2891151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.427339 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:22.817848  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1055) took 2048 ms. Trace:
I20260709 13:02:25.432590 12731 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:25.429914  8577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2336) took 2860 ms (client timeout 1759 ms). Trace:
W20260709 13:02:25.397881  8501 rpcz_store.cc:269] 0709 13:02:22.683839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.397311 (+2713472us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.397440 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:02:25.435422  8501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 852) took 2671 ms (client timeout 2123 ms). Trace:
W20260709 13:02:25.435840  8501 rpcz_store.cc:269] 0709 13:02:22.763836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.435218 (+2671382us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.435365 (+   147us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:22.689330  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:24.251534  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:25.437852  8575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 652) took 3090 ms (client timeout 3184 ms). Trace:
W20260709 13:02:25.438357  8575 rpcz_store.cc:269] 0709 13:02:22.347372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.685881 (+338509us) service_pool.cc:224] Handling call
0709 13:02:25.437652 (+2751771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.438458  9096 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:25.439220  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1068) took 1188 ms. Trace:
W20260709 13:02:25.439440  8575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2329) took 2884 ms (client timeout 1996 ms). Trace:
I20260709 13:02:25.439508  9096 rpcz_store.cc:276] 0709 13:02:24.250680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.250993 (+   313us) service_pool.cc:224] Handling call
0709 13:02:25.439134 (+1188141us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.439821  8575 rpcz_store.cc:269] 0709 13:02:22.554729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.439237 (+2884508us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.439390 (+   153us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:22.541540  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:25.441169  8575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2334) took 2872 ms (client timeout 2062 ms). Trace:
I20260709 13:02:25.441596  8579 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:25.434311  8577 rpcz_store.cc:269] 0709 13:02:22.569408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.429675 (+2860267us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.429841 (+   166us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:02:25.442121  8579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2327) took 2904 ms (client timeout 1725 ms). Trace:
W20260709 13:02:25.442711  8579 rpcz_store.cc:269] 0709 13:02:22.537413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.541218 (+  3805us) service_pool.cc:224] Handling call
0709 13:02:25.441981 (+2900763us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.443562  8579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2331) took 2876 ms (client timeout 2222 ms). Trace:
W20260709 13:02:25.443857  8579 rpcz_store.cc:269] 0709 13:02:22.566737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.443376 (+2876639us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.443506 (+   130us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:02:25.441486  8575 rpcz_store.cc:269] 0709 13:02:22.568542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.440984 (+2872442us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.441102 (+   118us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:25.444844  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:22.674117  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2044) took 2189 ms. Trace:
I20260709 13:02:25.447121  8581 rpcz_store.cc:276] 0709 13:02:20.485019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.487080 (+  2061us) service_pool.cc:224] Handling call
0709 13:02:20.487522 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.772334 (+284812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.673634 (+1901300us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540009a954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:22.673988 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577919744}
W20260709 13:02:25.449465  8577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2055) took 2877 ms (client timeout 2181 ms). Trace:
I20260709 13:02:25.449550  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2326) took 2912 ms. Trace:
I20260709 13:02:22.604619  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:22.697467  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:23.972036  8605 debug-util.cc:398] Leaking SignalData structure 0x7b08000e1880 after lost signal to thread 7338
W20260709 13:02:22.953436  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.252372  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:25.460968 12723 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.461826 12723 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.463779 12720 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.452775  8584 raft_consensus.cc:2410] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:25.464525 12720 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:25.465512  8584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2054) took 2893 ms (client timeout 1639 ms). Trace:
W20260709 13:02:24.159292  9098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1065) took 1754 ms (client timeout 1690 ms). Trace:
W20260709 13:02:25.467741  9098 rpcz_store.cc:269] 0709 13:02:22.404914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.158614 (+1753700us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:24.158974 (+   360us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:24.671868  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:25.469339  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1067) took 1219 ms. Trace:
I20260709 13:02:25.469659  9099 rpcz_store.cc:276] 0709 13:02:24.249960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.671369 (+421409us) service_pool.cc:224] Handling call
0709 13:02:25.469261 (+797892us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.659119  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:25.471122  9100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1063) took 2705 ms (client timeout 1932 ms). Trace:
W20260709 13:02:25.471487  9100 rpcz_store.cc:269] 0709 13:02:22.765282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.658581 (+1893299us) service_pool.cc:224] Handling call
0709 13:02:25.471058 (+812477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.177588  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:25.473062  9101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1062) took 2708 ms (client timeout 2215 ms). Trace:
W20260709 13:02:25.473390  9101 rpcz_store.cc:269] 0709 13:02:22.765013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.176716 (+1411703us) service_pool.cc:224] Handling call
0709 13:02:25.473000 (+1296284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:22.765066  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:24.174490 12115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.750s	user 0.020s	sys 0.027s
W20260709 13:02:24.653921 12191 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 2.226s	user 0.046s	sys 0.099s
I20260709 13:02:24.734560 12274 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:25.482355 12274 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:25.482807 12274 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:24.189349 12399 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.784s	user 0.013s	sys 0.017s
I20260709 13:02:25.489764 12399 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.599117 12402 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:24.601789 12441 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.601840 12467 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.495545 12441 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.496698 12467 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.604784 12471 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:25.499611 12471 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:22.708348 12473 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.073594 12483 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:25.504813 12483 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:24.671871 12504 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 2.268s	user 0.017s	sys 0.052s
I20260709 13:02:25.506752 12504 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.612392 12591 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.509953 12591 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:24.697304 12601 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:22.696869 12622 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:24.766185 12624 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.515359 12624 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:24.995803 12629 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.517165  9102 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:22.864964 12651 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:25.523168 12651 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:24.693542 12662 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 2.696s	user 0.033s	sys 0.062s
I20260709 13:02:24.652915 12665 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.561394 12674 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.533171 12665 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.534036 12674 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:22.719125 12679 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.639s	user 0.001s	sys 0.002s
W20260709 13:02:22.583178 12695 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:22.577205 12699 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:25.539816  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1058) took 4765 ms. Trace:
I20260709 13:02:25.540261 12699 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:25.540776 12699 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:22.544449 12700 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:24.073760 12704 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.545249 12704 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.575996 12705 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:25.548369 12115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.124s	user 0.020s	sys 0.031s
I20260709 13:02:25.548528 12705 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.592993 12707 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:25.550678  8510 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:25.551244 12707 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:25.552059  8510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2007) took 3037 ms (client timeout 2998 ms). Trace:
I20260709 13:02:22.650642 12709 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:25.553774 12709 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:22.679646 12711 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:22.550410 12691 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:02:25.558841 12711 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:22.532305 12702 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:25.561596 12702 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.562904  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2392) took 4885 ms. Trace:
I20260709 13:02:25.563988  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2169) took 3210 ms. Trace:
I20260709 13:02:25.564437  8427 rpcz_store.cc:276] 0709 13:02:22.353268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.359497 (+  6229us) service_pool.cc:224] Handling call
0709 13:02:22.359848 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.360201 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.360231 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.360688 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.485795 (+125107us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:22.485837 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.485911 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.563512 (+3077601us) raft_consensus.cc:1685] finished
0709 13:02:25.563556 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.563763 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32857,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":124678,"threads_started":1,"wal-append.queue_time_us":104516}
W20260709 13:02:25.246666  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.291694 12721 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:24.834259 12724 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:25.326272  8329 catalog_manager.cc:5697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:25.566321  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.566591 12724 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.567723 12731 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:25.328619  8331 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32800 (request call id 244) took 41392 ms (client timeout 15000 ms). Trace:
I20260709 13:02:25.567466  8329 catalog_manager.cc:5697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 6 to 7, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 7 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:02:25.568327 12731 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:25.569404  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.333261 12727 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:24.394580  8428 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 822) took 1846 ms (client timeout 1616 ms). Trace:
W20260709 13:02:25.342646  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.575245  8428 rpcz_store.cc:269] 0709 13:02:22.548114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.393981 (+1845867us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:24.394252 (+   271us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:25.349174 12729 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.576716  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:22.745582  9065 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:25.579500 12729 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.357846  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:25.580322  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 2.83437e+06us
I20260709 13:02:25.370093  8434 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:25.365461  8430 rpcz_store.cc:269] 0709 13:02:22.545585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.545702 (+   117us) service_pool.cc:224] Handling call
0709 13:02:25.364968 (+2819266us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.582345  8434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 816) took 3036 ms (client timeout 1756 ms). Trace:
I20260709 13:02:25.582827  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.583252 12721 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:25.583807  8430 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 820) took 3036 ms (client timeout 3253 ms). Trace:
I20260709 13:02:25.583963 12721 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:25.375268  8431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 828) took 2774 ms (client timeout 2129 ms). Trace:
I20260709 13:02:25.584537 12721 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:25.584702  8431 rpcz_store.cc:269] 0709 13:02:22.600663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.375046 (+2774383us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.375191 (+   145us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:25.376896  8432 rpcz_store.cc:276] 0709 13:02:20.571879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.572004 (+   125us) service_pool.cc:224] Handling call
0709 13:02:20.574569 (+  2565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.771188 (+196619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.771217 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.774633 (+  3416us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.390149 (+615516us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:21.390190 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.636149 (+1245959us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400128254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:22.636207 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.636254 (+    47us) raft_consensus.cc:1685] finished
0709 13:02:22.636264 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.636510 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7995,"raft.queue_time_us":9243,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":3431,"spinlock_wait_cycles":432939392,"thread_start_us":428523,"threads_started":1,"wal-append.queue_time_us":700769,"wal-append.run_cpu_time_us":33511,"wal-append.run_wall_time_us":2633023}
I20260709 13:02:25.586082  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.586889  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.587007  8431 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
W20260709 13:02:25.587919  8432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 825) took 3020 ms (client timeout 3949 ms). Trace:
W20260709 13:02:25.588392  8432 rpcz_store.cc:269] 0709 13:02:22.567176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.586524 (+3019348us) service_pool.cc:224] Handling call
0709 13:02:25.587847 (+  1323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.389166 12730 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:25.373617  8435 rpcz_store.cc:269] 0709 13:02:22.546642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.547637 (+   995us) service_pool.cc:224] Handling call
0709 13:02:25.373019 (+2825382us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.582866  8434 rpcz_store.cc:269] 0709 13:02:22.546198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.546351 (+   153us) service_pool.cc:224] Handling call
0709 13:02:25.582244 (+3035893us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.589990  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.590304  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.591454  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.591800  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.592425  8435 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:25.592685  8434 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:25.384804 12732 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.400864  8502 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:25.596598  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2000) took 3083 ms. Trace:
I20260709 13:02:25.597016  8502 rpcz_store.cc:276] 0709 13:02:22.513269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.593488 (+ 80219us) service_pool.cc:224] Handling call
0709 13:02:25.400423 (+2806935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:25.595241 (+194818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.596318 (+  1077us) spinlock_profiling.cc:243] Waited 2.81 s on lock 0x7b54001fed50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:25.596512 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6454227712}
W20260709 13:02:25.411688  8503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2005) took 2897 ms (client timeout 2329 ms). Trace:
W20260709 13:02:25.598186  8503 rpcz_store.cc:269] 0709 13:02:22.514510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.554373 (+ 39863us) service_pool.cc:224] Handling call
0709 13:02:25.411592 (+2857219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.418107  8504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 847) took 2669 ms (client timeout 1576 ms). Trace:
I20260709 13:02:25.418639 12716 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:25.599144  8504 rpcz_store.cc:269] 0709 13:02:22.762587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.417816 (+2655229us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.417948 (+   132us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:25.599546 12716 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:25.405552  8508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 1999) took 2892 ms (client timeout 2205 ms). Trace:
W20260709 13:02:25.601532  8508 rpcz_store.cc:269] 0709 13:02:22.513034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.519975 (+  6941us) service_pool.cc:224] Handling call
0709 13:02:25.405372 (+2885397us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.432104  8583 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2049) took 2861 ms (client timeout 1909 ms). Trace:
W20260709 13:02:25.602548  8583 rpcz_store.cc:269] 0709 13:02:22.570446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.431853 (+2861407us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.431983 (+   130us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:02:25.404218  8507 rpcz_store.cc:269] 0709 13:02:22.763605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.403476 (+2639871us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.403637 (+   161us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:22.545965  8578 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:25.607090  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2323) took 3071 ms. Trace:
I20260709 13:02:25.607476  8578 rpcz_store.cc:276] 0709 13:02:22.535159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.535323 (+   164us) service_pool.cc:224] Handling call
0709 13:02:22.545556 (+ 10233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.606505 (+3060949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.606907 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.446189  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:25.451413  8582 raft_consensus.cc:2410] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:02:25.449934  8577 rpcz_store.cc:269] 0709 13:02:22.572401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.443259 (+2870858us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.449384 (+  6125us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:25.422096 12722 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:25.465927  8584 rpcz_store.cc:269] 0709 13:02:22.572106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.697227 (+125121us) service_pool.cc:224] Handling call
0709 13:02:25.465412 (+2768185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.610173  8575 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.613363  8584 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:25.610383 12703 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.614184  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2338) took 3044 ms. Trace:
W20260709 13:02:25.455919  8605 debug-util.cc:398] Leaking SignalData structure 0x7b08000e15c0 after lost signal to thread 8367
I20260709 13:02:25.458163 12719 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:25.614494 12703 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.615392 12719 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:25.458420  8501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 854) took 2694 ms (client timeout 2129 ms). Trace:
W20260709 13:02:25.617014  8501 rpcz_store.cc:269] 0709 13:02:22.764275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.458190 (+2693915us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.458340 (+   150us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:02:25.452036  8476 connection.cc:256] RPC call timeout handler was delayed by -1.034672707000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 13:02:25.610824  8582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2333) took 3042 ms (client timeout 1627 ms). Trace:
W20260709 13:02:25.618350  8582 rpcz_store.cc:269] 0709 13:02:22.568226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.604301 (+ 36075us) service_pool.cc:224] Handling call
0709 13:02:25.610726 (+3006425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.619977  8582 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:25.620729  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2051) took 3049 ms. Trace:
I20260709 13:02:25.621099  8582 rpcz_store.cc:276] 0709 13:02:22.571120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.619170 (+3048050us) service_pool.cc:224] Handling call
0709 13:02:25.619673 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.620424 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.620668 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.611995  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2332) took 3044 ms. Trace:
I20260709 13:02:25.609409  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2330) took 3053 ms. Trace:
I20260709 13:02:25.622980  8584 rpcz_store.cc:276] 0709 13:02:22.570101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.612361 (+3042260us) service_pool.cc:224] Handling call
0709 13:02:25.612850 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.613874 (+  1024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.614121 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.624914  8584 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:25.625531  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2053) took 3053 ms. Trace:
I20260709 13:02:25.622681  8577 rpcz_store.cc:276] 0709 13:02:22.567852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.610794 (+3042942us) service_pool.cc:224] Handling call
0709 13:02:25.611183 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.611578 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.611617 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.611692 (+    75us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:25.611740 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.611810 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.611932 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.623669  8578 rpcz_store.cc:276] 0709 13:02:22.555706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.608325 (+3052619us) service_pool.cc:224] Handling call
0709 13:02:25.608803 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.609033 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.609069 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.609120 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:25.609158 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.609223 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.609351 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.552453  8510 rpcz_store.cc:269] 0709 13:02:22.515074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.563518 (+ 48444us) service_pool.cc:224] Handling call
0709 13:02:25.551838 (+2988320us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001fd954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:25.551996 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329300864}
I20260709 13:02:25.737052  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2413) took 3053 ms. Trace:
I20260709 13:02:25.736207 12699 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.569913  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2325) took 3033 ms. Trace:
I20260709 13:02:25.738251  8583 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:25.572227  8427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 826) took 2996 ms (client timeout 2489 ms). Trace:
W20260709 13:02:25.738940  8427 rpcz_store.cc:269] 0709 13:02:22.575572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.571977 (+2996405us) service_pool.cc:211] Skipping call since client already timed out
0709 13:02:25.572148 (+   171us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:02:25.739917  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.740015  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2328) took 3190 ms. Trace:
I20260709 13:02:25.740628  8583 rpcz_store.cc:276] 0709 13:02:22.549144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.603853 (+3054709us) service_pool.cc:224] Handling call
0709 13:02:25.604289 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.738832 (+134543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.739650 (+   818us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000cd5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:25.739900 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307357952}
I20260709 13:02:25.741364  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:25.568538  8331 rpcz_store.cc:269] 0709 13:01:43.935606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.973680 (+ 38074us) service_pool.cc:224] Handling call
0709 13:02:25.328313 (+41354633us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:11.139409 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:11.341579 (+202170us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:11.341628 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:02:11.341657 (+    29us) tablet.cc:662] Decoding operations
0709 13:02:11.354991 (+ 13334us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:11.357981 (+  2990us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:11.364639 (+  6658us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:02:11.468026 (+103387us) tablet.cc:701] Row locks acquired
0709 13:02:11.468051 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:02:11.480442 (+ 12391us) write_op.cc:270] Start()
0709 13:02:11.494316 (+ 13874us) write_op.cc:276] Timestamp: P: 1783602131478594 usec, L: 0
0709 13:02:11.495561 (+  1245us) op_driver.cc:348] REPLICATION: starting
0709 13:02:11.753273 (+257712us) log.cc:844] Serialized 3636 byte log entry
0709 13:02:12.618124 (+864851us) op_driver.cc:464] REPLICATION: finished
0709 13:02:12.682083 (+ 63959us) write_op.cc:301] APPLY: starting
0709 13:02:12.682204 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:12.683503 (+  1299us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:12.683639 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:12.684759 (+  1120us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:12.685061 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:02:12.685132 (+    71us) write_op.cc:312] APPLY: finished
0709 13:02:12.685550 (+   418us) log.cc:844] Serialized 71 byte log entry
0709 13:02:12.685787 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:12.685971 (+   184us) write_op.cc:454] Released schema lock
0709 13:02:12.748510 (+ 62539us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:12.748979 (+   469us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:12.749025 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38089,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":63588,"apply.run_cpu_time_us":4476,"apply.run_wall_time_us":66904,"num_ops":9,"prepare.queue_time_us":353559,"prepare.run_cpu_time_us":28037,"prepare.run_wall_time_us":894381,"raft.queue_time_us":422767,"raft.run_cpu_time_us":23574,"raft.run_wall_time_us":64039,"replication_time_us":1122355,"thread_start_us":844182,"threads_started":4,"wal-append.queue_time_us":439654,"wal-append.run_cpu_time_us":159777,"wal-append.run_wall_time_us":1497190}]]}
I20260709 13:02:25.583537 12728 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.738266  8576 rpcz_store.cc:276] 0709 13:02:22.536827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.549799 (+ 12972us) service_pool.cc:224] Handling call
0709 13:02:22.550164 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.567324 (+3017160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.567384 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.567438 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:25.567478 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.569541 (+  2063us) spinlock_profiling.cc:243] Waited 3.02 s on lock 0x7b540009a454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:25.569583 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.569757 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6938028800}
I20260709 13:02:25.743342 12728 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.588445  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.748045  8431 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:25.748982  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.593773  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.594594  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.752205  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.752666  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.753396  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:25.584314  8430 rpcz_store.cc:269] 0709 13:02:22.547504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.582406 (+3034902us) service_pool.cc:224] Handling call
0709 13:02:25.583752 (+  1346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.516324 12622 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.634181  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:25.635939  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:25.631909  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:25.637451  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:25.625880  8584 rpcz_store.cc:276] 0709 13:02:22.571808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.624153 (+3052345us) service_pool.cc:224] Handling call
0709 13:02:25.624651 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.625300 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.625479 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.737447  8510 rpcz_store.cc:276] 0709 13:02:22.683531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.736044 (+3052513us) service_pool.cc:224] Handling call
0709 13:02:25.736426 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.736679 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.736703 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.736762 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:25.736817 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.736871 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.736983 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:25.521131  9102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1061) took 2780 ms (client timeout 3221 ms). Trace:
I20260709 13:02:25.639007  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:25.641599  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2001) took 3128 ms. Trace:
I20260709 13:02:25.654394  8581 rpcz_store.cc:276] 0709 13:02:22.537139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.448338 (+2911199us) service_pool.cc:224] Handling call
0709 13:02:25.448950 (+   612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.449243 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.449264 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.449301 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:25.449329 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.449378 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.449484 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.569144  8329 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:25.679746 12719 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.680091 12624 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:25.680294  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 293222us
I20260709 13:02:25.681277 12709 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:25.682758 12705 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.683290 12629 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.684062 12651 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.684360 12704 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.754437  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.685276 12720 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.563318  8506 rpcz_store.cc:276] 0709 13:02:20.676908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.919862 (+242954us) service_pool.cc:224] Handling call
0709 13:02:20.920188 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.920401 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.920426 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.000743 (+ 80317us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.407790 (+1407047us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:22.407837 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.407910 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.692642 (+2284732us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:25.562348 (+869706us) raft_consensus.cc:1685] finished
0709 13:02:25.562376 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.562682 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19511552,"thread_start_us":1377913,"threads_started":1,"wal-append.queue_time_us":967774}
I20260709 13:02:25.763576  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.764243  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 846) took 3016 ms. Trace:
I20260709 13:02:25.755513  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.765301  8506 rpcz_store.cc:276] 0709 13:02:22.747967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.763292 (+3015325us) service_pool.cc:224] Handling call
0709 13:02:25.763625 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.763923 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.763950 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.764008 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:25.764041 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.764092 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.764193 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.766053  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.766844  8430 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:25.690147 12700 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.767786 12700 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:25.756621  8501 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:25.770315  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 849) took 3007 ms. Trace:
I20260709 13:02:25.770742  8501 rpcz_store.cc:276] 0709 13:02:22.763151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.769396 (+3006245us) service_pool.cc:224] Handling call
0709 13:02:25.769741 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.769946 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.769983 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.770047 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:25.770077 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.770133 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.770250 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.772617  8501 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:25.773358  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 850) took 3010 ms. Trace:
I20260709 13:02:25.692955 12727 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:25.693363  8605 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1b60 after lost signal to thread 8459
W20260709 13:02:25.775393  8605 debug-util.cc:398] Leaking SignalData structure 0x7b080005af40 after lost signal to thread 8534
W20260709 13:02:25.776398  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.776810  8605 debug-util.cc:398] Leaking SignalData structure 0x7b080038c5e0 after lost signal to thread 8608
W20260709 13:02:25.777218  8605 debug-util.cc:398] Leaking SignalData structure 0x7b0800361680 after lost signal to thread 8609
I20260709 13:02:25.776561 12727 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:25.778716  8605 debug-util.cc:398] Leaking SignalData structure 0x7b08002a0160 after lost signal to thread 9126
W20260709 13:02:25.779052  8605 debug-util.cc:398] Leaking SignalData structure 0x7b0800349d00 after lost signal to thread 9127
W20260709 13:02:25.693693  8398 connection.cc:256] RPC call timeout handler was delayed by -1.5878497559999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:02:25.757292  8507 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:25.780422  8398 connection.cc:256] RPC call timeout handler was delayed by -1.5788497559999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 13:02:25.780798  8398 connection.cc:256] RPC call timeout handler was delayed by -1.4600497559999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:02:25.781052  8398 connection.cc:256] RPC call timeout handler was delayed by -1.1480858189999026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
I20260709 13:02:25.781672  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:25.758102  8502 raft_consensus.cc:2410] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:25.783722 12629 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:25.783878  8502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 853) took 3019 ms (client timeout 3949 ms). Trace:
I20260709 13:02:25.694757 12745 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.784467 12629 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:25.784724 12745 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.785333 12745 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.785681 12629 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.787146 12274 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.695372 12725 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.697144 12722 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.593425  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.701022 12732 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.702291 12441 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.702529 12665 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.703939 12724 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.704249 12731 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.704552 12716 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.685846  8509 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:25.705710 12591 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:25.432816  9094 rpcz_store.cc:276] 0709 13:02:20.769353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.327907 (+558554us) service_pool.cc:224] Handling call
0709 13:02:21.367702 (+ 39795us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:21.448222 (+ 80520us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:22.727175 (+1278953us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18003b1dc0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf 00007f1a19359038
0709 13:02:22.813673 (+ 86498us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.814931 (+  1258us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.815493 (+   562us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:22.816050 (+   557us) log.cc:844] Serialized 52 byte log entry
0709 13:02:22.816211 (+   161us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:22.816404 (+   193us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.816683 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:02:22.817497 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.817572 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.817620 (+    48us) raft_consensus.cc:1685] finished
0709 13:02:22.817632 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.817784 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67945,"prepare.queue_time_us":357796,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":101,"raft.queue_time_us":98913,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":8121,"spinlock_wait_cycles":23875072,"thread_start_us":86932,"threads_started":2,"wal-append.queue_time_us":990,"wal-append.run_cpu_time_us":3352,"wal-append.run_wall_time_us":1303785}
I20260709 13:02:25.405495  8505 raft_consensus.cc:2410] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:25.708962 12703 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:25.710076 12483 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.707964 12471 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:25.719121 12467 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.722994 12723 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.724123 12504 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.725298  8582 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:25.724664 12721 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:25.577730  8428 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 818) took 3030 ms (client timeout 3184 ms). Trace:
I20260709 13:02:25.727106 12399 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:25.730999  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.47876e+06us
I20260709 13:02:25.445928  8579 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:25.764457  8432 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:25.687505 12674 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:25.688791 12711 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.767678  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.768355 12700 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:25.540295  9095 rpcz_store.cc:276] 0709 13:02:20.773883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.355823 (+581940us) service_pool.cc:224] Handling call
0709 13:02:21.371202 (+ 15379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:21.473840 (+102638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.473884 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:21.504069 (+ 30185us) log.cc:844] Serialized 52 byte log entry
0709 13:02:21.960575 (+456506us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:21.960625 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.960699 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.718577 (+757878us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:25.539245 (+2820668us) raft_consensus.cc:1685] finished
0709 13:02:25.539289 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.539601 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102140,"raft.queue_time_us":103345,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":108,"spinlock_wait_cycles":3437824,"thread_start_us":296972,"threads_started":1,"wal-append.queue_time_us":419608}
I20260709 13:02:25.691972 12707 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.781715  8507 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:25.694484 12702 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:25.783106  8398 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:25.694566  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 336914us
W20260709 13:02:25.714391  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 132923us
I20260709 13:02:25.789354 12274 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.760941  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.867441  8431 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:25.868425  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.870431  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 819) took 3323 ms. Trace:
I20260709 13:02:25.761061  8434 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:25.870745  8431 rpcz_store.cc:276] 0709 13:02:22.547196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.869400 (+3322204us) service_pool.cc:224] Handling call
0709 13:02:25.869827 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.870052 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.870077 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.870115 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:25.870169 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.870250 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.870355 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.872376  8434 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:25.872717  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 824) took 3322 ms. Trace:
I20260709 13:02:25.872931  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 823) took 3324 ms. Trace:
I20260709 13:02:25.873075  8431 rpcz_store.cc:276] 0709 13:02:22.551143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.871688 (+3320545us) service_pool.cc:224] Handling call
0709 13:02:25.872153 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.872410 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.872433 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.872487 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:25.872531 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.872581 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.872671 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43520}
I20260709 13:02:25.759922  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2415) took 3075 ms. Trace:
I20260709 13:02:25.874382  8510 rpcz_store.cc:276] 0709 13:02:22.684142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.758998 (+3074856us) service_pool.cc:224] Handling call
0709 13:02:25.759350 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.759563 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.759603 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.759646 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:25.759681 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.759735 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.759859 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.761538  8329 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:02:25.876211  8510 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:25.876323  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:25.875945  8329 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 6 to 8, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 8 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.873288  8434 rpcz_store.cc:276] 0709 13:02:22.548399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.871647 (+3323248us) service_pool.cc:224] Handling call
0709 13:02:25.872136 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:25.872725 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.872884 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68864}
I20260709 13:02:25.877090 12707 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:25.877471 12707 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.877859 12707 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.794341  8426 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:25.830219  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:25.969843 12729 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.970449 12729 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:25.970973  8426 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2178) took 3550 ms (client timeout 1980 ms). Trace:
W20260709 13:02:25.971441  8426 rpcz_store.cc:269] 0709 13:02:22.420200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.426148 (+  5948us) service_pool.cc:224] Handling call
0709 13:02:25.970739 (+3544591us) spinlock_profiling.cc:243] Waited 3.37 s on lock 0x7b5400127d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:25.970900 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7743437184}
W20260709 13:02:25.831899  8456 debug-util.cc:398] Leaking SignalData structure 0x7b08002f50e0 after lost signal to thread 7335
W20260709 13:02:25.972980  8456 debug-util.cc:398] Leaking SignalData structure 0x7b0800172da0 after lost signal to thread 7338
I20260709 13:02:25.973008 12729 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:25.973676  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.974092  8456 debug-util.cc:398] Leaking SignalData structure 0x7b0800098c40 after lost signal to thread 8367
I20260709 13:02:25.773751  8501 rpcz_store.cc:276] 0709 13:02:22.763376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.771971 (+3008595us) service_pool.cc:224] Handling call
0709 13:02:25.772353 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.773077 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.773297 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.829748  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:25.975484  9096 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:25.806761  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.976497  8432 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:25.761117  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:25.976846 12707 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.809140  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:25.877970  8434 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:25.978127 12711 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.810405  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:25.978834  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 169874us
I20260709 13:02:25.979068  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2007) took 1212 ms. Trace:
W20260709 13:02:25.979441  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 169148us
I20260709 13:02:25.979539 12629 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.979657  8434 rpcz_store.cc:276] 0709 13:02:24.766591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.877336 (+1110745us) service_pool.cc:224] Handling call
0709 13:02:25.877623 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.978797 (+101174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.978997 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.978391 12473 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:25.981016 12473 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:25.981580  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 220595us
I20260709 13:02:25.982121 12473 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.879834  8510 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:25.831137  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:25.980759 12467 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:25.984656  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:25.980197 12629 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.985394  9093 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:25.985551 12629 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.812110 12745 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.986460  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:25.987605 12467 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:25.806638  8429 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2172) took 3452 ms (client timeout 1826 ms). Trace:
W20260709 13:02:25.988679  8429 rpcz_store.cc:269] 0709 13:02:22.354101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.634939 (+280838us) service_pool.cc:224] Handling call
0709 13:02:25.806275 (+3171336us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540025a8d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:25.806440 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005492480}
W20260709 13:02:25.793988  8509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2008) took 3278 ms (client timeout 1585 ms). Trace:
W20260709 13:02:25.759034  9102 rpcz_store.cc:269] 0709 13:02:22.740293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.764814 (+ 24521us) service_pool.cc:224] Handling call
0709 13:02:25.520576 (+2755762us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b54005f3a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:25.521048 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96044416}
W20260709 13:02:25.989929  8509 rpcz_store.cc:269] 0709 13:02:22.515390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.541917 (+ 26527us) service_pool.cc:224] Handling call
0709 13:02:25.793882 (+3251965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.797788  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 848) took 3034 ms. Trace:
I20260709 13:02:25.828469  8433 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:25.991138  8506 rpcz_store.cc:276] 0709 13:02:22.762924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.766355 (+3003431us) service_pool.cc:224] Handling call
0709 13:02:25.766741 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:25.769229 (+  2488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.769259 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:25.769809 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.794221 (+ 24412us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:25.794255 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.794316 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.797558 (+  3242us) raft_consensus.cc:1685] finished
0709 13:02:25.797576 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.797698 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1920,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"thread_start_us":23987,"threads_started":1,"wal-append.queue_time_us":23921}
I20260709 13:02:25.795176 12703 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.993319 12703 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.988193 12467 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:25.994509 12467 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.995544 12703 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:25.805440  8579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2337) took 3235 ms (client timeout 3221 ms). Trace:
W20260709 13:02:25.996510  8579 rpcz_store.cc:269] 0709 13:02:22.569721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.444444 (+2874723us) service_pool.cc:224] Handling call
0709 13:02:25.805344 (+360900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.806972 12700 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.998538 12711 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.999155 12711 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:25.807473  8507 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:26.001298 12711 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:26.001545  8507 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.759678  8508 rpcz_store.cc:276] 0709 13:02:22.513491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.640375 (+3126884us) service_pool.cc:224] Handling call
0709 13:02:25.640834 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.641142 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.641177 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.641248 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:25.641299 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.641367 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.641507 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:26.002713  8507 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:26.003356  8433 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 815) took 3457 ms (client timeout 1608 ms). Trace:
I20260709 13:02:25.759491  8504 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
W20260709 13:02:26.003971  8433 rpcz_store.cc:269] 0709 13:02:22.545856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.545957 (+   101us) service_pool.cc:224] Handling call
0709 13:02:26.003165 (+3457208us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400126454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:26.003294 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249666432}
I20260709 13:02:26.005432  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:25.805142  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:26.006382  8429 raft_consensus.cc:2410] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:26.006799  9098 raft_consensus.cc:2368] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12.
I20260709 13:02:25.802847  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:25.810536  9065 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:25.817502  8580 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:25.799719  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2052) took 3228 ms. Trace:
W20260709 13:02:26.009330  8580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2050) took 3438 ms (client timeout 1586 ms). Trace:
W20260709 13:02:26.009752  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db7e0 after lost signal to thread 7335
W20260709 13:02:26.013826  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db960 after lost signal to thread 7338
W20260709 13:02:25.975593  8456 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9800 after lost signal to thread 8459
W20260709 13:02:26.014333  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db540 after lost signal to thread 8329
W20260709 13:02:26.014724  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db3c0 after lost signal to thread 8331
W20260709 13:02:26.014106  8580 rpcz_store.cc:269] 0709 13:02:22.570755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.581648 (+ 10893us) service_pool.cc:224] Handling call
0709 13:02:26.009243 (+3427595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.751413 12699 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:26.014755 12629 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:26.015434  8456 debug-util.cc:398] Leaking SignalData structure 0x7b0800380a40 after lost signal to thread 8534
W20260709 13:02:25.822044  8505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2403) took 3389 ms (client timeout 1627 ms). Trace:
W20260709 13:02:26.015872  8505 rpcz_store.cc:269] 0709 13:02:22.432290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.730541 (+298251us) service_pool.cc:224] Handling call
0709 13:02:25.821891 (+3091350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.808319  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:26.016495  8456 debug-util.cc:398] Leaking SignalData structure 0x7b080032b820 after lost signal to thread 8608
I20260709 13:02:25.761668 12728 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:25.758479  8503 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
W20260709 13:02:26.016867  8456 debug-util.cc:398] Leaking SignalData structure 0x7b0800375020 after lost signal to thread 8609
I20260709 13:02:25.761703  8427 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:26.016880  8430 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:25.877893  8329 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 7 to 8, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 8 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.811476 12725 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.200s
I20260709 13:02:25.794672 12591 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.018791  8329 catalog_manager.cc:5697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 9, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 9 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:02:26.019871 12591 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.020269  8329 catalog_manager.cc:5697] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 4 to 7, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 7 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.792249  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.022092 12591 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:25.861284  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 436418us
I20260709 13:02:25.853179  8575 raft_consensus.cc:2410] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:02:26.023118  8575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2335) took 3454 ms (client timeout 3815 ms). Trace:
W20260709 13:02:26.023501  8575 rpcz_store.cc:269] 0709 13:02:22.569047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.445824 (+2876777us) service_pool.cc:224] Handling call
0709 13:02:26.023029 (+577205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:26.014392  8426 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:25.832386  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:26.026634  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2013) took 1257 ms. Trace:
W20260709 13:02:25.708921  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.026965  8426 rpcz_store.cc:276] 0709 13:02:24.769046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.972257 (+1203211us) service_pool.cc:224] Handling call
0709 13:02:26.014181 (+ 41924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.026387 (+ 12206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.026558 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:26.017938  8456 debug-util.cc:398] Leaking SignalData structure 0x7b080033aea0 after lost signal to thread 9126
W20260709 13:02:26.028337  8456 debug-util.cc:398] Leaking SignalData structure 0x7b0800298460 after lost signal to thread 9127
W20260709 13:02:25.860236  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 449316us
I20260709 13:02:26.030406  8329 catalog_manager.cc:5697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 2 to 3, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:02:25.976702  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:26.012734 12441 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:26.038216 12441 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:26.007865  9094 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:26.039553 12441 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:25.852332  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 424251us
I20260709 13:02:26.039844  8329 catalog_manager.cc:5697] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 4 to 7, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 7 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:02:26.015125  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dba40 after lost signal to thread 8335
I20260709 13:02:25.875056  8431 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:26.018270  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:26.046962  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db740 after lost signal to thread 8360
I20260709 13:02:25.982486  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:25.804831  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:26.047853 12711 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:26.047870  9099 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:02:26.048321 12711 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:26.022471  8435 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:26.048759 12674 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:26.049237 12728 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:25.955188  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.804024  9101 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:26.050259  9096 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:25.799918  8428 rpcz_store.cc:269] 0709 13:02:22.546880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.576199 (+3029319us) service_pool.cc:224] Handling call
0709 13:02:25.577644 (+  1445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.804013  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:26.051222  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 71393.1us
I20260709 13:02:26.051697  9100 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:25.792690 12732 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:25.810611 12724 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:26.052656  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:26.053982 12727 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:26.054477 12727 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:26.054864 12727 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.799160 12721 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:26.055929  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.009425  8582 rpcz_store.cc:276] 0709 13:02:22.571497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.621968 (+3050471us) service_pool.cc:224] Handling call
0709 13:02:25.725041 (+103073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.799466 (+ 74425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.799666 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:26.056463  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.056950 12402 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:26.043226  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:26.012562  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 202141us
I20260709 13:02:26.061551 12738 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:26.062054 12738 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.062418 12738 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.064553 12707 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:26.066058  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 827) took 3484 ms. Trace:
I20260709 13:02:26.066484  8431 rpcz_store.cc:276] 0709 13:02:22.582183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.874468 (+3292285us) service_pool.cc:224] Handling call
0709 13:02:25.874845 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.065705 (+190860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.065949 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.987556  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:26.074245 12402 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:26.075599  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 88168.9us
I20260709 13:02:26.077075  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:26.077224 12738 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.045766  8507 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:02:26.047300  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db3a0 after lost signal to thread 8363
W20260709 13:02:26.114420  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db840 after lost signal to thread 8364
W20260709 13:02:26.114711  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db1c0 after lost signal to thread 8367
W20260709 13:02:26.114939  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db500 after lost signal to thread 8379
W20260709 13:02:25.907317  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.049162 12716 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:26.048821 12711 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.031131  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:26.112733 12441 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.062544  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:26.056396  8329 catalog_manager.cc:5697] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 5 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:25.987901 12745 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:26.077906 12402 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.078140 12724 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:25.784474  8502 rpcz_store.cc:269] 0709 13:02:22.764050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.631402 (+2867352us) service_pool.cc:224] Handling call
0709 13:02:25.783805 (+152403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:26.082759  9100 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.975709  8501 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:26.083297  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:26.083422  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:26.085788  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 103434us
I20260709 13:02:25.988891  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:25.851779  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.093178  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:26.147794  8431 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:26.107564  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.107975 12504 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.112037 12629 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:26.147444  8329 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 8 to 11, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 11 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.148726 12742 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:26.152822  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 69636.5us
I20260709 13:02:26.111724 12727 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.127806  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 855) took 3349 ms. Trace:
I20260709 13:02:26.152197  8329 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 7 to 8, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 8 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.157846  8507 rpcz_store.cc:276] 0709 13:02:22.764527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.781118 (+3016591us) service_pool.cc:224] Handling call
0709 13:02:25.781570 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.114015 (+332445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.114232 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:26.128466  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db920 after lost signal to thread 8387
W20260709 13:02:26.070446  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 204825us
I20260709 13:02:26.131673  8398 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:26.133229  8434 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:02:26.135931  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.139689  9096 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
W20260709 13:02:26.159545  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.159789  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db940 after lost signal to thread 8398
W20260709 13:02:26.160120  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db6c0 after lost signal to thread 8399
I20260709 13:02:26.134310 12732 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:26.133080 12729 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:02:26.149041 12441 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.148566 12721 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.165045  9099 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:26.163990  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:26.155562  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.139240  9093 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
W20260709 13:02:26.160367  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db9a0 after lost signal to thread 8400
I20260709 13:02:26.162758  9094 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:02:26.163158  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:26.163319  9067 connection.cc:256] RPC call timeout handler was delayed by -1.4174853810001196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:02:26.161490  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:26.157123 12665 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:02:26.164332  8329 catalog_manager.cc:5697] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:26.193936  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:26.194293  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 163303us
I20260709 13:02:26.153096 12741 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.199437  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:26.204800  8584 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.208353  8434 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:26.199600 12727 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:26.200062  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:26.203291  9094 pending_rounds.cc:85] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 7
I20260709 13:02:26.203549 12665 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:26.203718  8580 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:26.156904 12716 consensus_queue.cc:1243] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:26.165025 12629 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:26.209484  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:26.232297  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db360 after lost signal to thread 8401
I20260709 13:02:26.165877  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:26.242046 12629 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.242588 12629 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.243316  8547 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:26.244293  8547 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:26.245215  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:26.232023 12665 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:26.245934 12674 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:26.246867 12674 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:26.247061 12665 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.247833 12674 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.149979 12504 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.150662 12738 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:26.249202  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:26.233963  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800118ce0 after lost signal to thread 7335
I20260709 13:02:26.249908  8579 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
W20260709 13:02:26.250276  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000d0ee0 after lost signal to thread 7338
W20260709 13:02:26.251293  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000b89a0 after lost signal to thread 8367
I20260709 13:02:26.251151  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:26.252241  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000c4140 after lost signal to thread 8429
W20260709 13:02:26.252291  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 47873.7us
W20260709 13:02:26.253847 12763 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:02:26.254400 12739 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:26.254850 12739 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.255187 12739 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.256754 12504 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:26.249012  9095 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:26.249810 12738 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:26.257767 12738 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.258213 12738 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.258459 12741 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.207672 12473 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:26.252661  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2660 after lost signal to thread 8430
W20260709 13:02:26.259517  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002db9c0 after lost signal to thread 8409
I20260709 13:02:26.248584 12665 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:26.267654  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3c60 after lost signal to thread 8431
I20260709 13:02:26.245911  9100 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:26.231405  8329 catalog_manager.cc:5697] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 5 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.267834  8581 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:26.267998  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000b88e0 after lost signal to thread 8432
I20260709 13:02:26.165205  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:26.268378  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000c41a0 after lost signal to thread 8433
I20260709 13:02:26.210165  9094 pending_rounds.cc:107] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 8.8
W20260709 13:02:26.268746  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08001f20c0 after lost signal to thread 8434
W20260709 13:02:26.268668  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dba80 after lost signal to thread 8428
I20260709 13:02:26.269250  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:26.269616  9094 raft_consensus.cc:2889] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:26.269694  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080039f380 after lost signal to thread 8435
W20260709 13:02:26.269851  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbc40 after lost signal to thread 8429
W20260709 13:02:26.270382  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbb40 after lost signal to thread 8430
W20260709 13:02:26.270505  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9120 after lost signal to thread 8459
W20260709 13:02:26.270668  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbc20 after lost signal to thread 8431
W20260709 13:02:26.270884  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080039c100 after lost signal to thread 8474
W20260709 13:02:26.271018  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbb60 after lost signal to thread 8432
W20260709 13:02:26.271160  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf480 after lost signal to thread 8475
W20260709 13:02:26.271512  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbbe0 after lost signal to thread 8433
W20260709 13:02:26.271515  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf5e0 after lost signal to thread 8476
W20260709 13:02:26.272393  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08001c8400 after lost signal to thread 8491
W20260709 13:02:26.272810  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000da640 after lost signal to thread 8501
W20260709 13:02:26.273085  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800366c00 after lost signal to thread 8503
W20260709 13:02:26.273301  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080039f1e0 after lost signal to thread 8504
W20260709 13:02:26.273346  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 115889us
W20260709 13:02:26.273613  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba6a0 after lost signal to thread 8505
W20260709 13:02:26.273938  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080032bc60 after lost signal to thread 8507
W20260709 13:02:26.274202  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003ea5c0 after lost signal to thread 8508
W20260709 13:02:26.274426  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08001b01e0 after lost signal to thread 8509
W20260709 13:02:26.274608  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003397a0 after lost signal to thread 8510
W20260709 13:02:26.274981  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8760 after lost signal to thread 8525
W20260709 13:02:26.271977  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbc00 after lost signal to thread 8434
W20260709 13:02:26.275311  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080036eaa0 after lost signal to thread 8534
W20260709 13:02:26.275614  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6880 after lost signal to thread 8435
W20260709 13:02:26.275640  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003023e0 after lost signal to thread 8547
W20260709 13:02:26.276116  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080009af60 after lost signal to thread 8549
W20260709 13:02:26.276335  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800391060 after lost signal to thread 8550
W20260709 13:02:26.276746  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbfa0 after lost signal to thread 8459
W20260709 13:02:26.277307  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003185a0 after lost signal to thread 8474
W20260709 13:02:26.277664  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc0a0 after lost signal to thread 8475
W20260709 13:02:26.278039  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc080 after lost signal to thread 8476
W20260709 13:02:26.278808  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080035d760 after lost signal to thread 8501
W20260709 13:02:26.279223  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2fa0 after lost signal to thread 8503
W20260709 13:02:26.281292  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1940 after lost signal to thread 8575
I20260709 13:02:26.281416  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:26.282265  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:26.282922  9095 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:26.283551 12716 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:26.286481  8550 connection.cc:256] RPC call timeout handler was delayed by -2.2650944739999659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 13:02:26.286871  8550 connection.cc:256] RPC call timeout handler was delayed by -2.2607928679999532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:02:26.287140  8550 connection.cc:256] RPC call timeout handler was delayed by -1.9095944739999595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
I20260709 13:02:26.287782  8550 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:26.289348  8550 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:26.289541 12703 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.290114 12703 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:26.290933 12591 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:26.291443 12591 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:26.292361 12591 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.292855  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.293427  8575 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:26.294374  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:26.295009  9095 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:26.294404  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.296435  8579 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:26.296856 12700 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:26.297278 12700 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:26.297670 12700 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.298281 12703 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:26.301491  9100 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:26.303835  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.302995  8329 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 5 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:26.309031  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45707.9us
I20260709 13:02:26.282866  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:26.281687  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080035b520 after lost signal to thread 8577
W20260709 13:02:26.310307  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003eeac0 after lost signal to thread 8578
W20260709 13:02:26.310654  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08004015a0 after lost signal to thread 8579
W20260709 13:02:26.310953  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9480 after lost signal to thread 8580
W20260709 13:02:26.311224  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080041e860 after lost signal to thread 8581
W20260709 13:02:26.311506  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080038a420 after lost signal to thread 8582
W20260709 13:02:26.311766  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080016b500 after lost signal to thread 8583
W20260709 13:02:26.312021  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003f4600 after lost signal to thread 8584
W20260709 13:02:26.312610  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080023fa20 after lost signal to thread 8605
W20260709 13:02:26.312930  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080016ba20 after lost signal to thread 8608
W20260709 13:02:26.313213  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003b93e0 after lost signal to thread 8609
W20260709 13:02:26.313601  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08002bdc00 after lost signal to thread 9065
W20260709 13:02:26.313889  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800220080 after lost signal to thread 9066
W20260709 13:02:26.314617  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4e20 after lost signal to thread 9067
I20260709 13:02:26.315114  8584 raft_consensus.cc:2410] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:02:26.315426  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08004117a0 after lost signal to thread 9068
W20260709 13:02:26.317198  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000b46a0 after lost signal to thread 9093
I20260709 13:02:26.194543 12467 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:26.317730  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080041b880 after lost signal to thread 9094
W20260709 13:02:26.318125  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080041bcc0 after lost signal to thread 9096
W20260709 13:02:26.318508  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800411680 after lost signal to thread 9098
W20260709 13:02:26.318833  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9b60 after lost signal to thread 9099
W20260709 13:02:26.319144  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08002cf9c0 after lost signal to thread 9100
W20260709 13:02:26.316553  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800323100 after lost signal to thread 8504
W20260709 13:02:26.319479  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800415d40 after lost signal to thread 9101
W20260709 13:02:26.320340  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080037e3a0 after lost signal to thread 9102
W20260709 13:02:26.321341  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080031f860 after lost signal to thread 9126
W20260709 13:02:26.321724  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003739c0 after lost signal to thread 9127
W20260709 13:02:26.322034  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003ccd80 after lost signal to thread 12115
W20260709 13:02:26.322391  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800373b20 after lost signal to thread 12191
W20260709 13:02:26.322717  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080037bea0 after lost signal to thread 12274
W20260709 13:02:26.323081  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800379a40 after lost signal to thread 12399
W20260709 13:02:26.323443  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003e5520 after lost signal to thread 12402
W20260709 13:02:26.323799  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08001cee80 after lost signal to thread 12441
W20260709 13:02:26.324154  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003d18e0 after lost signal to thread 12467
W20260709 13:02:26.324505  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080037d720 after lost signal to thread 12471
W20260709 13:02:26.324848  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003ef280 after lost signal to thread 12473
W20260709 13:02:26.325218  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800308b40 after lost signal to thread 12483
W20260709 13:02:26.325610  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080032ff40 after lost signal to thread 12504
W20260709 13:02:26.319891  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800297860 after lost signal to thread 8505
W20260709 13:02:26.326153  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080019de40 after lost signal to thread 8507
W20260709 13:02:26.326601  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003bdb60 after lost signal to thread 12591
W20260709 13:02:26.327044  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003a54c0 after lost signal to thread 12601
W20260709 13:02:26.327487  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080031be40 after lost signal to thread 12622
W20260709 13:02:26.327827  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800142ec0 after lost signal to thread 12624
W20260709 13:02:26.328183  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003eec40 after lost signal to thread 12629
W20260709 13:02:26.328572  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef9a0 after lost signal to thread 12651
W20260709 13:02:26.328936  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800360b80 after lost signal to thread 12662
W20260709 13:02:26.329329  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff820 after lost signal to thread 12665
W20260709 13:02:26.329684  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7540 after lost signal to thread 12674
W20260709 13:02:26.330070  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080034dc00 after lost signal to thread 12679
I20260709 13:02:26.330978  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:26.332170  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:26.332711  9093 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:26.334693 12720 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:26.335780  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:26.337915 12504 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:26.338313 12504 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:26.339125 12504 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:26.342844  8549 connection.cc:256] RPC call timeout handler was delayed by -2.3703876629999741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 13:02:26.342912 12703 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.343130 12483 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.343437  8549 connection.cc:256] RPC call timeout handler was delayed by -2.3667876629999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 13:02:26.343640 12703 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:26.343721 12483 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:26.345160 12467 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:26.345803  8400 connection.cc:256] RPC call timeout handler was delayed by -2.2643599660000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 13:02:26.345898 12729 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.346252  8400 connection.cc:256] RPC call timeout handler was delayed by -2.1761599660001139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 13:02:26.346733  8400 connection.cc:256] RPC call timeout handler was delayed by -2.1455599660000644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260709 13:02:26.346556 12729 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:26.347143  8400 connection.cc:256] RPC call timeout handler was delayed by -1.9322599660000606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 13:02:26.347580  8400 connection.cc:256] RPC call timeout handler was delayed by -1.8728599660000782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 13:02:26.347935  8400 connection.cc:256] RPC call timeout handler was delayed by -1.7396599660000902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 13:02:26.348295  8400 connection.cc:256] RPC call timeout handler was delayed by -1.7288599660000727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 13:02:26.348676 12729 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:26.349231 12741 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:26.349475  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.349750 12741 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:26.350556  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 67782.7us
I20260709 13:02:26.351909 12741 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:26.352435  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:26.353453 12732 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.353542 12483 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:26.354420 12732 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:26.345916 12703 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:26.357424  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800208060 after lost signal to thread 8508
W20260709 13:02:26.357834  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003703a0 after lost signal to thread 8509
W20260709 13:02:26.358990  8549 connection.cc:256] RPC call timeout handler was delayed by -2.3541876629999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 13:02:26.359496  8549 connection.cc:256] RPC call timeout handler was delayed by -2.1858876629999031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:02:26.359874  8549 connection.cc:256] RPC call timeout handler was delayed by -2.1237876629999164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 13:02:26.360241  8549 connection.cc:256] RPC call timeout handler was delayed by -2.0562876629999209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:02:26.360601  8549 connection.cc:256] RPC call timeout handler was delayed by -1.9959876629999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 13:02:26.360953  8549 connection.cc:256] RPC call timeout handler was delayed by -1.7961876629999551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 13:02:26.361323  8549 connection.cc:256] RPC call timeout handler was delayed by -1.6845876629998884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23290000000000002s for a response
W20260709 13:02:26.361685  8549 connection.cc:256] RPC call timeout handler was delayed by -1.4586876629999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.258s for a response
W20260709 13:02:26.362066  8549 connection.cc:256] RPC call timeout handler was delayed by -1.082487662999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2998s for a response
W20260709 13:02:26.362954  7340 debug-util.cc:398] Leaking SignalData structure 0x7b080000f940 after lost signal to thread 9065
I20260709 13:02:26.267400 12473 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:26.377343  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:26.208141 12721 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.396287 12629 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:26.272938 12724 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.399277 12728 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:26.399709 12728 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:26.371141  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1140 after lost signal to thread 8510
I20260709 13:02:26.376386  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:26.377060  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:26.406339  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb4a0 after lost signal to thread 8534
I20260709 13:02:26.406508  9095 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
W20260709 13:02:26.406802  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08000e1220 after lost signal to thread 8547
I20260709 13:02:26.379809  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:26.407150  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800360480 after lost signal to thread 8549
W20260709 13:02:26.407442  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080037da80 after lost signal to thread 8550
W20260709 13:02:26.381342 12758 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:02:26.383059  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.416002  9102 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:26.383384  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.384282  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.417169  8504 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:26.384593  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.384328  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.384987 12441 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:26.388284 12765 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 13:02:26.389454  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:26.394184  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 104877us
I20260709 13:02:26.428452  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:26.362805  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003efd20 after lost signal to thread 12691
I20260709 13:02:26.397751 12721 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:26.415604  9100 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:26.416080  8501 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:26.432816  8581 raft_consensus.cc:2410] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:02:26.416715  8502 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
W20260709 13:02:26.439671  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.408000  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800334560 after lost signal to thread 8575
W20260709 13:02:26.440696  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08000c36c0 after lost signal to thread 8577
W20260709 13:02:26.440940  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7ac0 after lost signal to thread 8578
W20260709 13:02:26.441143  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003617c0 after lost signal to thread 8579
W20260709 13:02:26.441334  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002eaf60 after lost signal to thread 8580
W20260709 13:02:26.441522  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4240 after lost signal to thread 8581
W20260709 13:02:26.441728  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080032c660 after lost signal to thread 8582
W20260709 13:02:26.441915  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080034eda0 after lost signal to thread 8583
W20260709 13:02:26.442128  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003085a0 after lost signal to thread 8584
W20260709 13:02:26.436590  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800188540 after lost signal to thread 12695
I20260709 13:02:26.436125  8435 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
W20260709 13:02:26.443229  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800348aa0 after lost signal to thread 12699
W20260709 13:02:26.443511  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4cc0 after lost signal to thread 12700
W20260709 13:02:26.444284  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0c00 after lost signal to thread 8605
W20260709 13:02:26.444674  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003dfa20 after lost signal to thread 8608
W20260709 13:02:26.445058  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080034bec0 after lost signal to thread 8609
W20260709 13:02:26.445420  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800383e00 after lost signal to thread 9065
W20260709 13:02:26.445700  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab440 after lost signal to thread 9066
W20260709 13:02:26.445956  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800357700 after lost signal to thread 9067
W20260709 13:02:26.446237  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0860 after lost signal to thread 9068
I20260709 13:02:26.438010  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:26.446798  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080040cd00 after lost signal to thread 9093
W20260709 13:02:26.447204  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2540 after lost signal to thread 9094
W20260709 13:02:26.447495  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080040ce60 after lost signal to thread 9096
W20260709 13:02:26.448348  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080036ac40 after lost signal to thread 9098
I20260709 13:02:26.443519  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.400640 12473 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.455027  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:26.450747  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcde0 after lost signal to thread 9099
I20260709 13:02:26.455667  8435 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:26.456070  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080030ffc0 after lost signal to thread 9100
W20260709 13:02:26.456346  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800349d40 after lost signal to thread 9101
I20260709 13:02:26.451112  8427 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:26.447487  8431 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:26.451562  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08002938c0 after lost signal to thread 12702
W20260709 13:02:26.457216  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08003344a0 after lost signal to thread 12704
W20260709 13:02:26.457521  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea7a0 after lost signal to thread 12705
W20260709 13:02:26.457794  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080035eea0 after lost signal to thread 12707
W20260709 13:02:26.458053  8531 debug-util.cc:398] Leaking SignalData structure 0x7b080039ed20 after lost signal to thread 12709
W20260709 13:02:26.458318  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800355d60 after lost signal to thread 12711
I20260709 13:02:26.452386  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.453002  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:26.453143  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.438761 12483 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.456553  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08002faa20 after lost signal to thread 9102
W20260709 13:02:26.464075  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800332920 after lost signal to thread 9126
W20260709 13:02:26.464349  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800300720 after lost signal to thread 9127
W20260709 13:02:26.464583  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800401c20 after lost signal to thread 12115
W20260709 13:02:26.464792  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800410440 after lost signal to thread 12191
W20260709 13:02:26.470760  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080003a580 after lost signal to thread 12274
I20260709 13:02:26.469094  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:26.475330  9100 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.474336  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.444656 12742 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.476481  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080036aee0 after lost signal to thread 12399
W20260709 13:02:26.477996  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8c60 after lost signal to thread 12402
W20260709 13:02:26.478248  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0440 after lost signal to thread 12441
I20260709 13:02:26.478821  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.480733  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.481482  8507 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:26.464763 12601 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.484668  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.476643  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:26.486454  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800333900 after lost signal to thread 12467
I20260709 13:02:26.486744  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:26.485728  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 175941us
I20260709 13:02:26.487506  8434 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
W20260709 13:02:26.486761  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800338160 after lost signal to thread 12471
I20260709 13:02:26.490108  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.490219  8510 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.491695  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:26.493018  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd280 after lost signal to thread 12473
I20260709 13:02:26.494098  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:26.494812  8430 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.477056 12716 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.495255  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:26.493162  8427 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:26.497691  8505 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
W20260709 13:02:26.498545  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800403340 after lost signal to thread 12483
W20260709 13:02:26.499014  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4d20 after lost signal to thread 12504
I20260709 13:02:26.500314  8426 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:26.502956  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:26.503499  8507 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.505021  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.505722  8434 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:26.505918  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080039dbc0 after lost signal to thread 12591
W20260709 13:02:26.506356  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003a42c0 after lost signal to thread 12601
W20260709 13:02:26.506681  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8cc0 after lost signal to thread 12622
W20260709 13:02:26.506946  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080039ee80 after lost signal to thread 12624
W20260709 13:02:26.507325  9123 debug-util.cc:398] Leaking SignalData structure 0x7b0800308ac0 after lost signal to thread 12651
W20260709 13:02:26.507639  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080022e960 after lost signal to thread 12662
W20260709 13:02:26.507900  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8320 after lost signal to thread 12665
W20260709 13:02:26.508170  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003b04c0 after lost signal to thread 12674
W20260709 13:02:26.508446  9123 debug-util.cc:398] Leaking SignalData structure 0x7b080009b380 after lost signal to thread 12679
I20260709 13:02:26.478736 12483 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:26.513655  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:26.514379  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:26.515370  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.514209  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:26.521634  8426 raft_consensus.cc:2376] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11. Re-sending same reply.
I20260709 13:02:26.522204  8508 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:26.523241  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.523247  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.519817  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.529059  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.529686  8427 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
W20260709 13:02:26.541939  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.593830  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 204519us
I20260709 13:02:26.595645  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.596297  8505 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
W20260709 13:02:26.599017  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 85446.6us
I20260709 13:02:26.601496  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.604046  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.604663  8505 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 6.
I20260709 13:02:26.605494  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.484397 12742 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.606631  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:26.606014  8505 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:26.621611  8427 raft_consensus.cc:2368] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12.
I20260709 13:02:26.626003  8549 leader_election.cc:400] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12.
I20260709 13:02:26.626384  8549 leader_election.cc:403] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:26.523111 12629 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:26.630172  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.631839  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.481511  8584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44116e7a54d141108511e22185400ffe"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:02:26.497376 12601 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.484333 12728 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:26.635265  8584 raft_consensus.cc:606] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:26.675756  8584 raft_consensus.cc:614] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:26.660450  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:26.648707  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.636427  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:26.668466  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:26.672782  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:26.676810  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.608857 12741 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.691767  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.695894  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.696120  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.699973  8578 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:26.617743 12722 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:02:26.640359 12769 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.723739  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.696611  8502 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:26.731698  8501 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:26.726313  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.669090 12699 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.732899  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.728120  8507 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:26.733815  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.738040  8580 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:26.734730  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.741709  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.742952  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.743703  8426 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:26.743850  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.744551  8578 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:26.746376  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:26.746527  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 119057us
I20260709 13:02:26.747579  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:26.748155  8575 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.746977  8504 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:26.750612  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:26.750998  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.749246  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:26.753022  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.753733  8427 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:26.739918 12674 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.736160 12591 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.754956  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:26.760546  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:26.761440  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 127165us
I20260709 13:02:26.772867  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.771530  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.769884  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:26.755256 12769 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.780987  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:26.781628  8501 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:26.787092  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.789674  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.790900  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.792464  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.793200  8432 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:26.793643  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.793197  8433 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:26.806262  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.770994 12728 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.813060  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:26.806169  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:26.813935  8434 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.825256  8575 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
W20260709 13:02:26.787863 12665 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
W20260709 13:02:26.828538  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 63772.7us
I20260709 13:02:26.842893  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:26.848691 12700 consensus_meta.cc:287] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.009s
W20260709 13:02:26.850411 12773 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.102s	user 0.004s	sys 0.000s
I20260709 13:02:26.850646 12483 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:26.850847 12674 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.755716 12739 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.853513  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.882403  8431 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:26.836823  8429 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:26.846850 12402 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:02:26.860970  8434 raft_consensus.cc:2410] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:26.873492  8426 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:26.874449  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.767372 12738 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:26.885087  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:26.893296  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 114384us
I20260709 13:02:26.902657  8575 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:26.903759  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.904481  8578 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:26.905174  8584 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:26.897236 12764 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
W20260709 13:02:26.898253 12771 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:02:26.913781  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.915509  8578 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:26.916713  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:26.918413  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:26.874775 12700 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:26.926453  8434 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:26.920394  8507 raft_consensus.cc:2410] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:26.928932  8510 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
W20260709 13:02:26.928148  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 108217us
I20260709 13:02:26.903507 12775 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.909466 12769 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:26.924199 12766 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
W20260709 13:02:26.943428  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.944569  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:26.949126  8435 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:26.924712 12601 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:26.951097  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:26.953415  8435 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:26.956429  8578 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.960474  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:26.962671  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 49003.6us
I20260709 13:02:26.968811 12629 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:26.971123 12727 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:26.978492  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 82900us
W20260709 13:02:26.981237  9100 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.504s	user 0.004s	sys 0.006s
I20260709 13:02:26.981846  9100 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:26.987534  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:26.988196  8505 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.988368  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:26.991338  8580 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:26.992383  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.993002  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:26.993669  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:26.994562  8583 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:26.994447  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:27.000455  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:27.001389 12473 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.530s	user 0.001s	sys 0.006s
I20260709 13:02:27.001597  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:27.000600 12720 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:02:27.002703 12739 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:27.004966 12723 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:27.005815 12723 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.006214 12723 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:27.008709 12738 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:27.009738  8549 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.010496 12785 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:27.010743 12700 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:27.005345  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:27.005340 12791 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.011415 12700 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:27.010953 12785 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:27.012005 12700 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:27.012425 12700 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.012738 12785 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.013768 12785 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:27.015179  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.016028  8430 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.001s
I20260709 13:02:26.998816  8505 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:27.016455  8430 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:27.021476  8508 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
W20260709 13:02:27.010939  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.025805  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.032105  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.033190 12471 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.033609 12471 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.034058 12471 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:27.034188 12770 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 13:02:27.040473 12504 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.041826 12471 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.045331  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.046277  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.047340 12591 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.047631  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.047775 12591 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:27.048172 12591 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.047786 12601 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.050284 12601 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:27.050683 12601 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:27.055456  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.057932 12775 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.058535 12775 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:27.059487 12775 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:27.064087  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.066555  8435 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.029845  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.044730 12471 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:27.069356  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:27.071224  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:27.071878  8505 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:27.068081  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:27.075484  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.011672 12791 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:27.088495  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:27.087319  9065 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.094622  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:27.096119  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.092437 12504 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.097167 12504 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:27.097543 12504 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:27.098531  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 497562us
I20260709 13:02:27.100561 12591 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.101440 12786 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.096005 12742 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:27.102916 12782 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.001829 12473 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.096010 12601 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.103904  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.110471  8508 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:27.074824 12745 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:27.101876 12786 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:27.115446  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47444.3us
I20260709 13:02:27.109799  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:27.031271 12739 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:02:27.135156  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:27.125923  8502 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:27.142843  8433 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:27.143452  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:27.144485  8505 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:27.145937  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.103439 12782 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.104426 12791 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.143857  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.116086 12402 raft_consensus.cc:2764] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:27.151827  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:27.139317 12724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.008s	sys 0.017s
I20260709 13:02:27.118984 12745 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:27.136811 12786 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.159864  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:27.157394  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.160679  8430 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.161532  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.164139  8508 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:27.160951  8510 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:27.157809 12724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.009s	sys 0.017s
I20260709 13:02:27.166481  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:27.171689  8508 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:27.172070  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:27.166625  8580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77b025d136d04841aa2759be7b816f77"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:02:27.172951  8580 raft_consensus.cc:606] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:27.173386  8580 raft_consensus.cc:614] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:27.152773 12709 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.173834  8430 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:27.155072 12738 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:27.149925 12782 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.155355 12471 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.177961  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:27.161969 12745 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:27.181917  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:27.182585  8508 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:27.184516  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:27.171063 12399 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.179291 12471 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.210386 12399 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.210561 12471 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.210908 12399 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.210286 12504 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.198359 12591 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:27.198817  9065 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.213124  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:27.204833  8510 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:27.214893  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.215404  8510 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.206693 12699 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12.
I20260709 13:02:27.160264 12769 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:02:27.207269  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.211971 12473 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:27.177570 12738 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:27.207096 12724 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.196892  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:27.183997 12711 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.049s	user 0.011s	sys 0.001s
I20260709 13:02:27.213124 12441 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.223227  8584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:02:27.235702  8433 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:02:27.235986  8433 pending_rounds.cc:85] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 6
I20260709 13:02:27.177870 12709 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.227311  8578 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:27.229072  8510 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:27.213732  8430 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
W20260709 13:02:27.230080  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 43709.3us
I20260709 13:02:27.230638  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.267069  8508 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.268051 12738 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.231397  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 2036) took 1171 ms. Trace:
I20260709 13:02:27.270200  8428 rpcz_store.cc:276] 0709 13:02:26.055069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.055627 (+   558us) service_pool.cc:224] Handling call
0709 13:02:27.225842 (+1170215us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400125a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:27.225969 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589235584}
I20260709 13:02:27.271317 12709 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.275180  8428 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:27.275990  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:27.276531  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:27.277395 12725 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.277899  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.278245  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:27.279049  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.279891 12702 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.280072 12674 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.280294 12702 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.280707 12702 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.234117 12723 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.282269 12699 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.282888 12723 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:27.283017 12699 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:27.284860  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:27.285878  9096 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:27.231621  8435 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:27.232784  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:27.286751 12473 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.287618  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.269693 12738 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.236279  8433 pending_rounds.cc:107] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:02:27.235704  8584 raft_consensus.cc:606] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:27.240022  8509 raft_consensus.cc:2410] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:27.293596  8433 raft_consensus.cc:2889] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:27.240306  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.241158  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:27.236886 12727 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:02:27.244704  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.246101  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.237053 12798 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.246886 12504 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:27.235193 12441 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:27.247495 12767 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.520s	user 0.004s	sys 0.000s
W20260709 13:02:27.250586 12804 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:27.323346  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.251466 12471 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.251806 12399 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.252758 12700 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.229590 12791 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.256003 12786 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.259953  8547 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.288638  8505 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.318856 12441 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.224264 12601 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:27.288168  8504 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:27.289739  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:27.281358  8508 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:27.290457  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:27.349259  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 58854.7us
I20260709 13:02:27.292174  8575 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:27.289223  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.277904 12725 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.296213  8503 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:27.351538  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 62381.3us
I20260709 13:02:27.351967  9102 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:27.311324  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.311590  8579 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:27.311780  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:27.234193 12724 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.297011  9068 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.316573  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:27.317967  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 174201us
I20260709 13:02:27.352630  8582 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:27.355666  9067 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:27.357089  9098 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:27.319700  8510 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:27.328495  8509 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:27.329769  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:27.330235  8576 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:02:27.342993  8581 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:02:27.318400 12729 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.288897  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:27.360232  8578 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:27.357417  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.343281  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.360608  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:27.237226 12711 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.363569 12729 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.364522 12402 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.365052 12402 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.365648 12729 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:27.365478 12727 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:27.366197  9095 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.357286 12504 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.350936 12725 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.357760 12724 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.355162 12591 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.369293 12504 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.369376 12786 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:27.369378 12591 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.370172 12591 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.370715  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:27.370831  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.371127 12791 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:27.371472  8576 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:27.360018  8581 pending_rounds.cc:85] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 4
I20260709 13:02:27.372076  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.372534  8581 pending_rounds.cc:107] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:27.372689 12399 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:27.372859  8581 raft_consensus.cc:2889] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:27.373917  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.347023 12775 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:27.378361 12775 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.378747 12775 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:27.344189  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 84326.8us
I20260709 13:02:27.381906  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.382711 12601 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:27.383136 12601 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.383482 12601 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:27.383548  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.384132 12402 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:27.321028 12674 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.350304  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:27.311126  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:27.362488 12810 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.392122 12611 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:27.392468  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.392704 12611 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:27.393873 12611 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.363394 12700 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:27.363070 12471 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:27.395994  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.397013  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.397614 12810 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.409449  8430 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:27.414047 12810 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:27.415102 12810 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:27.416131  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 175971us
I20260709 13:02:27.410224  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:27.416935  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.417675 12674 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:27.385071 12699 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.418540  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.386976 12782 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.419364 12728 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:27.419516  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.419965 12728 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:27.408488 12745 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.421043 12728 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.421324 12782 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:27.386276 12473 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.423084 12473 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.423290  8510 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:27.398072 12504 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.425644 12504 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.395069  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.426045 12504 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.426321  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.427067  8501 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:27.407635  8581 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:27.384662  8506 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.406926  8505 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:02:27.428682  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.384485  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.408924  8576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:02:27.429906  8576 raft_consensus.cc:606] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:27.430240  8576 raft_consensus.cc:614] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:27.399037  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.405217 12711 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:27.407756  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 110814us
I20260709 13:02:27.419140 12674 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:27.432284  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.441749  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:27.443725  9068 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.439208  8550 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:27.432811  9095 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:27.413681  8503 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:27.439178  8504 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:27.439292  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:27.447225  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.447523  8508 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.418541 12699 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:27.438520  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.450182  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.448890  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.451166  8505 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.451545 12742 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.451707 12791 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.452171 12791 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:27.452585 12791 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.452312 12699 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.454677  8509 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:27.456856  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 858) took 1043 ms. Trace:
I20260709 13:02:27.457219  8506 rpcz_store.cc:276] 0709 13:02:26.403063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.427677 (+ 24614us) service_pool.cc:224] Handling call
0709 13:02:26.449679 (+ 22002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.427884 (+978205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.445875 (+ 17991us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54001fcf54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:27.446066 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2149772672}
W20260709 13:02:27.451655  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 67232.9us
I20260709 13:02:27.461483  8547 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.459182  8550 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.437067 12745 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:27.476555  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:27.477815  8504 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:02:27.470731  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50148.2us
I20260709 13:02:27.450414 12399 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.439776 12674 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:27.462939 12786 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.406915 12702 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:27.488340  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 172462us
I20260709 13:02:27.478709  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:27.469151  9068 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:27.482573  8582 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:27.465684 12723 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.494335  8584 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.512692  8398 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:27.465284 12739 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:27.465027 12774 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.497506  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:27.476907 12722 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:27.498039 12703 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:27.499732 12709 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.467954 12769 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:27.504627  8505 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:27.505172  8576 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:27.503715 12674 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.449445 12716 raft_consensus.cc:2764] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:27.445799 12471 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:02:27.546350 12815 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:27.547008 12471 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:27.547482 12471 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:27.491542 12399 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.520764  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.494009 12483 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:27.548308 12813 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.548789 12483 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:27.519289 12729 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:02:27.550077 12483 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.550998 12729 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:27.551364 12729 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:27.526044  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:27.552248 12729 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.553020  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:27.553503 12729 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.512077  9068 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.515980 12785 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:27.533222  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.548342 12399 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.555070 12629 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.555902 12629 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.556299 12629 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:27.556664 12629 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.534433  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:27.558917  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:27.548817 12813 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.559414  8398 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:27.559585  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:27.559845 12813 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.560532 12727 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.561260 12727 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:27.561723 12727 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:27.561990 12815 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.562620 12727 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.523788 12721 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.540202  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.502985 12720 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:02:27.570865  8583 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.526422 12739 raft_consensus.cc:697] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:27.532143 12700 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:27.574819  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 62777.9us
I20260709 13:02:27.604301  9068 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.605669  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:27.577958  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 116550us
I20260709 13:02:27.575368  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:27.578087  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44940.5us
I20260709 13:02:27.565156 12441 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:27.612279  8475 connection.cc:256] RPC call timeout handler was delayed by -3.7461334270000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:02:27.616165  8475 connection.cc:256] RPC call timeout handler was delayed by -3.6984334269999408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 13:02:27.616506  8475 connection.cc:256] RPC call timeout handler was delayed by -3.4554334270000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:02:27.616894  8475 connection.cc:256] RPC call timeout handler was delayed by -3.2106334269999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
I20260709 13:02:27.571300 12721 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:27.571554 12769 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:27.595278 12785 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:27.618955  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 151946us
W20260709 13:02:27.621627  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 62117.1us
I20260709 13:02:27.603601 12810 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.604668 12774 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:27.622182  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.612004 12723 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:27.634060  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 74716.5us
I20260709 13:02:27.629159  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:27.603705 12700 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:27.628033 12721 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.646245 12810 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:27.648974 12591 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.651029  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:27.634807 12786 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.654336 12820 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:02:27.654866 12775 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:27.657612  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 52055.4us
W20260709 13:02:27.658892  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 83577.5us
I20260709 13:02:27.687755  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:27.637605  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:27.688776 12720 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:27.641379 12504 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.689410  9068 leader_election.cc:400] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12.
I20260709 13:02:27.571761 12724 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.645598 12629 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.695499  9096 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:02:27.696348  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 58877.4us
W20260709 13:02:27.696949  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 89516.3us
W20260709 13:02:27.698048  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47077.7us
I20260709 13:02:27.701689  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.703197  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.702380  9102 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:27.708300  9095 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:27.708947  8584 raft_consensus.cc:2368] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13.
W20260709 13:02:27.693725 12809 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:02:27.692188 12728 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.710942  9098 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:27.692852 12820 consensus_queue.cc:1243] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:27.689460 12720 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:27.717926  8502 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.719532  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:27.723723  9095 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:27.685141 12815 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:27.730652 12504 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:27.732138 12591 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:27.733418 12702 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:27.733784 12729 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:27.714967 12742 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:27.737378  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 108469us
I20260709 13:02:27.741183  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.741839  9095 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:27.727531  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:27.743147  9098 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.747732  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.748339  8504 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.725478 12774 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:27.751881  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 90381.6us
W20260709 13:02:27.752400  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 43751.2us
I20260709 13:02:27.756444  9095 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.735168 12709 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:27.766983  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 76967us
I20260709 13:02:27.763088  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.761600 12702 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:02:27.763872 12441 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:27.769583 12742 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.769795 12709 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:27.770390 12709 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:27.770292 12742 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.771400 12709 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:27.772614 12821 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:27.776573 12791 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:27.763665  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 61330.8us
I20260709 13:02:27.769484 12828 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.784294  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:27.786365  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.787000  9096 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:27.729979 12402 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:02:27.755612 12774 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.788944  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.790155  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.790689  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.791440  9094 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:27.791388  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.790899  8578 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:27.792269  8575 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:27.792897  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.792999  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.794073  9094 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:27.701128 12739 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.795743  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.797066  8578 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 5.
I20260709 13:02:27.798195  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.801532  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.799407  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.772643 12709 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:27.828609 12817 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:02:27.829054 12819 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:02:27.791021 12826 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.835016  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.841010  9096 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:27.835876  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.827334  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.842682  9102 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:27.844393  8581 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:27.760203 12601 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.763070 12727 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:02:27.827284  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.795720 12441 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.728371 12769 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.850708 12814 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:02:27.827473 12823 raft_consensus.cc:993] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:02:27.839005  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.854425  9094 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 7: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:27.839730  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 57074.3us
W20260709 13:02:27.839781  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 47728.5us
I20260709 13:02:27.855587  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.855885  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:27.857540  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.858732 12591 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.858872 12745 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:27.859251 12591 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:27.859344 12745 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:27.859800 12473 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.860219 12591 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:27.860836 12829 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:27.861619  9098 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:27.862183 12611 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:27.865474  8510 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:27.866478  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:27.867199  8502 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.867658  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:27.869431  8501 pending_rounds.cc:85] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 5
I20260709 13:02:27.869751  8501 pending_rounds.cc:107] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:27.869987  8501 raft_consensus.cc:2889] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:27.872345  8577 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:27.841912  8580 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:27.758250 12783 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:02:27.836790  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 120375us
I20260709 13:02:27.782414 12742 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:27.847641  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.792106 12774 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:27.838061  8504 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:27.796579 12720 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.873903  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:27.877175  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.884332  9065 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.871097 12823 raft_consensus.cc:1081] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:02:27.860787 12832 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:27.888705  8502 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:27.893581  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.894871  8578 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:27.890728  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 137413us
I20260709 13:02:27.899089  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:27.899940  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 118220us
I20260709 13:02:27.841307 12826 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:27.910871  8400 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:27.903586  8583 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:27.903373  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.905085  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.905790 12722 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.912949  9096 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:27.900738  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.908320  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.758558 12810 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:27.923066  8583 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:27.929464  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:27.845595 12820 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:02:27.894800 12738 consensus_meta.cc:287] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.002s
I20260709 13:02:27.896585 12783 consensus_queue.cc:1243] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:27.893849 12828 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:27.981109  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:27.987906  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:27.988499  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50191.6us
I20260709 13:02:27.892716 12703 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.895709 12832 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:27.909217 12742 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:27.976992 12829 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:02:27.979740  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:27.980181 12724 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:27.895818 12815 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:02:27.982832  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.981046 12791 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:27.986847  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 85323.9us
I20260709 13:02:27.991784  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:27.909539 12782 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:28.030596  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:27.995812  9094 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:27.926628  8502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59098
I20260709 13:02:28.031306  9094 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:28.031651  8502 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:27.915447 12775 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:27.915870 12826 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.993721 12629 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:28.003640 12738 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.860291 12745 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:28.011270  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 103002us
I20260709 13:02:28.000304 12832 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.020927  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:28.046271  9093 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.037345  9094 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.049228  9094 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:28.055621  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.021848  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:27.980530 12473 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:28.023859  9098 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:27.932159  8577 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:28.032593  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:27.995436 12783 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.032157  8502 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.988206 12828 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:28.004956  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:28.036090  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:28.027848  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:28.038564  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:27.912487 12823 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:02:28.040268  9101 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:28.019382  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:28.043169  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:28.040017 12716 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:28.062543  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:28.068511  8504 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.002557 12674 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.068958  9099 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:28.069020  8505 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:28.061367  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:28.069759  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 136886us
I20260709 13:02:28.022321 12813 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:28.041954 12782 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:28.045562 12724 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.078730  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:28.080765  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59038.4us
I20260709 13:02:28.081471  8550 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:28.028600 12742 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.084554  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:28.085703  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:28.083495  8577 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:28.064751 12738 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:28.091017  8507 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:02:28.092133  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:28.092757  8507 raft_consensus.cc:2368] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12.
I20260709 13:02:28.093406  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:28.093868  8507 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.182403  8427 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:28.181627  8429 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:28.114534  8510 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.187407  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.113934  8503 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:28.140717  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.206004  8426 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:28.188011  8398 leader_election.cc:400] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12.
I20260709 13:02:28.172895  8434 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:28.208856  8398 leader_election.cc:403] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.113392  8509 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:28.095168  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:28.147553  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.121233  8506 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:28.187404  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:28.143385  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 57675.7us
I20260709 13:02:28.148914  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:28.128409  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:28.120509  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.218495  8431 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.099150  8580 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:02:28.094316  8504 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:28.074008 12716 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.149466  8582 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:28.129418  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:28.237959  9093 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:28.239477  8577 raft_consensus.cc:2368] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11.
I20260709 13:02:28.100371  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:28.112882 12725 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.002s
I20260709 13:02:28.232463  8576 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:28.082494 12728 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:28.240952  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:28.142488  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.085801 12791 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:28.086337 12786 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.253160  8507 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
W20260709 13:02:28.242125  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 54301us
I20260709 13:02:28.183491 12769 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:28.266255  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 355434us
I20260709 13:02:28.097229  8502 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:28.256639  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 224106us
I20260709 13:02:28.142700 12836 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:28.140913 12745 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.099300 12834 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:28.269301  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:28.269361  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:28.241708 12716 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.291893  8577 raft_consensus.cc:2368] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10.
I20260709 13:02:28.272058  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:28.279489  8502 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:28.279542  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:28.249162 12814 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.285667  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:28.086638 12823 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.179s
I20260709 13:02:28.113117 12775 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 13:02:28.147710 12833 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.243s
I20260709 13:02:28.297013  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:28.297673  8503 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.279201 12836 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:28.285395  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:28.281267 12399 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.005s
I20260709 13:02:28.320029 12399 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.322271 12399 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:28.322341 12728 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.323201  9095 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:28.322952 12728 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.256116 12782 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.325276 12728 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:28.257310 12725 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.291702 12791 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:28.326987  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:28.333493  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 248115us
I20260709 13:02:28.334860  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:28.338845  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53562.2us
I20260709 13:02:28.312458 12834 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:28.355648  8428 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:28.345996  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:28.147068 12828 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.278898 12738 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:28.335641 12728 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.394433  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.326862 12829 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:28.413954  9094 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:02:28.395339  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:28.342895 12815 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.397778 12783 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:28.360175 12473 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:02:28.420639  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 151463us
I20260709 13:02:28.344310 12769 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:28.426854 12774 consensus_meta.cc:287] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.003s
I20260709 13:02:28.427294 12774 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:28.428148 12822 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.712s	user 0.004s	sys 0.000s
I20260709 13:02:28.399647 12700 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:28.406648 12857 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:02:28.407436  8431 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:28.407579 12813 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:28.414556  9094 pending_rounds.cc:85] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 9
I20260709 13:02:28.444324  9094 pending_rounds.cc:107] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:28.343928 12858 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:28.355161 12720 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:28.361819 12840 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 13:02:28.419229  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 152711us
I20260709 13:02:28.399130 12742 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:28.357303 12841 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:28.421778  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:28.423810 12725 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:28.393266 12674 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:28.446058 12833 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.442893  8503 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:28.394847  8577 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:28.444785  9094 raft_consensus.cc:2889] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.454804  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2359) took 1129 ms. Trace:
I20260709 13:02:28.458889  9093 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:28.455704  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:28.463992  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:28.446856 12721 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.004s
I20260709 13:02:28.492057 12721 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.493643  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:28.415218 12849 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:28.486337  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 119673us
I20260709 13:02:28.435384  9100 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:28.496589  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:28.495146  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:28.497198  9094 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:28.497246  9093 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:28.357286 12844 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.208s
W20260709 13:02:28.502614  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 183876us
W20260709 13:02:28.502849  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.503176  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:28.499832  9099 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:28.503522  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:28.416005 12728 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:28.491457  8579 rpcz_store.cc:276] 0709 13:02:27.314844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.373169 (+ 58325us) service_pool.cc:224] Handling call
0709 13:02:27.373503 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.459827 (+ 86324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.459871 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.465819 (+  5948us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.575322 (+109503us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:27.575364 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.575430 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.427447 (+852017us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:28.431332 (+  3885us) raft_consensus.cc:1685] finished
0709 13:02:28.431362 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.444636 (+ 13274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":17089,"spinlock_wait_cycles":8267008,"thread_start_us":73946,"threads_started":1,"wal-append.queue_time_us":185171}
I20260709 13:02:28.465457 12700 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.509791  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:28.506685  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.507023  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:28.511791  9094 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:28.507673  9101 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:28.507791  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:28.510746  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:28.514014  9093 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 8: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:28.515138  8430 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:28.516042  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:28.516594  9102 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.465427 12855 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.503369  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:28.487093 12774 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:28.497275 12742 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:28.530829  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.533644  8398 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:28.497474 12739 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.542434  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:28.522660 12703 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:02:28.538371  9098 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.508515 12674 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.505096 12823 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:28.545627  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.555430  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:28.532251 12591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.014s	sys 0.043s
I20260709 13:02:28.560276  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:28.566497  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.577136  8433 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.568477  8509 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:02:28.570363  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2058) took 1036 ms. Trace:
I20260709 13:02:28.542788 12725 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:28.507687 12861 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:28.578034  8582 rpcz_store.cc:276] 0709 13:02:27.534131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.535067 (+   936us) service_pool.cc:224] Handling call
0709 13:02:28.149228 (+614161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.241434 (+ 92206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.570063 (+328629us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b5400349250. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:28.570256 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358707456}
I20260709 13:02:28.538530 12742 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.585781  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.501968 12702 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:02:28.587028 12879 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:28.587044 12872 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:28.594255 12847 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:02:28.594350 12872 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:28.595731 12859 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:02:28.595415 12872 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:28.435340 12836 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.555292 12703 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:28.466198 12858 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.602190 12864 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:02:28.602600 12858 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:28.533896 12834 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:28.547996 12820 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:28.589107  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:28.579876 12591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.015s	sys 0.043s
I20260709 13:02:28.626557  8580 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:02:28.620252  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:28.632622  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.591774 12860 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:28.633916  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:28.633704 12860 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.634676  9099 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:28.635546  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:28.636598  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:28.579532 12725 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:28.503393 12833 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.487991 12841 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:28.593652 12851 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:02:28.639711  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:28.649295  8427 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:28.583822 12861 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:28.633870  9098 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
W20260709 13:02:28.593016 12852 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:02:28.610885 12742 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.610303 12721 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:28.556219 12844 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:02:28.658766  9096 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:28.488623 12791 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.657503  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:28.660207  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:28.575076 12774 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:02:28.591830 12879 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.591730 12850 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:28.662590  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:28.663352 12833 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:28.666864 12728 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:28.667572  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:28.660893 12861 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.674832 12716 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.641702 12725 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:28.675971  9097 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:02:28.645346 12820 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:28.723680 12820 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:28.727860  9097 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:28.729784  8575 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:28.729756 12814 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12.
I20260709 13:02:28.693943 12879 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.734973 12844 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:28.735538 12844 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:28.736507 12844 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:28.686640  8428 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:28.687480  9098 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:28.690779  9102 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:28.592145 12863 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:28.721982  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:28.921331  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.921939  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 379561us
I20260709 13:02:28.925796  8583 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
W20260709 13:02:28.943851  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 410239us
W20260709 13:02:28.695130 12832 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.006s
I20260709 13:02:28.591900 12862 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.243s
W20260709 13:02:28.964864  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 429840us
I20260709 13:02:28.969852  8433 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
W20260709 13:02:28.976125  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.002478  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:29.014940  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 69230.1us
W20260709 13:02:29.015250  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.737986 12844 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.686575 12837 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.274s
I20260709 13:02:29.032008  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:29.032779  8582 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:29.037369  8430 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:28.943151 12728 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.914788 12850 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:29.021591  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:29.047003  8507 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:29.062985  8507 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:29.048795  8427 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:02:29.061128  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:29.051400  8433 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:29.026430  8505 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:29.068645  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:29.067404  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 65004.1us
I20260709 13:02:29.026403 12725 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:29.071180  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:29.074008  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:29.075085  8427 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:29.071388  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:29.018508 12674 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:29.079092  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:29.080546  8508 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:29.030459 12863 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:29.098415  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:29.100687  8433 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:29.101652  8433 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:29.143273  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45036.5us
I20260709 13:02:29.029796 12858 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:02:29.072072 12774 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:29.151535  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.074262 12855 consensus_meta.cc:287] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.002s
I20260709 13:02:28.984887 12832 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.162694  8581 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:29.164043 12832 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.165800 12855 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.166828 12855 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.082612 12724 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:02:29.098006 12674 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.167766 12855 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.169446 12674 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.066002 12728 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.099536 12834 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:02:29.171144 12834 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:29.171478 12834 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:29.172049 12728 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.172582 12728 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:29.172277 12834 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.184687 12834 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.186254 12869 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.186791 12869 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.188985 12869 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.030928 12864 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:02:29.151204 12826 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.107s	user 0.011s	sys 0.000s
I20260709 13:02:29.173738  8509 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:29.178102 12674 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:29.179788 12880 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.181237 12867 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:02:29.181607 12774 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:29.159858 12699 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:29.182840 12875 log.cc:927] Time spent T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:02:29.248831  8582 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:29.183317 12879 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:29.193526  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 114870us
I20260709 13:02:29.173029 12728 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.082424 12862 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 13:02:29.081573 12739 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.117s
W20260709 13:02:29.262228  8503 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.011s	sys 0.019s
W20260709 13:02:29.309540  8503 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.011s	sys 0.019s
W20260709 13:02:29.318996 12886 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:29.322463 12863 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.328316 12716 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.332926 12878 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.333711 12878 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.345745 12833 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.346414 12833 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.348621 12833 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.350286 12850 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.222743 12826 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.360782 12826 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:29.365206 12742 consensus_meta.cc:287] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.000s
I20260709 13:02:29.367380 12841 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.248852 12774 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:29.374791  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.248924 12880 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.221374 12848 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.158s
I20260709 13:02:29.381688 12855 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.306620  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:29.387894  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 140398us
I20260709 13:02:29.387406 12878 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.420903  8427 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:29.422320  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:29.427407  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 405853us
I20260709 13:02:29.428637  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:29.430335  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:29.432055  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:29.434366  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:29.394649 12835 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:02:29.439764  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 356267us
I20260709 13:02:29.390911 12742 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:29.442145  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.442520  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:29.443451  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:29.391206 12699 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:29.455169  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:29.461629  9097 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:29.464349  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:29.442422 12716 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:29.438882 12864 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:29.427088 12855 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:29.468513  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:29.469980  8579 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:29.447010 12674 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:29.452355 12869 raft_consensus.cc:2764] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:29.449798 12721 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:29.475502  9097 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:29.482306  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:29.482566  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:29.466198 12739 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:29.472527 12835 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:29.491051  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:29.475845 12887 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:02:29.472137 12716 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:29.496676  9097 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:29.525954  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.489482 12739 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:29.535290  9097 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.503575 12716 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.501289 12877 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:29.485952 12855 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.525501 12864 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:29.543567  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2453) took 1033 ms. Trace:
I20260709 13:02:29.535355 12889 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.504266 12835 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:29.487959 12721 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:29.545287  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 62841.6us
I20260709 13:02:29.528244 12869 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:29.547851  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:29.538472 12725 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.539441 12674 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:29.539090 12720 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:29.542109 12891 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.538702 12857 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:02:29.567041 12720 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.567978  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:29.565878 12844 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.000s
I20260709 13:02:29.541759 12775 consensus_queue.cc:1059] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:02:29.571434 12864 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:29.572095 12864 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:29.572293  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2449) took 1484 ms. Trace:
I20260709 13:02:29.572221 12832 raft_consensus.cc:3055] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:29.572923 12864 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.572981 12832 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:29.572844  8504 rpcz_store.cc:276] 0709 13:02:28.085666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.224509 (+138843us) service_pool.cc:224] Handling call
0709 13:02:28.224962 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.415946 (+1190984us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b1800359140. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a19337060 00007f1a19337bfb 00007f1a1934264b
0709 13:02:29.416067 (+   121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.416100 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.416533 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.534477 (+117944us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:29.534516 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.534587 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:29.558754 (+ 24167us) raft_consensus.cc:1685] finished
0709 13:02:29.558768 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.569971 (+ 11203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7300,"raft.queue_time_us":88983,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":21619,"spinlock_wait_cycles":4706048,"thread_start_us":208392,"threads_started":2,"wal-append.queue_time_us":107814}
I20260709 13:02:29.574872 12832 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:29.576556 12888 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:02:29.566970 12892 raft_consensus.cc:2764] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:29.533579 12699 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.581269  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:29.551460 12728 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:29.562305 12884 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.196s	user 0.001s	sys 0.001s
I20260709 13:02:29.567469 12855 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.559077 12879 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.562824 12674 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.597350 12722 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.597518  8584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2057) took 2077 ms (client timeout 1891 ms). Trace:
I20260709 13:02:29.597945 12722 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:29.598510  8584 rpcz_store.cc:269] 0709 13:02:27.520239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.520428 (+   189us) service_pool.cc:224] Handling call
0709 13:02:29.597267 (+2076839us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400283054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:29.597424 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334295936}
I20260709 13:02:29.562915 12739 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:29.599740 12739 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:29.600243 12722 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:29.599833 12402 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:29.600835 12402 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:29.601817 12402 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:29.603117 12402 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:29.605707 12861 consensus_meta.cc:287] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.686s	user 0.000s	sys 0.009s
I20260709 13:02:29.552692 12869 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.568511 12880 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.586748 12832 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.561431 12725 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.614055  8475 leader_election.cc:400] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11.
I20260709 13:02:29.614532  8475 leader_election.cc:403] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.612393 12835 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.629352 12721 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:29.631938 12869 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.606886 12855 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.649158  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:29.651626  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:29.652750 12880 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.653913 12774 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:29.659358  9068 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.181s (SENT) [suppressed 31 similar messages]
I20260709 13:02:29.659649  8582 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.641794 12721 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:29.661783 12782 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.663355 12879 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:29.665409 12782 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.644555 12716 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:29.643748 12855 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:02:29.668160 12893 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:02:29.674268 12855 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.664424 12721 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.678706  8428 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:29.678561  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:29.680847  8435 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:29.661685  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:29.648082 12674 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:29.683763  8575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2067) took 1888 ms (client timeout 2113 ms). Trace:
I20260709 13:02:29.610515 12861 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:29.673960  9095 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1214) took 1655 ms (client timeout 2107 ms). Trace:
W20260709 13:02:29.698940  9095 rpcz_store.cc:269] 0709 13:02:28.018920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.019079 (+   159us) service_pool.cc:224] Handling call
0709 13:02:29.673762 (+1654683us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400475254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:29.673900 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581412096}
W20260709 13:02:29.671232  9100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1083) took 1657 ms (client timeout 1690 ms). Trace:
I20260709 13:02:29.649415 12869 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11.
W20260709 13:02:29.700393  9100 rpcz_store.cc:269] 0709 13:02:28.013998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.014213 (+   215us) service_pool.cc:224] Handling call
0709 13:02:29.671050 (+1656837us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54005479d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:29.671163 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843401088}
I20260709 13:02:29.671622  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2079) took 1052 ms. Trace:
I20260709 13:02:29.702723  8581 rpcz_store.cc:276] 0709 13:02:28.619841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.619973 (+   132us) service_pool.cc:224] Handling call
0709 13:02:29.671472 (+1051499us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54002fdfd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:29.671568 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218301312}
I20260709 13:02:29.704702  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:29.688745 12702 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:29.708609 12702 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:29.686539  8575 rpcz_store.cc:269] 0709 13:02:27.795399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.795769 (+   370us) service_pool.cc:224] Handling call
0709 13:02:29.672225 (+1876456us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b540009a954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:29.672351 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955522304}
I20260709 13:02:29.670279 12846 consensus_queue.cc:1059] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 13:02:29.691239  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.692855  8578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2064) took 1903 ms (client timeout 2520 ms). Trace:
I20260709 13:02:29.689682  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:29.667583 12774 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.695160 12716 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:29.695240 12879 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:29.695639 12601 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:29.696833  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2446) took 1615 ms. Trace:
I20260709 13:02:29.892488  8506 rpcz_store.cc:276] 0709 13:02:28.081804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.081934 (+   130us) service_pool.cc:224] Handling call
0709 13:02:28.099139 (+ 17205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.221175 (+122036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.696613 (+1475438us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b540008d254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:29.696777 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50285312}
I20260709 13:02:29.697264 12591 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:29.697793 12841 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:29.700788  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2077) took 1550 ms. Trace:
W20260709 13:02:29.709996  8578 rpcz_store.cc:269] 0709 13:02:27.789512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.797866 (+  8354us) service_pool.cc:224] Handling call
0709 13:02:29.692669 (+1894803us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b54000659d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:29.692796 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220223232}
I20260709 13:02:29.899843  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:29.900609  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:29.901185  8578 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:29.901525  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:29.742306  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.821489  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:29.826316  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:29.827672  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:29.672432 12725 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.858220  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:29.889351  8475 leader_election.cc:400] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13.
W20260709 13:02:29.825512 12905 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:02:29.689010 12848 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.909847  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2442) took 1829 ms. Trace:
I20260709 13:02:29.899996  8579 rpcz_store.cc:276] 0709 13:02:28.150215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.522837 (+372622us) service_pool.cc:224] Handling call
0709 13:02:28.547254 (+ 24417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.486724 (+939470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.700535 (+213811us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400348d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:29.700730 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113997056}
I20260709 13:02:29.908284  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:29.914160  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:29.921000  8505 rpcz_store.cc:276] 0709 13:02:28.080645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.094914 (+ 14269us) service_pool.cc:224] Handling call
0709 13:02:29.909560 (+1814646us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b540008f2d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:29.909751 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875158272}
I20260709 13:02:29.922408  9102 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:29.920073  8475 leader_election.cc:403] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.915465  8502 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:29.923373  9095 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.923125 12848 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.924228  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2044) took 1836 ms. Trace:
I20260709 13:02:29.924580  8502 rpcz_store.cc:276] 0709 13:02:28.087640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.325958 (+238318us) service_pool.cc:224] Handling call
0709 13:02:29.915158 (+1589200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.923385 (+  8227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.924027 (+   642us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540008f2d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:29.924154 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3653785984}
W20260709 13:02:29.913615 12898 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
I20260709 13:02:29.925798 12848 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.909054  8431 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:29.928261  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 858) took 1423 ms. Trace:
I20260709 13:02:29.928606  8431 rpcz_store.cc:276] 0709 13:02:28.505096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.505259 (+   163us) service_pool.cc:224] Handling call
0709 13:02:28.505498 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.927403 (+1421905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.928007 (+   604us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54003a1e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:29.928187 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3227279616}
I20260709 13:02:29.901942  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:29.930240  8578 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:29.937067  9095 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:02:29.918042  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:29.940519  9097 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.902135  8575 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:29.966588  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:29.966967  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.967443  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 78303.5us
I20260709 13:02:29.970094  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:29.973615  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:29.975529  8475 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.690s (SENT)
I20260709 13:02:29.976764  9100 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:29.913331 12591 consensus_queue.cc:1243] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:29.979756  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:29.981163  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:29.981374  9097 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:29.906080 12879 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:29.988325 12835 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.988021 12702 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.988874 12835 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:29.989663 12702 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.989607  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:29.990556  9097 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:29.988750 12879 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.993888 12601 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.994078 12709 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.994542 12601 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:29.994837 12709 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:29.998059 12674 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.998649 12674 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.000628 12674 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:29.908007 12782 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:29.969568 12716 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13.
I20260709 13:02:30.013809  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:30.035526 12782 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.036182 12629 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:02:30.074589 12888 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:30.035351 12703 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:30.086005  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 107798us
I20260709 13:02:30.089160  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:30.092343  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:30.094724 12674 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:30.095423 12674 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:30.096163 12848 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:30.097151  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:30.096570 12674 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.097591 12848 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:30.097915 12402 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:30.098384 12402 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:30.098465 12848 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:30.098790 12402 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.098897 12848 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:30.100065 12848 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.100631  8433 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.101117 12825 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:30.101804  8433 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.103327  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.104539  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:30.105101  9097 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.106935 12814 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:30.107323 12814 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:30.108086 12814 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.109074 12814 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.113092 12601 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.114746 12709 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:30.115429 12889 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
I20260709 13:02:30.115835 12889 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:30.118613 12903 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:02:30.105949 12891 consensus_meta.cc:287] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.546s	user 0.003s	sys 0.006s
I20260709 13:02:30.120460 12891 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:30.123102  8580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2378) took 1492 ms (client timeout 1721 ms). Trace:
W20260709 13:02:30.123546  8580 rpcz_store.cc:269] 0709 13:02:28.630736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.639489 (+  8753us) service_pool.cc:224] Handling call
0709 13:02:30.122877 (+1483388us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400284454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:30.123036 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025314176}
I20260709 13:02:30.124545  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:29.546273  8503 rpcz_store.cc:276] 0709 13:02:28.509769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.510135 (+   366us) service_pool.cc:224] Handling call
0709 13:02:28.543189 (+ 33054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.543389 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:29.310207 (+766818us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.543209 (+233002us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:29.543260 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:29.543313 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.543381 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.543504 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14229,"prepare.queue_time_us":88331,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3174,"raft.queue_time_us":50474,"thread_start_us":927305,"threads_started":3}
I20260709 13:02:30.032254 12471 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.087822 12703 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.133249 12725 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.133805 12471 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.134680  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:30.135522 12839 raft_consensus.cc:2764] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:30.137977 12828 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.137908  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:30.081825 12782 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.141461 12483 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:30.142961 12483 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:30.089397 12861 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.144197 12483 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.145532 12716 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.146073 12716 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.146476 12716 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.147238  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2459) took 1100 ms. Trace:
I20260709 13:02:30.147286 12839 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:30.148465 12441 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:02:30.149515 12839 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:30.151108 12860 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.153446  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2374) took 1526 ms. Trace:
I20260709 13:02:30.153740 12839 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:30.154405  8430 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 863) took 1647 ms (client timeout 1504 ms). Trace:
I20260709 13:02:30.154917  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1087) took 1525 ms. Trace:
I20260709 13:02:30.155107 12837 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:30.155728 12837 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:30.154353  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.156476  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.156872  8428 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:30.157033  8431 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:30.156677 12837 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.157843  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:30.158181  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:30.154822  8430 rpcz_store.cc:269] 0709 13:02:28.508406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.544188 (+ 35782us) service_pool.cc:224] Handling call
0709 13:02:30.154233 (+1610045us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54003a4654. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:30.154338 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379102592}
I20260709 13:02:30.158906  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:30.159133  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.159337  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.159709  8434 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:30.159893  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.160187  8430 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:30.160676  8428 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:02:30.160567  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.161059  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.161597  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.141814  8432 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:30.162163  8430 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:30.163297  9067 leader_election.cc:400] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10.
I20260709 13:02:30.163666  9067 leader_election.cc:403] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.157845  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:30.147693  8509 rpcz_store.cc:276] 0709 13:02:29.046578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.046702 (+   124us) service_pool.cc:224] Handling call
0709 13:02:30.147068 (+1100366us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54003967d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:30.147179 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246542080}
I20260709 13:02:30.161130  8434 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:30.153895  8582 rpcz_store.cc:276] 0709 13:02:28.627291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.263864 (+636573us) service_pool.cc:224] Handling call
0709 13:02:29.354623 (+ 90759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.661867 (+307244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.153236 (+491369us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400066dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:30.153393 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701054208}
I20260709 13:02:30.168608  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2227) took 1119 ms. Trace:
I20260709 13:02:30.169210  8433 rpcz_store.cc:276] 0709 13:02:29.049301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.073815 (+ 24514us) service_pool.cc:224] Handling call
0709 13:02:29.100487 (+ 26672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.100259 (+999772us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b4c004376c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1760ba20 00007f1a1761ca29 00007f1a175e2644 00007f1a17609f2d 00007f1a17609b93 00007f1a1933a18b 00007f1a1933acb5 00007f1a19335f30 00007f1a193377de 00007f1a19341b49 00007f1a19342416
0709 13:02:30.168066 (+ 67807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.168110 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:30.168168 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:30.168221 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.168358 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.168510 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34450,"spinlock_wait_cycles":13393792}
I20260709 13:02:30.178136  9096 rpcz_store.cc:276] 0709 13:02:28.629415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.629554 (+   139us) service_pool.cc:224] Handling call
0709 13:02:28.658587 (+ 29033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.682851 (+ 24264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.154728 (+1471877us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b5400526550. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:30.154840 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65882496}
I20260709 13:02:30.175091  8476 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:30.183298  8430 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:30.183846  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:30.164366  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:30.101395 12848 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.214318  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:30.161916 12836 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.218508  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:30.219377  8578 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:30.191182  9097 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:30.191553  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:30.193291  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.194645  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:30.192442  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:30.222183  8550 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:30.196317  8433 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:02:30.191442 12727 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:02:30.196733 12879 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:30.197330 12805 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:30.225812 12820 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:30.226377 12820 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.226830 12820 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.230085 12798 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.230623  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:30.232007  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:30.232801  8582 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:30.084518 12629 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.204427 12402 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.212247 12709 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.212535  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:30.223410  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:30.196461 12862 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.225925  8583 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.197976 12860 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:30.233773  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:30.210281 12846 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10.
I20260709 13:02:30.235672  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:30.200795 12864 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.000s
I20260709 13:02:30.237421  8433 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:30.249501 12832 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.634s	user 0.003s	sys 0.007s
W20260709 13:02:30.446528  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.233641 12863 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:30.485673 12716 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:30.262682  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 98411.2us
I20260709 13:02:30.499104 12860 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.515316  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:30.515648 12860 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.517023 12872 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:30.518122 12864 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.518586 12611 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.519132 12844 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:30.519546 12844 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:30.520313 12864 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:30.520368 12402 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:30.521196  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 287470us
W20260709 13:02:30.521597  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 285968us
I20260709 13:02:30.522269 12591 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:30.522837 12591 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:30.523741  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.523839 12591 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.520316 12844 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.488976 12785 raft_consensus.cc:3055] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:30.525884 12844 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.526204 12785 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:30.527274 12785 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:30.287477  8429 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.034s	sys 0.050s
W20260709 13:02:30.495426  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 272049us
I20260709 13:02:30.528846 12891 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:30.529294 12891 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:30.529637 12891 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:30.530962  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.319279  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 119061us
I20260709 13:02:30.234915 12879 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:30.496289  8432 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:30.534363  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:30.534653  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:30.496212  8426 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:30.248677 12709 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.535612  8506 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:30.536799  8502 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:30.537264 12709 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:30.537518 12629 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.240291 12702 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:02:30.224479 12724 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:30.507186  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.511636  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.512789 12846 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.513478 12863 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.522730  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:30.526229 12835 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:30.527629  8575 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:30.531713 12889 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:30.489459 12782 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:30.537925  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:30.216208 12601 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:30.485715 12922 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.539842  8509 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:30.541761  8429 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.037s	sys 0.062s
I20260709 13:02:30.544525  8504 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:02:30.545282  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.549325  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:30.550226 12877 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.543941 12699 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:30.544350 12785 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.537829 12709 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.553831 12825 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.499476 12862 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.538704 12674 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.510442 12855 consensus_meta.cc:287] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.833s	user 0.021s	sys 0.006s
I20260709 13:02:30.554371  8427 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:30.554405  8502 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:02:30.609665  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.555975  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:30.495872 12805 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.507745 12869 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:30.559123  8432 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:30.563329  8577 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:30.553231 12702 consensus_queue.cc:1243] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:30.554736 12629 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.619719  9093 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: [6.8-10.10]
I20260709 13:02:30.547940 12864 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.619508  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:30.620894  9096 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:30.578348  8580 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:30.547709 12879 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:30.553534 12863 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.555369 12724 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:30.606698 12709 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.593930 12813 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:02:30.639922 12813 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:30.555250 12846 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:30.640693  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.616791 12869 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.641476 12869 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.642452 12846 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:30.645509 12721 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:30.648636 12911 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.538s	user 0.001s	sys 0.001s
I20260709 13:02:30.650151 12629 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.653329 12629 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.653987 12879 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.583331  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.587321  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:30.557845 12835 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:30.655745 12721 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.519172 12611 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.608784  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.656555  9101 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:30.656638 12879 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.614684  8583 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:30.657140 12879 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:30.657691 12611 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:30.658249  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 71025.4us
I20260709 13:02:30.580608 12471 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.591871 12402 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:30.579191 12877 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.625355 12864 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.664891  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2230) took 1264 ms. Trace:
I20260709 13:02:30.665347  8427 rpcz_store.cc:276] 0709 13:02:29.400547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.421917 (+ 21370us) service_pool.cc:224] Handling call
0709 13:02:30.664704 (+1242787us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400200154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:30.664830 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600829184}
I20260709 13:02:30.665642 12864 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.620656 12805 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.566454 12699 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.654634 12857 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.655815 12849 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:30.566861 12601 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.590003  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.658318 12611 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:02:30.658540 12724 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:30.660902 12896 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:30.662479 12471 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.640444 12813 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:30.656088 12835 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.570341 12922 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.613332 12832 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:02:30.640430 12709 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.617126 12855 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:30.691671  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.666337 12402 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.632694 12862 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.623595  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:30.613514 12674 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.715006  9097 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:30.716248  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:30.752100  9096 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.717613  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:30.719312  9095 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:30.720948  9098 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:30.694270  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 171621us
I20260709 13:02:30.754842  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:30.755903 12879 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:30.756377 12879 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:30.756831 12879 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.766906  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:30.768903  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:30.770372  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:30.680492 12782 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:02:30.774091  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:30.634611 12820 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.775136  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.776589  9099 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:30.778998  9102 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:30.685247 12721 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:02:30.777652  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2234) took 1080 ms. Trace:
I20260709 13:02:30.780841  9095 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:30.711786 12864 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.712039 12798 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.725051 12923 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.795217  9095 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:30.724956 12441 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.712791 12846 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:30.809475  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.773065 12402 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.782537  8429 rpcz_store.cc:276] 0709 13:02:29.697449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.697566 (+   117us) service_pool.cc:224] Handling call
0709 13:02:29.697878 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.698093 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:30.569504 (+871411us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.777288 (+207784us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:30.777341 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:30.777392 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.777469 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.777597 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3282,"prepare.queue_time_us":314789,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":44240,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5519,"thread_start_us":1069732,"threads_started":2}
I20260709 13:02:30.822608  9096 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:30.750646 12700 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:02:30.832221  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 187817us
I20260709 13:02:30.835114  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.835474  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.835788  9100 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:30.835831  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.828951  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:30.829434  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.827705  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.838691  9095 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:30.840631  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.841967  9102 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:30.848399  8502 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:30.698670 12849 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.853340  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:30.854602  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:30.857025  8580 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:30.857345  8584 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:30.854812  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:30.851902  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:30.793996 12832 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.860110  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.712821 12857 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.864838  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:30.865257  8583 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:02:30.867177  8583 pending_rounds.cc:85] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 6
I20260709 13:02:30.864374  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.867461  8583 pending_rounds.cc:107] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:30.867722  8583 raft_consensus.cc:2889] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:30.867730  8432 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:30.865561  8510 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:30.869213  8580 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:30.866001  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:30.869904  8584 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:02:30.870338  8431 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:30.871145  8502 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:30.872362  8503 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:30.873975  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:30.874965  8575 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:30.853160 12798 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:30.878382  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:30.878999  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:30.879639  8503 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:30.881278  8506 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:30.881439  8582 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:30.883029 12703 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:30.879694 12832 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:02:30.827481 12923 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.884043 12832 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.884536 12832 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.885499 12923 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:02:30.848228 12834 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:02:30.887054 12922 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:30.887118 12832 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:30.887615 12834 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.887833 12832 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:30.888461 12834 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:30.888839 12834 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:30.831606 12441 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.859738 12700 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.878465 12798 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.890605 12798 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.891016 12869 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.891631 12441 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:30.892575  9098 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:30.893002 12869 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.894623 12879 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.895812  8504 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:30.897485 12879 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.878620 12591 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:02:30.898756 12855 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.898981 12471 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.889624 12834 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:30.900776 12917 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:02:30.901074 12834 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.861608 12629 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:02:30.902832 12629 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:30.903162 12629 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:30.903467  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:30.904032  8506 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:30.903936 12629 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.905099 12629 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.906833  8503 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:30.907508 12805 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:30.908000 12928 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.826731 12864 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.908481  8503 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:30.910508  8503 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:02:30.910758 12864 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.911545  9097 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:30.867799 12727 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.915719  8503 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:30.897087 12863 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:30.934047  8510 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:30.831808 12846 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:30.935036  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 366265us
I20260709 13:02:30.858636 12862 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:02:30.851797 12926 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:02:30.951747  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:30.960022  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 105891us
I20260709 13:02:30.961153 12709 raft_consensus.cc:3055] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:30.961632 12709 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:30.962888  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:30.964748  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:30.965595  8575 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:30.963835  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:30.891642 12700 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.967506  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:30.825493 12813 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.970274  8580 raft_consensus.cc:2368] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12.
I20260709 13:02:30.969645  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:30.972405  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:30.927695 12879 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:30.972963  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:30.973181  8509 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:30.935377 12869 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:30.974123  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:30.963999  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:30.947588 12441 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.985575 12441 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.986239 12927 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:30.986649 12927 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.986979 12927 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.987988 12441 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:30.988533 12441 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:30.983310  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:30.975433 12864 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.977087 12703 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:02:30.990723 12864 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:30.991261 12864 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:30.992228 12864 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:30.994565 12674 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.995218 12674 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:30.995592 12674 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.996275 12674 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.998961 12849 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.999600 12849 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:31.000593 12849 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.001080 12849 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.003296 12863 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:31.005080 12846 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:31.010465 12601 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:30.976446 12591 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:02:31.012490 12932 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:31.012997 12591 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:31.013188 12932 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:31.013573 12591 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.014200 12938 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.016295 12857 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.016129 12798 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.017590 12813 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.964785 12841 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.019312 12841 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.022118 12891 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.022686  8509 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:31.024117 12891 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.984869 12700 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:02:31.025645 12919 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.512s	user 0.001s	sys 0.002s
I20260709 13:02:31.025879 12700 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:31.026319 12700 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:31.027082 12700 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.028631 12700 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:31.029836  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.018927 12860 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.503s	user 0.003s	sys 0.007s
I20260709 13:02:31.024042 12720 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:31.032284  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.042651  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.011608 12699 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:30.995522 12742 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.032954  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:31.054391  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 86282.1us
I20260709 13:02:31.021772 12841 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:31.049865  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.058053  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:31.059499  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:31.060146  8476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.017s	sys 0.019s
W20260709 13:02:31.060487  8476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.017s	sys 0.019s
I20260709 13:02:31.060724  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.060875  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.061458  8502 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:31.062359  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.062480  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.062973  9096 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:31.063292  9095 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:31.064000  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:31.064246  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.504s (SENT)
I20260709 13:02:31.064548  8426 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.043498  8509 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:31.066248  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.063004  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:31.066675  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.068783  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.069551  8507 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:31.067096  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.067238  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.070382  8433 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:31.070676  8501 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:31.071393  8509 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:31.067327  8432 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.051157  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.067346  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:31.067548  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.073304  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.073937  8502 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:31.067619  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.073819  8508 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:31.031997 12591 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.080124  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:31.080739  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.081288  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:31.082397  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:31.074986  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.084270  8510 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:31.085752  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:31.086145  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.054976 12848 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.088660  8503 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:31.088891  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.091920  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.092638  9093 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:30.983844 12879 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.071774 12844 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.055735 12836 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.097708  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.097708  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.098820  8426 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:31.110607  9102 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:31.077993 12725 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:02:31.093525 12721 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:02:31.055071 12785 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:02:31.106976 12849 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.106724 12941 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:31.131531 12721 raft_consensus.cc:3055] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:31.132032 12721 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:31.133016 12721 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.134780 12877 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:31.135118  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.137387  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.107568 12879 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:31.137959  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.078416 12929 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.084710 12798 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:31.079275 12928 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.109809  8432 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:31.099630  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.094424 12724 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:31.143731  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.144505  8581 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:31.114332  8503 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:02:31.109058 12846 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.055219 12876 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:02:31.148351  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.099913 12932 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.148854 12876 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:31.148979  8575 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.149257 12876 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:31.150104 12876 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.151264 12876 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.143515 12929 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.145628 12879 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:02:31.153503 12879 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:31.114969 12844 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.153877 12879 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:31.155156 12879 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.155915 12844 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.085430 12872 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:02:31.156498 12879 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.157351  8430 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
W20260709 13:02:31.126581  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.053004 12860 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.158490 12721 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:31.159554  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.160152 12860 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.160722 12860 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.085547 12782 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:02:31.098204 12848 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.129458 12725 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:31.138051  8578 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:31.098861 12923 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:02:31.175309 12848 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:31.168403 12725 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:31.178472  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:31.179229  9102 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:31.179070 12725 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.180658 12725 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:31.169267 12872 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.186749  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 2047) took 1033 ms. Trace:
I20260709 13:02:31.186532 12872 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.187114  8435 rpcz_store.cc:276] 0709 13:02:30.152892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.161218 (+  8326us) service_pool.cc:224] Handling call
0709 13:02:30.523563 (+362345us) spinlock_profiling.cc:243] Waited 973 us on lock 0x7b5800060398. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:02:31.186542 (+662979us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540026ff54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:31.186692 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232202240}
I20260709 13:02:31.188681 12872 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:31.192369 12402 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.193583  8427 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:31.140141 12836 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.153733 12929 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.197098 12836 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.163705 12927 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.200112 12727 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.161139 12860 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.202013 12927 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:31.203406 12860 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:31.204411  8577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2078) took 2661 ms (client timeout 1548 ms). Trace:
I20260709 13:02:31.204226 12591 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:31.204924  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.204873  8577 rpcz_store.cc:269] 0709 13:02:28.543539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.553485 (+  9946us) service_pool.cc:224] Handling call
0709 13:02:31.204220 (+2650735us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54000aaad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:31.204335 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4344523136}
I20260709 13:02:31.210687  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.211367  9097 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:31.215889  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.216130  8435 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:31.216862  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:31.217248  9101 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:31.217690  8428 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:02:31.218470  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.218743  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.219245 12728 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:31.219383  8435 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:31.219591  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:31.220383  8432 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:31.220299  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.221077 12837 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.221151  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:31.222277  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.222350  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.223047 12402 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.223410  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.224179  9099 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:31.225307  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:31.138566  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:31.139081  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.137069  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.141726  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:31.143364  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.228183  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.228303  8584 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:31.229082  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 88139.3us
I20260709 13:02:31.143251 12724 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.146078 12846 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:31.167740  8575 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:31.214876 12674 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.147301  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.230284  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:31.221881  8432 raft_consensus.cc:2376] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12. Re-sending same reply.
I20260709 13:02:31.251940  8581 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.252445  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.252611  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:31.253078  8432 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:31.254222  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.232045  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.247633 12930 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.257033  9096 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:31.257210 12930 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:31.232232  8430 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:31.257696 12930 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.258587  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.259207  8430 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:31.260001  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:31.233608  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:31.260574  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:31.221344  8435 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:31.261628  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.262784  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:31.225883  8429 raft_consensus.cc:2376] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12. Re-sending same reply.
I20260709 13:02:31.222993  8428 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:31.219671 12728 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:31.236361 12483 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.237471  8427 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:31.266598  9094 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:31.227396  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:31.266000  9100 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:31.263259  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:31.228294  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 89795.6us
I20260709 13:02:31.268867  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:31.263442  8426 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:02:31.238430  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.267751  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:31.269927  8476 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:31.270218  9097 raft_consensus.cc:2410] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:02:31.270768  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:31.271131  8426 pending_rounds.cc:85] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 9
I20260709 13:02:31.271397  8426 pending_rounds.cc:107] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:02:31.271617  8426 raft_consensus.cc:2889] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.272759  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:31.238584 12724 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.267823  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:31.336942  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:31.347970  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 80204.2us
I20260709 13:02:31.348117  8430 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.349141  8584 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:02:31.248600 12846 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.354773  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.276769  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:31.259862 12879 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:31.265976 12402 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.383016  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.337654  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.384081  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.345580 12727 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.254959 12860 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:31.398237 12860 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:31.398721 12860 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.353199 12939 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:31.366340  8426 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:31.383764  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.384433  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.345112 12828 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:31.408931  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.273217 12861 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.276636  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:31.279114  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.391273  8430 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
W20260709 13:02:31.412380  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 135806us
I20260709 13:02:31.412739  8427 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:31.281827  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.413388  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:31.413573  8432 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:31.390686  8501 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:31.353068 12928 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:31.353412 12891 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.352939 12849 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.353775 12947 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:31.395949  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.397706  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.359464 12835 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.366958 12700 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:31.403874  8507 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:31.364910  8581 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:31.424263 12876 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:31.425364 12891 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.390744  8505 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:31.352150  8577 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:02:31.453264  8577 pending_rounds.cc:85] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 7
I20260709 13:02:31.453619  8577 pending_rounds.cc:107] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:02:31.453971  8577 raft_consensus.cc:2889] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.351301 12839 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:02:31.415131  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:31.416003  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 329374us
I20260709 13:02:31.511252  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:31.511379  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.511901  9065 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:31.394042  8510 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:31.423413  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:31.366688 12877 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:02:31.513517  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.415417 12939 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:31.514518  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:31.515220 12939 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.515908 12923 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:31.516402 12923 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.410742 12828 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.516719 12923 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.516916 12828 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.411959 12855 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:31.515997  8576 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:31.511873  9096 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.518231  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.507638  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.518843  8584 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:31.519619  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:31.409731  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 133013us
I20260709 13:02:31.427361 12872 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:31.524039  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 109007us
I20260709 13:02:31.525880  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.526533  8584 raft_consensus.cc:2376] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9. Re-sending same reply.
I20260709 13:02:31.433444 12849 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.429580 12928 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:31.435546 12944 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.393673 12728 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.530970 12949 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:02:31.531689 12728 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.437387 12700 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.439829 12869 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.482475 12930 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.541067  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.430394 12813 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:02:31.452383 12876 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:31.473693 12891 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.453822 12591 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.503472 12674 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.507593  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.508550  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.558049  8580 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:31.512919  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.462767  8579 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:31.521051 12839 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:31.522092 12720 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:31.522784 12927 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.523131 12855 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.524305  8578 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:31.526656  8501 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:31.527486  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:31.527719  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:31.575428  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 48014.4us
I20260709 13:02:31.575762  8578 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:31.576359  8398 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:31.576916  8578 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:31.528544  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.524140 12929 raft_consensus.cc:2764] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:31.529407 12849 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.557967  9098 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
W20260709 13:02:31.520781  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 97476.2us
I20260709 13:02:31.620496  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:31.559003  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.622558  8580 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:31.268519 12798 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:31.528400 12782 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:31.560720  9096 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:31.537312 12700 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.566213  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:31.555281 12876 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.569460  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.626317  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:31.632468  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.693917  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.694145  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:31.694391  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 58316.9us
I20260709 13:02:31.715987  8576 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:31.713203  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 92799.1us
I20260709 13:02:31.715582  8579 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.715950  8580 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:31.718384  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.535698 12944 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.717334  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:31.713815  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.572551 12839 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.574617 12927 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.718528  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:31.734586  8501 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:31.544425 12869 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.742075  8579 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:31.590755 12855 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.626920 12725 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:31.621227 12674 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.636395 12872 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:31.746706  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 120492us
I20260709 13:02:31.756024  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:31.747289  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:31.757330  8580 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:31.753607  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.577919 12889 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.169s
I20260709 13:02:31.742856 12839 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.574542 12879 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.176s
I20260709 13:02:31.772977  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:31.773561  8501 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.774902 12966 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:31.775347 12966 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:31.775735 12966 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.775882 12960 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:31.780575  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:31.781430  8505 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 7: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:31.782524  8505 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:31.784001  8505 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:02:31.782717  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 88725.9us
I20260709 13:02:31.784900  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:31.785310  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 76178.6us
I20260709 13:02:31.786347  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:31.744529  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 117085us
I20260709 13:02:31.747622 12927 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.744200 12955 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:31.818298  8509 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:31.621938 12828 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.749934 12702 raft_consensus.cc:2764] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:31.793478  9068 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:31.721285 12848 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:02:31.754074 12725 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.745074 12929 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.744642 12813 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:31.829962  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.830720 12702 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:31.831331 12702 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:31.832134 12702 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.768586 12938 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:31.821954  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:31.835378 12950 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:02:31.842439 12951 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
W20260709 13:02:31.849850 12935 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.743s	user 0.015s	sys 0.000s
I20260709 13:02:31.850258 12959 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.826808  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.762758 12872 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.874446  9094 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:31.830619  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.876497  9099 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:31.832492 12965 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:31.833925 12938 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:31.823798  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.719661 12782 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.825343  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:31.853252  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:31.852087 12716 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:31.863052 12483 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 13:02:31.862658 12720 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:31.854748 12861 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:31.859743  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:31.859055 12937 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.751s	user 0.004s	sys 0.004s
I20260709 13:02:31.860740 12774 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:31.851697 12828 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:31.868809  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 46926.4us
I20260709 13:02:31.863170 12879 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.856699 12837 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
I20260709 13:02:31.899824  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:31.822660 12954 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:31.868212 12725 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.864775 12709 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.878382  8501 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:31.882295  9095 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.765354 12877 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:02:31.907876  8433 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:31.908790 12876 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.911083  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2239) took 1744 ms. Trace:
I20260709 13:02:31.879856 12872 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.913111  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:31.915407  9068 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:31.919894  9095 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:31.880752  8550 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:31.763672 12674 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:31.886782  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.884620 12724 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.002s
I20260709 13:02:31.884939 12805 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:31.885205 12727 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.766601 12932 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:02:31.770236 12591 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
W20260709 13:02:31.889578  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 104759us
I20260709 13:02:31.889747  9101 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.890911  8575 raft_consensus.cc:2410] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:31.814471 12949 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.896310  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:31.952611  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 166393us
W20260709 13:02:31.884454 12846 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.003s
I20260709 13:02:31.956192  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:31.905117 12879 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.925959  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.743780 12928 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.945087 12805 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.983479  8503 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:31.926841  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:31.993575  8428 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.911471  8434 rpcz_store.cc:276] 0709 13:02:30.166474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.184365 (+ 17891us) service_pool.cc:224] Handling call
0709 13:02:30.184660 (+   295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:30.185002 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.185028 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:30.210750 (+ 25722us) log.cc:844] Serialized 52 byte log entry
0709 13:02:30.658542 (+447792us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b1800417ac0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:02:30.772318 (+113776us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:30.772353 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.772424 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.858482 (+1086058us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:31.910876 (+ 52394us) raft_consensus.cc:1685] finished
0709 13:02:31.910894 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.911028 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23190,"raft.queue_time_us":6217,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":142,"spinlock_wait_cycles":54222464,"thread_start_us":113590,"threads_started":1,"wal-append.queue_time_us":852205}
I20260709 13:02:31.924793  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.889029 12965 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:31.947870  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.998286  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.998659  8426 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:02:31.998989  8427 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:31.946939 12828 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:31.946964 12954 raft_consensus.cc:697] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:31.867087 12929 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.885273 12959 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.954114  9099 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:31.852617 12820 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.880033 12813 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:31.899221 12923 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.911522 12629 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.975613  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 258317us
I20260709 13:02:31.900770 12774 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:31.984778  8576 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:31.980237  8501 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:02:31.926582  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45926.5us
I20260709 13:02:31.994761  8435 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:02:31.995187  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:31.924765 12961 raft_consensus.cc:2764] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:31.896320 12860 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.050520 12813 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.050633  8507 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:32.051573 12860 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.824589 12955 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:31.999903  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 246112us
I20260709 13:02:31.993724  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:32.051738 12954 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:32.052843  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 59228.4us
I20260709 13:02:32.053579 12955 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.054155 12955 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:32.054526 12955 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:32.054889 12955 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:32.005033  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:32.052861  8547 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:32.056093  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:32.056654  8434 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:32.056990  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:32.006632  8427 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:02:32.058208 12829 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:32.058300 12828 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:32.058624 12829 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.058867 12828 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.059167  8427 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:32.059350 12828 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:32.001818 12728 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:32.060392 12728 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:32.061491 12728 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.063810 12629 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:31.952039 12930 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:31.987746 12709 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.924281 12966 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.076488  9101 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
W20260709 13:02:32.072556  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 157221us
I20260709 13:02:32.020238  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:31.999473 12805 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:32.026366  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:32.099949  8435 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:32.100977  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:32.101056  8434 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:32.101662  8435 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:32.027410  8431 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:02:32.102192  8431 pending_rounds.cc:85] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 5
I20260709 13:02:32.102494  8431 pending_rounds.cc:107] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:02:32.102802  8431 raft_consensus.cc:2889] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:32.025379 12774 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:32.106590  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 86456.1us
I20260709 13:02:31.978626 12889 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:02:31.978363 12846 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.031409 12974 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:32.032200 12970 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.039582 12836 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:32.046207 12967 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:02:32.059068 12829 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.951344  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:31.949620 12724 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.067625  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:32.068813  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:32.093554  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:32.094436  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:32.107698  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:32.030773  8475 leader_election.cc:400] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12.
I20260709 13:02:32.104542  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:31.978176 12798 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:32.111402  9100 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:32.117069  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:32.118899  8433 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:02:32.127889  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 176616us
I20260709 13:02:32.122568  8510 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:32.124174  8435 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:32.121784  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53049.4us
I20260709 13:02:31.979067 12949 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.108794 12720 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:32.132368  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:31.955531 12938 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.123700  8475 leader_election.cc:403] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:32.136168  9093 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:32.124719  8508 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:32.135857  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:32.113334 12924 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:32.157950 12924 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.158459 12924 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.162545  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:32.106302 12877 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:02:32.117710 12836 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:32.110175 12820 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:02:32.064872 12839 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.122718 12970 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.191248 12839 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.191885 12970 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.191867 12839 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:32.192934 12782 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.193478  8426 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:32.193738  8435 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:32.198246 12798 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.126042 12933 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:32.193064  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.154302 12876 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.140825 12813 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.119800 12976 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:32.153313 12483 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:32.173939  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 143355us
I20260709 13:02:32.134516 12774 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:32.205868  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:32.167621 12862 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:32.220430  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:32.124267  8434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:02:32.134140 12700 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.254694  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:32.178541 12939 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12.
I20260709 13:02:32.131603 12969 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:02:32.253888  8434 raft_consensus.cc:606] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:32.154809 12961 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:02:32.268078  8434 raft_consensus.cc:614] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:32.205097 12982 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.271617  9094 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:32.272876  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:32.272972  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:32.265291 12805 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.216035 12938 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:32.279161  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 116691us
I20260709 13:02:32.213688 12976 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:32.188462 12727 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:02:32.292568  8581 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:32.253852 12876 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:32.293663  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 161329us
W20260709 13:02:32.296701  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.295302  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:32.295270  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:32.267386 12728 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:32.301250  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 191888us
I20260709 13:02:32.258195 12972 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.297823  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:32.306713  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:32.298463  9101 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.268687 12889 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:32.308279 12889 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:32.309455 12889 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.268666 12970 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.312307 12970 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.315630 12970 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.316288  9101 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:32.317441  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:32.319099  9096 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:02:32.322220  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:32.322530  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:32.323834  9101 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:02:32.325511 12970 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:32.326375 12970 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.326923 12970 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.338632  9099 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:32.258654 12782 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:02:32.290035 12813 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:32.346498  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 48805.9us
I20260709 13:02:32.289258 12674 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.293519 12862 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:32.153851 12965 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:32.347289  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 52053.9us
I20260709 13:02:32.359926  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:32.299810 12702 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:32.363970  8547 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:32.366499  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:32.367944  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:32.301098 12976 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:32.370381  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 236884us
I20260709 13:02:32.303515 12879 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.378000  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:32.345932 12728 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:32.346948 12961 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:32.397336  9094 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 12. Ops: [10.8-10.8]
W20260709 13:02:32.399014  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 101482us
I20260709 13:02:32.358111 12862 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:32.278770 12836 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:32.384684 12891 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.811s	user 0.003s	sys 0.007s
I20260709 13:02:32.393231  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:32.353081 12813 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:32.385476  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 179567us
I20260709 13:02:32.387415  8434 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 10. Ops: []
I20260709 13:02:32.387599  8426 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:32.429052  9094 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:02:32.381330 12929 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.291710 12720 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.383190 12969 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.401057 12922 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:32.506003 12985 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:32.394207 12995 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:32.448029 12978 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:02:32.449043 12629 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.450389 12728 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.403753 12862 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:32.403386 12959 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.461717  8428 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:32.289376 12982 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.429486 12966 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.441926 12836 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:32.467236  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 343619us
I20260709 13:02:32.445399 12724 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.442389 12846 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:32.404091 12961 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.467619 12949 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.442541 12993 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:32.468662 12700 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.338364 12864 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:32.371855 12877 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.473754 12782 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:32.465147 12933 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:02:32.498337  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:32.603952 12782 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:32.610213 12782 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.501215 12994 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:32.501617 12992 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.504163 13004 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.483717 12924 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.507858  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:32.497459 12805 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:32.494385 12947 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:32.345196 12972 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:32.630317  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 122561us
I20260709 13:02:32.631268 12991 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:02:32.442759  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 82955.4us
W20260709 13:02:32.619796 12828 consensus_meta.cc:287] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.001s
I20260709 13:02:32.632203 12972 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:32.528975  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 159695us
I20260709 13:02:32.641355  8576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44116e7a54d141108511e22185400ffe"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:02:32.529313  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 728) took 1019 ms. Trace:
I20260709 13:02:32.443725 12727 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:02:32.642428  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:32.642192  8584 rpcz_store.cc:276] 0709 13:02:31.509499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.579927 (+ 70428us) service_pool.cc:224] Handling call
0709 13:02:31.616709 (+ 36782us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:31.733819 (+117110us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:31.946283 (+212464us) log.cc:844] Serialized 14 byte log entry
0709 13:02:32.269020 (+322737us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:32.277724 (+  8704us) log.cc:844] Serialized 78 byte log entry
0709 13:02:32.277863 (+   139us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:32.277894 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.277955 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.529074 (+251119us) raft_consensus.cc:1685] finished
0709 13:02:32.529091 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.529253 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108209,"prepare.queue_time_us":401638,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":193388,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":13575,"thread_start_us":445085,"threads_started":2,"wal-append.queue_time_us":378413}
W20260709 13:02:32.643983 12955 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.003s
I20260709 13:02:32.535321 12721 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:32.644191 12992 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:32.536178 12987 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:02:32.512979 12981 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:02:32.543313  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:32.543520  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 913) took 1024 ms. Trace:
I20260709 13:02:32.515285 12929 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.528378 12855 consensus_meta.cc:287] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.001s
I20260709 13:02:32.661396  8507 rpcz_store.cc:276] 0709 13:02:31.519428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.519555 (+   127us) service_pool.cc:224] Handling call
0709 13:02:31.520636 (+  1081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.051298 (+530662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.540615 (+489317us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54003a07d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:32.540831 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218246016}
I20260709 13:02:32.662338 12855 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.564131  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1111) took 1466 ms. Trace:
I20260709 13:02:32.564848  9102 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:32.514788 12922 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:02:32.561314 12725 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.636s	user 0.005s	sys 0.005s
I20260709 13:02:32.500005 12988 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:02:32.670296  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48366.5us
I20260709 13:02:32.526005 12611 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.521068 12702 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:32.614899 12849 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.893s	user 0.007s	sys 0.004s
I20260709 13:02:32.633481  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:32.515017 12891 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.526582 12869 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.643594  9067 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:32.533895 12956 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.666s	user 0.000s	sys 0.003s
I20260709 13:02:32.642004  8576 raft_consensus.cc:606] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:32.625546 12402 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:32.644212 12924 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.644771 12992 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:32.644424 12955 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.644497 12721 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:32.563149 12813 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.663776  9093 rpcz_store.cc:276] 0709 13:02:31.097282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.099323 (+  2041us) service_pool.cc:224] Handling call
0709 13:02:32.563862 (+1464539us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b540007b054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:32.564057 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284082944}
I20260709 13:02:32.664670  8504 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:32.661865 12929 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.675050 12611 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.697962 12929 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.698249  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1118) took 1132 ms. Trace:
I20260709 13:02:32.698990 12702 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:32.670363  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 134672us
I20260709 13:02:32.609911 12963 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:32.638677 12998 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:32.601428 12993 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.636516 12994 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:32.682428  8576 raft_consensus.cc:614] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:32.686211  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:32.776147  8426 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:32.776312  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 73916.8us
I20260709 13:02:32.776665  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:32.674728 12727 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:32.682636 12877 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:02:32.639243 12947 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.692569  8502 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:32.684813 13005 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:32.691350  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:32.792784  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 101481us
I20260709 13:02:32.646986 12828 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.692610 12483 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.748387 12932 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.749183 12721 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.723763 12973 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.685482 12402 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:32.750771 12855 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.751407 12992 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.685751 12933 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:02:32.682505 12700 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:02:32.682145 12849 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.690606 13006 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.747426  8400 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:32.688865 13009 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.680198 13004 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:32.675143 12725 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.792459 12949 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:02:32.760684  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:32.706552  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1104) took 1494 ms. Trace:
I20260709 13:02:32.698685  9100 rpcz_store.cc:276] 0709 13:02:31.565647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.565801 (+   154us) service_pool.cc:224] Handling call
0709 13:02:32.698062 (+1132261us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54002b8c54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:32.698194 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903476992}
I20260709 13:02:32.777259  8503 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:32.843840  9102 rpcz_store.cc:276] 0709 13:02:31.212429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.226565 (+ 14136us) service_pool.cc:224] Handling call
0709 13:02:32.564612 (+1338047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.671573 (+106961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.706302 (+ 34729us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540007b050. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:32.706480 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3050728704}
I20260709 13:02:32.777438  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:32.845118  8505 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:32.781936  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:32.777072 12927 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.953s	user 0.012s	sys 0.000s
I20260709 13:02:32.806257  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1255) took 1286 ms. Trace:
I20260709 13:02:32.806293  8506 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:32.852876  8510 raft_consensus.cc:2410] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:32.752138 12976 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.811425  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:32.823312 12483 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.790467 12872 consensus_meta.cc:287] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.843s	user 0.002s	sys 0.009s
I20260709 13:02:32.698712 12611 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.770936 12995 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.789965 12813 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:32.816480 12848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.010s	sys 0.014s
I20260709 13:02:32.829450 12993 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.833564  8426 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:32.775125 12720 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:02:32.809725 12924 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:32.823735 12829 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.005s
I20260709 13:02:32.775864 12970 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.847182  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:32.851405 12944 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.853565  9097 rpcz_store.cc:276] 0709 13:02:31.520048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.520187 (+   139us) service_pool.cc:224] Handling call
0709 13:02:31.520464 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.525053 (+  4589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.525083 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.525545 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.451346 (+925801us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b18003e6c20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:02:32.594707 (+143361us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:32.594747 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.594818 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.790902 (+196084us) raft_consensus.cc:1685] finished
0709 13:02:32.790923 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.806190 (+ 15267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4235,"raft.queue_time_us":4344,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":10948,"spinlock_wait_cycles":6544768,"thread_start_us":111415,"threads_started":1,"wal-append.queue_time_us":1100855}
I20260709 13:02:32.783696 12727 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.857331  8576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:02:32.893551 12727 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:32.894312 12862 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.827260 12982 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.859153  8501 raft_consensus.cc:2368] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11.
I20260709 13:02:32.861057  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 710) took 1356 ms. Trace:
I20260709 13:02:32.880787 13009 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:32.908550 13009 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.907537  8577 rpcz_store.cc:276] 0709 13:02:31.504946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.509249 (+  4303us) service_pool.cc:224] Handling call
0709 13:02:31.509594 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:31.509952 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:31.509979 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:31.510578 (+   599us) log.cc:844] Serialized 52 byte log entry
0709 13:02:31.620431 (+109853us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:31.620485 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.630004 (+  9519us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.527868 (+897864us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:32.856474 (+328606us) raft_consensus.cc:1685] finished
0709 13:02:32.856495 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.860994 (+  4499us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1186,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":41675520,"thread_start_us":109419,"threads_started":1,"wal-append.queue_time_us":318537}
I20260709 13:02:32.908927 13009 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:32.853649 12933 consensus_queue.cc:1243] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:32.819072 12932 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.870345  8429 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:02:32.869515 12848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.011s	sys 0.014s
I20260709 13:02:32.866251 12703 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.944631 12703 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.896814  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:32.852408 13006 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.947268  8506 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:32.836871 12973 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.904841 12727 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.872428 12611 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.839576 12721 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.870954 12995 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.957185 12944 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:32.957794 12944 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.958863 12995 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.959945 12944 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.961622 12727 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.868165 12798 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.858310 12927 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.970348  9096 raft_consensus.cc:2368] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11.
I20260709 13:02:32.928325 12923 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.933367  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 712) took 1427 ms. Trace:
I20260709 13:02:32.977631  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:32.977844  8575 rpcz_store.cc:276] 0709 13:02:31.505507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.512700 (+  7193us) service_pool.cc:224] Handling call
0709 13:02:32.933125 (+1420425us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54000cd5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:32.933296 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763265280}
I20260709 13:02:32.937868 12805 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:32.938235 12849 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:32.942647  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 195307us
I20260709 13:02:32.942862 12839 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:32.979339 12839 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.979715 12839 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.979962 12976 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.980798  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:32.981467 12970 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:32.942687  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 182126us
I20260709 13:02:32.943286 12929 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:32.948518  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:32.863363 12483 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.995906  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:32.997563  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:32.997841 12483 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:32.999019 12828 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:33.000617 12725 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.951931  8503 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:32.866484 12872 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.962189 12611 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:32.966328  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.966696 12798 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.860496 12994 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:32.976199 12891 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.965762 12973 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:32.949067 12848 consensus_queue.cc:1243] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:32.864874 12402 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:32.897214 12829 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:32.995510 12774 consensus_meta.cc:287] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.742s	user 0.008s	sys 0.003s
I20260709 13:02:32.953281 12855 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.043627 12932 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.043394 12855 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:33.035710  8427 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:02:33.046618 12966 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:33.047875  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:33.049212  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:33.036043  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:33.050966  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:33.003965  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:33.052006  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48134.8us
I20260709 13:02:33.052150 12611 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:32.998857 12862 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:33.011179  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:33.053442  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 711) took 1548 ms. Trace:
I20260709 13:02:33.053839 12798 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.054224  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:33.011982  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:33.012203  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:33.054921  8576 raft_consensus.cc:606] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:33.055441  8576 raft_consensus.cc:614] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:33.053862  8581 rpcz_store.cc:276] 0709 13:02:31.505241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.511145 (+  5904us) service_pool.cc:224] Handling call
0709 13:02:33.053263 (+1542118us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54000cdad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:33.053392 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1794659584}
I20260709 13:02:33.002663 12929 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:32.973276 12944 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.017091  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2478) took 1632 ms. Trace:
I20260709 13:02:33.013607  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:33.059623  8504 rpcz_store.cc:276] 0709 13:02:31.384247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.395683 (+ 11436us) service_pool.cc:224] Handling call
0709 13:02:33.016909 (+1621226us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54003737d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:33.017036 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2830729088}
I20260709 13:02:33.021396  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:33.060464  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.060743  8506 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:32.982914 12805 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:02:33.028718  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 217353us
I20260709 13:02:33.029845  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:33.041661 12829 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.065095  8504 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:33.065194  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:33.065853  8433 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.066241  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:33.066982  8504 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:33.015461 12828 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.032781 13011 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.036545 12872 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.037772 12963 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:33.055948  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:33.096601  8503 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:33.097023  8580 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:33.055024  8426 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:33.057303  8434 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:02:33.059881  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46353.3us
I20260709 13:02:33.026743  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:33.063135 13002 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.560s	user 0.002s	sys 0.001s
I20260709 13:02:33.098191  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:33.099318  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:33.100034  8434 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:33.100503  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.007781 12998 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:33.109989  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.009402 12991 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:33.069130  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:33.110684  8582 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:32.969935 12927 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:33.100871  8434 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:33.103956  8502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2474) took 1720 ms (client timeout 1719 ms). Trace:
W20260709 13:02:33.196884  8502 rpcz_store.cc:269] 0709 13:02:31.383176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.383541 (+   365us) service_pool.cc:224] Handling call
0709 13:02:33.103704 (+1720163us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540008f7d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:33.103871 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2961395072}
I20260709 13:02:33.062747 12849 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:33.109330  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:33.207377  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:33.070968 12961 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:33.109330  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.109616  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:33.092681  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.212281  8426 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:33.212364  8579 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:33.130195  8505 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:33.021310 12923 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:02:33.194969  8476 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:33.101704  8550 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:33.215263  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 113652us
I20260709 13:02:33.027891 13008 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:02:33.067698 13022 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:33.110229 12402 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:33.205788  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 136728us
I20260709 13:02:33.206324  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2252) took 1281 ms. Trace:
I20260709 13:02:33.228361  8430 rpcz_store.cc:276] 0709 13:02:31.925280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.926169 (+   889us) service_pool.cc:224] Handling call
0709 13:02:31.926448 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.065990 (+139542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.068962 (+  2972us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.069481 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.293945 (+224464us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:32.293982 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.109401 (+815419us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400021054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:33.109449 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.109493 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:33.109505 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.206255 (+ 96750us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320313216,"thread_start_us":178996,"threads_started":1,"wal-append.queue_time_us":354737}
I20260709 13:02:33.063679 12929 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.088438  8581 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:02:33.234436  8581 pending_rounds.cc:85] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 8
I20260709 13:02:33.234789  8581 pending_rounds.cc:107] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:02:33.235093  8581 raft_consensus.cc:2889] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.209331  8434 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:33.210120  8433 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:33.210824  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:33.210824  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:33.117898 12836 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.000s
I20260709 13:02:33.214313  8582 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:33.214094 12872 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.109709 12963 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:33.211668 12849 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:33.224277  8426 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:33.198274  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:33.226691 13022 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.067184 12891 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.142s
I20260709 13:02:33.207202 12727 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.194540 12864 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.227936 12862 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:33.240830  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:33.286940  8505 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:33.201311 12889 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.082114 12944 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.092983 12828 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.294283 13030 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:02:33.295733 13033 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:02:33.295835 12828 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.108316 12992 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 13:02:33.296802 12855 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:33.306915  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:33.307657  8426 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:33.308706  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:33.309484  8426 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:33.267416  8432 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:33.214419 12946 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:33.310971 12946 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:02:33.269789  8329 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57098 (request call id 370) took 33680 ms (client timeout 15000 ms). Trace:
I20260709 13:02:33.318943  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:33.266283 12611 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:33.207129 13006 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:33.245729 12938 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.947s	user 0.013s	sys 0.001s
I20260709 13:02:33.098045 13011 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.239890  8430 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:02:33.238672 12728 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:33.284754  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.427019  8579 raft_consensus.cc:2410] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:33.273836  8502 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:33.312088  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:33.266587 13008 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:33.313763  8426 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:33.315266  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1260) took 1022 ms. Trace:
I20260709 13:02:33.435155  9098 rpcz_store.cc:276] 0709 13:02:32.292437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.292560 (+   123us) service_pool.cc:224] Handling call
0709 13:02:32.292912 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.296230 (+  3318us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:32.296261 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.303631 (+  7370us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.417380 (+113749us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:32.417441 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.417545 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.002083 (+584538us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:33.292444 (+290361us) raft_consensus.cc:1685] finished
0709 13:02:33.292464 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.315175 (+ 22711us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2860,"raft.queue_time_us":104268,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":38947,"spinlock_wait_cycles":4984064,"thread_start_us":69693,"threads_started":1,"wal-append.queue_time_us":125590}
I20260709 13:02:33.316612  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:33.249965 13031 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:33.255095 13009 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.268359 12969 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:33.320585  8506 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.295781 12839 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.397524  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:33.399372  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 204492us
I20260709 13:02:33.431461 12946 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.489900  9100 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:33.490531  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 178507us
I20260709 13:02:33.437443  8507 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.428231  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:33.493033  8502 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:33.272465 12872 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.279184 13022 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:33.447717  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.508527  8584 raft_consensus.cc:2410] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:33.370730 12591 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.459002  8427 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:33.517283  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:33.467172  9097 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:02:33.488067  9095 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:02:33.519055  9095 pending_rounds.cc:85] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 10
I20260709 13:02:33.519418  9095 pending_rounds.cc:107] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:02:33.519739  9095 raft_consensus.cc:2889] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.285744 12727 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.451720 12725 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.494508  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:33.424786 12988 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.505882  8505 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:02:33.511386  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 113956us
I20260709 13:02:33.434381 13008 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:33.275952 12805 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.313066 12862 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.291069 12864 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:33.526715  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:33.312005 12889 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:33.527554  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.527665  8431 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:33.530359  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:33.555264  8579 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.531134  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:33.556201  9099 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.532114  9102 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:02:33.532500  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.533133  8502 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:33.542332  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:33.395974 12611 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.525339 12993 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:33.504217 13000 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:33.464968 12938 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:33.489774 12879 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:33.560958  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.564035  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.565330  8502 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 10. Ops: []
I20260709 13:02:33.548349 12728 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.546810  8507 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
W20260709 13:02:33.318493  8329 rpcz_store.cc:269] 0709 13:01:59.562668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.615187 (+ 52519us) service_pool.cc:224] Handling call
0709 13:02:33.242990 (+33627803us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:26.905862 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:27.102095 (+196233us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:27.102162 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:02:27.102185 (+    23us) tablet.cc:662] Decoding operations
0709 13:02:27.112039 (+  9854us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:27.112165 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:27.112206 (+    41us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:02:27.114153 (+  1947us) tablet.cc:701] Row locks acquired
0709 13:02:27.114216 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:02:27.114406 (+   190us) write_op.cc:270] Start()
0709 13:02:27.114593 (+   187us) write_op.cc:276] Timestamp: P: 1783602147114340 usec, L: 0
0709 13:02:27.114641 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:02:27.184123 (+ 69482us) log.cc:844] Serialized 7087 byte log entry
0709 13:02:27.614737 (+430614us) op_driver.cc:464] REPLICATION: finished
0709 13:02:27.778394 (+163657us) write_op.cc:301] APPLY: starting
0709 13:02:27.778483 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:29.413370 (+1634887us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:29.453629 (+ 40259us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:30.109455 (+655826us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:30.109857 (+   402us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:02:30.109917 (+    60us) write_op.cc:312] APPLY: finished
0709 13:02:30.121587 (+ 11670us) log.cc:844] Serialized 164 byte log entry
0709 13:02:30.484684 (+363097us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:30.484878 (+   194us) write_op.cc:454] Released schema lock
0709 13:02:30.484955 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:30.524608 (+ 39653us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:30.528278 (+  3670us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5451935,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":133734,"apply.run_cpu_time_us":64088,"apply.run_wall_time_us":2720166,"cfile_cache_hit":70,"cfile_cache_hit_bytes":73080,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":2,"lbm_read_time_us":223210,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":5,"lbm_reads_lt_1ms":6,"num_ops":18,"prepare.queue_time_us":297576,"prepare.run_cpu_time_us":24678,"prepare.run_wall_time_us":582935,"raft.queue_time_us":57501,"raft.run_cpu_time_us":22147,"raft.run_wall_time_us":122005,"replication_time_us":499930,"thread_start_us":712059,"threads_started":5,"wal-append.queue_time_us":635410,"wal-append.run_cpu_time_us":4989,"wal-append.run_wall_time_us":2077672}]]}
I20260709 13:02:33.567862  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:33.525722 13031 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:33.593571  8503 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 6: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:33.568439  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:33.594229  9100 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.569624  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:33.595309  9095 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:33.572183  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:33.572356 13035 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:02:33.572777  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:33.599537  8577 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.573359  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.580668  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:33.601655  9093 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:33.583292  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:33.584520 13030 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.596606  8583 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:33.602741  8505 raft_consensus.cc:2410] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:33.592228  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:33.607200  9102 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.468079 12969 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.531917 12591 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.571022 13037 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.513490 12849 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.569926 13000 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:33.571066 12993 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:33.622771  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:33.658360  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.622833 13032 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:02:33.623874  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.549986 12982 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:02:33.577752 13022 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:33.619544  8579 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:33.630518 12992 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.550563 12725 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.653051  9100 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:33.663997  8577 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:33.553566 12988 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.658615  9093 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:33.592990 12938 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:33.635046 12782 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.010s	user 0.008s	sys 0.004s
I20260709 13:02:33.666148  8580 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:02:33.317353 12998 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.675210  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:33.686236  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.598713 12879 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.695340  8577 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:02:33.604391 12728 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.667546 12993 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:33.699874  9102 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:02:33.719044  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 177526us
I20260709 13:02:33.725709  9093 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:33.734398 12611 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.621187 13008 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.614648 13030 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.748288  9065 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:33.748742  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:33.747057  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.749496  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:33.753417  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:33.754655  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:33.756129  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:33.690517 12992 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.717473 12782 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.761757  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:33.740847 12944 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.826007  8577 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:33.752635 12872 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.838507  8506 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:33.839821  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:33.757499 13011 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.752146 13009 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:33.829874 12994 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:33.844089 13043 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:02:33.844884 13041 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:33.845518  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:33.846349  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.847031  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:33.847661  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.848284  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.906996  8579 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:33.905282  8581 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.907364  8578 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
W20260709 13:02:33.821763 13034 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:02:33.907011  8584 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:33.849092  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:33.849766  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.870627 12959 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:33.871660 12782 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:33.872370 12988 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:33.873817 13030 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:33.874428  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:33.877427 12938 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:33.877614  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:33.878583 13036 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:02:33.878726 12944 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:33.814142 13008 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.732921 13000 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.890209  9099 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:33.932694 12959 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:33.942664  8584 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:33.825276 12611 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:33.949945  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 274774us
I20260709 13:02:33.915177  8578 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:02:33.893335 13040 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:02:33.919358  9100 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:33.919471  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:33.735316 13031 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:33.892001 12864 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:33.908756 12963 consensus_meta.cc:287] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.005s
I20260709 13:02:33.937937  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:33.936956 12988 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:33.913427 13009 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:33.956599  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.952709  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:33.969735  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:33.977434  8581 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:33.937191 12944 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.904497 12994 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:33.947618 12591 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.990237  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:34.009764  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:33.971355  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 251597us
W20260709 13:02:34.012213  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 256132us
I20260709 13:02:34.013587  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:34.014981  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:34.017210  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:34.017971  8584 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:34.021325  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:34.022676  9102 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:33.977149 12862 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:33.980203 12889 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:33.980070 13009 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:33.988994 12944 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:34.031159 12889 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:34.031711 12889 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:34.032575 12889 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:34.034278  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.034898  8580 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:33.993960 13022 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:33.965514 12611 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:33.968972 13046 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:02:34.057471  8503 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:02:34.059389  8503 pending_rounds.cc:85] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 8
I20260709 13:02:34.059675  8503 pending_rounds.cc:107] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:02:34.059963  8503 raft_consensus.cc:2889] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:34.060796  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2077) took 1086 ms. Trace:
I20260709 13:02:34.061172  8503 rpcz_store.cc:276] 0709 13:02:32.973962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.020946 (+1046984us) service_pool.cc:224] Handling call
0709 13:02:34.053918 (+ 32972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.060467 (+  6549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.060728 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.057260  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:33.984323 12963 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.063292  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:34.066538  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53041.6us
I20260709 13:02:34.066991  8579 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:34.025702 12879 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.034976 13009 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.065623  9102 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:34.079875  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37100 (request call id 24) took 1223 ms. Trace:
W20260709 13:02:34.081746  9096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1115) took 1689 ms (client timeout 1680 ms). Trace:
I20260709 13:02:34.076382  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:34.081172  8504 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:34.074890  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:34.089488  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.086386  8577 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
W20260709 13:02:34.063311 12929 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.795s	user 0.006s	sys 0.006s
I20260709 13:02:34.091351 12725 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.091259  8576 rpcz_store.cc:276] 0709 13:02:32.856475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.857167 (+   692us) service_pool.cc:224] Handling call
0709 13:02:34.079675 (+1222508us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54001171d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a19339853 00007f1a1e30760a 00007f1a1788d7d4 00007f1a1788d762 00007f1a1788d691 00007f1a1788d60c 00007f1a1788c8c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:34.079788 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370709888}
I20260709 13:02:34.102638  8579 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:02:34.063154 13011 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.091481  9096 rpcz_store.cc:269] 0709 13:02:32.392810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.393002 (+   192us) service_pool.cc:224] Handling call
0709 13:02:34.081561 (+1688559us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54005479d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:34.081681 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064342272}
I20260709 13:02:34.103263  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 929) took 1126 ms. Trace:
I20260709 13:02:34.106859  8504 rpcz_store.cc:276] 0709 13:02:32.975779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.080704 (+1104925us) service_pool.cc:224] Handling call
0709 13:02:34.081015 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.101701 (+ 20686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.101972 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.090957  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:34.103929  8503 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:02:34.109086  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2078) took 1134 ms. Trace:
W20260709 13:02:34.098289 12402 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.858s	user 0.004s	sys 0.008s
I20260709 13:02:34.075636 13030 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.110816  8503 rpcz_store.cc:276] 0709 13:02:32.974267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.065366 (+1091099us) service_pool.cc:224] Handling call
0709 13:02:34.103666 (+ 38300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:34.108693 (+  5027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.109014 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.113972  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2075) took 1150 ms. Trace:
I20260709 13:02:34.110651  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:34.115542  8503 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:02:34.115859  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:34.116766  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2080) took 1113 ms. Trace:
I20260709 13:02:34.117177 12922 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.117379  8503 rpcz_store.cc:276] 0709 13:02:33.003644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.114551 (+1110907us) service_pool.cc:224] Handling call
0709 13:02:34.115209 (+   658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.116302 (+  1093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.116667 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:34.118531 12922 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.083221 12994 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:34.082733 12611 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:34.117396  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:34.091075 12864 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:34.074995 13042 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:02:34.149991  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 154051us
I20260709 13:02:34.145809  9102 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:34.109870 12725 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.078209 13056 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:02:34.162000 13060 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.147449 12992 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:34.107532 12929 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:34.166427 12929 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.110112 13011 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.169199 13011 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.160512 12725 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.149034 13063 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:34.176783  8504 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:34.172675 12849 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:34.179204 13063 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.155951 12864 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.183560 12879 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:34.190980 12889 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:34.187709 12849 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:34.194819 13063 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.214537 12929 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.239737  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 88535.5us
I20260709 13:02:34.186949 13011 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:34.245414  8435 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:34.243036  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 125723us
I20260709 13:02:34.261083  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:34.268784  8426 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:34.246111  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:34.270814  8433 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 6.
I20260709 13:02:34.269870  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:34.271313  8435 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:34.275082  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2073) took 1311 ms. Trace:
I20260709 13:02:34.226135 12849 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:34.230518 12889 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:34.279068  9097 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:02:34.276000  8502 rpcz_store.cc:276] 0709 13:02:32.963247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.587310 (+624063us) service_pool.cc:224] Handling call
0709 13:02:33.587663 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:33.587939 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:33.930135 (+342196us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.239596 (+309461us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.274791 (+ 35195us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:34.274838 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.274908 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.275028 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49192,"prepare.queue_time_us":464182,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":82217,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":8487,"thread_start_us":582730,"threads_started":3,"wal-append.queue_time_us":253053}
I20260709 13:02:34.243018 12929 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.283475 12929 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.286361 12725 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:34.290654 13053 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:02:34.294757 13062 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:34.280944  9097 pending_rounds.cc:85] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 10
I20260709 13:02:34.297430  9097 pending_rounds.cc:107] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:02:34.297791  9097 raft_consensus.cc:2889] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:34.275754  8435 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:34.302649  8435 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:34.290531 13057 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:02:34.267874 13066 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:34.315220  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 930) took 1311 ms. Trace:
I20260709 13:02:34.315786  8503 rpcz_store.cc:276] 0709 13:02:33.003644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.119375 (+1115731us) service_pool.cc:224] Handling call
0709 13:02:34.120265 (+   890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.120891 (+   626us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:34.121777 (+   886us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.239746 (+117969us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.275555 (+ 35809us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.314832 (+ 39277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.314896 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:34.314950 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.315020 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.315154 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22801,"prepare.queue_time_us":40694,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":2168,"thread_start_us":125520,"threads_started":2}
I20260709 13:02:34.243472 12963 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.320262 12864 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.321199  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2072) took 1358 ms. Trace:
W20260709 13:02:34.324728 13065 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:02:34.323943  8508 rpcz_store.cc:276] 0709 13:02:32.962922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.558241 (+595319us) service_pool.cc:224] Handling call
0709 13:02:33.585305 (+ 27064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.949424 (+364119us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:33.949470 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.987219 (+ 37749us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.182161 (+194942us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:34.182198 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.182273 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.320960 (+138687us) raft_consensus.cc:1685] finished
0709 13:02:34.320988 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.321134 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":250208,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":35522,"thread_start_us":498553,"threads_started":2,"wal-append.queue_time_us":257063}
I20260709 13:02:34.323082  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2491) took 1542 ms. Trace:
I20260709 13:02:34.326364  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2076) took 1362 ms. Trace:
I20260709 13:02:34.326799  8506 rpcz_store.cc:276] 0709 13:02:32.973575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.893774 (+920199us) service_pool.cc:224] Handling call
0709 13:02:33.920343 (+ 26569us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:33.920772 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.920813 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:33.934297 (+ 13484us) log.cc:844] Serialized 52 byte log entry
0709 13:02:34.088722 (+154425us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.088769 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.091090 (+  2321us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.326112 (+235022us) raft_consensus.cc:1685] finished
0709 13:02:34.326132 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.326290 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107470,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":100684,"threads_started":1,"wal-append.queue_time_us":203875}
W20260709 13:02:34.331570  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.325692  8509 rpcz_store.cc:276] 0709 13:02:32.780946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.781104 (+   158us) service_pool.cc:224] Handling call
0709 13:02:32.781407 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.817904 (+ 36497us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:32.837093 (+ 19189us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.201706 (+364613us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.315724 (+1114018us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b2c0005c2d8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:02:34.316119 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.316313 (+   194us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:34.316351 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.316420 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.322757 (+  6337us) raft_consensus.cc:1685] finished
0709 13:02:34.322881 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.323022 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41373,"prepare.queue_time_us":19042,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2798,"raft.queue_time_us":48210,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":10678,"spinlock_wait_cycles":14348544,"thread_start_us":323709,"threads_started":1,"wal-append.queue_time_us":407200}
I20260709 13:02:34.312767  8435 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:02:34.335287  8435 pending_rounds.cc:85] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 6
I20260709 13:02:34.335646  8435 pending_rounds.cc:107] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:02:34.336093  8435 raft_consensus.cc:2889] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:34.338536 13073 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:34.352689 13073 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.356722 13073 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.358491 13074 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:34.274446 13011 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:34.358016 12849 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:34.331530 13066 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:34.368230 12700 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.394268 13037 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.765s	user 0.012s	sys 0.001s
I20260709 13:02:34.370926 13081 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:02:34.393743 12981 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:34.400346 12981 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:34.402959 13009 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:34.403556 12993 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.667s	user 0.012s	sys 0.000s
I20260709 13:02:34.403980 12993 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.404768 13009 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.405561 12993 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.407011 13066 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.398366 13037 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.409538 13063 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.409811 13011 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.411620 13063 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:34.443728  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 144261us
I20260709 13:02:34.446556  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:34.448168  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:34.449587  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:34.451160  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2074) took 1487 ms. Trace:
I20260709 13:02:34.451653  8507 rpcz_store.cc:276] 0709 13:02:32.963525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.589550 (+626025us) service_pool.cc:224] Handling call
0709 13:02:33.589972 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.755597 (+165625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.755624 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.760878 (+  5254us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.066127 (+305249us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:34.066181 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.066269 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.450529 (+384260us) raft_consensus.cc:1685] finished
0709 13:02:34.450567 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.450868 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":288028,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":60,"thread_start_us":469950,"threads_started":2,"wal-append.queue_time_us":389220}
I20260709 13:02:34.452105  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:34.467908  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.470322  9095 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 7.
I20260709 13:02:34.390996 12700 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.473251 12849 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.474761 12849 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.475099 12700 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.475579 12849 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:34.479370 12849 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.375500 12889 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.401247 12981 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.493042 12981 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.496558 12864 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:34.497243 12864 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:34.497735 12864 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.502727 13083 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:34.504555 13052 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:34.505028 13063 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:34.505995 13063 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.506556 13060 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:34.508016 13052 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:34.509311 12993 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.509799 13052 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.510255 12993 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.514012 12993 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:02:34.515264  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2255) took 2570 ms. Trace:
I20260709 13:02:34.515731  8429 rpcz_store.cc:276] 0709 13:02:31.944654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.945019 (+   365us) service_pool.cc:224] Handling call
0709 13:02:31.961890 (+ 16871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.922486 (+960596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.514584 (+1592098us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b5400361fd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:34.515043 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080582016}
I20260709 13:02:34.518639  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:34.519861  8583 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:34.522414  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:34.523228  8583 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:34.114421  8505 rpcz_store.cc:276] 0709 13:02:32.963799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.610556 (+646757us) service_pool.cc:224] Handling call
0709 13:02:33.629122 (+ 18566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.629440 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.629475 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.629896 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:02:33.971253 (+341357us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:34.112114 (+140861us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.112362 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.112443 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.112483 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:34.112499 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.113919 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":118387,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":2349,"raft.queue_time_us":249125,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":55,"thread_start_us":393052,"threads_started":2,"wal-append.queue_time_us":387353}
I20260709 13:02:34.502689 13037 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:34.525586  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:34.531076  8501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2482) took 2438 ms (client timeout 1680 ms). Trace:
W20260709 13:02:34.533233  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.559351  8501 rpcz_store.cc:269] 0709 13:02:32.092442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.093268 (+   826us) service_pool.cc:224] Handling call
0709 13:02:34.530550 (+2437282us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54001fcf54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:34.530805 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694860672}
I20260709 13:02:34.496657 12928 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:34.558351  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 79949.6us
I20260709 13:02:34.531855  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:34.562165  8575 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.562851 12928 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:34.563310 13085 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:34.529927  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2270) took 1428 ms. Trace:
I20260709 13:02:34.531373  8576 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:34.532256  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.517849  8431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 2082) took 1486 ms (client timeout 1884 ms). Trace:
I20260709 13:02:34.529834  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:34.580071  8579 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
W20260709 13:02:34.588148  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.595252  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:34.596351  9098 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 9.
I20260709 13:02:34.599560  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:34.600647  9102 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:34.601380 12709 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:34.601909 12709 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:34.602052  9093 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:34.603485  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:34.604667  9096 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:34.605298  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:34.606374  9102 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:34.608086  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1137) took 1066 ms. Trace:
I20260709 13:02:34.608489  9097 rpcz_store.cc:276] 0709 13:02:33.541446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.541621 (+   175us) service_pool.cc:224] Handling call
0709 13:02:33.541925 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.298287 (+756362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.607546 (+309259us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b5400560ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:34.607896 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694180096}
I20260709 13:02:34.610556 13011 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:34.612462 13014 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:34.617782  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:34.618673 13014 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:34.619071 13014 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:34.619916 12805 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.620182  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:34.620373 13014 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:34.613168 12483 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.534611 13063 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.615335  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:34.536651 12849 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:34.622402  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:34.578369  8431 rpcz_store.cc:269] 0709 13:02:33.030924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.050729 (+ 19805us) service_pool.cc:224] Handling call
0709 13:02:34.517276 (+1466547us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400128254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:34.517573 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094742272}
I20260709 13:02:34.628985 12483 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:34.630944 12837 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:02:34.630755 12938 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:34.631850 12483 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.622344 13011 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.633957 12839 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.641081  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:34.650872  9101 raft_consensus.cc:2410] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:34.650943 12947 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.623140 13014 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:34.655522  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:34.657454  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.658002  9100 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:34.626076 12849 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.662369 12849 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.662914  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:34.663717  9102 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:34.574805  8434 rpcz_store.cc:276] 0709 13:02:33.101029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.243543 (+142514us) service_pool.cc:224] Handling call
0709 13:02:33.243786 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.244091 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.244108 (+    17us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.244447 (+   339us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.528680 (+1284233us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b1800467140. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1
0709 13:02:34.529109 (+   429us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.529160 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.529276 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.529396 (+   120us) raft_consensus.cc:1685] finished
0709 13:02:34.529411 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.529746 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2791,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3551,"spinlock_wait_cycles":41779968,"thread_start_us":4786,"threads_started":1,"wal-append.queue_time_us":98566,"wal-append.run_cpu_time_us":1941,"wal-append.run_wall_time_us":1009268}
I20260709 13:02:34.672803  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:34.673291  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:34.673679  8501 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.674391  8507 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:34.638513 12938 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.676313  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:34.677184  8509 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:34.676605 12938 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.635906 13063 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.679059 13063 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.651573 13011 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.684500  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:34.686168 12703 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:34.686400 12938 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:34.603541 12709 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:34.688786  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:34.691123  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:34.694845  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 128980us
I20260709 13:02:34.705502  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:34.704234  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:34.708963  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:34.712090  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.712486  9099 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:34.713048  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:34.716974  9068 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.721s (SENT) [suppressed 10 similar messages]
I20260709 13:02:34.703858 13063 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.719718  9102 raft_consensus.cc:2393] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:34.726704 12798 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:34.731945  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:34.734797 12709 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.736572 12969 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.739068 13011 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:34.739089 12864 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.748476 12727 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.749348  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:34.750098  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 61805.3us
I20260709 13:02:34.750831 12703 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:34.751698 12728 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.753306  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:34.755921  9101 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
W20260709 13:02:34.756132 12944 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.699s	user 0.000s	sys 0.020s
W20260709 13:02:34.756665  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.757779 12955 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.710769  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:34.778537  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:34.792232  8431 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:34.806588  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:34.819905  8427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 898) took 1788 ms (client timeout 1721 ms). Trace:
I20260709 13:02:34.825474  8575 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
W20260709 13:02:34.839483  8427 rpcz_store.cc:269] 0709 13:02:33.031600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.048959 (+ 17359us) service_pool.cc:224] Handling call
0709 13:02:34.781797 (+1732838us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54001d38d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:34.819706 (+ 37909us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932088704}
I20260709 13:02:34.812637  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:34.838178 12944 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:34.811830  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:34.810949  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:34.813573  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:34.806898  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:34.815321  8510 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:34.846325  9095 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:34.847121 12944 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:34.804745 13004 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:02:34.792045  9100 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:34.789199  9097 raft_consensus.cc:2410] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:02:34.856351  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 107411us
I20260709 13:02:34.816673  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:34.818385 13011 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.858915 12725 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:34.859527 12725 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.860038 12725 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:34.861178 13011 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.863793 12864 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.864557  8504 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:34.864923  9096 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
W20260709 13:02:34.792390 13086 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:02:34.871549  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 79605.4us
I20260709 13:02:34.878428  8501 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:34.882201 12829 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:34.885304 13000 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:34.781988 12703 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.870400 12923 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:34.911296  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:34.896399  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 164598us
W20260709 13:02:34.899869  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 182931us
W20260709 13:02:34.917240  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.923305  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:34.912274 12703 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.910866 12923 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:34.925356 12727 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:02:34.937551  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:34.942811  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.946563 13056 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:34.947613 13056 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:34.952255  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:34.952675  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 224212us
I20260709 13:02:34.944993  8429 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:34.943866  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:34.957477  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44063.5us
I20260709 13:02:34.960017  8432 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:34.949147 13056 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.953327  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:34.964715 12879 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:34.983357  8428 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:34.987032 12611 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.987790 12611 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.990546 12611 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:34.974939 12879 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.008526  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.009389  8430 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:35.010118  8505 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:02:35.011224 12965 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:02:35.012173 12864 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:35.012588 12864 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:35.013679 12864 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.014807 12864 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.018887 13055 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:35.019501 13055 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:35.020051  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.020735 13055 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:34.998044 13091 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:02:35.023607 12835 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.023732 12611 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:35.024183 12611 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:35.024264 12835 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.025422 12611 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:35.026363 12941 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:35.026892 12611 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.027228 12835 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:35.026958 12941 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:35.025908 13071 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.730s	user 0.002s	sys 0.001s
I20260709 13:02:35.029402  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:35.029618  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:35.030486  8510 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:35.031787  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:35.032692  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.033916 13034 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:02:35.034245  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:35.036093 13004 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.036773 13004 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:35.044672  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 68505.8us
I20260709 13:02:35.042755  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.039640  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:35.042269  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 220164us
I20260709 13:02:35.041857  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.048969  8575 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 8: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:35.001372 12879 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.038772  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.050946  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.052155  8583 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:35.053122  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 51026.1us
W20260709 13:02:35.051067  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 68777.9us
I20260709 13:02:35.041927 13055 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:35.049026  8398 connection.cc:256] RPC call timeout handler was delayed by -1.2708753650000517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 13:02:35.029372 12941 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:35.041826 13004 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:35.056255  8427 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:35.038475 12923 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:35.060241  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.060606 12923 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.066543  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.067408  8580 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 7.
I20260709 13:02:35.068368  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.069607  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.060302 12954 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:02:35.071156  8577 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:02:35.071573  8577 pending_rounds.cc:85] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 10
I20260709 13:02:35.071795  8577 pending_rounds.cc:107] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:02:35.072105  8577 raft_consensus.cc:2889] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:35.065490  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:35.074506  8398 connection.cc:256] RPC call timeout handler was delayed by -1.0546936399999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
I20260709 13:02:35.069738 12703 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.075896  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.076503  8575 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.077654 12703 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:35.079167  8582 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:35.076040  8579 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:35.037984 12725 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:35.085410  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.072582  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.088404  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.090655  8578 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:35.091290  8575 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:35.099499 12879 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.101395  8584 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.103753 12725 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:35.106510  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.106657  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.107749  8581 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 7: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:35.111595  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.112167  8583 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:35.090202 13014 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.113188  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.116966  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.119037  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44688.8us
I20260709 13:02:35.119735  8575 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:35.117301  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.126430  8582 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:35.125286  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.114825 12725 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.139629  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 96905.9us
I20260709 13:02:35.134378  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.142911  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:35.143246  8429 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:35.125018 12727 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.148403  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:35.151808  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.166051  9101 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:35.165544  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.142776 12879 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:35.171145  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:35.122040 12849 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.173151  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.175164 12703 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:35.175669  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:35.176234  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.176403  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.177284  8583 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:35.178414  8583 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:35.178339  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:35.181852  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.182751  8579 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:35.179955  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.188956  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.190039  8575 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:35.191053  9093 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:35.143169 13014 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:35.195969  8578 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:35.194146  8476 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:35.203100  8429 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:35.204535  9101 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:35.195942  8435 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:35.210232  8505 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:35.210613  8430 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:35.164513 12725 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.213004  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.216921  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.220125  9099 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:35.218767  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.198393 12611 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:35.222544  8582 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:35.224299  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:35.236240  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:35.187891 12727 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.241408  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:35.243566  8430 raft_consensus.cc:2410] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:35.245802  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:35.246789  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:35.251492  8333 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 5 to 6, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 6 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:35.254788 13101 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:02:35.258165  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 94221us
I20260709 13:02:35.258757 12954 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:35.259045  8476 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:35.259701  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:35.260476  9096 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:35.260777 12798 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:35.261233 12798 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.261600 12798 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.262178 12864 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:35.262817 12864 consensus_queue.cc:1243] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:35.265126  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:35.265703  8435 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.268787 12829 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:35.269239 12829 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:35.271064  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:35.271539 12727 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:35.225279 12611 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.238776  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:35.243304  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:35.273914  8431 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:35.275059  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.273212  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:35.234437 12483 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.242700 12891 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:35.292424  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 68197.4us
I20260709 13:02:35.304479  8582 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:02:35.301337  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 78838.9us
I20260709 13:02:35.253824  8333 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 5 to 8, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 8 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.317335  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.286340 12611 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.324419  8476 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:35.320109  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:35.298246 12891 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.259492 12954 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:35.304977 12728 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:35.351462  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.351634  8584 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:35.356033  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.351634  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:35.389484  8430 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:35.390825 13031 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:02:35.392627  9099 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:35.341926 12891 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.385962  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:35.361703  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 55552us
I20260709 13:02:35.397709  8576 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:35.304015 12483 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:35.394654  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.361413 12969 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:35.325011 13037 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:02:35.406741  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.316244 12829 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.357316 12728 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:35.399428 12969 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.346503 12879 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:35.399366 13011 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:35.442327  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 169186us
I20260709 13:02:35.399919  8333 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 6 to 7, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 7 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:35.458636  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.458907  8576 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:02:35.464998  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.444681  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46303.9us
I20260709 13:02:35.466507 12879 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.467866 12879 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.396111 12944 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:35.491456  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:35.495936  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.491585  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:35.435016 12849 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:35.522789  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.477979 13011 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:35.529268  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.485291 12829 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.537796  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:35.537200  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 187865us
W20260709 13:02:35.528164  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 88788.2us
I20260709 13:02:35.517125 12998 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:35.562996  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.541733 12725 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:35.435815 12969 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.422964 12728 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:35.631301 13055 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.575s	user 0.004s	sys 0.007s
W20260709 13:02:35.637801  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 160358us
W20260709 13:02:35.639056  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 103209us
I20260709 13:02:35.602162  8333 catalog_manager.cc:5697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:35.644163  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:35.619405 12944 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:35.635135 13011 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.634891 12998 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.661787  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:35.629022  8580 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:35.654001  8547 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:35.601089  9101 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:35.665170  8434 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:02:35.669234  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.670604  8433 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:35.671638  8398 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:35.671653  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.661044  8333 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 4 to 7, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 7 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:02:35.683254  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.686200  8426 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:02:35.649550 12923 consensus_meta.cc:287] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.000s
I20260709 13:02:35.691241  8429 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:35.693940  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.653084 12727 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:35.645293 12982 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.701465  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.662261 12944 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.685802 12998 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:35.727613  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 73708us
I20260709 13:02:35.728492  8433 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:35.730708  8432 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:35.737511  9093 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:35.743420 12960 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.744288 12960 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.718775 12727 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:35.750346  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:35.751226  9101 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:35.752024  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:35.753123  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:35.754649 12483 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:35.756822 12798 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:35.725198 12982 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.736099  8434 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 8. Current term is 10. Ops: []
I20260709 13:02:35.758443  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.709177 13004 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.730533  8333 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 8 to 9, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 9 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:35.765200  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.765460  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:35.766817  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:35.767685 13106 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.291s	user 0.003s	sys 0.000s
I20260709 13:02:35.767982 12727 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:35.769399  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.769755  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.770561  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:35.770815  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.771320  8427 raft_consensus.cc:2368] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:02:35.771486  8433 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:35.772181  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:35.765303  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 115714us
I20260709 13:02:35.773088  8427 raft_consensus.cc:2410] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:35.765921  8434 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:35.778693  8427 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:35.778743  8547 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:35.723982 12725 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:35.724429 12954 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:35.784579  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.788690  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:35.794121  8432 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:35.781297  8428 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 6.
I20260709 13:02:35.781991 12709 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:02:35.809638 12709 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:35.809890  8426 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.810122 12709 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:35.810683  8427 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:02:35.811053  8427 pending_rounds.cc:85] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 8
I20260709 13:02:35.811308  8427 pending_rounds.cc:107] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:02:35.811583  8427 raft_consensus.cc:2889] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:35.796274 12483 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:35.823284  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.821240  8547 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:35.830936  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:35.831700 13109 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:35.831756  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:35.834874  9097 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:02:35.826578 13000 consensus_meta.cc:287] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.941s	user 0.010s	sys 0.005s
I20260709 13:02:35.811161 12709 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:35.834638 12725 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.891820  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.896123  9097 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:35.857015 13004 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:35.890507 12798 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:35.853636 12891 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:35.918792 13107 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:35.920137 12891 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:35.924000  9098 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:35.917235 13011 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:35.927102  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 255388us
W20260709 13:02:35.930665 13113 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:02:35.933238  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:35.936023  8430 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:35.904117 13004 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.911576  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:35.949307  8435 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.002s
I20260709 13:02:35.954800  8435 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:35.956286  8434 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:35.961033  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 176223us
W20260709 13:02:35.961324  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 329641us
I20260709 13:02:35.901897 12725 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:35.966678  8582 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.002s
I20260709 13:02:35.950768 13004 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.974551  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:35.972851  8582 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:35.955904 12483 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.956835 13055 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:35.982764  9094 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:02:35.990659 12611 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 13:02:35.959435 12982 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:35.978511  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:35.998291  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:35.950045 12944 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:35.999431  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:36.007195  8435 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:36.007367  8333 catalog_manager.cc:5697] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:36.002354  8428 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.997279 13055 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:35.967813 12709 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:35.972208 12849 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:02:36.002662 12805 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.993942 12998 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.023411  8333 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 7 to 9, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 9 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:02:36.024799  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 164527us
I20260709 13:02:36.021322  8475 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:36.012305 13055 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.041383  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:36.002801 12611 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.043247 13056 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:36.014597 12982 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.053653 12982 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.056038 12982 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:36.056689 13120 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:36.057322 13120 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.059458 13120 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:36.050438 13083 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.062203 12798 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:36.062402 13083 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.063776 13128 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:02:36.022269 12805 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.053087 13056 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:36.064845 13128 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:36.065586 13128 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:36.008183 12835 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:02:36.064486 12889 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:36.019258 13011 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:36.007195 12483 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.076362  8582 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:36.062896 12798 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:36.065945 13128 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:36.077682 12889 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.078186 12960 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:36.066015 12879 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.001s
I20260709 13:02:36.066182 13056 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.079619  8435 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:36.081704  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 114437us
I20260709 13:02:36.084781  8578 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:36.044242 12727 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:36.096822  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:36.110224  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:36.100595  8333 catalog_manager.cc:5697] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 3 to 5, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 5 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.106555  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:36.111061  8584 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:36.111126  8577 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.106859  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:36.088564  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:36.046676 13000 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.116557  8428 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:36.067188 13083 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:36.109715  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:36.138602  8575 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:36.138743  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:36.141487  8576 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.084484 12805 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:36.085569 13014 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:36.145232  8434 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.145624  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:36.153625  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:36.154418  8579 raft_consensus.cc:2376] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9. Re-sending same reply.
I20260709 13:02:36.150739  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:36.158617  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:36.160131 13131 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:02:36.159605 12728 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.160933  8501 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:36.161768  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:36.162974 13122 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:02:36.164686 12864 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:36.166145 12864 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:36.167414 12864 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.170615 12849 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:36.171656 13128 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.172883 12965 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.173043 13128 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.173390 12965 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.142587 13000 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.174311  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:36.175690 12965 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:36.136633 12969 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.176286 13000 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:36.177783 12969 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:36.178686  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:36.179414  8435 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:36.180171  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:36.180653  8435 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.177035  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:36.182186 13083 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.182950 13083 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.183053 12944 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:36.184876 12611 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:36.183164 12965 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.186546 12965 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:36.187863 13114 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:02:36.188555  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:36.189057  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1151) took 1028 ms. Trace:
I20260709 13:02:36.189445 12954 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.189447  9095 rpcz_store.cc:276] 0709 13:02:35.160468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.160631 (+   163us) service_pool.cc:224] Handling call
0709 13:02:35.187942 (+ 27311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.238191 (+ 50249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.238233 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.272340 (+ 34107us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.522466 (+250126us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:35.522516 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.522581 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.188835 (+666254us) raft_consensus.cc:1685] finished
0709 13:02:36.188853 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.188991 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17477,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":42968,"thread_start_us":249546,"threads_started":1,"wal-append.queue_time_us":574991}
I20260709 13:02:36.191872  8430 raft_consensus.cc:1217] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[8.5-12.7]   Dedup: 8.5->[10.6-12.7]
I20260709 13:02:36.192323  8430 pending_rounds.cc:85] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 5
I20260709 13:02:36.192566  8430 pending_rounds.cc:107] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:36.192807  8430 raft_consensus.cc:2889] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:36.194370 12805 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.195077 12889 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:36.194865 12805 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.137318 12879 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.176942  8333 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 8 to 9, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 9 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.197497 12805 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:36.195117  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.197336  8333 catalog_manager.cc:5697] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 3 to 8, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 8 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.200750  8427 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:36.205778  8429 raft_consensus.cc:2368] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10.
I20260709 13:02:36.206602  8577 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
W20260709 13:02:36.207335  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 301046us
I20260709 13:02:36.208948  8576 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:36.210815  8432 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:36.209946  8426 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:02:36.213943  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.216162  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:36.221380  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:36.222522  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:36.214357 12727 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:36.216866 12889 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:02:36.226881 12798 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.227667  8579 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:36.227504 12727 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.228109 13037 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:36.228680 13037 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:36.228720  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:36.229651 13037 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.231431 12954 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:36.231698  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.232349  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:36.232899  8584 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.233573  8432 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:36.233721  8501 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:36.246558  8584 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
W20260709 13:02:36.248333  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 89784.2us
I20260709 13:02:36.248754  8435 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 7.
I20260709 13:02:36.243116  8333 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 4 to 6, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 6 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:36.256565  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 46173.4us
I20260709 13:02:36.257642  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:36.258774  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:36.264282  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:36.266001 12889 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:36.244774 13014 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:36.236192 13132 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:36.245396 12725 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:36.252033 12849 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:36.269299  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.279518  8501 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:36.281512  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.246141 12944 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:02:36.284446  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.260738 13083 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:02:36.278702 13132 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:36.292869 13132 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:36.282461 12889 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:36.295197 12889 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.274170 13055 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.302368 13142 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.303109 13142 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:36.304659  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.268069 12709 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.311277  8434 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
W20260709 13:02:36.315213  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 46491.2us
I20260709 13:02:36.321802  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.321920  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.318915  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:36.310236 12982 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.338958  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.326439 13055 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:36.326953 12955 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.320447 12923 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:02:36.346187  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.349740 12955 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.352015 12955 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:36.352748 12965 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:36.355274  9094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1123) took 2399 ms (client timeout 1715 ms). Trace:
W20260709 13:02:36.355695  9094 rpcz_store.cc:269] 0709 13:02:33.955825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.989933 (+ 34108us) service_pool.cc:224] Handling call
0709 13:02:36.355042 (+2365109us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54005d4154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:36.355190 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4314557312}
I20260709 13:02:36.361892 12998 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:36.367568  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.368080  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.367791 12611 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:36.368141 12835 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:36.369534 12835 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:36.378468 13140 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.379179 13140 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.382428  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:36.383330  8576 raft_consensus.cc:2410] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:02:36.384241 12864 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:36.385185  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 69273.9us
I20260709 13:02:36.386350  8400 leader_election.cc:400] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11.
I20260709 13:02:36.386716  8400 leader_election.cc:403] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:36.340659 12727 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:36.346477 12728 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:36.390043 13117 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:36.392320 13141 raft_consensus.cc:3055] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:36.392689 13141 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:36.393507 13141 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.375582  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:36.394690 13141 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.394773  8578 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:36.375988  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:36.395869  8583 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:36.367597 12483 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:36.397080  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:36.398274  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 134068us
I20260709 13:02:36.399260  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:36.344483 12725 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.401332  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:36.402858 12727 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:36.403887 12727 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.404620  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.405757  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:36.406545  8507 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:36.406455  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.407307  8510 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:36.407428  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.408244  8502 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:02:36.408289  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:36.408555 12969 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:36.409137  8576 raft_consensus.cc:2410] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:02:36.406592  8504 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:36.322189 12709 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.451001  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:36.381798 13140 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:36.454360  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.409971 12969 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:36.459331  8501 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:36.482797  8507 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:36.462833  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 63696.8us
W20260709 13:02:36.462481  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 49783.6us
I20260709 13:02:36.461656  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:36.331383 12982 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.491406  8504 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:36.494845  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.450793 13055 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.501127  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.501013  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.504117  8510 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:36.460884 13014 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:36.506932  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.515082  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:36.520419 13014 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:36.521409 12960 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:36.521807 12960 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.522168 12960 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.521982 13014 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.462193 13000 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:36.492000 12969 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:36.520479  8509 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:36.530689  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.462662 12835 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:36.607844  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.607605  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.608963  8508 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:02:36.500629 12849 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:36.507400 13055 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.537236 12923 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:02:36.645040 13144 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.668021  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:36.676748  9099 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.650951  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:36.677527  9094 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:36.677590  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 68444.6us
W20260709 13:02:36.680727  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 195582us
I20260709 13:02:36.552976 13000 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:36.694267  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 236096us
I20260709 13:02:36.695438  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:36.644254 13142 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:36.714416  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:36.715009  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:36.715729  8501 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:36.717453  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:36.721953  8398 leader_election.cc:400] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11.
I20260709 13:02:36.642081 12835 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.759449  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:36.763957  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:36.766204  8433 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:36.760686  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:36.770402  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:36.771173  8431 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
W20260709 13:02:36.749692 13146 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:02:36.775028  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 65158.6us
W20260709 13:02:36.811792  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.817965  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:36.782384 12955 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:36.819608 12955 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.820075 12955 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.774673 12992 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.836148  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:36.683375 12969 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:36.840617  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 145254us
I20260709 13:02:36.685933 13144 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:36.842387 12923 raft_consensus.cc:3055] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:36.776950 13164 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:36.846565  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:36.853952  9068 leader_election.cc:336] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.721s (SENT)
W20260709 13:02:36.915978  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 62043.1us
W20260709 13:02:36.916663  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.832297 12703 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:36.878888  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 178857us
W20260709 13:02:36.879240  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.837873 12879 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:36.757731 12849 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:36.889771  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.850873  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:36.840412 13056 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:36.914882  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 68416.4us
W20260709 13:02:36.877980 13128 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.704s	user 0.014s	sys 0.000s
W20260709 13:02:36.920833  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.919910  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:36.855162 13164 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.938320  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:36.943037  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 82990.4us
W20260709 13:02:36.943179  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 92434.3us
I20260709 13:02:36.944211  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:36.944775  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:36.945767 13157 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:02:36.947130 13166 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
W20260709 13:02:36.944418 13132 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.010s
W20260709 13:02:36.950495 13158 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:02:36.949538 13148 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:02:36.851670 12923 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:36.963611  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:36.919240 12982 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:36.932199 12703 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:36.953327 12969 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.983606 12703 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:36.988386  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:36.990623 12805 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:36.991262 12805 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:36.992318 12805 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:36.994629  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50544.7us
I20260709 13:02:36.996623 13166 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:36.997244 13166 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.997689 13166 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:36.951952 13004 consensus_meta.cc:287] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.955s	user 0.007s	sys 0.006s
W20260709 13:02:36.979146 13149 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.355s	user 0.004s	sys 0.001s
I20260709 13:02:36.979964 13055 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:36.847483 12992 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:37.038234  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 104464us
W20260709 13:02:37.006083  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.008152 13169 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:02:37.009047 13178 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.010053 13173 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.012737  8547 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:37.016741  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.019315 13168 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:02:37.019556 13162 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 13:02:37.020357 13163 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:02:36.938556 12864 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:02:36.929356 13037 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:37.023133  9067 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:36.990541 13171 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.939530 13164 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.950237 13132 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:37.046681  9099 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:36.989382 12960 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:37.037904 13156 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:02:37.056247 13083 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:37.038828 12703 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:02:37.027626  9094 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:37.035298 12982 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.034384 12805 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:37.069823  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.043610 12611 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.049554 13011 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:37.072031  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49026.8us
I20260709 13:02:37.043918 13004 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.062157 13142 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.020372 13172 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:37.073239  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 60607.3us
I20260709 13:02:37.066201 13180 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.127049 13055 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.108527 13128 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.136225  8547 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:37.137948  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:37.117254 13171 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:37.107576 13181 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:37.143851  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 155536us
I20260709 13:02:37.122301 13144 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:37.057542 13178 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.124528 13037 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:37.128046 13011 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:37.193737  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 58374.5us
I20260709 13:02:37.200315  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:37.191613  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53775.8us
W20260709 13:02:37.196090  8427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.012s	sys 0.041s
W20260709 13:02:37.204494  8427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.012s	sys 0.042s
I20260709 13:02:37.204609  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:37.133399 13172 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:37.205994  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2109) took 1211 ms. Trace:
W20260709 13:02:37.207222  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.207484  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:37.208950  8432 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:37.205304 13167 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:37.205719  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:37.191819 12829 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.216878  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:37.127892 12982 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.218039  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.128010 12611 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.217097  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:37.227315  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.205961 13160 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.370s	user 0.004s	sys 0.000s
I20260709 13:02:37.125372 13083 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.241967  8434 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:37.200109 12835 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:37.115406 12923 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.202919 13011 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.258320 12703 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:37.269896 13154 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.585s	user 0.000s	sys 0.001s
I20260709 13:02:37.270440  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:37.243261  9068 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.550s (SENT)
W20260709 13:02:37.248080  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 45666.3us
I20260709 13:02:37.271888 13181 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:37.272420 13181 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:37.273340 13181 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.275588  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2108) took 1287 ms. Trace:
I20260709 13:02:37.275822 13004 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:37.203090 13000 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:37.278457 13189 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:37.279024 13189 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.280783  8433 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:37.210944 13144 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:37.252215 13132 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:37.252665 12820 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.206822  8427 rpcz_store.cc:276] 0709 13:02:35.994870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.204868 (+209998us) service_pool.cc:224] Handling call
0709 13:02:36.205237 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.208193 (+  2956us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:36.459279 (+251086us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.204970 (+745691us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:37.205035 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:37.205101 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.205754 (+   653us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.205938 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4076,"prepare.queue_time_us":81546,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":31,"raft.queue_time_us":165364,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":38061,"thread_start_us":857996,"threads_started":3,"wal-append.queue_time_us":706096}
I20260709 13:02:37.244319  8429 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.276057  8430 rpcz_store.cc:276] 0709 13:02:35.987779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.191281 (+203502us) service_pool.cc:224] Handling call
0709 13:02:36.191678 (+   397us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:36.200003 (+  8325us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:36.242573 (+ 42570us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.343872 (+101299us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:36.350228 (+  6356us) log.cc:844] Serialized 52 byte log entry
0709 13:02:36.350385 (+   157us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:36.350417 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.350484 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.269167 (+918683us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:37.275280 (+  6113us) raft_consensus.cc:1685] finished
0709 13:02:37.275386 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.275529 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37349,"prepare.queue_time_us":17023,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4240,"raft.queue_time_us":15257,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":41394,"spinlock_wait_cycles":33038592,"thread_start_us":68196,"threads_started":1,"wal-append.queue_time_us":274660}
I20260709 13:02:37.281173 13189 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:37.281355 13000 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:37.282476 13175 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:37.283686  8432 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:37.303457  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:37.304145  8432 raft_consensus.cc:2368] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:02:37.284277  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:37.286619  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.289659  8582 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:37.290426  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.254541 13172 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.295559  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.295506  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.307533  8434 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:02:37.306377  8581 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:37.311637  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:37.313160  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 349629us
I20260709 13:02:37.312435  8430 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:37.320013  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:37.321056  8426 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:37.322063  8431 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:37.320076  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.324755  8427 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
W20260709 13:02:37.325796  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.327199  8432 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:37.329038  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:37.203858 13055 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.331935  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.332662  8582 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:37.333151  8428 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:02:37.334074  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49853.5us
I20260709 13:02:37.306792  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.315059 13117 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.337953  8434 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:37.336881  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.364820  8432 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:37.308138 12955 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.335423 13185 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:37.340705 13172 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.343176 13083 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:37.346374 12992 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:37.317159 12960 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:37.351272  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.382588  8431 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:37.351354 12611 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:37.352861 13056 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.362241  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.371821  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.359606 12982 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:37.375159  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.388530  8432 raft_consensus.cc:2368] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12.
I20260709 13:02:37.378603  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.379923  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:37.389873  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:37.381192 13183 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 13:02:37.259315 13037 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:37.391306  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:37.382943 13188 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
W20260709 13:02:37.340794 13176 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:02:37.392509  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.393368  8426 raft_consensus.cc:2410] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:02:37.393985 13141 consensus_meta.cc:287] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.999s	user 0.007s	sys 0.007s
W20260709 13:02:37.383487 13165 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
W20260709 13:02:37.388854 13186 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260709 13:02:37.389881  9099 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:37.384871  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:37.387691  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.434960  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.406973  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.435863  8575 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:37.436093  8433 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:37.436702  8502 raft_consensus.cc:2410] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:02:37.412546  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 205159us
I20260709 13:02:37.435563  8576 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:37.436455  8578 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:37.441488  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.442166  8578 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
W20260709 13:02:37.442443  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 57678.8us
I20260709 13:02:37.444708  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:37.445482  8580 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.445405  8582 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:37.446514  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.449739  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:37.451447  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.453635  8578 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:37.383193 13174 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:02:37.454447  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:37.456120  9095 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:37.456264  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.374748 13189 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.451499  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.460877  9102 raft_consensus.cc:2410] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:37.463505  8577 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:37.336786 12864 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:02:37.389358 13142 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:37.308367 13173 consensus_queue.cc:1175] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ffc86752d264d0c81f68028e6413a91" responder_term: 13 status { last_received { term: 10 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: [12.8-12.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:37.462546 12483 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:02:37.467033  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.493912  8433 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:37.479782  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.494400  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.482399 12960 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:37.484186  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.486348  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.502442  8431 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:37.507668  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.511686  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:37.514465  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.515071  8433 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:37.486646  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.462546  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:37.485414 13167 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:37.437641 13120 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:37.493114  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:37.522608  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.496999  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.443648 12982 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:37.518582  8582 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 12: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:37.518492  9096 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.526218  8506 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:37.504230 13186 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:37.521472  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.523711  8575 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:37.523164  8576 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.524307  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:37.389989 13117 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:37.531454  9102 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:37.525372  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.528353  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.459230 12611 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:02:37.503756 12820 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:37.532886  8508 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:37.534097  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:37.523120 13167 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.539883  8431 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:02:37.540050  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.540830  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:37.523000 13120 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.492380 13159 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 13:02:37.556692  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:37.557957  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:37.542869  8433 raft_consensus.cc:2376] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14. Re-sending same reply.
I20260709 13:02:37.543006  8432 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:02:37.561692  8576 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:37.537902  8580 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:37.544155 12960 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.554544 13178 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:37.572981  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:37.573607  8508 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:37.576471  8429 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:37.577065  8427 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:37.578413  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.559306 13120 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.580996  8501 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:37.590916  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.592324  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:37.592968  8429 raft_consensus.cc:2368] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:02:37.593782  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:37.595211 13014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.002s	sys 0.004s
I20260709 13:02:37.566318 13138 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11.
W20260709 13:02:37.599321 13014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.002s	sys 0.004s
W20260709 13:02:37.601598 13166 consensus_meta.cc:287] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.000s
I20260709 13:02:37.610416  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2102) took 1198 ms. Trace:
I20260709 13:02:37.610998  8502 rpcz_store.cc:276] 0709 13:02:36.411474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.411591 (+   117us) service_pool.cc:224] Handling call
0709 13:02:37.610132 (+1198541us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b540033a254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:37.610314 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170309504}
I20260709 13:02:37.613584  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.616833  8501 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:37.617954  9096 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:37.572131 13172 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.545558 12820 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.571326 12982 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:37.623715  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.631460 12709 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:37.635468  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.637223 13000 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 13:02:37.639238  8505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2090) took 1364 ms (client timeout 1528 ms). Trace:
W20260709 13:02:37.639667  8505 rpcz_store.cc:269] 0709 13:02:36.275019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.275227 (+   208us) service_pool.cc:224] Handling call
0709 13:02:37.638975 (+1363748us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001fe854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:37.639159 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2938343168}
I20260709 13:02:37.640699  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1297) took 1003 ms. Trace:
I20260709 13:02:37.642550  8509 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:37.580523 13170 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:02:37.643019  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 85154.5us
I20260709 13:02:37.647543  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:37.581389 13178 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:02:37.641234  9093 rpcz_store.cc:276] 0709 13:02:36.637523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.639772 (+  2249us) service_pool.cc:224] Handling call
0709 13:02:36.675005 (+ 35233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.048697 (+373692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.048772 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.057039 (+  8267us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.495084 (+438045us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:37.495140 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.495226 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.640420 (+145194us) raft_consensus.cc:1685] finished
0709 13:02:37.640450 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.640621 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":275162,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":55539,"thread_start_us":715666,"threads_started":2,"wal-append.queue_time_us":501170}
I20260709 13:02:37.655367  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.658937  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.658535  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.661813  8427 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
W20260709 13:02:37.662380  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46802.1us
I20260709 13:02:37.665108  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.645676 12992 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:37.664033  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:37.669014  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:37.669886  8506 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.655097 13172 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.620774 13166 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.674904  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:37.675468  8431 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.678146  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.683110  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2113) took 1660 ms. Trace:
I20260709 13:02:37.677400 12969 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:02:37.683537  8435 rpcz_store.cc:276] 0709 13:02:36.022781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.249541 (+226760us) service_pool.cc:224] Handling call
0709 13:02:36.249845 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.333530 (+ 83685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.333562 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.344295 (+ 10733us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.474392 (+1130097us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b18003740e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:02:37.566098 (+ 91706us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:37.566154 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.566410 (+   256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.682762 (+116352us) raft_consensus.cc:1685] finished
0709 13:02:37.682799 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.683050 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64314,"raft.queue_time_us":70165,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8278,"spinlock_wait_cycles":113805696,"thread_start_us":91500,"threads_started":1,"wal-append.queue_time_us":1302241}
I20260709 13:02:37.684597 13166 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:37.673185 13014 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:37.685540 13014 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:37.672545 12992 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:37.692637  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 45199.1us
I20260709 13:02:37.693286  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:37.700197  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:37.701679 12992 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:37.710464  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.711251  8435 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
W20260709 13:02:37.714470 13164 consensus_meta.cc:287] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.002s
I20260709 13:02:37.714949 13164 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.718055  8504 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:37.719092  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:37.719606  8504 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:37.724505 13191 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.374s	user 0.000s	sys 0.002s
I20260709 13:02:37.726967  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:37.738173  8431 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:37.685957 13014 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.748726  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:37.754475  8476 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:37.752768  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 77004.1us
I20260709 13:02:37.755015  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:37.755816  8431 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.758083  8476 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:37.759352  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:37.760620  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.752482 13181 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:37.687849 13171 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:02:37.771824  8578 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:37.771824  8476 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:37.773396  8505 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:37.779915  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:37.777443  8506 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:37.786098 13056 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:37.786996 12960 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.787847  9099 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.752948 12992 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.754392 12891 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.798579  9099 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:37.796605  8476 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:37.797421  8431 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:02:37.758561 13178 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.800598  8577 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:02:37.802416  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 102253us
I20260709 13:02:37.804930  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:37.806736  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.806821  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.807650  8435 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:37.801051 12798 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:02:37.812495 12725 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:37.802537 13181 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:37.813151 12725 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.814416 13181 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.815424 12725 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:37.817137  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.775717 13193 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:37.818559 13193 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.819046 13193 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:37.822981 13011 consensus_meta.cc:287] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.006s
I20260709 13:02:37.823555 13011 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.825958  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.826706  8427 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:37.826649  9093 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:37.753998 13138 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:02:37.828121 13178 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.831328 13178 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:37.818089 13161 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:37.832054 13161 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.832466 13161 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:37.800195 13117 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:37.799101 13140 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:37.835028 13140 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:37.835584  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:37.836503  8581 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:37.836182 13140 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:37.764477 13037 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:02:37.840972  8508 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:37.841177  8504 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:37.846081  9097 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:02:37.852273  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 44628.8us
I20260709 13:02:37.838616 13164 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:37.854929  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:37.855805  9096 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:37.856612  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:37.857499 13167 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:37.859669  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:37.860198  8503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2103) took 1397 ms (client timeout 1688 ms). Trace:
I20260709 13:02:37.860867 13164 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:37.861186  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:37.865039  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:37.861402 13164 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:37.869385  8578 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:02:37.870194  8578 pending_rounds.cc:85] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 6
I20260709 13:02:37.852644  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:37.851686  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.870544  8578 pending_rounds.cc:107] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:02:37.870944  8578 raft_consensus.cc:2889] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:37.871208  8508 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:37.874732  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:37.860677  8503 rpcz_store.cc:269] 0709 13:02:36.462447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.462603 (+   156us) service_pool.cc:224] Handling call
0709 13:02:37.859975 (+1397372us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000d7ad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:37.860120 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310442752}
I20260709 13:02:37.880177  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.842983 13056 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:37.889822 13056 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:37.887642  8432 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:37.890913 13056 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:37.895120  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.895854  9100 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:37.851256 13011 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:37.898804  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.898592 13164 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:37.899425  9096 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:37.843627 12960 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.901235  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:37.901818  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:37.903786  8433 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:37.900106  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 47575.4us
I20260709 13:02:37.914770  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:37.918908  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 185339us
I20260709 13:02:37.917490  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:37.878485 13185 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:37.923882  9093 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:37.925727  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:37.922523  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.928073  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.928385  9098 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:37.926856  8426 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:37.883345 12944 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.929466  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2156) took 1550 ms. Trace:
W20260709 13:02:37.930449  9068 leader_election.cc:336] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.747s (SENT)
I20260709 13:02:37.929746  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:37.932231  9101 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:37.932938  8584 rpcz_store.cc:276] 0709 13:02:36.372718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.374942 (+  2224us) service_pool.cc:224] Handling call
0709 13:02:36.375243 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.484853 (+109610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.484896 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.491332 (+  6436us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.692324 (+200992us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:36.692425 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.341015 (+648590us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b48000b1558. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:02:37.923014 (+581999us) spinlock_profiling.cc:243] Waited 83.2 ms on lock 0x7b5400115b54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:37.923072 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.923120 (+    48us) raft_consensus.cc:1685] finished
0709 13:02:37.923134 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.923272 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":544,"raft.run_cpu_time_us":3661,"raft.run_wall_time_us":852237,"spinlock_wait_cycles":201877248,"thread_start_us":78884,"threads_started":1,"wal-append.queue_time_us":252593}
I20260709 13:02:37.935498 13171 raft_consensus.cc:2764] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:37.936825  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.913406 13130 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:37.939106  8429 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:37.936290  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:37.943286  9096 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:37.946955  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.933071  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:37.933629 13195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.016s	sys 0.024s
I20260709 13:02:37.963358  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:37.937763 13138 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:37.965616  9093 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:37.932456 13132 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:37.965682  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:37.972289  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.941174 12889 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.951509 13185 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:02:37.978189  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47777.1us
I20260709 13:02:37.964006  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:37.936175 13194 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:02:37.964788 13195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.017s	sys 0.025s
I20260709 13:02:37.969245  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:37.979614  9068 leader_election.cc:336] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.598s (SENT)
I20260709 13:02:37.979549  8505 raft_consensus.cc:2410] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:02:37.988163  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:37.988329  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:37.992980  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:38.002655  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:38.024389  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.970892 12969 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:38.044569  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 51677.9us
I20260709 13:02:38.052673  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.968863 13138 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:38.060770  8578 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:38.060976  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:38.064312  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:38.068112  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:38.061303  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 58745.7us
W20260709 13:02:38.056869  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.054500  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:37.977556 13167 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:37.974943 12960 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:38.106945  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 46028.5us
I20260709 13:02:38.107666  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:38.109138  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:38.109898  8430 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:38.109968  8575 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:02:38.106542  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:38.111975  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:38.112747  8583 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:38.068840  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:38.113242  8580 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:38.115312  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:38.047446 13011 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:38.059612 13189 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:37.987462 13132 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:38.046197 13178 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:38.116369  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:38.101281 13138 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.067301 13173 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:38.060134 12969 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:38.184962  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 79475.3us
W20260709 13:02:38.190817  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 82120.3us
I20260709 13:02:38.191887  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:38.172952 13011 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.200599  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:38.172493 13166 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.163046 13170 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:38.163930 13171 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.194366  9068 leader_election.cc:400] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:02:38.163321 12805 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:38.201269  8505 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:38.176574 13167 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.205987  9068 leader_election.cc:403] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:02:38.210513  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 149840us
I20260709 13:02:38.213850  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:38.188275 13173 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.185073 12960 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:38.193081 12969 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.214006  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:38.065194 13193 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.204082 13011 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.263331  8547 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:38.188458 12611 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:38.202477 13172 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.277729  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:38.260916 13154 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:02:38.282505  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 219422us
I20260709 13:02:38.283880  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:38.283385  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:38.284852  8584 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:38.325946  9096 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:38.327354  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:38.327991  9096 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.326241  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:38.328742  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 134813us
I20260709 13:02:38.333058  8505 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:38.330194  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:38.348245  9096 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
W20260709 13:02:38.369549  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45945.8us
W20260709 13:02:38.371992  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 159209us
I20260709 13:02:38.372360  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:38.377264  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47178.8us
I20260709 13:02:38.378373  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:38.272508 13170 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:38.388074  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:38.219996 13195 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:02:38.388974  9096 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:38.285356  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:38.373956  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:38.392423  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:38.393503  8426 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:38.217955 13014 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.395097  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:38.397161  9096 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
W20260709 13:02:38.371353 13203 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:02:38.401957  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:38.337476 13161 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.003s
I20260709 13:02:38.263093 12805 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.201086 13185 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.405561  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:38.417366  9096 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:38.262498 13173 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.370725 13166 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:38.220212 13037 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 13:02:38.333349 13178 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 7. Current term is 8.
I20260709 13:02:38.410599  8430 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:38.331368 12611 raft_consensus.cc:697] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:38.275473 12960 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.424015 13161 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.435011 13235 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.435556  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:38.443198  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:38.444186  8426 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:38.453850  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:38.455170  8426 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:38.466976 12992 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:38.467209 13193 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:38.467963 13224 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:02:38.468436 12992 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:38.468916 12992 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.469249 12992 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.470237 13173 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.472522 13173 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:38.473106 13173 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:38.473387  8506 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:38.474725  8506 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:38.476150 13216 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 13:02:38.477305  8431 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:38.480209 13055 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:38.481841  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:38.482941  8430 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:02:38.484104 13218 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
W20260709 13:02:38.485294  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.485699 13170 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.491923  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:38.412755 13189 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:02:38.495072  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.424674 13171 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:38.500428  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 166302us
I20260709 13:02:38.509330 13189 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.330842 13132 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.516463  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2513) took 1007 ms. Trace:
I20260709 13:02:38.446331 12849 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.517001  8509 rpcz_store.cc:276] 0709 13:02:37.509419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.509579 (+   160us) service_pool.cc:224] Handling call
0709 13:02:37.642299 (+132720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.651155 (+  8856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.516160 (+865005us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54001fe850. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:38.516378 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304418048}
I20260709 13:02:38.523219  8505 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
W20260709 13:02:38.549242  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 175390us
I20260709 13:02:38.552850  8432 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:38.544963  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:38.559363  8426 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.438877 13166 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.502344 13055 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:38.512184 13189 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:38.573302  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:38.577220  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:38.552383 13214 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.438s	user 0.000s	sys 0.001s
W20260709 13:02:38.550505 13221 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:02:38.551589 13195 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.551807 13140 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.594151  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:38.549801 13238 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:38.514606 13171 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:38.610567  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 232250us
I20260709 13:02:38.606957  9065 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:38.616004  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:38.618386  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.618525  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:38.585099 13237 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.585453 13236 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:38.628321  8426 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:38.629037  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:38.550963 12849 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.629616  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:38.638221  8582 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.597554 13239 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:38.646876  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:38.649500  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 72406.8us
I20260709 13:02:38.652299  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:38.655908  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:38.623108 13173 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:38.660302  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:38.644995 13219 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
W20260709 13:02:38.679174  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 187902us
I20260709 13:02:38.602782 13140 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.589946 13055 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:38.688632  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.012s	sys 0.016s
I20260709 13:02:38.602408 13195 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:38.666990 13120 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.074s	user 0.009s	sys 0.004s
W20260709 13:02:38.692065  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 408754us
I20260709 13:02:38.659010 13239 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.633239 12728 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:02:38.661726 13237 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:38.698949  9097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.009s	sys 0.021s
W20260709 13:02:38.711656  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 148195us
W20260709 13:02:38.689167  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.012s	sys 0.016s
W20260709 13:02:38.750788  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 644238us
I20260709 13:02:38.754338  8584 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:38.756317  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:38.757321  9097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.009s	sys 0.021s
I20260709 13:02:38.760102  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:38.693971 12805 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:38.703979  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:38.775305  8579 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 13:02:38.729151  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 76942.6us
I20260709 13:02:38.776010  8582 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:38.684984 13243 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:38.698711 13236 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:38.636303 12611 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:38.784348  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 75510.4us
I20260709 13:02:38.696552 13014 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:38.787362  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.789731  9102 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:38.789676  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:38.787962  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:38.793485  8506 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:38.788776  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 128577us
I20260709 13:02:38.797744  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:38.721189 13239 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.813895  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:38.814477  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2172) took 1189 ms. Trace:
I20260709 13:02:38.814627  9095 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.701278 13120 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.815012  8576 rpcz_store.cc:276] 0709 13:02:37.624842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.649520 (+ 24678us) service_pool.cc:224] Handling call
0709 13:02:37.649940 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.668428 (+ 18488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.668456 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.671514 (+  3058us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.968810 (+297296us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:37.968850 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.968918 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.814194 (+845276us) raft_consensus.cc:1685] finished
0709 13:02:38.814222 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.814404 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3288,"raft.queue_time_us":3445,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4505,"thread_start_us":215602,"threads_started":1,"wal-append.queue_time_us":487868}
I20260709 13:02:38.790113 13243 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:38.789165 13173 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:38.790280 13161 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:38.790350 12960 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:38.813244 13220 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
I20260709 13:02:38.837709  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:38.826048 13189 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.822329 13231 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:38.823570 13266 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:38.848399  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 55282us
I20260709 13:02:38.823621 13264 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:38.842941  8502 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:38.826511 13238 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:38.827641 13236 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:38.830684 13173 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:38.852659  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 65312.4us
I20260709 13:02:38.856307  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:38.830495 13243 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.804813 12992 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.820664 13164 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:02:38.871572  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:38.871840  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 941) took 1051 ms. Trace:
I20260709 13:02:38.872148  9098 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:38.872403  8435 rpcz_store.cc:276] 0709 13:02:37.820372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.821951 (+  1579us) service_pool.cc:224] Handling call
0709 13:02:37.822469 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.822873 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.822908 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.823529 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.968458 (+144929us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:37.968501 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.968573 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.871554 (+902981us) raft_consensus.cc:1685] finished
0709 13:02:38.871584 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.871769 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":144471,"threads_started":1,"wal-append.queue_time_us":339927}
I20260709 13:02:38.873847  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:38.875296  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.836315 12805 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:02:38.854175 13266 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:38.880625  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:38.854436 13264 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:38.853039 13166 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:38.884107  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:38.887773  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:38.893550  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:38.895336  8435 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.862669 13173 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.898222 13258 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:38.903038  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:38.903762  9098 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.873749 13171 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:38.908576 13254 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:02:38.909251 12992 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:38.909799 13253 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:02:38.910612  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:38.943656  8576 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:38.911974 13172 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.544s	user 0.013s	sys 0.000s
I20260709 13:02:38.914283 12709 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:38.915323 13238 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.918529  9098 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
W20260709 13:02:38.923146  8317 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 09de6eee9632412ebe0a904f65cd2a3c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0b9f7467deed4381835a85ffd0e88af6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:38.924265 13267 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:38.926461 12955 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:38.927661  8435 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
W20260709 13:02:38.930846 13226 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.542s	user 0.003s	sys 0.000s
I20260709 13:02:38.966962  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2525) took 1108 ms. Trace:
I20260709 13:02:38.859467 13231 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.958333 13172 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.854153 13189 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.895838 12849 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:38.900714 13164 consensus_queue.cc:1243] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:02:38.923177 13241 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:02:38.967423  8504 rpcz_store.cc:276] 0709 13:02:37.858333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.867541 (+  9208us) service_pool.cc:224] Handling call
0709 13:02:37.867987 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.879708 (+ 11721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.880017 (+   309us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.901277 (+ 21260us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.987627 (+ 86350us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:37.987664 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.987726 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.929423 (+941697us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:38.966629 (+ 37206us) raft_consensus.cc:1685] finished
0709 13:02:38.966652 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.966878 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14159,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":10288000,"thread_start_us":50864,"threads_started":1,"wal-append.queue_time_us":294338}
I20260709 13:02:38.876401 12960 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:02:38.896443 13264 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:38.982940 13138 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.788s	user 0.012s	sys 0.000s
I20260709 13:02:38.987121 13231 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:38.988521 13055 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:38.990226 13236 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:38.991166 13196 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:38.991833 13213 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.791s	user 0.001s	sys 0.002s
I20260709 13:02:38.992081 13120 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:38.968561 13140 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:39.009348  8576 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:38.980880 13254 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:39.022517 13254 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:39.023500 13254 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:39.010221 13260 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.159s	user 0.001s	sys 0.002s
I20260709 13:02:39.025012  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:39.067422  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:39.010865 13196 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:39.110492  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.110853  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 43579.2us
I20260709 13:02:39.112488  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:39.124248  8550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.001s	sys 0.009s
W20260709 13:02:39.124610  8550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.001s	sys 0.009s
I20260709 13:02:39.143102  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2143) took 1164 ms. Trace:
I20260709 13:02:39.060806 13172 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:39.067843 12709 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.110458 13269 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:39.150007  8577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.036s	sys 0.064s
I20260709 13:02:38.952642 13266 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.001147 13138 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.143697  8433 rpcz_store.cc:276] 0709 13:02:37.978572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.979945 (+  1373us) service_pool.cc:224] Handling call
0709 13:02:38.044595 (+ 64650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.193602 (+149007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.193634 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.206261 (+ 12627us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.493465 (+287204us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:38.493508 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.493579 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.142817 (+649238us) raft_consensus.cc:1685] finished
0709 13:02:39.142843 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.143026 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13419,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":2965,"thread_start_us":312227,"threads_started":2,"wal-append.queue_time_us":346341}
I20260709 13:02:39.161492  9095 raft_consensus.cc:2410] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:02:39.161904  8577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.037s	sys 0.064s
I20260709 13:02:39.123188 13128 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.159600 12709 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.165205 13259 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:39.166597  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:39.166903 12709 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:39.169694  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:39.170215  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:39.171130  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:39.172456  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:39.146335 13257 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:39.174281  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:39.175854  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 494747us
I20260709 13:02:39.177789  8435 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:39.157938 12611 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.162437 13237 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.186077  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:39.182421  8550 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:39.189283  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2520) took 1471 ms. Trace:
I20260709 13:02:39.169271 13172 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:39.175535 13266 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.187553 12611 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:39.201087  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.180594 13170 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.019s
I20260709 13:02:39.189821  8510 rpcz_store.cc:276] 0709 13:02:37.717359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.719631 (+  2272us) service_pool.cc:224] Handling call
0709 13:02:37.719969 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:37.720296 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.720331 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:37.720903 (+   572us) log.cc:844] Serialized 52 byte log entry
0709 13:02:37.936432 (+215529us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:37.936494 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.936969 (+   475us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.991001 (+1054032us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:39.179920 (+188919us) raft_consensus.cc:1685] finished
0709 13:02:39.179940 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.189185 (+  9245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26188,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":638,"spinlock_wait_cycles":127907712,"thread_start_us":211445,"threads_started":1,"wal-append.queue_time_us":345152}
I20260709 13:02:39.171795 13171 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:02:39.183638 13128 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.211295  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:39.213773  8433 raft_consensus.cc:2410] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:02:39.207119 13170 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.000s	sys 0.019s
I20260709 13:02:39.195204 13254 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:39.169023 13269 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:39.204108 12709 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:39.226473  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 425810us
I20260709 13:02:39.215799 13171 consensus_queue.cc:1243] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:02:39.242678  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 68498us
I20260709 13:02:39.258049  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:39.262040  8584 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:39.261906  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:39.262221  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:39.227849 13014 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:39.222160 13282 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:39.267665  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:39.226374 13189 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:39.271807  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:39.274880  9102 raft_consensus.cc:2410] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:02:39.259254 13257 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:39.292207  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:39.293553 13273 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:39.295076 13262 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:39.298270 13194 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:39.299482 13280 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:02:39.283601 13014 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:39.280521 13189 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:39.283905  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:39.276250 13161 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:02:39.284092 12889 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:39.343150  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 766) took 1290 ms. Trace:
W20260709 13:02:39.308475 13283 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:02:39.320741 13138 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:39.328748 13251 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:02:39.282768 13282 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.265836 13172 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.338069  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:39.199800 13196 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.321074 13257 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.356449  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:39.363538  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 159883us
I20260709 13:02:39.343653  8577 rpcz_store.cc:276] 0709 13:02:38.052890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.055088 (+  2198us) service_pool.cc:224] Handling call
0709 13:02:38.106367 (+ 51279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.433301 (+326934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.433448 (+   147us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.436010 (+  2562us) log.cc:844] Serialized 26 byte log entry
0709 13:02:39.163008 (+726998us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:39.163065 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.163152 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.342924 (+179772us) raft_consensus.cc:1685] finished
0709 13:02:39.342946 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.343089 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36476,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":59236,"thread_start_us":981050,"threads_started":2,"wal-append.queue_time_us":856797}
I20260709 13:02:39.316603 13000 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:39.365850  8432 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:39.361954  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 97766.9us
W20260709 13:02:39.357522 12969 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.074s	user 0.014s	sys 0.009s
W20260709 13:02:39.370369  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 86564.4us
I20260709 13:02:39.371133  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:39.372982  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:39.374140  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:39.375293  8582 pending_rounds.cc:85] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 8
I20260709 13:02:39.375773  8582 pending_rounds.cc:107] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:02:39.376068  8582 raft_consensus.cc:2889] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:39.377115  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:39.375319  8432 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:02:39.380757  8577 pending_rounds.cc:85] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 5
I20260709 13:02:39.381054  8577 pending_rounds.cc:107] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:39.381273  8577 raft_consensus.cc:2889] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:39.397758 13261 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.268s	user 0.000s	sys 0.002s
I20260709 13:02:39.376689 13161 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.399252 13269 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:39.400079  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:39.400585 13238 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.401115 13238 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.377341 12955 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:39.404573  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:39.417122  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45611.3us
W20260709 13:02:39.422240  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.423228 13269 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:39.425006 13238 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:39.425237  8550 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:39.370201 13000 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.426771  8550 leader_election.cc:400] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:02:39.427106  8550 leader_election.cc:403] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:39.427043 13290 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.428252 13000 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:39.428519 13238 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 6. Current term is 7.
I20260709 13:02:39.430456  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:39.431296 13238 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:39.433105  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:39.414844 12849 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:39.421813  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:39.386245 12889 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:39.435945  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:39.362875 13282 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:39.440580  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1168) took 1545 ms. Trace:
W20260709 13:02:39.437052 13056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.024s
W20260709 13:02:39.416306 13011 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.080s	user 0.014s	sys 0.001s
I20260709 13:02:39.450974  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:39.441270  9097 rpcz_store.cc:276] 0709 13:02:37.895036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.898126 (+  3090us) service_pool.cc:224] Handling call
0709 13:02:37.898480 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.898808 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.898838 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.899297 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.757845 (+858548us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:38.757907 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.758005 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.440302 (+682297us) raft_consensus.cc:1685] finished
0709 13:02:39.440333 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.440503 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3085,"spinlock_wait_cycles":4681984,"thread_start_us":858141,"threads_started":1,"wal-append.queue_time_us":1111713}
I20260709 13:02:39.381354 13120 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:02:39.418416 13265 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:39.372985 12969 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.435295 13238 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:39.484730 13238 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:39.447803 13243 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
W20260709 13:02:39.445394 13056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.001s	sys 0.024s
I20260709 13:02:39.443096 13244 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:39.459514 13281 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:39.472585 13161 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:39.476033 13282 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:39.418190 12709 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:02:39.482251 12728 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:39.442205 13000 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.484946 13289 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:02:39.381628 13272 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:02:39.486575 12820 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:39.453725 13290 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.491865  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:39.546561  8584 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:39.492719  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:39.465613 13265 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:39.510689  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:39.514168  8509 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:39.507416 13291 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:39.522863 13287 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
I20260709 13:02:39.455668 13011 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:39.523752  9099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1140) took 1983 ms (client timeout 1613 ms). Trace:
I20260709 13:02:39.507380 13170 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:39.502974 13238 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:39.548058  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:39.554853  9099 rpcz_store.cc:269] 0709 13:02:37.540076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.540265 (+   189us) service_pool.cc:224] Handling call
0709 13:02:39.523505 (+1983240us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400508054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:39.523646 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524258176}
I20260709 13:02:39.509159 13244 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:39.560540  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:39.549455 12820 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.567574 12820 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.552270 13265 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:39.552465 13142 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:39.569903 12820 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:39.574270 13142 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:39.574532 13282 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:39.570926  8427 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:39.575366 13282 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:39.575405 13142 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:39.577111 13142 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.579402  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:39.508219 13243 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.570406  8433 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:39.537933 13000 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.584575 13000 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:39.584930 13282 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:39.536748 12728 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:39.565402 13173 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.001s
W20260709 13:02:39.598994  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.599028  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:39.604892 13288 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:39.597122  9097 raft_consensus.cc:2376] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10. Re-sending same reply.
I20260709 13:02:39.563602 13295 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:39.534971  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 84122.2us
I20260709 13:02:39.571822 13244 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:39.611792 12805 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.623077  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:39.622758 12805 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.562345 13170 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.612465 13295 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.646173 13243 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:39.647552 13239 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.820s	user 0.012s	sys 0.000s
I20260709 13:02:39.615345 13173 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.613896  8550 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:39.724690  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:39.635316 13295 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.731942  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:39.790290  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 176502us
I20260709 13:02:39.792448  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:39.721052 13264 consensus_meta.cc:287] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.710s	user 0.015s	sys 0.001s
I20260709 13:02:39.822618 13173 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:39.795161 12820 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:39.845562  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.797430 13291 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.859127 12728 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:39.860127 13011 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:39.832211 13264 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.864593 13264 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:39.671458 13239 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.867245 13239 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:39.867687 12923 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:39.851889 12805 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:39.875985  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1179) took 1953 ms. Trace:
I20260709 13:02:39.876575  9096 rpcz_store.cc:276] 0709 13:02:37.922582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.428121 (+505539us) service_pool.cc:224] Handling call
0709 13:02:38.428509 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.444785 (+ 16276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.444830 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:38.444884 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:38.444928 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.875485 (+1430557us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b540063d3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:39.875555 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.875904 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36794624}
W20260709 13:02:39.850539  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 58185.6us
I20260709 13:02:39.882556  9095 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:39.881768  8550 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:39.887845  8578 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:39.830453 13172 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.912124  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:39.886348 13288 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.894349  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:39.912573  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:39.937184  8579 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:39.896812  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:39.798290 12709 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:39.939302  9098 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:39.911451 13264 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:39.949573 13264 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:39.950186 13264 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.885411  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:39.944729  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:39.952843  9102 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:39.943321 13172 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:39.750255 12969 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:39.963781  8582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.035s	sys 0.047s
W20260709 13:02:39.993538  8582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.035s	sys 0.047s
W20260709 13:02:39.942595 13184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.021s	sys 0.053s
W20260709 13:02:39.996956  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 111639us
I20260709 13:02:39.998618  8550 leader_election.cc:400] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12.
I20260709 13:02:39.999080  8550 leader_election.cc:403] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:40.000494  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:40.001101  9099 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.934398 12820 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.006639 13170 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.008641 13238 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:39.925139 13011 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:02:40.009927  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 959) took 2181 ms. Trace:
I20260709 13:02:39.951681 13288 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.013899  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2148) took 1621 ms. Trace:
I20260709 13:02:40.014511  8430 rpcz_store.cc:276] 0709 13:02:38.392214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.484842 (+ 92628us) service_pool.cc:224] Handling call
0709 13:02:38.485194 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.631281 (+146087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.631327 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:38.631384 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:38.631436 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.013563 (+1382127us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400125a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:40.013651 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.013822 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335415168}
I20260709 13:02:40.015821 13288 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.010640 13244 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.019284 13172 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.021100  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2146) took 1916 ms. Trace:
I20260709 13:02:40.021520  8427 rpcz_store.cc:276] 0709 13:02:38.104451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.477229 (+372778us) service_pool.cc:224] Handling call
0709 13:02:38.477564 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.575697 (+1098133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.020863 (+445166us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003f0054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:40.021036 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514012032}
I20260709 13:02:40.026810  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.027832 13244 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.028355  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1170) took 2115 ms. Trace:
W20260709 13:02:40.029136  9068 connection.cc:256] RPC call timeout handler was delayed by -1.0615353250000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 13:02:40.028941  9101 rpcz_store.cc:276] 0709 13:02:37.895705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.900891 (+  5186us) service_pool.cc:224] Handling call
0709 13:02:37.925585 (+ 24694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.934234 (+  8649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.011063 (+2076829us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b54000ebad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:40.011388 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14705024}
I20260709 13:02:40.030809  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:40.032344  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:40.033013  9097 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:40.033594 13238 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:40.011900 13184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.021s	sys 0.053s
I20260709 13:02:40.040990  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:40.041918  8434 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:40.012641  9095 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:40.012950 13254 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12.
I20260709 13:02:40.013375 12820 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:40.043680 13248 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.127s	user 0.002s	sys 0.000s
I20260709 13:02:40.045289  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 767) took 1992 ms. Trace:
I20260709 13:02:40.045497 12820 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.046301 13175 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.047039 13175 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.045727  8581 rpcz_store.cc:276] 0709 13:02:38.053210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.055181 (+  1971us) service_pool.cc:224] Handling call
0709 13:02:38.066444 (+ 11263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.219451 (+153007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.219511 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.263989 (+ 44478us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.604046 (+340057us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:38.604084 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.604172 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.037179 (+1433007us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:40.044958 (+  7779us) raft_consensus.cc:1685] finished
0709 13:02:40.044982 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.045226 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116079,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5749,"spinlock_wait_cycles":34033024,"thread_start_us":297400,"threads_started":2,"wal-append.queue_time_us":469534}
I20260709 13:02:40.060200 13267 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:40.060907 13267 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:40.010569  8502 rpcz_store.cc:276] 0709 13:02:37.828007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.828129 (+   122us) service_pool.cc:224] Handling call
0709 13:02:37.828452 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.851533 (+1023081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.009555 (+1158022us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003728d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:40.009809 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2332498688}
I20260709 13:02:40.064356  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.065382  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.066071  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.068173  8427 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:02:40.078823 12709 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:40.079681  8429 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:40.080055  8429 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:40.080775  8429 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.083421 12982 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.083998 12982 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.084913 12611 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.087028  8550 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.087399 13267 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.087900 13281 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:40.088472  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.088507 13267 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.091490 13262 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:40.103860  9099 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:40.107722  9102 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
W20260709 13:02:40.143196 13252 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.183s	user 0.013s	sys 0.000s
I20260709 13:02:40.145514  8579 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:40.147732 13170 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:40.148316 13170 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.097479  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:40.150341  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 56627.3us
W20260709 13:02:40.150727  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53346.6us
I20260709 13:02:40.151392  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.151718  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.152467  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.154819  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:40.155897  8427 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:40.161563 13271 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:40.162581 12805 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:40.163632 13173 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:40.165176  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:40.166976  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:40.167670  8433 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.170421  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:40.172065  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:40.158614  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:40.179493  8432 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:40.180877  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.191905  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.194308  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:40.195309  8435 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:40.196781  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:40.197680  8426 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:40.201396  8434 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:40.145161 13262 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.067317 13175 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.179989 13281 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:40.222550  8476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.026s	sys 0.024s
I20260709 13:02:40.190080 12805 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.226385  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:40.200508 13271 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.189749 13173 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:40.235855  8434 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:40.238328  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:40.224252 12849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.054s	sys 0.098s
I20260709 13:02:40.239265  8434 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:40.232296  8435 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:40.229570 13175 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:02:40.240458 12849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.054s	sys 0.098s
W20260709 13:02:40.225564 13083 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.019s	sys 0.028s
W20260709 13:02:40.230304  8476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.027s	sys 0.024s
I20260709 13:02:40.242674 13270 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.230926 13170 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.212491  8550 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.223376 13262 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.227605 13264 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.267676  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2131) took 2394 ms. Trace:
I20260709 13:02:40.268198  8431 rpcz_store.cc:276] 0709 13:02:37.873087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.873212 (+   125us) service_pool.cc:224] Handling call
0709 13:02:38.476952 (+603740us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.477861 (+   909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.267398 (+1789537us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b540023ad50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:40.267602 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387647232}
W20260709 13:02:40.270944  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.257033 13235 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.530s	user 0.056s	sys 0.113s
W20260709 13:02:40.274006  8584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.013s	sys 0.022s
W20260709 13:02:40.274518  8584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.013s	sys 0.022s
W20260709 13:02:40.266481 13083 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.019s	sys 0.029s
W20260709 13:02:40.267418 13265 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.000s
W20260709 13:02:40.259223 12955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.030s	sys 0.036s
I20260709 13:02:40.225590 13281 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.263399 12849 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:40.272320 13184 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:40.314250  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:40.235203  8433 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:40.281884  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:40.285719  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 73334.4us
I20260709 13:02:40.280752  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:40.259822 13194 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:40.260010 13258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.017s	sys 0.037s
I20260709 13:02:40.237600 13271 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.327237 13264 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.327742 13271 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.328279 13184 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:40.286574 12879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.008s	sys 0.027s
W20260709 13:02:40.329279 12879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.008s	sys 0.027s
I20260709 13:02:40.330816 13184 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.314250 12849 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.275920 12820 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:40.276223 12969 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.334919 12969 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.340978 13178 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.341540 13178 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:40.345697  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.346463  9094 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:40.346644  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:40.279246  8435 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:40.264106 13294 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.253794 13295 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.287133  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:40.318800  8503 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
W20260709 13:02:40.372494  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 85482.7us
I20260709 13:02:40.319893  8504 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:40.375728  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:40.319697  8502 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:40.287125  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:40.325631 13258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.017s	sys 0.038s
I20260709 13:02:40.267127 13037 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:40.276381 13235 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.547s	user 0.056s	sys 0.114s
I20260709 13:02:40.275914 13142 raft_consensus.cc:2764] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:40.366976  8433 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:40.313606 12955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.030s	sys 0.039s
W20260709 13:02:40.273291  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.025s	sys 0.076s
W20260709 13:02:40.430320  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.026s	sys 0.076s
W20260709 13:02:40.430698  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 991764us
I20260709 13:02:40.432180  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:40.368076  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:40.435719  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67777.8us
I20260709 13:02:40.436623  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:40.437793  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.440780  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:40.255541 12889 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.020s	sys 0.032s
W20260709 13:02:40.380154  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.380820  8503 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:40.386790  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:40.366422 13011 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.389638 12611 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:40.395818 13295 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.476980 13295 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:40.477655 13295 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.478128  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:40.479501  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:40.480275 13295 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.480850 13117 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:40.377530 13294 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.481711 13117 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.483587 13294 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.484263 13294 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:40.484745 13294 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:40.484848 13117 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.480319  9099 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
W20260709 13:02:40.430550 13257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.027s	sys 0.063s
W20260709 13:02:40.495226 13257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.028s	sys 0.063s
W20260709 13:02:40.497244  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 115724us
I20260709 13:02:40.498303 12820 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:40.498824 12820 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:40.498874 13271 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:40.499307 12820 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:40.499580 13271 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.500141 13271 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:40.502573 13263 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:40.502785  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 66265.3us
I20260709 13:02:40.503216 13263 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.504004 13264 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:40.407889  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:40.399052  8576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.081s	user 0.020s	sys 0.021s
W20260709 13:02:40.506924  8576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.189s	user 0.020s	sys 0.023s
I20260709 13:02:40.389181 12923 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.508823 12923 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.511135 12923 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.321370 13265 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.362329 13281 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.405011 13170 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.513484 13265 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.409348 12969 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.506469  9095 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:40.513631 13170 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.516659 13178 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.516772 13170 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.429879 12955 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:40.404592 13173 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.517867 13173 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.518321 12955 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.520567 13173 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.475136 13011 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.409420 13037 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.523176  9102 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:40.524492 13173 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.525627 13173 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.527290  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:40.528147  9101 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:40.528716 13173 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:40.457877 12889 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.021s	sys 0.032s
I20260709 13:02:40.481032 13295 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:40.371114 13194 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.498095  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:40.505900 13263 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:40.514432 12969 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.517010 12820 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.524618 13037 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.460114 13244 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:40.460569 12611 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:02:40.530844  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.530326 13267 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:40.535714  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:40.551430 13238 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:40.458048  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:40.398802 13172 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
W20260709 13:02:40.538481  8580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.021s	sys 0.036s
W20260709 13:02:40.536239  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.544862  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.553665  8433 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:40.551715 12709 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:02:40.557406  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:40.539487 13264 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:40.548557 12611 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.568496 12982 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:40.568922 13254 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:40.569332 13254 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.569689 13254 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.570271 13305 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:40.545210 13265 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.573864  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:40.563436  8580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.022s	sys 0.036s
W20260709 13:02:40.564706  9096 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.013s	sys 0.009s
I20260709 13:02:40.538163 13311 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:40.567162  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 109243us
W20260709 13:02:40.575439  9096 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.013s	sys 0.009s
I20260709 13:02:40.550400 13267 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.578429 12879 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:40.579119 13194 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.579317 12725 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.579947 13314 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:40.485862 13294 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.566711 13244 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:40.544742 12969 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.582093  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:40.597016 13184 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.615968  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:40.566910 13238 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:40.579949 13265 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.572234 13262 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.580873 13264 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:40.632797 13195 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.628094 12611 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.637961 13265 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.581251 13305 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:02:40.638974 12611 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.639213 13305 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:40.639797 13305 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:40.640216 13259 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.640797 13259 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.629891 13311 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:40.641260 13305 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.637095 13264 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.576154 13239 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:40.680706 13305 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:40.611132 13267 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.572060 13172 consensus_queue.cc:1243] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:40.683393  8507 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:02:40.704716  8507 pending_rounds.cc:85] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 6
I20260709 13:02:40.705128  8507 pending_rounds.cc:107] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:02:40.705446  8507 raft_consensus.cc:2889] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:40.684219  9095 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
W20260709 13:02:40.706517  8575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.007s	sys 0.028s
I20260709 13:02:40.625628  9096 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:40.612941 13281 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:40.682175 12820 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.618057 12725 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.709666 12725 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.710256 12725 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.710741 12725 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.712898 12725 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.712945 13254 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.717208 13267 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.677489 13196 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.642488 13311 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:40.629945 13256 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.748s	user 0.003s	sys 0.000s
I20260709 13:02:40.617338 13269 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:40.629545 13272 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:40.736083 13254 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:40.706905  8575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.007s	sys 0.028s
I20260709 13:02:40.753522 13272 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.710598 13244 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.756376 13272 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.758265 13271 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.760667 13271 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:40.762393  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 776) took 1180 ms. Trace:
I20260709 13:02:40.762912  8584 rpcz_store.cc:276] 0709 13:02:39.581639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.581813 (+   174us) service_pool.cc:224] Handling call
0709 13:02:39.582194 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.582615 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.582648 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.583190 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.275076 (+691886us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:40.275138 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.275237 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.762110 (+486873us) raft_consensus.cc:1685] finished
0709 13:02:40.762135 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.762323 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2133,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":691418,"threads_started":1,"wal-append.queue_time_us":1150063}
I20260709 13:02:40.683643 13184 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.766438 13290 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:40.767925 13184 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.768920 12969 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:40.771602 13311 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:40.773033 13311 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:40.751133 13269 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.774564 13269 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:40.718719 13281 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:40.778398 13281 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:40.796159  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.796849  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.800942  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.803984  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.805042  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.804550  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.806306  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.806900  8582 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:02:40.807307  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:40.807819  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:40.808122  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.808373  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.808761  8581 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:40.809456  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.807039 13314 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:40.807080  8579 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:40.807734  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.812122  8582 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:40.837646  8583 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:40.838867  8581 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:40.811215  8577 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:40.839470  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:40.848786  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:40.849625  8507 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:40.791150 13250 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.065s	user 0.021s	sys 0.054s
I20260709 13:02:40.855660  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:40.856714  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:40.856966  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:40.866535  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:40.839978 13314 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:40.852612 13250 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.126s	user 0.021s	sys 0.054s
I20260709 13:02:40.881142  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:40.885147  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:40.892593  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.006s	sys 0.022s
W20260709 13:02:40.899509  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.007s	sys 0.022s
W20260709 13:02:40.900051  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 712131us
I20260709 13:02:40.855089 13172 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.901789  8508 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:40.901834  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:40.938930  9097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.021s	sys 0.022s
W20260709 13:02:40.939571  9097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.021s	sys 0.022s
W20260709 13:02:40.941004  8432 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.026s	sys 0.046s
I20260709 13:02:40.941470  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:40.944775  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:40.884122 13181 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.947170  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:40.946220 13173 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:40.912459 13236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.008s	sys 0.021s
I20260709 13:02:40.948680  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:40.884030 13274 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:40.914455 13242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.114s	user 0.018s	sys 0.023s
I20260709 13:02:40.901079 13254 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.958118  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2120) took 2217 ms. Trace:
W20260709 13:02:40.960773  8430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.009s	sys 0.025s
W20260709 13:02:41.014424  8430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.009s	sys 0.025s
I20260709 13:02:40.962723  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:40.966850  8432 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.026s	sys 0.046s
W20260709 13:02:40.959477 13270 consensus_meta.cc:287] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.683s	user 0.016s	sys 0.005s
I20260709 13:02:40.973747  8503 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:40.946995 13271 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:41.020550  8427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.016s	sys 0.048s
W20260709 13:02:40.949679  8428 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.021s	sys 0.020s
I20260709 13:02:41.013697  8509 rpcz_store.cc:276] 0709 13:02:38.740294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.740473 (+   179us) service_pool.cc:224] Handling call
0709 13:02:38.740834 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.550755 (+809921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.957826 (+1407071us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54003c5d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:40.958059 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773098880}
I20260709 13:02:41.018572  8510 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:41.019250  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:41.022967  8428 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.022s	sys 0.021s
I20260709 13:02:40.901652 13238 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.035262 13254 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:40.943629 13172 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.040377 13172 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:41.025620 13270 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:40.949728 13170 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:02:41.046193 13170 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:41.046677 13170 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:41.047925 13254 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:41.020699 13242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.230s	user 0.018s	sys 0.023s
I20260709 13:02:40.965410 13314 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.058838 13314 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.059064  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:41.060297  8426 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
W20260709 13:02:41.009884 13236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.011s	sys 0.021s
I20260709 13:02:41.071105  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:41.007691 13173 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:41.021062  8427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.016s	sys 0.048s
I20260709 13:02:41.060526 12805 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:41.114749  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:41.115125  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:41.115587  8505 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:41.115731  8581 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:41.117837  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:41.124570  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.136535  8507 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:41.079831 13173 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.025293 13274 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:41.063479 13271 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:41.130899 13288 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.004s	sys 0.032s
I20260709 13:02:41.010820 13181 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.157836 13267 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:41.159962 13316 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.141s	user 0.003s	sys 0.000s
I20260709 13:02:41.164376 13011 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:41.109266 13259 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:41.169163 13175 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:41.169606 13274 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:41.172045 13239 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:41.174851  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:41.175685  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 779) took 1576 ms. Trace:
I20260709 13:02:41.138775 12982 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:41.164927 13170 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.201187  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:41.203709  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:41.258000  8580 rpcz_store.cc:276] 0709 13:02:39.599352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.599502 (+   150us) service_pool.cc:224] Handling call
0709 13:02:39.599833 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.604947 (+  5114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.604984 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.607123 (+  2139us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.574928 (+967805us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:40.574980 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.575139 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.175423 (+600284us) raft_consensus.cc:1685] finished
0709 13:02:41.175451 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.175617 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":606,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3899,"thread_start_us":967357,"threads_started":1,"wal-append.queue_time_us":1454024}
I20260709 13:02:41.262578  8504 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:41.114797 13270 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.229346  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.250131 13305 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
W20260709 13:02:41.180773  9094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1132) took 3819 ms (client timeout 1633 ms). Trace:
W20260709 13:02:41.249162  8434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.009s	sys 0.049s
W20260709 13:02:41.281111  8434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.009s	sys 0.049s
W20260709 13:02:41.280983  9094 rpcz_store.cc:269] 0709 13:02:37.361600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.361796 (+   196us) service_pool.cc:224] Handling call
0709 13:02:41.180600 (+3818804us) spinlock_profiling.cc:243] Waited 2.96 s on lock 0x7b54006685d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:41.180698 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6802305280}
I20260709 13:02:41.252115  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:41.257401  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 82645.5us
W20260709 13:02:41.284565  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.285681  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:41.179365 13288 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.004s	sys 0.033s
W20260709 13:02:41.251242  8431 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.013s	sys 0.035s
I20260709 13:02:41.201584 13263 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:41.249095 13164 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.289263  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:41.287007  8431 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.013s	sys 0.035s
W20260709 13:02:41.310616  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.015s	sys 0.032s
W20260709 13:02:41.347084  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.017s	sys 0.033s
I20260709 13:02:41.266855 13272 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:41.353062  8429 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:41.351784  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.010s	sys 0.042s
I20260709 13:02:41.178511 12805 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.180929 13269 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:41.383602  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.012s	sys 0.043s
W20260709 13:02:41.399215  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.0235e+06us
W20260709 13:02:41.335559 13083 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.029s	sys 0.021s
I20260709 13:02:41.346915  8435 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:41.310324 13267 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:41.410951  8399 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.005s	sys 0.050s
I20260709 13:02:41.349197 13170 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.414779  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:41.420285  8580 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:41.261817 13175 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:41.286927 13292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.014s	sys 0.035s
W20260709 13:02:41.411545  8399 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.006s	sys 0.050s
W20260709 13:02:41.382615 13246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.019s	sys 0.027s
I20260709 13:02:41.295351 13274 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.422564  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:41.380656 13272 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.299849 13263 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:02:41.408711 13083 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.030s	sys 0.022s
I20260709 13:02:41.296303 13290 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:02:41.280357 13270 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.382323 13259 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:41.427198  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:41.348124 13164 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.435094  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:41.411830 12849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.017s	sys 0.029s
I20260709 13:02:41.345821 13242 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:02:41.434499 13255 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:41.455346  8429 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:41.493602  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2142) took 3527 ms. Trace:
I20260709 13:02:41.494066  8429 rpcz_store.cc:276] 0709 13:02:37.966490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.966616 (+   126us) service_pool.cc:224] Handling call
0709 13:02:37.980928 (+ 14312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.079581 (+2098653us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b5400440320. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b6dc0 00007f1a193411c0 00007f1a19342231 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c
0709 13:02:41.352653 (+1273072us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b580064dfd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1929b0aa 00007f1a1931d447 00007f1a19335fe7 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4
0709 13:02:41.493298 (+140645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.493533 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1663103744}
W20260709 13:02:41.438527 13000 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.018s	sys 0.030s
W20260709 13:02:41.437717 13292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.014s	sys 0.038s
I20260709 13:02:41.509004  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:41.482826  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:41.434682  8583 raft_consensus.cc:2410] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:02:41.484290  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:41.510849  8435 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:41.486351  8581 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:41.487517  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:41.511860  8584 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:41.434741 13267 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.433670  8580 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:41.441210 13272 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:41.476217  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:41.475980 13011 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:41.485733 13140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.004s	sys 0.047s
I20260709 13:02:41.520099  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:41.521498  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:41.522416  8429 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:41.523636  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:41.524623  8429 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:41.448905 13235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.018s	sys 0.035s
I20260709 13:02:41.506004 13128 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.509725  8398 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.613s (SENT) [suppressed 42 similar messages]
W20260709 13:02:41.435174 13246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.019s	sys 0.028s
W20260709 13:02:41.545310 13235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.018s	sys 0.035s
I20260709 13:02:41.514253  8582 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:41.486714 12849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.017s	sys 0.029s
I20260709 13:02:41.545356  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:41.549892 13323 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:41.550557 13323 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.516655  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:41.541937  8435 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:41.518913  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:41.555341  8581 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:41.556717  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:41.505829 12889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.015s	sys 0.033s
W20260709 13:02:41.558501 12889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.015s	sys 0.033s
I20260709 13:02:41.559386 13304 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:41.559800 13304 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.560249 13304 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.515925 13255 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:41.506107 13000 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.018s	sys 0.030s
I20260709 13:02:41.545791 13291 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:41.553188 13323 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:02:41.530592  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:41.563616  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:41.495213 13185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.720s	user 0.010s	sys 0.030s
I20260709 13:02:41.437852 13274 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:41.427589 13325 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:02:41.568635  9102 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:41.569469  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:41.491554 13259 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:41.572211 13318 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
W20260709 13:02:41.559692 13326 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:02:41.573033  8433 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.000s	sys 0.024s
W20260709 13:02:41.574003  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 43511.1us
I20260709 13:02:41.574244  8435 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:41.562845 13255 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:41.528873  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:41.564875 13327 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:41.566540 13140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.005s	sys 0.048s
I20260709 13:02:41.602613  9102 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:02:41.570757  9099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.010s	sys 0.014s
I20260709 13:02:41.571870 13282 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.581489 13185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.853s	user 0.010s	sys 0.031s
W20260709 13:02:41.605758  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.564045 13011 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:41.610575  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:41.572919 13311 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:02:41.526963 13267 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:41.654763  8582 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:02:41.650322 13132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.753s	user 0.019s	sys 0.041s
W20260709 13:02:41.658663 13132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.762s	user 0.019s	sys 0.041s
I20260709 13:02:41.661950  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:41.664868 13322 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:02:41.607513 13181 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:41.667068  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2144) took 3685 ms. Trace:
I20260709 13:02:41.667603  8428 rpcz_store.cc:276] 0709 13:02:37.981618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.981870 (+   252us) service_pool.cc:224] Handling call
0709 13:02:38.059025 (+ 77155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.059434 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:39.297610 (+1238176us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b48002f0358. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:02:40.208123 (+910513us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b18003125e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf
0709 13:02:40.208338 (+   215us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.062804 (+854466us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.075400 (+ 12596us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.075600 (+   200us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:41.075653 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.075763 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.666777 (+591014us) raft_consensus.cc:1685] finished
0709 13:02:41.666806 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.666988 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59590,"prepare.queue_time_us":356662,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4246,"raft.queue_time_us":1294,"raft.run_cpu_time_us":3241,"raft.run_wall_time_us":1234054,"spinlock_wait_cycles":87109248,"thread_start_us":1034394,"threads_started":2,"wal-append.queue_time_us":1217557}
I20260709 13:02:41.605106  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:41.624854  9099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.010s	sys 0.015s
I20260709 13:02:41.581251  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:41.722361  8429 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.721843  9093 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:41.615603  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:41.602484  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:41.670617 13308 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:02:41.663725  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:41.610258  8433 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.000s	sys 0.025s
I20260709 13:02:41.687579 13274 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:41.567251 13263 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:41.693022 13281 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.848s	user 0.007s	sys 0.003s
I20260709 13:02:41.609479 13271 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:41.651188 13282 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.648939 13257 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:41.643942 13327 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:41.576707 13291 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.707017  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2448) took 1772 ms. Trace:
I20260709 13:02:41.718412  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:41.750486  9094 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:41.731333  9097 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
W20260709 13:02:41.757221  8474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.176s	user 0.010s	sys 0.018s
W20260709 13:02:41.775941  8474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.010s	sys 0.018s
I20260709 13:02:41.759214  8429 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:41.701526 13259 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:41.705363 13269 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:41.708138 13270 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:41.771581  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:41.706216 13175 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:41.775044  8581 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:41.704720 13011 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:41.773209  8575 rpcz_store.cc:276] 0709 13:02:39.934806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.935001 (+   195us) service_pool.cc:224] Handling call
0709 13:02:39.961597 (+ 26596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.961815 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.961844 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.966638 (+  4794us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.752455 (+785817us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:40.752513 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.752608 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.706760 (+954152us) raft_consensus.cc:1685] finished
0709 13:02:41.706788 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.706947 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23296,"thread_start_us":785283,"threads_started":1,"wal-append.queue_time_us":1261579}
I20260709 13:02:41.725852 13328 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:41.783463  8549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.016s	sys 0.042s
W20260709 13:02:41.798131  8549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.172s	user 0.016s	sys 0.042s
W20260709 13:02:41.798621  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 1.17238e+06us
I20260709 13:02:41.799379 13140 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.799921 13140 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.801079  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:41.784171  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:41.788378 13173 consensus_meta.cc:287] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
W20260709 13:02:41.782131 13276 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.035s	sys 0.024s
I20260709 13:02:41.792943 13267 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:41.577986 13128 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:41.770128 13257 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.770267 13263 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:41.752866 13244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.022s	sys 0.037s
I20260709 13:02:41.804648  8504 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:41.719404 12955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.019s	sys 0.050s
I20260709 13:02:41.806866  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:41.807696  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:41.808434  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:41.809217  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:41.809993  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:41.810797  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:41.840415  8508 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:02:41.820158  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:41.812971  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.229s	user 0.018s	sys 0.034s
I20260709 13:02:41.811707 13196 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:41.842394 13196 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:41.843551 13196 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.845247 13196 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:41.846400  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.263s	user 0.019s	sys 0.034s
W20260709 13:02:41.846966  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 1.26924e+06us
I20260709 13:02:41.856963  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:41.885998  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:41.886973  8508 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:41.795233 13259 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.802940 13276 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.036s	sys 0.024s
I20260709 13:02:41.764503 13281 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.863811  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:41.899931  8428 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:41.902347  8476 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:41.903350 13117 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:41.903728 13117 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.904070 13117 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:41.828787  8430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.018s	sys 0.007s
W20260709 13:02:41.905242  8430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.019s	sys 0.008s
W20260709 13:02:41.866243 13250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.027s	sys 0.030s
I20260709 13:02:41.802002 13140 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:41.868418  8432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.011s	sys 0.019s
W20260709 13:02:41.837294 12955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.020s	sys 0.050s
W20260709 13:02:41.838078 13244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.025s	sys 0.037s
I20260709 13:02:41.832386 13257 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:41.840466 13264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.005s	sys 0.022s
W20260709 13:02:41.840715 13238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.016s	sys 0.012s
W20260709 13:02:41.838354 13294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.002s	sys 0.014s
I20260709 13:02:41.830715 13328 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:41.883427  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:41.802706 13173 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:41.879797 13130 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:02:41.907037  8432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.011s	sys 0.019s
W20260709 13:02:41.917682 13250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.027s	sys 0.031s
I20260709 13:02:41.879685 13333 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:41.919726  8435 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:42.006700  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2163) took 1437 ms. Trace:
I20260709 13:02:42.007071  8435 rpcz_store.cc:276] 0709 13:02:40.569525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.919185 (+1349660us) service_pool.cc:224] Handling call
0709 13:02:41.919550 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.006431 (+ 86881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.006644 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:41.921973  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:41.922433  8584 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:42.010792 13239 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:41.921288  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:42.011270 13239 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:42.011551  8583 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.012217 13239 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.013473 13239 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.921682  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:42.014341  8577 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:42.015221  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:41.896564 13267 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.015960 13130 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.016034 13267 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.016564 13130 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:41.890347 13305 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:41.892195 13164 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:41.896876 13269 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:41.986939  8575 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:42.019289 13281 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:42.019178 13269 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:42.019917  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:42.020177 12805 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:42.020416 13282 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:42.021106  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:42.021289 13269 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:42.021623 13291 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:41.980655  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.021754  8575 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
W20260709 13:02:42.022512 13336 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:02:42.023166  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:41.899259 13259 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.011294  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:41.988108  8426 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.028s	sys 0.037s
I20260709 13:02:41.986732  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:42.026950  8426 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.028s	sys 0.037s
W20260709 13:02:41.970468 13238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.017s	sys 0.013s
W20260709 13:02:41.987879 13294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.002s	sys 0.014s
I20260709 13:02:41.906307  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2321) took 1750 ms. Trace:
W20260709 13:02:41.992134  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 108797us
W20260709 13:02:41.962639 13264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.005s	sys 0.022s
I20260709 13:02:42.052179  8581 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:41.998180 13328 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:41.999621 13173 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:41.986305 13330 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:02:42.000331  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1330) took 1383 ms. Trace:
I20260709 13:02:42.027977 13271 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:42.000857 13337 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:02:41.990185 13308 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:02:42.001442  8505 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:42.001331  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.002360  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.002985  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.003720  8506 raft_consensus.cc:1217] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Deduplicated request from leader. Original: 9.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:02:42.072744  8506 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:42.005434  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.073691  8509 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
W20260709 13:02:42.030407  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.971397  8578 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:02:41.990733 13314 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.920s	user 0.013s	sys 0.000s
I20260709 13:02:42.035666  8430 rpcz_store.cc:276] 0709 13:02:40.155728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.173118 (+ 17390us) service_pool.cc:224] Handling call
0709 13:02:40.173420 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.178516 (+  5096us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:41.015901 (+837385us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.905941 (+890040us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:41.905992 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:41.906072 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.906136 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.906253 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1296837,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":110041,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"thread_start_us":1725713,"threads_started":2}
W20260709 13:02:42.042371 13329 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
W20260709 13:02:42.070716 13272 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 13:02:42.066469 13271 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:42.058373  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.016s	sys 0.029s
W20260709 13:02:42.122869  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.016s	sys 0.029s
W20260709 13:02:42.123277  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 982423us
I20260709 13:02:42.124660  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:42.059903  9099 rpcz_store.cc:276] 0709 13:02:40.617588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.617742 (+   154us) service_pool.cc:224] Handling call
0709 13:02:40.640932 (+ 23190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:40.641379 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.641417 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:40.641968 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.727180 (+1085212us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:41.727240 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.727330 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.000039 (+272709us) raft_consensus.cc:1685] finished
0709 13:02:42.000066 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.000227 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2966,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4971,"thread_start_us":1079644,"threads_started":1,"wal-append.queue_time_us":1356354}
I20260709 13:02:42.000531  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:42.049777  8583 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:02:42.062981 13128 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:42.063059 13259 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:42.064498 13257 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:42.039287 12805 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:42.068207  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.021s	sys 0.024s
W20260709 13:02:42.136858  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.021s	sys 0.025s
I20260709 13:02:42.137243  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 786) took 1319 ms. Trace:
I20260709 13:02:42.068275  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:42.138468  8581 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:42.138780  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:42.112473  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.114518 13130 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:42.142231  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.116626  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.143700  8501 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:02:42.056306 12709 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:02:42.118801  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.146899  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.061102 13267 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:42.128612  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:42.156242  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.156869  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:42.157197  9068 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:42.093851  8507 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:42.137746  8578 rpcz_store.cc:276] 0709 13:02:40.804209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.804328 (+   119us) service_pool.cc:224] Handling call
0709 13:02:42.123416 (+1319088us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000aaad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:42.123608 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2678509312}
I20260709 13:02:42.158612  8429 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:42.119570  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.157970  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:42.162415  8509 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:42.120337 13314 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.109815 13173 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:42.134348 13271 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.141018 13345 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.156091  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2436) took 2880 ms. Trace:
I20260709 13:02:42.198166  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.205291  8509 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:42.141306 13321 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:42.208870  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:42.210177  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53039.6us
I20260709 13:02:42.211277  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:42.205076  8576 rpcz_store.cc:276] 0709 13:02:39.260763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.260912 (+   149us) service_pool.cc:224] Handling call
0709 13:02:39.261383 (+   471us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:39.316934 (+ 55551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.316978 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:39.317742 (+   764us) log.cc:844] Serialized 78 byte log entry
0709 13:02:40.507323 (+1189581us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:40.507615 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.507926 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.508076 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.154123 (+646047us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b5400155754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:41.154195 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.140964 (+986769us) raft_consensus.cc:1685] finished
0709 13:02:42.141001 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.141206 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178712,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":7932,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":209,"spinlock_wait_cycles":114181376,"thread_start_us":1188976,"threads_started":1,"wal-append.queue_time_us":2069590}
I20260709 13:02:42.153699  8577 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
W20260709 13:02:42.192538  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.154624  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:42.199407  8581 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:42.167551  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:42.202682  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2173) took 1026 ms. Trace:
I20260709 13:02:42.214350  8578 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:42.214579  8429 rpcz_store.cc:276] 0709 13:02:41.176452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.201041 (+1024589us) service_pool.cc:224] Handling call
0709 13:02:42.201913 (+   872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.202265 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.202301 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.202358 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:42.202400 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.202470 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.202613 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.217132  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.218986  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.219563  8509 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:42.220614  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.221277  8509 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:42.224052  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69549.9us
I20260709 13:02:42.139639  8583 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:42.203564  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.141762 13175 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.222007  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.228055  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.229331  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:42.227265  8507 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:42.239130  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.238919 13175 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.239745  8502 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:42.239995  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.240486  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2174) took 1016 ms. Trace:
I20260709 13:02:42.241047  8502 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:42.241966 13244 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.240846  8429 rpcz_store.cc:276] 0709 13:02:41.202187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.216099 (+1013912us) service_pool.cc:224] Handling call
0709 13:02:42.216478 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.216700 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.216737 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.216781 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:42.216822 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.218469 (+  1647us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.218585 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.242661 12849 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:42.160166 13327 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:42.245899 13244 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.246354 13244 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.246716 13244 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.167759 13270 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.249172 13270 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.249512 13270 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.167398 13181 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:42.251122 13181 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.251837 13257 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:42.167582 13185 consensus_queue.cc:1059] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:02:42.260383  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.120967 13272 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.159093 13254 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:42.258728  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:42.218568 13170 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.000s
I20260709 13:02:42.208801 13321 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.157922 12805 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:42.260648 13288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.007s	sys 0.019s
I20260709 13:02:42.239759 12982 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.218153 13345 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:42.208861 13314 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:42.266220 13172 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.009s	sys 0.050s
I20260709 13:02:42.275375 13305 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:42.289273  8434 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.007s	sys 0.044s
W20260709 13:02:42.303556  8434 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.007s	sys 0.044s
I20260709 13:02:42.273680  8577 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:42.307987  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2324) took 2151 ms. Trace:
I20260709 13:02:42.207226 13173 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.264683  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:42.310797  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46227us
I20260709 13:02:42.311784  8577 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:42.312485  8427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.016s	sys 0.045s
W20260709 13:02:42.312645  8431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.016s	sys 0.027s
W20260709 13:02:42.312836  8427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.016s	sys 0.045s
W20260709 13:02:42.313072  8431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.016s	sys 0.027s
W20260709 13:02:42.315726  8398 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.002s	sys 0.018s
W20260709 13:02:42.316483  8398 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.002s	sys 0.018s
W20260709 13:02:42.316951  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 807172us
I20260709 13:02:42.318694  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:42.330955  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:42.331836  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:42.334005  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:42.334702  8547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.011s	sys 0.010s
W20260709 13:02:42.335084  8547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.011s	sys 0.010s
W20260709 13:02:42.302202 13172 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.010s	sys 0.051s
W20260709 13:02:42.368358  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.287251 13288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.007s	sys 0.019s
I20260709 13:02:42.288604 13170 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.388441  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:42.388973  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 58095.1us
I20260709 13:02:42.393379  8550 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:42.384305  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:42.287823 13321 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:42.384965  8399 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.004s	sys 0.025s
W20260709 13:02:42.395282  8399 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.004s	sys 0.025s
I20260709 13:02:42.399916  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.402679  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.403652  8504 raft_consensus.cc:2410] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:42.307789 13333 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:42.403779  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.364043 12982 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:42.424332  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.425259  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:42.365753 13235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.016s	sys 0.007s
I20260709 13:02:42.432489  8502 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 16 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:02:42.433758 13359 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:42.434046 13343 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:02:42.434273 13235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.016s	sys 0.008s
I20260709 13:02:42.434425 13359 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.276634 13254 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:42.432862  8333 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32800 (request call id 245) took 31475 ms (client timeout 15000 ms). Trace:
W20260709 13:02:42.456549  8582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.006s	sys 0.019s
I20260709 13:02:42.395581 13264 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:42.398729 13170 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:42.408314 13304 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.848s	user 0.006s	sys 0.006s
W20260709 13:02:42.428102 13330 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:42.395650 13181 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:42.385363 13350 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:42.403131 13172 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:42.404474 13238 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:42.456964  8582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.006s	sys 0.019s
I20260709 13:02:42.466629  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.430371 13140 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:42.395380 12849 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
W20260709 13:02:42.458513 13000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.012s	sys 0.014s
I20260709 13:02:42.438494 12982 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:42.489126  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:42.472182  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:42.472661  8579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.003s	sys 0.022s
I20260709 13:02:42.489778  8501 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:42.490371  8579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.004s	sys 0.023s
I20260709 13:02:42.458244 13288 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:42.504628  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.467417 13170 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.465431 13175 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:42.513654  8398 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:42.478248 13294 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.485348 13140 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.516963  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:42.515317  8433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.008s	sys 0.017s
W20260709 13:02:42.516304  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.023s	sys 0.033s
W20260709 13:02:42.517750  8433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.008s	sys 0.018s
I20260709 13:02:42.428828 13333 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.503808 13238 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:42.488806 13172 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:02:42.529719 12889 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.013s	sys 0.018s
W20260709 13:02:42.515224 13292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.003s	sys 0.018s
W20260709 13:02:42.516742 13083 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.000s	sys 0.025s
I20260709 13:02:42.519933 13164 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:42.502668 12982 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.523654  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2156) took 1964 ms. Trace:
W20260709 13:02:42.517923  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.023s	sys 0.033s
I20260709 13:02:42.487341 13350 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:42.527328 13327 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:42.515120 13255 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.000s	sys 0.020s
I20260709 13:02:42.504807  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:42.543599  8401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.013s	sys 0.011s
I20260709 13:02:42.512375 13128 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:42.544090  8432 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.005s	sys 0.010s
I20260709 13:02:42.470158 13304 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:42.539359 13276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.006s	sys 0.004s
I20260709 13:02:42.482301 13335 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:42.552793  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.523527 13140 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:42.558233  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:42.646818  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.550091 13311 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.013s	sys 0.013s
W20260709 13:02:42.742566  8426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.020s	sys 0.008s
W20260709 13:02:42.745054  8426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.020s	sys 0.008s
W20260709 13:02:42.683655 13255 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.000s	sys 0.020s
I20260709 13:02:42.676713 13271 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.510756 13235 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.661227  8433 rpcz_store.cc:276] 0709 13:02:40.559769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.563023 (+  3254us) service_pool.cc:224] Handling call
0709 13:02:40.580765 (+ 17742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.581014 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:41.749369 (+1168355us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.523293 (+773924us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.523356 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:42.523403 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.523467 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.523598 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1027994,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"thread_start_us":1908146,"threads_started":2}
W20260709 13:02:42.757640  8435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.034s	sys 0.029s
W20260709 13:02:42.541083 12889 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.014s	sys 0.018s
W20260709 13:02:42.683832  8401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.013s	sys 0.012s
I20260709 13:02:42.529034 13294 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:42.554085 13292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.003s	sys 0.018s
W20260709 13:02:42.684101  8432 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.006s	sys 0.010s
W20260709 13:02:42.684110  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 179415us
W20260709 13:02:42.488457 13000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.012s	sys 0.014s
I20260709 13:02:42.513037 13288 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.538734 13175 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:42.439278  8333 rpcz_store.cc:269] 0709 13:02:10.923644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.927766 (+  4122us) service_pool.cc:224] Handling call
0709 13:02:42.399330 (+31471564us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:37.251236 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:37.252038 (+   802us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:37.252101 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:02:37.252141 (+    40us) tablet.cc:662] Decoding operations
0709 13:02:37.253591 (+  1450us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:37.253698 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:37.253734 (+    36us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:02:37.578076 (+324342us) tablet.cc:701] Row locks acquired
0709 13:02:37.591789 (+ 13713us) write_op.cc:260] PREPARE: finished
0709 13:02:37.614221 (+ 22432us) write_op.cc:270] Start()
0709 13:02:37.614366 (+   145us) write_op.cc:276] Timestamp: P: 1783602157614148 usec, L: 0
0709 13:02:37.614403 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:02:37.615110 (+   707us) log.cc:844] Serialized 4710 byte log entry
0709 13:02:38.190968 (+575858us) op_driver.cc:464] REPLICATION: finished
0709 13:02:38.840933 (+649965us) write_op.cc:301] APPLY: starting
0709 13:02:38.849741 (+  8808us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:39.523516 (+673775us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:39.523649 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:39.590667 (+ 67018us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933c32a 00007f1a192c1f14 00007f1a192c1ec3 00007f1a192c1e38 00007f1a192c1df3 00007f1a192c10dc 00007f1a192eae16 00007f1a192d2cbb 00007f1a192bd39d 00007f1a192c0d75
0709 13:02:40.343518 (+752851us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:40.343920 (+   402us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:02:40.343993 (+    73us) write_op.cc:312] APPLY: finished
0709 13:02:40.388538 (+ 44545us) log.cc:844] Serialized 113 byte log entry
0709 13:02:41.545678 (+1157140us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:41.548861 (+  3183us) write_op.cc:454] Released schema lock
0709 13:02:41.548947 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:41.549370 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:41.549399 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":423,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":635639,"apply.run_cpu_time_us":77389,"apply.run_wall_time_us":2708421,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":232440,"prepare.run_cpu_time_us":15831,"prepare.run_wall_time_us":447527,"raft.queue_time_us":206330,"raft.run_cpu_time_us":33892,"raft.run_wall_time_us":1532237,"replication_time_us":548728,"spinlock_wait_cycles":87689088,"thread_start_us":1723463,"threads_started":5,"wal-append.queue_time_us":1571978,"wal-append.run_cpu_time_us":35373,"wal-append.run_wall_time_us":1187553}]]}
I20260709 13:02:42.693795 13304 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:42.663293  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 1.00525e+06us
I20260709 13:02:42.775884  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:42.717504  8503 raft_consensus.cc:2368] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14.
I20260709 13:02:42.734766  8504 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:42.737769  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:42.778635  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:42.779871  8581 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:42.778398  8428 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.005s	sys 0.026s
I20260709 13:02:42.738696 13367 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:42.747323  8430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.016s	sys 0.012s
I20260709 13:02:42.549026 13346 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.175s
I20260709 13:02:42.671713  8501 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
W20260709 13:02:42.758116  8435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.034s	sys 0.029s
W20260709 13:02:42.724736 13276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.006s	sys 0.008s
W20260709 13:02:42.554250 13083 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.000s	sys 0.025s
W20260709 13:02:42.763038  8580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.004s	sys 0.026s
W20260709 13:02:42.821758  8580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.004s	sys 0.026s
I20260709 13:02:42.694432 13128 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:42.822588 13356 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 13:02:42.822700 13128 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:42.824306 13357 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.314s	user 0.000s	sys 0.000s
I20260709 13:02:42.696822 12805 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:42.738883 13311 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.013s	sys 0.014s
W20260709 13:02:42.751586 13117 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.847s	user 0.011s	sys 0.002s
W20260709 13:02:42.830399  9065 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.014s	sys 0.038s
I20260709 13:02:42.717005 13314 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:42.718231 13130 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:42.749118 13359 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:42.783944  8430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.017s	sys 0.012s
W20260709 13:02:42.753491  8508 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.014s	sys 0.015s
W20260709 13:02:42.838248  8508 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.014s	sys 0.015s
I20260709 13:02:42.785336  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:42.779481 13379 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:42.838306  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:42.782109  8428 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.005s	sys 0.026s
I20260709 13:02:42.840518  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2162) took 2271 ms. Trace:
W20260709 13:02:42.777367 13250 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.030s	sys 0.036s
I20260709 13:02:42.790377  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:42.791314  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:42.793821 13282 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.795207  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2164) took 2225 ms. Trace:
I20260709 13:02:42.798132 13350 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.799814 13254 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:42.800642 13355 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 13:02:42.773387 13172 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.821550  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2325) took 2664 ms. Trace:
I20260709 13:02:42.771922  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:42.717638 13272 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:42.874369  8431 rpcz_store.cc:276] 0709 13:02:40.157001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.269483 (+112482us) service_pool.cc:224] Handling call
0709 13:02:40.269931 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.396044 (+1126113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.396096 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.414729 (+ 18633us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.313617 (+898888us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:42.437580 (+123963us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.463998 (+ 26418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.464070 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.821201 (+357131us) raft_consensus.cc:1685] finished
0709 13:02:42.821238 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.821461 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132040,"prepare.queue_time_us":121168,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":71393,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":23715,"spinlock_wait_cycles":19437824,"thread_start_us":1884975,"threads_started":2,"wal-append.queue_time_us":1321673}
W20260709 13:02:42.843924 13250 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.030s	sys 0.036s
I20260709 13:02:42.885499  8506 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:42.786749 12889 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
W20260709 13:02:42.844463  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54192.6us
W20260709 13:02:42.861477  8584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.016s	sys 0.028s
W20260709 13:02:42.891588  8584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.016s	sys 0.028s
I20260709 13:02:42.891841  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:42.892320  8510 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.002s	sys 0.044s
W20260709 13:02:42.892704  8510 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.002s	sys 0.044s
I20260709 13:02:42.846644 13379 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:42.788142 13292 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
W20260709 13:02:42.826778 13353 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
I20260709 13:02:42.840987  8428 rpcz_store.cc:276] 0709 13:02:40.569278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.923753 (+1354475us) service_pool.cc:224] Handling call
0709 13:02:41.924047 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.924234 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:41.987802 (+ 63568us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.840098 (+852296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.840165 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:42.840236 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.840302 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.840449 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65091,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"thread_start_us":851948,"threads_started":1}
I20260709 13:02:42.906560  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:42.861896  8435 rpcz_store.cc:276] 0709 13:02:40.569758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.007958 (+1438200us) service_pool.cc:224] Handling call
0709 13:02:42.008305 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.008514 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:42.008853 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.794754 (+785901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.794830 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:42.794890 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.794988 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.795137 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7651,"prepare.queue_time_us":1481,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":8710,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":777837,"threads_started":1}
I20260709 13:02:42.783380 13367 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:42.864825  8575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.014s	sys 0.031s
W20260709 13:02:42.909727  8575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.015s	sys 0.032s
W20260709 13:02:42.874781  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.884644 13254 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:42.880659  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.017s	sys 0.025s
I20260709 13:02:42.843568 13083 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:42.887769  8549 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.034s	sys 0.053s
W20260709 13:02:42.865634 13342 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:02:42.772505 13235 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.864687 13130 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:42.835105  8509 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.024s	sys 0.023s
I20260709 13:02:42.877926  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:42.787087 13327 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 13:02:42.879578 13185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.033s	sys 0.051s
I20260709 13:02:42.822008 13175 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.776263 13238 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:42.880586  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 108749us
I20260709 13:02:42.911785  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:42.882565 13255 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:42.914068  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.018s	sys 0.025s
W20260709 13:02:43.091650  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 933655us
I20260709 13:02:43.093240  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:42.837469 13117 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:42.917948  8549 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.034s	sys 0.054s
W20260709 13:02:43.097397  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 786525us
W20260709 13:02:42.931100  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.029s	sys 0.029s
W20260709 13:02:43.098081  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.030s	sys 0.029s
W20260709 13:02:43.098608  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 887355us
W20260709 13:02:42.940627  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.950827  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 59075.2us
I20260709 13:02:43.100471  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:42.889038 13374 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:42.952980  8429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.014s	sys 0.031s
W20260709 13:02:43.117367  8429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.015s	sys 0.032s
W20260709 13:02:42.830969  9065 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.014s	sys 0.038s
W20260709 13:02:43.118129  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 1.06048e+06us
I20260709 13:02:42.914517 13367 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.035389 13276 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:43.011437 12849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.022s	sys 0.000s
I20260709 13:02:43.036983 13314 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:43.038479 13372 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:02:43.039799 13380 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.143646 13327 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.143510 13314 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.143786 13380 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.145406 13361 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:02:43.042454  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2197) took 1003 ms. Trace:
I20260709 13:02:43.146601  8581 rpcz_store.cc:276] 0709 13:02:42.038822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.261651 (+222829us) service_pool.cc:224] Handling call
0709 13:02:42.283881 (+ 22230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.780289 (+496408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.042180 (+261891us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54002fdfd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:43.042394 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1139983744}
I20260709 13:02:43.043535 13294 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.047885 13345 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:43.048931 13128 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:42.917382 13083 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:42.952625 13346 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:43.052493  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:42.975428  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 518782us
I20260709 13:02:42.891507 13173 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:43.070320  8509 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.031s	sys 0.026s
I20260709 13:02:43.070936  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:43.085153 13263 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.249s	user 0.011s	sys 0.002s
W20260709 13:02:43.068382 13270 consensus_meta.cc:287] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.814s	user 0.018s	sys 0.001s
I20260709 13:02:43.180768 13083 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.181577 13270 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.182337 13083 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.183980 13270 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:43.109601  8582 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:43.184629  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.185281  9100 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.185320  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.185596 13117 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.186509  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.186781  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:43.187412  9096 raft_consensus.cc:2410] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:43.187875  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.188359  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.188899  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.189146  9096 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:43.108529  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.190776  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.110751  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.192484  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.193018  8583 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:43.113207  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.195763  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.196272  9094 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.113947  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.198578  9098 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:02:43.199434  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.200162  9098 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:02:43.115182 13373 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:02:43.058754 13335 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.201678 13335 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.116222  8428 raft_consensus.cc:2410] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:43.110198  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.120581  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.099234  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:43.122361  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:43.087569 13363 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:02:43.135725  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:43.086939 13185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.033s	sys 0.051s
I20260709 13:02:43.142665 13288 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.206478  9093 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:43.146494 13314 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.163605  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:43.231500  8581 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.162669 13359 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.117157 13374 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.245573 13374 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:43.152155 12849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.023s	sys 0.000s
I20260709 13:02:43.247923 12849 consensus_queue.cc:1243] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:43.175485  8431 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:43.144273 13327 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.253465  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2185) took 1312 ms. Trace:
I20260709 13:02:43.253619 13327 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.254220 13175 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:43.253939  8575 rpcz_store.cc:276] 0709 13:02:41.941347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.022991 (+ 81644us) service_pool.cc:224] Handling call
0709 13:02:42.023401 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.023823 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:42.023857 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.024339 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.048491 (+ 24152us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b48000b1558. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:02:42.910245 (+861754us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:42.910308 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.910409 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.253156 (+342747us) raft_consensus.cc:1685] finished
0709 13:02:43.253176 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.253405 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2184,"raft.run_cpu_time_us":2352,"raft.run_wall_time_us":20576,"spinlock_wait_cycles":25198848,"thread_start_us":885499,"threads_started":1,"wal-append.queue_time_us":1226898}
I20260709 13:02:43.257534  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:43.269373 13239 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.255s	user 0.012s	sys 0.003s
W20260709 13:02:43.178330 13321 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.776s	user 0.013s	sys 0.000s
I20260709 13:02:43.270819 13321 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.273093 13321 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:43.280067  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2331) took 1909 ms. Trace:
I20260709 13:02:43.280546  8429 rpcz_store.cc:276] 0709 13:02:41.370692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.242757 (+872065us) service_pool.cc:224] Handling call
0709 13:02:42.243045 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.243596 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.243624 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.244044 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.117767 (+873723us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:43.117808 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.117886 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.279812 (+161926us) raft_consensus.cc:1685] finished
0709 13:02:43.279832 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.279991 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":873319,"threads_started":1,"wal-append.queue_time_us":973973}
I20260709 13:02:43.280546  8584 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:43.282814  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:43.283465  8429 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
W20260709 13:02:43.283898 13339 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.876s	user 0.010s	sys 0.002s
I20260709 13:02:43.284641  8429 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:43.285127 13311 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:43.285674 13311 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:43.286711 13311 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.288048 13311 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:43.291152 13377 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 13:02:43.174530  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:43.126796 13276 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.292384 13276 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:43.121941 13271 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.297375  8433 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:43.298235  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 958) took 1780 ms. Trace:
I20260709 13:02:43.298571  8433 rpcz_store.cc:276] 0709 13:02:41.517399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.296876 (+1779477us) service_pool.cc:224] Handling call
0709 13:02:43.297201 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.297921 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.298177 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:43.299763  8433 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:43.300315  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 960) took 1782 ms. Trace:
W20260709 13:02:43.147351 13244 consensus_meta.cc:287] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.900s	user 0.018s	sys 0.000s
W20260709 13:02:43.300751 13140 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.002s
I20260709 13:02:43.301079 13244 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.301146 13140 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.302670  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.303269 13244 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.168474 13368 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:43.181104 13128 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.173629 13346 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:43.304818 13368 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:43.305552 13346 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:43.300622  8433 rpcz_store.cc:276] 0709 13:02:41.518333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.299318 (+1780985us) service_pool.cc:224] Handling call
0709 13:02:43.299611 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.300104 (+   493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.300267 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:43.306631 13346 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:43.307109 13368 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:43.307387  8433 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:43.307945  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 964) took 1784 ms. Trace:
I20260709 13:02:43.137423  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.308234  8433 rpcz_store.cc:276] 0709 13:02:41.523166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.306744 (+1783578us) service_pool.cc:224] Handling call
0709 13:02:43.307052 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.307716 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.307894 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:42.308408  8434 rpcz_store.cc:276] 0709 13:02:40.156675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.260552 (+103877us) service_pool.cc:224] Handling call
0709 13:02:40.261026 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:40.303724 (+ 42698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:40.303780 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:40.308585 (+  4805us) log.cc:844] Serialized 52 byte log entry
0709 13:02:41.281618 (+973033us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:42.303952 (+1022334us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.304367 (+   415us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.307660 (+  3293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.307751 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.307791 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:42.307801 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.307936 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27869,"prepare.queue_time_us":381991,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":26071,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":36237,"spinlock_wait_cycles":12330112,"thread_start_us":1906821,"threads_started":2,"wal-append.queue_time_us":1439607}
I20260709 13:02:43.309535  8433 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:43.310868 13359 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.312079  9099 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:43.313009 13359 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:43.314775  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.315927  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.316475  9099 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:43.317209  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.318188 13333 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.318708  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.319293  9099 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:43.320086  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:43.320446 13352 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.912s	user 0.006s	sys 0.007s
I20260709 13:02:43.322769  8578 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:43.200862  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.204813  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:43.324206  9096 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
W20260709 13:02:43.176735  9065 connection.cc:256] RPC call timeout handler was delayed by -1.0288674979999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 13:02:43.325001  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 965) took 1801 ms. Trace:
I20260709 13:02:43.325350  8433 rpcz_store.cc:276] 0709 13:02:41.524863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.308970 (+1784107us) service_pool.cc:224] Handling call
0709 13:02:43.309246 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.309881 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.324941 (+ 15060us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:43.206178  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 107010us
I20260709 13:02:43.206682  8435 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.205291  8577 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:02:43.201135  9098 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:02:43.206743  9101 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:43.329267  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.189924  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.149061  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.330791  9097 raft_consensus.cc:2410] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:43.157658  8507 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:43.131047 13272 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:43.148454 13325 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:43.333195  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:43.219462  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.334111  9093 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.146062 13380 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.239056  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.128396 13255 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.235561 13394 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:43.353271 13394 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:02:43.240893 13390 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:02:43.353871  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.354707  9096 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:43.354261 13394 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.355224  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2186) took 1392 ms. Trace:
I20260709 13:02:43.355548  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.244066 13235 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.282166 13304 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:43.285259  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 957) took 1768 ms. Trace:
I20260709 13:02:43.364404  8429 rpcz_store.cc:276] 0709 13:02:41.517094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.284210 (+1767116us) service_pool.cc:224] Handling call
0709 13:02:43.284489 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.285008 (+   519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.285183 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:43.126116 13328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.016s	sys 0.050s
I20260709 13:02:43.303283  8575 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:43.157580 13250 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.364224 13304 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:43.374574 13304 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.375777 13304 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:43.336038  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.342368 13359 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.347029 13368 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.338872  9102 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:43.203796 13335 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.347828  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:43.356359  9096 raft_consensus.cc:2368] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11.
I20260709 13:02:43.355594  8580 rpcz_store.cc:276] 0709 13:02:41.962752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.024126 (+ 61374us) service_pool.cc:224] Handling call
0709 13:02:42.024490 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:42.024832 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.024865 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:42.025412 (+   547us) log.cc:844] Serialized 52 byte log entry
0709 13:02:42.822255 (+796843us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:42.822300 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.822381 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.355043 (+532662us) raft_consensus.cc:1685] finished
0709 13:02:43.355062 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.355178 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1238,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9938,"thread_start_us":752117,"threads_started":1,"wal-append.queue_time_us":1004424}
I20260709 13:02:43.326524  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:43.368976 13328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.017s	sys 0.051s
I20260709 13:02:43.378700  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.387739  9097 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:43.381966  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 55552.5us
I20260709 13:02:43.389360  9068 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:43.375371  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:43.382843 13264 raft_consensus.cc:2764] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:43.383597  9100 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:43.384150  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.131349 13376 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:43.157351 13395 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:43.387907  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:43.365991 13380 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.386643  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.425462  9102 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.425338 13380 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:43.429404 12982 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.001s
I20260709 13:02:43.395119  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:43.393749 13376 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:43.429950 12982 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.430522 13376 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.432610 12982 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:43.378561 13250 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.434930  9102 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:43.406469  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:43.436060  8575 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:43.439081 13140 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.403422  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.416440  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2322) took 3260 ms. Trace:
I20260709 13:02:43.440462  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.439795  8432 rpcz_store.cc:276] 0709 13:02:40.156040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.199389 (+ 43349us) service_pool.cc:224] Handling call
0709 13:02:40.199814 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.200123 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:41.015467 (+815344us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.415794 (+2400327us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.416031 (+   237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.416091 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:43.416148 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.416240 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.416376 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":672213,"prepare.queue_time_us":1940742,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":2531,"raft.queue_time_us":29866,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":158,"thread_start_us":2522834,"threads_started":3,"wal-append.queue_time_us":1316067}
I20260709 13:02:43.441082  9095 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:43.418190  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2170) took 2242 ms. Trace:
I20260709 13:02:43.418895 13011 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:43.420779 13291 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:43.345598 13325 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.345798 13272 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:43.423802 13255 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.430536  8580 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.378749 13361 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:43.415074  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2161) took 2846 ms. Trace:
I20260709 13:02:43.442006  8432 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:43.457713  8580 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:43.442783  9095 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:02:43.459839 13391 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:02:43.460808  9095 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:43.461133  9093 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:43.445819  8429 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:43.462402  8435 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:43.454946  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 964) took 1444 ms. Trace:
W20260709 13:02:43.398952  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 51200.5us
W20260709 13:02:43.463845  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.443974  9099 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:43.450237  9101 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:43.458003  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:43.464547  9094 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:43.492563  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:43.986132  8580 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:43.456162  8581 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:43.447167 13376 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:43.849892 13346 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.001s
I20260709 13:02:43.989281 12709 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.984067  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2177) took 2180 ms. Trace:
I20260709 13:02:43.990176 12709 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:43.991390 13364 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.148s	user 0.007s	sys 0.004s
I20260709 13:02:43.992730  8433 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:43.992859  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2320) took 3837 ms. Trace:
I20260709 13:02:43.993402  8427 rpcz_store.cc:276] 0709 13:02:40.155411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.156637 (+  1226us) service_pool.cc:224] Handling call
0709 13:02:40.157043 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.078955 (+921912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.079003 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.347159 (+268156us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.313213 (+966054us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:42.401657 (+ 88444us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.455336 (+ 53679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.455415 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.284034 (+828619us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b1800385660. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a1d21358f 00007f1a16252571 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd
0709 13:02:43.990707 (+706673us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:43.992672 (+  1965us) raft_consensus.cc:1685] finished
0709 13:02:43.992693 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.992803 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":199412,"prepare.queue_time_us":114461,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":191427,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":32423,"spinlock_wait_cycles":29427712,"thread_start_us":1702098,"threads_started":2,"wal-append.queue_time_us":1364617}
I20260709 13:02:43.995741  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:43.442543 13011 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:43.500680 13392 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.081s	user 0.007s	sys 0.000s
W20260709 13:02:43.452767  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.952632  8578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.020s
W20260709 13:02:44.006227  8578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.013s	sys 0.022s
I20260709 13:02:43.458105 13395 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.463470  8507 rpcz_store.cc:276] 0709 13:02:42.010640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.259443 (+248803us) service_pool.cc:224] Handling call
0709 13:02:42.286296 (+ 26853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.331164 (+1044868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.454578 (+123414us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b540005a0d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:43.454872 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2003437440}
I20260709 13:02:43.387413 13359 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.064821  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:43.859829 13264 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.503360  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:43.459211 13175 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.549891  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:43.985788  8432 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:44.082484  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:44.028788  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.084280  8583 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:44.083393  8432 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:43.539242  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:44.059074  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 671195us
I20260709 13:02:44.088485  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:43.506270 12982 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:43.983744  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 519852us
W20260709 13:02:44.093514  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 554339us
I20260709 13:02:44.094175  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:43.386178 13321 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:43.442265  8430 rpcz_store.cc:276] 0709 13:02:41.175475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.080399 (+904924us) service_pool.cc:224] Handling call
0709 13:02:42.080961 (+   562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.081217 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:42.082460 (+  1243us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.417539 (+1335079us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.417743 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.417800 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:43.417862 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.417955 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.418126 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":605305,"prepare.queue_time_us":609847,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":23278,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":17210,"thread_start_us":755190,"threads_started":1,"wal-append.queue_time_us":956181}
I20260709 13:02:44.096045  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:44.096653  8430 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.453121  8426 rpcz_store.cc:276] 0709 13:02:40.568998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.114124 (+545126us) service_pool.cc:224] Handling call
0709 13:02:41.114508 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.114959 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:42.027414 (+912455us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.414454 (+1387040us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.414660 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.414715 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:43.414773 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.414858 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.415005 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":679064,"prepare.queue_time_us":1195339,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":43986,"raft.queue_time_us":20974,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":8330,"thread_start_us":1586971,"threads_started":2,"wal-append.queue_time_us":1275167}
I20260709 13:02:44.078197  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.080340  9100 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:44.100036  8431 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:02:43.443477 13263 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:43.443339 13170 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.924s	user 0.011s	sys 0.000s
W20260709 13:02:43.490861 13355 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.075s	user 0.004s	sys 0.009s
I20260709 13:02:43.992928 12709 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.508221 13270 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:44.113767  9100 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:43.710861 13235 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.101708  8549 leader_election.cc:400] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11.
W20260709 13:02:44.089689 13267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.026s	sys 0.028s
I20260709 13:02:43.573525 13380 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:43.387318 13368 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.077364 13395 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.131312  8549 leader_election.cc:403] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:02:44.134917  9097 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.747s	user 0.010s	sys 0.002s
W20260709 13:02:44.132077 13267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.027s	sys 0.028s
I20260709 13:02:43.453015 13361 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.140753  9097 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:44.102207 13321 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:44.117216 13263 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.092756 13264 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.137190  9100 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:44.140410  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 47831.8us
I20260709 13:02:44.148798  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:44.130514 13270 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:44.152684 13250 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:44.153453  9097 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:44.136029 12709 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:44.100229 13175 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.156448  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2176) took 2353 ms. Trace:
W20260709 13:02:44.156623  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 109088us
I20260709 13:02:44.193336  8433 rpcz_store.cc:276] 0709 13:02:41.803235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.338349 (+1535114us) service_pool.cc:224] Handling call
0709 13:02:43.338633 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.993292 (+654659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.156237 (+162945us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54003f0f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:44.156396 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503728512}
I20260709 13:02:44.194651  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:44.195802  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.110402 12982 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.202373  9096 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.161178 13130 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:44.166165 13185 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.174154  8577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.062s	sys 0.051s
W20260709 13:02:44.203171  8577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.062s	sys 0.051s
I20260709 13:02:44.135205 13238 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:44.174640  8582 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:44.176625  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.204749  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.205298  8426 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:44.177160  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.134369 13376 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:44.155512 13325 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:44.190388  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:43.990410  8428 rpcz_store.cc:276] 0709 13:02:41.803561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.358524 (+1554963us) service_pool.cc:224] Handling call
0709 13:02:43.358876 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.359110 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:43.420076 (+ 60966us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.983711 (+563635us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.983771 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:43.983815 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.983879 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.984009 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60683,"prepare.queue_time_us":61209,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":256758,"thread_start_us":306496,"threads_started":1}
I20260709 13:02:44.143044 13257 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:44.153913  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 794) took 1029 ms. Trace:
I20260709 13:02:44.183825 13270 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.207896  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.121883 13170 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:44.185497 13412 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.783s	user 0.016s	sys 0.000s
I20260709 13:02:44.207171  8432 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:44.242478  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.147527 13321 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.151678 13263 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:44.215212  9097 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:02:44.201787 13250 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:44.136214 13235 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.224630  8430 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:44.255286  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.256116  8430 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:44.257153  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.206259  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.225875  8583 rpcz_store.cc:276] 0709 13:02:43.124971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.207937 (+ 82966us) service_pool.cc:224] Handling call
0709 13:02:43.208250 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.084844 (+876594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.153667 (+ 68823us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b5400282154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:44.153848 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2013839744}
I20260709 13:02:44.230266  9102 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:44.258402  8426 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
W20260709 13:02:44.258667  8460 heartbeater.cc:646] Failed to heartbeat to 127.7.41.254:45431 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.41.254:45431 timed out after 15.000s (SENT)
I20260709 13:02:44.237610  8433 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:44.192605 12709 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.260551  8426 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:44.260632 12709 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.240624 13238 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:44.257727  8430 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:44.218123  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.262399  8428 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:44.268733  9102 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:44.269876 13235 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:44.269676 12709 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.270871 13368 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:44.271950 13414 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:02:44.272400 13380 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.272948 13380 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.275146 13380 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:44.276304  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2196) took 2240 ms. Trace:
I20260709 13:02:44.276707  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2151) took 1812 ms. Trace:
I20260709 13:02:44.277238  8504 rpcz_store.cc:276] 0709 13:02:42.464441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.839169 (+374728us) service_pool.cc:224] Handling call
0709 13:02:42.839521 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.862493 (+ 22972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.862542 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.863137 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.235017 (+371880us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:43.235063 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.235134 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.164879 (+929745us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:44.276392 (+111513us) raft_consensus.cc:1685] finished
0709 13:02:44.276416 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.276638 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22529,"raft.queue_time_us":48102,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9612,"spinlock_wait_cycles":95208064,"thread_start_us":328292,"threads_started":1,"wal-append.queue_time_us":485059}
I20260709 13:02:44.279309 12709 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:44.261541 13238 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:44.245378  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.295859  8432 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
W20260709 13:02:44.283126 13411 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.877s	user 0.010s	sys 0.000s
I20260709 13:02:44.298514  9099 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:02:44.284868 13291 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.842s	user 0.009s	sys 0.005s
I20260709 13:02:44.285557  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 2182) took 1524 ms. Trace:
I20260709 13:02:44.301090  8435 rpcz_store.cc:276] 0709 13:02:42.761120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.907852 (+146732us) service_pool.cc:224] Handling call
0709 13:02:44.285334 (+1377482us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b5400126454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:44.285486 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74919296}
I20260709 13:02:44.276798  8576 rpcz_store.cc:276] 0709 13:02:42.036274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.212336 (+176062us) service_pool.cc:224] Handling call
0709 13:02:42.212681 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.477531 (+264850us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:42.506442 (+ 28911us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.037159 (+530717us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.037223 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:43.037273 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.276005 (+1238732us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54000163d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:44.276070 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.276229 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7094,"prepare.queue_time_us":563836,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":58376,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"spinlock_wait_cycles":608529664,"thread_start_us":470129,"threads_started":1,"wal-append.queue_time_us":788602}
W20260709 13:02:44.283182 13083 consensus_meta.cc:287] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.100s	user 0.010s	sys 0.000s
I20260709 13:02:44.217031 13185 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.293056  9096 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
W20260709 13:02:44.304672  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.214542 13350 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11.
W20260709 13:02:44.294809 13374 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.049s	user 0.011s	sys 0.000s
I20260709 13:02:44.309635  8432 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:02:44.311096  8503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 976) took 2297 ms (client timeout 1735 ms). Trace:
W20260709 13:02:44.311520  8503 rpcz_store.cc:269] 0709 13:02:42.013993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.141891 (+127898us) service_pool.cc:224] Handling call
0709 13:02:44.308022 (+2166131us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54003967d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:44.311026 (+  3004us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268331904}
I20260709 13:02:44.239324 13257 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.319344  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.320045  8430 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:44.320695  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 799) took 1194 ms. Trace:
I20260709 13:02:44.322325  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2545) took 2324 ms. Trace:
I20260709 13:02:44.322458  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.324393  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:44.304931 13291 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:44.332762  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 184056us
I20260709 13:02:44.332020  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:44.337167  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.337937  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:44.292542 13250 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.321081  8578 rpcz_store.cc:276] 0709 13:02:43.126209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.323658 (+197449us) service_pool.cc:224] Handling call
0709 13:02:43.323913 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.446783 (+122870us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:43.447071 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:02:44.295382 (+848311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:44.295460 (+    78us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:44.295522 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.320492 (+ 24970us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000672d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:44.320533 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.320644 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56398,"prepare.queue_time_us":527,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":83420,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9902,"spinlock_wait_cycles":282109696,"thread_start_us":772956,"threads_started":2,"wal-append.queue_time_us":868401}
I20260709 13:02:44.322938  8510 rpcz_store.cc:276] 0709 13:02:41.997454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.002243 (+  4789us) service_pool.cc:224] Handling call
0709 13:02:42.002544 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.002752 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:42.896833 (+894081us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.148523 (+251690us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.318895 (+170372us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b1800490cc0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1
0709 13:02:43.319529 (+   634us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b1800490cc0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:44.321689 (+1002160us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b1800490cc0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:02:44.321878 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:44.321950 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:44.322016 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.322100 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.322242 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52030,"prepare.queue_time_us":885941,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":5273,"raft.queue_time_us":76,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":11507,"spinlock_wait_cycles":134489984,"thread_start_us":1141065,"threads_started":2,"wal-append.queue_time_us":349922,"wal-append.run_cpu_time_us":1381,"wal-append.run_wall_time_us":1007691}
I20260709 13:02:44.326282 12955 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:44.309564 13395 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.341936 13350 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:44.369117  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 273917us
I20260709 13:02:44.371243  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:44.373641  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:44.315886 13374 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:44.367578 13420 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:02:44.364465 13350 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:02:44.382416  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.20783e+06us
I20260709 13:02:44.383368  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:44.385177  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:44.387589  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.387750  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2548) took 2383 ms. Trace:
W20260709 13:02:44.388177  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.378783 13276 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.086s	user 0.009s	sys 0.003s
I20260709 13:02:44.388130  8509 rpcz_store.cc:276] 0709 13:02:42.004540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.244527 (+239987us) service_pool.cc:224] Handling call
0709 13:02:42.244789 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.244969 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:43.177974 (+933005us) log.cc:844] Serialized 14 byte log entry
0709 13:02:44.387429 (+1209455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:44.387479 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:44.387519 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.387590 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.387698 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1047746,"prepare.queue_time_us":705608,"prepare.run_cpu_time_us":11417,"prepare.run_wall_time_us":31939,"thread_start_us":1091226,"threads_started":2,"wal-append.queue_time_us":196026,"wal-append.run_cpu_time_us":1056,"wal-append.run_wall_time_us":1002470}
I20260709 13:02:44.397535  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2539) took 2427 ms. Trace:
I20260709 13:02:44.366716  8428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:02:44.400557  8428 raft_consensus.cc:606] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:44.406476  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.386080 13350 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.397948  8508 rpcz_store.cc:276] 0709 13:02:41.969991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.989401 (+ 19410us) service_pool.cc:224] Handling call
0709 13:02:41.989731 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.989932 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:42.869457 (+879525us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.984878 (+1115421us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b1800490a80. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:02:44.397205 (+412327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:44.397260 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:44.397305 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.397377 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.397486 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76730,"prepare.queue_time_us":842571,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"spinlock_wait_cycles":6265600,"thread_start_us":1200696,"threads_started":2}
I20260709 13:02:44.412317  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.412936  8508 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.413136  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.413985  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.415518  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.416025  8435 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:44.392186 13314 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:44.417395  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.391899 13305 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:44.417966  8505 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:44.417747 13379 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.418675 13185 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:44.418969 13379 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.404577 13184 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:44.390177 13431 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:44.419974 13431 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:44.420372 13431 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.420605 13000 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:44.421342 13236 raft_consensus.cc:3055] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:44.421608 13421 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:44.421744 13236 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:44.422746 13236 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.423262 12982 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:44.423561 13170 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:44.423744 13236 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:44.425796  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 91204us
I20260709 13:02:44.426625  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:44.426636 13083 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:44.427470 13244 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:44.427942 13083 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.430290 13083 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:44.411131 13272 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:44.430823 13117 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:44.431618 13185 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:44.431833 13401 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:44.433442 13345 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:44.437266 13400 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:44.437673 13400 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:44.438570 13400 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.439913 13400 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.439692 13431 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.393440 13140 raft_consensus.cc:2764] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:02:44.441696 13422 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:44.441848 13431 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:44.442525  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.443825  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.444437  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2175) took 2721 ms. Trace:
W20260709 13:02:44.444784  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.414675  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.444831  8434 rpcz_store.cc:276] 0709 13:02:41.723113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.309303 (+1586190us) service_pool.cc:224] Handling call
0709 13:02:43.309581 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.309943 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.309969 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.328569 (+ 18600us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.725602 (+397033us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:43.725663 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.725741 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.444220 (+718479us) raft_consensus.cc:1685] finished
0709 13:02:44.444241 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.444382 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":366,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":396569,"threads_started":1,"wal-append.queue_time_us":970832}
I20260709 13:02:44.446132  8507 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:44.440027 13257 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:44.428056 13244 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.432155 13185 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:44.412609  8509 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:02:44.391139 13267 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.444465  8502 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:44.390398 13264 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:44.454813  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.458074  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.472085  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1205) took 1207 ms. Trace:
I20260709 13:02:44.473692  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:44.460750  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 121931us
I20260709 13:02:44.460876  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.461652  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.466609  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.475831  8505 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:44.467351  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.476409  8510 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.467136  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:44.449728 13420 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:02:44.480464  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50022.9us
I20260709 13:02:44.487931  8508 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:44.472783  9101 rpcz_store.cc:276] 0709 13:02:43.264506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.998109 (+733603us) service_pool.cc:224] Handling call
0709 13:02:43.998464 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.998656 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:44.096493 (+ 97837us) log.cc:844] Serialized 14 byte log entry
0709 13:02:44.471518 (+375025us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:44.471632 (+   114us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:44.471707 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.471833 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.472012 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":307769,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":75847,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":471544,"threads_started":3,"wal-append.queue_time_us":308525}
I20260709 13:02:44.488852  8578 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:44.488875  8504 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: [13.6-14.7]
I20260709 13:02:44.365938 13238 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.497189  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:44.497987  8583 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:44.491480  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 84096.4us
W20260709 13:02:44.489754  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 63224.4us
I20260709 13:02:44.495038  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:44.491863  8502 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:44.492092  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.493510  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:44.502538  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:44.502748  8578 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:02:44.471247 13304 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:02:44.504511  8576 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:44.504081 13185 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.505264 13185 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.505647  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:44.506474  8582 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:44.510381  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.510406  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:44.511276  8582 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:44.511495  8509 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:02:44.512409  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.513537  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.470376 13314 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:44.514753  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.516861  8510 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:02:44.517942  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.502463  8502 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:44.520972  8510 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:44.521782  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.521968  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.522357  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.522785  8508 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:44.522939  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.521840  8582 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:44.478425 13172 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:44.526088  8505 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:44.480113 12889 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:44.520082  8502 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.529609  8502 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.527900  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.530627  8503 raft_consensus.cc:2376] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14. Re-sending same reply.
I20260709 13:02:44.531818  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.532500  8503 raft_consensus.cc:2376] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14. Re-sending same reply.
I20260709 13:02:44.533579  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.514305 13292 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.534888  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.547394  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.492655 13361 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:44.535624  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.549278  9065 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:44.409778 13276 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.528366  8398 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:44.497817 13432 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.500976 13264 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:44.538735  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.539453  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:44.497632 13429 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:44.620800  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.500465 13250 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:44.540402  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:44.525836 13304 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:44.535060 13395 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:44.538806 12889 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.659518  8434 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:44.620348 13311 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.332s	user 0.015s	sys 0.000s
I20260709 13:02:44.541657  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:44.686733  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 137557us
I20260709 13:02:44.536389 13305 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:44.632779  8505 raft_consensus.cc:2368] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14.
W20260709 13:02:44.633217  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 138265us
I20260709 13:02:44.686882  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:44.635452  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 95133.3us
I20260709 13:02:44.630060  8503 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:44.687263  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 158972us
I20260709 13:02:44.705636  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:44.626951  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.713474  8508 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:44.720211  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.549259 13376 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.138s
W20260709 13:02:44.720746  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.720990  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2179) took 1960 ms. Trace:
W20260709 13:02:44.644309 13367 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.492s	user 0.009s	sys 0.001s
W20260709 13:02:44.755995  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.762545  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.762238  8429 rpcz_store.cc:276] 0709 13:02:42.760267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.372878 (+612611us) service_pool.cc:224] Handling call
0709 13:02:43.373206 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.462233 (+ 89027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.720765 (+1258532us) spinlock_profiling.cc:243] Waited 72.4 ms on lock 0x7b5400001754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:44.720936 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166578944}
W20260709 13:02:44.656454 13420 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:02:44.632220 13409 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:44.732604  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 250635us
I20260709 13:02:44.631290 13264 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.631107 13304 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:44.551208  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.638743 13263 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.788129  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 807) took 1380 ms. Trace:
I20260709 13:02:44.637773 13428 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.785759  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 81905.6us
I20260709 13:02:44.792409  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:44.656278 13444 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:44.789746  8509 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:44.635690 13257 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:44.793673  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:44.706776 13305 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:44.644663 13438 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:44.801252  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.789870  8575 rpcz_store.cc:276] 0709 13:02:43.407446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.436574 (+ 29128us) service_pool.cc:224] Handling call
0709 13:02:43.437026 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.437498 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:43.437880 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.728173 (+290293us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.729187 (+  1014us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.729624 (+   437us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.730276 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.730449 (+   173us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:43.730499 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.730597 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.787918 (+1057321us) raft_consensus.cc:1685] finished
0709 13:02:44.787942 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.788071 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":405,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":113,"raft.queue_time_us":2298,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":394,"thread_start_us":284530,"threads_started":1,"wal-append.queue_time_us":699262}
I20260709 13:02:44.798039  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:44.787462 13371 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.729s	user 0.004s	sys 0.016s
I20260709 13:02:44.721521 13350 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.787177 13264 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.815907 13236 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.817519  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.808320  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.781410 13374 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:44.803855 13444 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.830206  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.826067  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:44.847476  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.798800 13257 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:44.852512  8509 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:44.854571  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:44.856027  8506 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:44.854898  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:44.858202  8506 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:02:44.858206  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1339) took 1569 ms. Trace:
I20260709 13:02:44.858729  8506 pending_rounds.cc:85] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 6
I20260709 13:02:44.859169  8506 pending_rounds.cc:107] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:02:44.859699  8506 raft_consensus.cc:2889] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:44.832304 13321 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.002s
I20260709 13:02:44.682216 13314 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.858791  9102 rpcz_store.cc:276] 0709 13:02:43.289143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.435600 (+146457us) service_pool.cc:224] Handling call
0709 13:02:44.856954 (+1421354us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400508cd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:44.858155 (+  1201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341372800}
I20260709 13:02:44.781149 13367 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.855132 13441 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.851958 13445 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.855507 13257 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.853176 13444 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.858506 13244 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:44.832479 13236 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.864130 13452 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:44.885927 13443 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:02:44.886912 13236 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:44.875988 13376 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.865527 13374 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:02:44.874830 13455 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.869125 13439 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:02:44.899381 13367 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:44.955614  8330 catalog_manager.cc:5697] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 3 to 4, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 4 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.028615 13291 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:44.866643 13321 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:44.983765  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.620716 13292 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:45.031976  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.987342  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:45.034797  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.035018  8431 raft_consensus.cc:2410] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:02:45.033936 13311 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.988476  8506 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:44.989823  8507 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:44.856968  8509 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:44.988715  8502 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:02:44.901790 13416 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.692s	user 0.000s	sys 0.002s
I20260709 13:02:45.086939 13083 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:45.021196 12889 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:45.027647 13185 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260709 13:02:44.887302 13263 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:45.095712 13011 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.098165 13257 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.912001 13264 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.102645  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:45.103582 13257 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.105372  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:44.908245 13270 consensus_meta.cc:287] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.661s	user 0.004s	sys 0.007s
I20260709 13:02:44.897135 13276 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:44.868923 13304 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.896833 13305 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.896129 13350 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:44.824383  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 118841us
I20260709 13:02:45.029779 13291 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:44.969882  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 176159us
I20260709 13:02:45.036614 13311 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:44.926581 13418 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.566s	user 0.002s	sys 0.012s
I20260709 13:02:45.019438  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2457) took 3529 ms. Trace:
I20260709 13:02:44.797335 13428 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.633080 13429 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.632401 13432 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:44.878201 13441 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:44.880036 13445 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:45.073975  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.080436 12849 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:45.083065  9065 leader_election.cc:400] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14.
I20260709 13:02:45.099792 13321 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:45.105667 13264 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.143808  9065 leader_election.cc:403] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:45.087899 13083 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:45.144413 12849 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:45.106379 13000 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.928275 13444 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.158944 13263 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:45.161284 13444 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:45.163022  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.165369 13321 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:45.143953  8579 rpcz_store.cc:276] 0709 13:02:41.490262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.490426 (+   164us) service_pool.cc:224] Handling call
0709 13:02:41.511556 (+ 21130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.511850 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.511877 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.519476 (+  7599us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.491017 (+971541us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:42.491074 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.491152 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:44.786969 (+2295817us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:45.018343 (+231374us) raft_consensus.cc:1685] finished
0709 13:02:45.018395 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.019020 (+   625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37627264,"thread_start_us":877626,"threads_started":1,"wal-append.queue_time_us":1305217}
I20260709 13:02:45.181329 13270 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.177846 13263 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:45.198228 13445 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:45.200033  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 125378us
W20260709 13:02:45.193086  8475 connection.cc:256] RPC call timeout handler was delayed by -1.1116265260000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 13:02:45.201573 13000 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.207477  9097 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:45.213474 13175 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:45.215447 13250 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:45.215848 13292 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.223320 13238 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.223587 13429 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:45.224407  9093 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:45.193747 12849 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:45.228457  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1340) took 1938 ms. Trace:
I20260709 13:02:45.229463 13359 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:45.230711  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1347) took 1939 ms. Trace:
I20260709 13:02:45.235481 13172 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.236186 13250 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.233909  9099 rpcz_store.cc:276] 0709 13:02:43.291165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.162760 (+871595us) service_pool.cc:224] Handling call
0709 13:02:44.163099 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.299092 (+135993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.230155 (+931063us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400475254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:45.230547 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310664960}
W20260709 13:02:45.225555  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 402494us
W20260709 13:02:45.238657  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 133569us
I20260709 13:02:45.241778 13428 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:45.248723  9096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1342) took 1944 ms (client timeout 2180 ms). Trace:
I20260709 13:02:45.232879  9100 rpcz_store.cc:276] 0709 13:02:43.289394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.150870 (+861476us) service_pool.cc:224] Handling call
0709 13:02:44.151134 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.232222 (+ 81088us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:44.392617 (+160395us) log.cc:844] Serialized 14 byte log entry
0709 13:02:44.538470 (+145853us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:44.538522 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:44.538567 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.227948 (+689381us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b540063e054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:45.228009 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.228228 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":109284,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1866,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":81902,"spinlock_wait_cycles":185774976,"thread_start_us":297591,"threads_started":2,"wal-append.queue_time_us":255707}
W20260709 13:02:45.249285  9096 rpcz_store.cc:269] 0709 13:02:43.289870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.381334 (+ 91464us) service_pool.cc:224] Handling call
0709 13:02:45.209967 (+1828633us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b540049cd54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:45.234252 (+ 24285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1863976320}
I20260709 13:02:45.250460 13432 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:45.247536  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:45.259181 13292 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:45.271124 13291 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:45.254179 13130 raft_consensus.cc:993] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: : Instructing follower 5ffc86752d264d0c81f68028e6413a91 to start an election
I20260709 13:02:45.272161 13130 raft_consensus.cc:1081] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Signalling peer 5ffc86752d264d0c81f68028e6413a91 to start an election
W20260709 13:02:45.272184  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 189571us
I20260709 13:02:45.252035 13441 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.257220  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 967) took 1081 ms. Trace:
I20260709 13:02:45.258847 13238 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:45.259310  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 54763us
I20260709 13:02:45.261102 13305 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:45.262050 13304 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.270210  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:45.270001 13175 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:45.257561  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:45.275333  8431 rpcz_store.cc:276] 0709 13:02:44.175505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.189931 (+ 14426us) service_pool.cc:224] Handling call
0709 13:02:45.256939 (+1067008us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54003a1e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:45.257137 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878147968}
I20260709 13:02:45.256039  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1204) took 1991 ms. Trace:
W20260709 13:02:45.274374  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0585265259999233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 13:02:45.273439 13270 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:45.271163 13461 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.085s	user 0.004s	sys 0.000s
I20260709 13:02:45.277244  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:45.252900 13263 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:45.281214  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.282541 13175 consensus_queue.cc:1243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:45.283753  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:45.280578  9093 rpcz_store.cc:276] 0709 13:02:43.264244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.490666 (+226422us) service_pool.cc:224] Handling call
0709 13:02:45.219179 (+1728513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.235465 (+ 16286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.255776 (+ 20311us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540049cd50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:45.255958 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2838341888}
I20260709 13:02:45.289572 13350 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.289641 13292 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:45.290343  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:45.290993 13292 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.291405 13292 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.292143 13374 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:45.292748 13374 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:45.294430 13459 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:45.312436 13459 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.312610  9099 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:45.312917 13459 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:45.312120  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 54823.8us
I20260709 13:02:45.303122  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1352) took 1987 ms. Trace:
W20260709 13:02:45.308656  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0333265259999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:02:45.319370  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0216265259999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 13:02:45.290401 13350 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.293973  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:45.317723  9097 rpcz_store.cc:276] 0709 13:02:43.300450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.267089 (+966639us) service_pool.cc:224] Handling call
0709 13:02:44.267395 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.221309 (+953914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.275000 (+ 53691us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54000ebad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:45.288062 (+ 13062us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154094464}
I20260709 13:02:45.300487  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.326776  8507 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:45.303447 13175 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.328801 13175 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.329429 13175 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.303488  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:45.300822  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.301267  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.303990  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:45.302598  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.301992  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:45.306638 13311 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:45.300185  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.302446  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:45.323724 13291 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:45.305788 13238 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:45.298178  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.298622 13359 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:45.301177  8330 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 3 to 4, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 4 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.303411 13374 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:45.346215  8398 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:45.347126 13000 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:45.348954  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.337006 12849 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.354883  9096 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:45.307350 13292 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.314436 13083 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.363252 13432 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 13:02:45.369532  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 75751us
I20260709 13:02:45.370680  9065 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:45.371454  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.372581 13350 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.373144  9065 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:45.340265 13359 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:45.376322  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.380043 13291 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:45.380399  8502 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:45.380805 13291 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:45.380959  8510 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:45.381219 13321 raft_consensus.cc:2764] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:45.382258  8579 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:45.381907 13291 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.382560 13083 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.384081  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.388839  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:45.362178 13270 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.390720 13270 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.391474 13305 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:45.391960 13305 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.392345 13305 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.370690 13432 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:45.394418 13432 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:45.395560  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.395699 13432 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.397545  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.399631  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.373425 13395 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:02:45.380188  8506 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.380215  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.407492  9097 raft_consensus.cc:2410] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:45.379078  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.366763 13250 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.430799 13359 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.432967 13359 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.432783 13250 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:45.434887  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 104715us
I20260709 13:02:45.435154 13250 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:45.442493 13432 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:45.443974  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.448712 13172 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14.
I20260709 13:02:45.413929 13000 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:45.450155  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 81493.5us
I20260709 13:02:45.453166  8575 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:45.456029  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 83076.3us
I20260709 13:02:45.413025 13270 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:45.458745  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.458541  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:45.462714  8506 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:45.466576  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:45.473278  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:45.473874  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.475412  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.465384 13321 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:02:45.478469  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.479678 13441 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:45.479801  8578 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:45.462168 13395 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:45.489961  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:45.495319  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.494801 13374 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:02:45.499272  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.503885 13395 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:45.504948  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.509065  8508 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:02:45.510368 13345 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:02:45.511307 13345 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:45.511667 13345 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:45.512566 13345 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.513016 13305 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.515962  9097 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:45.518419 13395 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.518940 13350 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:45.519032 13395 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.520118 13350 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:45.521052 13350 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:45.521368 13350 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:45.499215 13321 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:02:45.524148 13235 raft_consensus.cc:3055] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:45.524578 13235 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:45.525871  8575 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:45.525694 13235 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.527025 13235 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.528836 13238 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:45.530737 13350 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.531530  8575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44116e7a54d141108511e22185400ffe"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:02:45.532339 13350 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.533303  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.533492 13305 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.531612 13409 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:02:45.489503 13175 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.513888 13345 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.535025 13374 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:45.535501 13374 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:45.536053  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.536852  8578 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:45.536641 13374 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:45.538074 13374 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.557673  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.558682  9096 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.560289 13292 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:45.561453  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 58571.3us
I20260709 13:02:45.562361  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:45.563417 13305 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:45.564004 13305 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:45.565057 13305 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.521576 13395 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:45.574858  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.575228  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.576205  9097 raft_consensus.cc:2410] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:45.576395  9102 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:45.580158  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.583226  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.586794  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:45.591120 13468 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:45.596248  8506 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:45.595252  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 215738us
W20260709 13:02:45.603542  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 137377us
I20260709 13:02:45.602370  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.597575  9099 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:45.603003  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.598722  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.607237  9097 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:45.610736  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.611567  9093 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:45.613533  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.613555  8431 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:45.615801  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:45.619442 13238 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.620113 13238 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:45.622781  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.623307  8583 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:02:45.624624  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.625560  8579 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:45.625468  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.626456  8577 raft_consensus.cc:2410] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:45.626675  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:45.627452  8584 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:45.629743 13250 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.630386 13250 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.597759 13175 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:45.602342  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:45.633018  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.641000  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:45.641999  9102 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:45.642488  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:45.642926  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.643368  8505 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.642828  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:45.644436  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:45.646188  9096 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:45.642038  8583 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.648109  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.649034  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.650919  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.651789  8434 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:45.652244  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.653110  8581 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:45.653177  8576 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:45.654071  8503 pending_rounds.cc:85] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 7
I20260709 13:02:45.654385  8503 pending_rounds.cc:107] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:02:45.654639  8503 raft_consensus.cc:2889] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.647585  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.658074  8504 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:45.641520 13250 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.662235  8509 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:45.665092  9065 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:45.669096  8584 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:45.669492  8505 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:45.670795 13238 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:45.672260  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:45.688485  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49982.1us
I20260709 13:02:45.689996  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.690618  9096 raft_consensus.cc:2376] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9. Re-sending same reply.
I20260709 13:02:45.689483  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:45.691879  8584 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:45.690814  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.691517  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:45.692795  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.693024  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.693235  8578 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:45.701920  9102 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:45.710551  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:45.712905  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 73705.8us
I20260709 13:02:45.709143  8429 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.716274  9099 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.722302  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.677870 13459 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.725126  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:45.721710  9097 raft_consensus.cc:2376] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10. Re-sending same reply.
I20260709 13:02:45.713382 13175 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:45.727767  9096 raft_consensus.cc:2376] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14. Re-sending same reply.
I20260709 13:02:45.728623  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:45.731312  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.707816 13395 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:02:45.734268  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:45.734534  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.737613  8434 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:45.737459  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.727784 13175 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.738219  9102 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:45.735858  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.740481  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:45.741556  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.744817  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.748530  8575 raft_consensus.cc:606] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:45.748701 13305 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:45.749025  8575 raft_consensus.cc:614] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:45.753706  9098 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:45.753611  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.754361  9101 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:45.755554 13459 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.741726 13175 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.768348  8584 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
W20260709 13:02:45.768862  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 118528us
I20260709 13:02:45.770751  9096 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:45.768190  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:45.775539  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 55381.1us
I20260709 13:02:45.777872  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:45.780436  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.781735  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:45.783914 13321 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:45.784093  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:45.790242  8432 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.797376  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.774243 13459 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:45.798936 13459 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.801203 13459 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:45.798439  9098 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 10: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:45.803881  8577 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:45.805258  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.805456 13270 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:45.805902  9095 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:45.804915 13409 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:45.806874  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.807379  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.808090  8431 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 7.
I20260709 13:02:45.808954  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.810111  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:45.810971  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 80781.7us
I20260709 13:02:45.811372  9096 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:45.812917  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.813632  8427 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:45.814759  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.815680  8428 raft_consensus.cc:2410] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:45.817488  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.819036  9097 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:45.820991  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.768577 13431 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:45.822350 13431 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:45.804836  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 103527us
I20260709 13:02:45.805027 13172 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:45.828876 13172 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:45.829370 13172 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:45.806137  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.821794  8435 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:45.831602  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47602.4us
I20260709 13:02:45.835093 13431 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:45.838305  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:45.838912  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.839207 13395 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:45.839628 13395 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.839998 13395 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.840268  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:45.842176  8576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:02:45.842810  8576 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:45.843195  8576 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.842168  9095 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:45.846001  8429 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:45.848062  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:45.848495  8427 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:45.846439  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 68707.2us
I20260709 13:02:45.846421  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.839988  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:45.857555  8432 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:45.859441  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:45.860924  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.861972  9095 raft_consensus.cc:2410] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:45.862986  9099 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:45.860894  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:45.865521  8584 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.866358  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.867373 13431 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:45.867776  8501 raft_consensus.cc:2410] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:45.864821  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.874115 13438 raft_consensus.cc:2764] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:45.883845  8583 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:45.877189  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:45.885303  9065 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:45.891481  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.898905  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.899238  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.905882  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.906777  8432 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:45.907184  8584 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:45.908442  8576 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:45.887161 13459 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:45.912485  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:45.848306 13395 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:45.914877  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 66905.4us
W20260709 13:02:45.902791 13475 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.134s	user 0.003s	sys 0.001s
I20260709 13:02:45.916994  9097 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:45.918664  9093 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:02:45.938812  9093 pending_rounds.cc:85] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 11
I20260709 13:02:45.939165  9093 pending_rounds.cc:107] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:02:45.939458  9093 raft_consensus.cc:2889] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.918624  8576 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:45.919384  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:45.920660  8510 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:02:45.921216  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.926766  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:45.926966 13438 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:45.912050 13270 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:45.927817  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.928493  8549 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:45.929208  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.931070  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:45.934798  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 75459.4us
I20260709 13:02:45.948941  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:45.955482  8501 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:45.958907  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 81821.1us
I20260709 13:02:45.921657 13172 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:45.915807 13321 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:02:45.961062  8502 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:45.967209  8504 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:02:45.966285  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 105112us
I20260709 13:02:45.971099  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.973065  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:45.952693 13270 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:45.989337  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.993600  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:45.987325  9101 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
W20260709 13:02:45.965758 13478 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 13:02:45.998788  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:45.999980  8501 raft_consensus.cc:2410] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:45.963354 13431 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.006596  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:45.953933 13432 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:02:46.008607  9099 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:46.010465  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.015259  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:46.015774  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:46.021317  8400 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:46.022835 13459 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:46.023242 13459 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:46.023675 13459 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.024116  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:45.969256 13438 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:02:46.026701  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 98411.2us
I20260709 13:02:46.029776  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:46.031597  8506 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:46.031888 13238 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:46.032198  8506 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:45.966704 13359 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:02:46.040094  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.018266 13083 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.050139  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.043725 13238 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:46.039023  8506 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:46.056875  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.039973  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:46.058959  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:46.059598  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 72391.8us
I20260709 13:02:46.039565 13409 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.061820  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:46.066712  8427 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:46.070592  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:46.071332  8435 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:02:46.067046  8427 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:46.043835 13291 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.072583  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:46.074501  8428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:02:46.076704  8428 raft_consensus.cc:606] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:46.077055  8428 raft_consensus.cc:614] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:46.033310 13345 consensus_queue.cc:1059] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:02:46.049624 13250 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.082006 13272 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:46.063611 13304 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:46.065630 13238 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:46.087443 13238 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:46.088054 13250 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.090327 13250 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:46.094863  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:46.095546  8505 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
W20260709 13:02:46.098963  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 143748us
W20260709 13:02:46.099160  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 110986us
I20260709 13:02:46.102520  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.107796  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:46.103940  8501 raft_consensus.cc:2376] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16. Re-sending same reply.
I20260709 13:02:46.111527  8429 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:46.077116 13000 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:46.117343  8506 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.114990  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:46.059839 13083 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.120285  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:46.120703  8510 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:46.122527  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 93379.2us
W20260709 13:02:46.128268  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 104303us
W20260709 13:02:46.134454  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 67850.4us
I20260709 13:02:46.110311 13270 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.136545  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:46.113231  8427 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:46.138957  8427 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:46.142222  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.143206  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.144546 13175 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.112716 13321 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:46.146351 13321 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:46.147640 13321 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.149147 13321 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.123214 13395 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:46.150730 13250 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:46.150909 13395 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.151291 13250 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.151791 13250 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.154524  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.127709 13409 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:46.158596 13409 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.145934  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.159091 13409 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.161182  9068 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.162227 13395 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.162494  9100 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:46.150095 13292 consensus_queue.cc:1175] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0b9f7467deed4381835a85ffd0e88af6" responder_term: 13 status { last_received { term: 13 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 13 index: 7 } }
I20260709 13:02:46.163524 13238 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:46.129750 13477 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:02:46.174120  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:46.174875  8501 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:46.178512  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.111928 13432 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:46.206861  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.105536 13374 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:02:46.209940  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:46.215241  8435 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:46.219707  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 65280.8us
W20260709 13:02:46.211665  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 257129us
I20260709 13:02:46.112123  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:46.221694  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 109677us
W20260709 13:02:46.225432  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.266392  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.267815  8506 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:46.223026 13438 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:46.274627 13482 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 13:02:46.276038  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 164387us
I20260709 13:02:46.276856  8503 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:46.279093 13083 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:46.282979  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.277560  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.290486  8427 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:46.297670  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:46.305341  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:46.305960  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:46.308892  8510 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.311791  8506 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:46.315397  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:46.267259 13432 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:46.317044  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 144181us
I20260709 13:02:46.312139  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:46.319227  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.320976  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 162564us
I20260709 13:02:46.323693  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:46.305444 13431 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:46.326786  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49312.2us
I20260709 13:02:46.306753 13304 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:46.331493 13304 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.333070  8501 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:46.305742 13486 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:46.338305  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 218073us
I20260709 13:02:46.337217 13374 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:46.344547 13374 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:46.345041 13374 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.328624 13485 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.345373 13499 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:46.355895  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.338284 13350 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:46.339365 13486 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:46.361117  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.366554  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:46.327453 13345 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:02:46.370759  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:46.349438 13432 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:46.374979  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 69783.9us
I20260709 13:02:46.357118 13499 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:46.382818  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:46.386569  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74543us
I20260709 13:02:46.369381 13486 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.400892  8435 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:02:46.378546 13431 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:46.403112  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.373847 13350 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:46.404917  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 226154us
W20260709 13:02:46.407567  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 56654.2us
W20260709 13:02:46.410439  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 88194.7us
I20260709 13:02:46.367990 13485 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.419555 13083 raft_consensus.cc:3055] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:46.420070 13083 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:46.422196 13305 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:46.424417 13488 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:02:46.427886  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:46.427315 13499 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:46.428663 13499 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.430716 13432 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:46.433466 13172 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:46.442175  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 54355.6us
I20260709 13:02:46.443151  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.445650  8510 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:46.447398  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:46.409770 13238 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:46.442747  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:46.454486  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:46.456959  8501 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:46.460876  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:46.457618  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 82976.3us
I20260709 13:02:46.453619  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:46.441857 13438 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.456851  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:46.451154 13172 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:46.452185 13291 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.467468  8507 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:46.464123 13490 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:46.454681 13272 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:46.472927  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:46.441928 13250 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.463263 13321 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.462809 13175 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:46.477864  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 101880us
I20260709 13:02:46.478788  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:46.479940  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:46.485868 13291 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.486152 13492 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:02:46.481014 13350 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:46.487504 13484 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:02:46.486181  8501 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:46.474016 13490 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.474197 13172 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:46.474669 13272 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.491240 13438 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:46.482815 13505 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:46.496833 13490 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.499855 13272 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:46.516687  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.507685 13238 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:46.519618 13512 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:46.521839 13512 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:46.523041  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44331.1us
I20260709 13:02:46.524091 13512 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:46.530761  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 160057us
I20260709 13:02:46.533215  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:46.533383  8430 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:46.534147  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:46.535081 13305 raft_consensus.cc:2764] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:46.535842 13305 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:46.538096 13305 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:46.539357 13305 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.542680 13489 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:46.551504  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:46.552822  8432 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:02:46.531806  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.561125  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.600479 13513 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:02:46.603961  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 147186us
I20260709 13:02:46.513065 13488 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:46.508622 13504 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
W20260709 13:02:46.623900  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 174010us
W20260709 13:02:46.623250  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 171563us
I20260709 13:02:46.625622  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:46.629312  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:46.631222 13506 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:46.632855  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:46.637035  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 121901us
I20260709 13:02:46.635829 13506 raft_consensus.cc:2764] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:46.640928 13500 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
I20260709 13:02:46.645004 13509 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.135s
I20260709 13:02:46.645944 13509 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:46.646308 13509 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:46.650887  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:46.652344 13250 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:46.523101 13516 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:46.615326 13488 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:46.655055  8550 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:46.662619  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.658051  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:46.676393  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.694250  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:46.696597  8547 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:46.698112  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 173433us
I20260709 13:02:46.707351  8510 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:46.691007 13250 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:46.660794 13485 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:46.666879 13488 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:46.717826  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.735522  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.741703  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 83735.9us
I20260709 13:02:46.697016 13305 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:46.761071  9068 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.512s (SENT)
I20260709 13:02:46.755290  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:46.704723 13504 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:46.779814  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.706946 13516 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:46.783047  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:46.718700 13250 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.815483  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.655532 13172 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:46.818866  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.777134 13432 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.756603 13485 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.731992 13350 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:02:46.818545  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:46.745496 13238 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.821300 13235 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:46.826583  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 43619us
W20260709 13:02:46.834623  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 179765us
I20260709 13:02:46.805508 13250 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:46.835559  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 174497us
I20260709 13:02:46.838999  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:46.817549 13500 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.840515  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:46.846318  8429 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:46.846781  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 62272.3us
I20260709 13:02:46.846184  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:46.847743  8435 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:46.806066 13515 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:46.692775 13509 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.779078 13305 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.850930  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:46.855779  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:46.856794  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:46.861347  9101 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:46.862082  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 101068us
I20260709 13:02:46.826959 13291 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:46.862896  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.571s (SENT)
I20260709 13:02:46.864486  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:46.846189 13304 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.870608  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:46.872924  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:46.827715 13512 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:02:46.851347 13515 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:46.866505 13409 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.005s
I20260709 13:02:46.883065  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:46.829576 13490 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:46.851006 13514 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.891520  8435 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:02:46.839716 13485 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.906386  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:46.892266 13409 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:46.880946 13515 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:46.908007 13527 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:46.909147 13516 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:46.920647  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.045575 13529 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.198s	user 0.000s	sys 0.009s
I20260709 13:02:47.038326  8427 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [13.10-15.11]
W20260709 13:02:46.904286 13528 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:46.889789 13509 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:46.918788 13510 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 13:02:46.872753 13459 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.849s	user 0.014s	sys 0.000s
W20260709 13:02:46.906284 13487 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:02:47.045508  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 182612us
W20260709 13:02:47.093381  9068 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.581s (SENT) [suppressed 36 similar messages]
I20260709 13:02:47.094048 13537 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:47.037859  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 194891us
I20260709 13:02:47.050227  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:47.097371  8432 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:47.055013  8429 raft_consensus.cc:2410] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:47.059825  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:47.062547  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:47.060663  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 221707us
I20260709 13:02:47.098242  8431 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:47.098914  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:46.874459 13291 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:47.094547 13537 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:47.100106 13537 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.100404  8428 raft_consensus.cc:2368] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12.
I20260709 13:02:47.100220 13291 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.104154 13250 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.107293  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:47.107992  8426 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.061215  9101 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:47.111019  8427 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:47.040489 13350 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:47.057667 13272 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.542s	user 0.014s	sys 0.003s
I20260709 13:02:47.053017 13235 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:47.062139 13500 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.092651 13459 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.115705 13539 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:47.110155 13517 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.174s	user 0.000s	sys 0.006s
I20260709 13:02:47.123296  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:47.126717  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.142135  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:47.145224  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.138855  8426 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:47.144866  8430 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:47.141662  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:47.153906 13498 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:47.154102 13519 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.154572 13498 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:47.155135 13498 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.154907 13519 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:47.157085 13524 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:02:47.160454  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.137102 13486 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.004s
I20260709 13:02:47.162923  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:47.167505  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:47.165086  8428 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:47.122411 13539 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.139267 13523 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:47.173862  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.172135  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:47.175875  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:47.178396  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:47.191632  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:47.192870  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:47.193712  9101 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:47.195782  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 102433us
W20260709 13:02:47.197109  9068 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.669s (SENT)
I20260709 13:02:47.142838 13304 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:02:47.163848 13250 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:47.116786 13272 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.200109  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:47.175845 13523 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.176093 13359 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:47.173416 13539 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:47.206941  8427 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:47.208490  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:47.256289  8503 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.209107  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:47.170363 13486 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:47.256291  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 64802us
I20260709 13:02:47.247503  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:47.244110  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:47.244272  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:47.248859  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:47.241096  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:47.261790  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:47.262706  8429 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:47.309258  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46079.6us
I20260709 13:02:47.305145  8507 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.312105  8503 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:47.264050  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:47.205787 13304 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:47.203387 13501 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.206161 13496 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:47.318920  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.261094 13374 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.901s	user 0.014s	sys 0.006s
I20260709 13:02:47.242666 13523 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.246738 13438 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.398607  9093 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:47.317720 13521 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:02:47.260548 13545 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:47.414923  8501 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:47.259019 13359 raft_consensus.cc:697] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:47.201306 13235 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.322220 13304 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:47.211004 13490 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:47.427006  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.439124  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 242005us
I20260709 13:02:47.443617  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:47.448360  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:47.449249  8576 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:47.450989  8577 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:47.454309  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:47.455225  8583 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.366799 13409 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:47.441470  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 180611us
I20260709 13:02:47.414575 13551 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:47.467571  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.423782 13506 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.480811 13359 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.431133 13504 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:47.461138 13172 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.410403 13374 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.504997  8583 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
W20260709 13:02:47.495703 13531 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.378s	user 0.001s	sys 0.001s
I20260709 13:02:47.413450 13496 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.482944 13459 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:47.420949 13438 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.476569 13545 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:47.460582  8429 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:02:47.528012  8584 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:47.537422  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 275763us
W20260709 13:02:47.538750  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 66382us
I20260709 13:02:47.538833  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:47.549109  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 74206.3us
I20260709 13:02:47.524966 13172 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.518596 13000 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:02:47.574666  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:47.509274 13504 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.578315  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:47.581496  8503 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:47.483455 13551 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.583815  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:47.573971 13459 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:47.591253  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:47.591778  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:47.597999  8583 raft_consensus.cc:2393] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:47.599771  9068 leader_election.cc:400] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12.
I20260709 13:02:47.600140  9068 leader_election.cc:403] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.572590 13506 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:47.602948 13563 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:47.603498 13545 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:47.610683  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.611147 13491 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:47.578272 13490 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:47.615626  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.627184  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:47.624619  8550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.001s	sys 0.010s
W20260709 13:02:47.630856  8550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.001s	sys 0.010s
I20260709 13:02:47.576844 13519 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:47.596385 13272 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:47.611941 13563 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.635195 13563 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.635893 13560 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.543691 13304 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:47.632975 13499 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.202s	user 0.017s	sys 0.000s
I20260709 13:02:47.635126 13564 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:47.645624 13559 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:02:47.637234 13490 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.646944 13559 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:47.647334 13559 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:47.648418 13490 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:47.648253 13559 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:47.631472  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 532580us
I20260709 13:02:47.575328 13172 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.650089 13561 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.643579 13518 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.623595 13491 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:47.661417  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:47.630889 13486 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:47.649818 13559 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.663141  8583 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:47.667506  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:47.668534  8504 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.669754  8502 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:47.664526 13490 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:47.670531 13490 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.623980 13506 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.673173 13490 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:47.677174 13567 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:02:47.676344 13563 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.679857 13551 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:47.680094 13563 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:47.682068  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.682190 13172 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:47.683548 13509 consensus_meta.cc:287] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.003s
I20260709 13:02:47.684819  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1013) took 1584 ms. Trace:
I20260709 13:02:47.685335  8505 rpcz_store.cc:276] 0709 13:02:46.100266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.100437 (+   171us) service_pool.cc:224] Handling call
0709 13:02:46.116312 (+ 15875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.319179 (+202867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.319280 (+   101us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.327614 (+  8334us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.471617 (+144003us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:46.472472 (+   855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.684227 (+1211755us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b54001fe354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:47.684299 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:47.684365 (+    66us) raft_consensus.cc:1685] finished
0709 13:02:47.684384 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.684720 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13555,"raft.queue_time_us":148121,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":6913,"spinlock_wait_cycles":160509824,"thread_start_us":255356,"threads_started":2,"wal-append.queue_time_us":140829,"wal-append.run_cpu_time_us":1892,"wal-append.run_wall_time_us":1001903}
I20260709 13:02:47.691041 13438 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:47.692838 13498 consensus_meta.cc:287] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.002s
I20260709 13:02:47.692315 13491 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.693270 13498 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.695233 13504 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:47.695562 13538 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.656s	user 0.002s	sys 0.002s
I20260709 13:02:47.661957 13560 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.699239 13485 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:47.700402 13560 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:47.701169 13555 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:02:47.638950 13000 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:47.636627 13489 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:47.708600  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47296.6us
W20260709 13:02:47.642697 13558 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:02:47.713984  8504 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:47.707165 13505 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:47.626766 13083 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.719283  8501 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:47.724555  8579 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:47.724995  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:47.734962  8576 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:47.717844  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:47.729959  8581 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:47.638517 13519 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:02:47.730671  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:47.731732 13374 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:47.732507 13496 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:47.733462  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:47.738188  8580 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:47.738487  8582 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:47.738245 13578 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.738716  8581 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:47.739311  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:47.749792  8576 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:47.713946 13272 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:47.744514  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 92882.6us
I20260709 13:02:47.750989  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:47.724697 13505 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:02:47.779925  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 174460us
I20260709 13:02:47.796123  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:47.798753  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:47.735075 13489 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:47.802284  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 51373.9us
W20260709 13:02:47.802479  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 538474us
I20260709 13:02:47.794467 13496 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.807674 13569 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.808266  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:47.797876 13536 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.808894 13083 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.809253  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:47.801486 13537 consensus_meta.cc:287] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.701s	user 0.012s	sys 0.001s
I20260709 13:02:47.824481 13537 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.816188 13272 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:47.827005 13272 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:47.827965 13272 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.828986  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:47.829571  8502 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:47.808435 13519 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:47.802831 13500 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.001s
I20260709 13:02:47.807783  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:47.787123 13578 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.839773 13578 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:47.840220 13515 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.000s
I20260709 13:02:47.840646 13515 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.840745 13519 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:47.841328 13539 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.000s
I20260709 13:02:47.823859  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:47.842335  8510 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:47.826267  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:47.843065 13519 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:47.843238  8509 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.846225 13569 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.848461 13569 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:47.849057  8504 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:47.851238 13374 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:47.854187 13305 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:47.854436 13374 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:47.855706 13374 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:47.856065 13374 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:47.856920 13374 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:47.828492  8507 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.001s
I20260709 13:02:47.813395  8505 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:47.859899  8507 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:47.862703 13000 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12.
W20260709 13:02:47.863782 13522 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.812s	user 0.006s	sys 0.002s
I20260709 13:02:47.869601 13537 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:47.830821  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:47.810808  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:47.831128  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:47.804692 13488 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.025s	user 0.001s	sys 0.012s
I20260709 13:02:47.833812 13500 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:47.833623 13523 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.834646 13498 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:47.833528 13505 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.836042 13489 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:47.860518  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:47.882627  8509 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
W20260709 13:02:47.885643  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 54912.8us
W20260709 13:02:47.886809 13511 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.246s	user 0.008s	sys 0.009s
I20260709 13:02:47.891348  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:47.892575 13511 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.008s	sys 0.010s
I20260709 13:02:47.892827  8505 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
W20260709 13:02:47.893435  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 82720.7us
I20260709 13:02:47.894222 13537 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:47.894745  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:47.891831  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 75223.6us
I20260709 13:02:47.891784  9065 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:47.896050  9102 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:47.896641  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:47.897083 13533 log.cc:927] Time spent T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.849s	user 0.003s	sys 0.000s
I20260709 13:02:47.897524  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:47.898221 13359 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:47.900123 13359 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.900522 13359 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.891626 13583 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:47.902832 13583 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.903223 13583 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.904888 13506 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:47.898689 13500 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:47.906358 13500 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:47.907246 13500 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.909292  8435 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:47.894857 13537 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:47.910687  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:47.895996  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:47.910965 13537 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.911598 13489 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:47.912295 13489 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:47.912424 13498 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:47.912886 13498 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:47.913062  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:47.913290 13498 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:47.913352 13489 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.914319 13492 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:47.899694 13588 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:47.915051 13588 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.915432 13588 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:47.892093 13000 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.915910  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:47.816444 13486 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:02:47.921130  8429 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:02:47.922039  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.917953  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:47.924984  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 64606.2us
I20260709 13:02:47.925983  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:47.927587  8577 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:47.928632  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1018) took 1283 ms. Trace:
I20260709 13:02:47.923733  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:47.931320  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:47.931738  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:47.931466  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:47.931998  8506 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:47.887763 13553 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.930584  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:47.841733 13539 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.936136  8429 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:02:47.921394 13374 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.939268  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:47.940095 13566 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:47.940774 13496 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.941000  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:47.950037  8435 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
W20260709 13:02:47.941216 13501 consensus_meta.cc:287] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.004s
I20260709 13:02:47.941452 13518 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:47.954929 13499 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:47.955637 13566 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:47.956656 13566 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.947273  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:47.950409  8435 pending_rounds.cc:85] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 6
I20260709 13:02:47.998467  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:47.929145  8508 rpcz_store.cc:276] 0709 13:02:46.644790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.644962 (+   172us) service_pool.cc:224] Handling call
0709 13:02:46.645408 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.645906 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.645946 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.646627 (+   681us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.815670 (+169043us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:46.815714 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.815793 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:47.896385 (+1080592us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:47.921723 (+ 25338us) raft_consensus.cc:1685] finished
0709 13:02:47.921743 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.928546 (+  6803us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3182,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":3270,"spinlock_wait_cycles":4493184,"thread_start_us":148428,"threads_started":1,"wal-append.queue_time_us":216027}
I20260709 13:02:47.958153  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:47.995998  8584 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:47.932847 13432 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:47.996471  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.949191 13516 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:47.997856  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.032059  8432 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:47.998750  8435 pending_rounds.cc:107] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 14.7
W20260709 13:02:48.033272  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.033390  8435 raft_consensus.cc:2889] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.923504 13519 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.040391 13519 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:48.043295  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 119715us
I20260709 13:02:48.045020  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:48.045797 13560 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:48.046396 13508 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:48.047703  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:47.911015 13562 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:02:48.051493 13570 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:48.051890 13570 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:47.933789 13409 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.884749 13488 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:47.929715 13536 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.013135  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.072582  8433 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.013520  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:48.073251  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.014320 13486 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:48.024804 13509 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:47.999482 13518 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:48.073282  8431 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
W20260709 13:02:48.034139  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.038009 13503 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:48.082177 13432 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:48.038615 13345 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:47.927238 13000 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:47.994952 13501 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:48.054519  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.091650  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.935173 13459 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:02:48.058131  8432 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:48.015539 13581 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:48.071869 13516 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:48.069231 13291 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:48.072280 13515 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:48.008807 13559 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.100069  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.102329  8427 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
W20260709 13:02:48.104905  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.071565 13238 consensus_queue.cc:1059] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:02:48.106242  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.109123  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 110751us
I20260709 13:02:48.094897 13500 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.096814 13503 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:48.084497 13509 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.113289  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:48.074771 13570 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:48.116511  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.084662 13486 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.117388 13238 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:02:48.098909 13581 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.128026 13581 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:48.130175 13523 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:48.134522 13570 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:48.135509 13000 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:48.112689 13513 raft_consensus.cc:3055] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:48.106514 13359 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.157625 13486 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:48.158543  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:48.108054 13559 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.166069 13539 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:48.138057 13536 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:48.175530  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.148027 13509 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:02:48.146634 13513 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:48.114121 13500 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.177691 13536 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.207885  8506 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:48.210930  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 213219us
I20260709 13:02:48.211444 13503 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.215585  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:48.213842  8433 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:48.216706 13562 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.217191  8431 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:48.218899  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:48.217372 13562 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.220029 13272 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:48.223414 13598 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:48.261719 13598 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:48.262691 13598 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.223858  9068 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:48.225911 13485 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:48.272181  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48398.7us
W20260709 13:02:48.227252 13573 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.575s	user 0.002s	sys 0.000s
I20260709 13:02:48.227169 13500 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:48.230317  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:48.231009 13359 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:48.232769 13562 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:48.153254 13516 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:48.235110 13304 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:48.240217 13519 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:48.242750  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:48.243620 13488 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:48.224648 13459 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:02:48.274092 13575 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.247308 13491 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.249207  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:48.307910  8507 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:48.307757  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:48.225934 13559 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:48.212180 13536 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:48.251170  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:48.253003 13505 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:48.161062 13518 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.254109  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1198) took 1067 ms. Trace:
I20260709 13:02:48.254344 13583 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.255543  8501 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:48.256876  8506 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:48.219941 13499 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:48.276324  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:48.241459 13498 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:48.302211 13509 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.317936  9102 rpcz_store.cc:276] 0709 13:02:47.186543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.193351 (+  6808us) service_pool.cc:224] Handling call
0709 13:02:47.193655 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.896531 (+702876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.253852 (+357321us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b5400560ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:48.254053 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1614418816}
I20260709 13:02:48.297721  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.321842  8432 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:48.260699 13272 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:48.273263 13570 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.246631  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:48.272531 13485 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:48.301337  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:48.273558 13486 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.309515  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:48.286403 13523 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.311071  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:48.317077 13537 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:48.340019  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:48.341411  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:48.306386 13500 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:02:48.310776 13575 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.349377  9102 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:48.224380 13513 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.310933 13588 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.315232  8508 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.316273  8429 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:48.318990  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:48.360163  8507 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
W20260709 13:02:48.310828 13592 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.271s	user 0.001s	sys 0.002s
I20260709 13:02:48.362433  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:48.362987  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.363409  9098 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:02:48.363811  9099 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:48.364439  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.366132  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:48.276229 13600 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:02:48.346740 13486 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:48.383064  9101 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:48.383435 13486 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:48.383962 13486 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.386205  9101 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:48.344413 13561 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:02:48.388084 13561 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:48.388603 13561 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.389699  9101 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:02:48.390203  9101 pending_rounds.cc:85] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 10
I20260709 13:02:48.391032  9101 pending_rounds.cc:107] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:02:48.391386  9101 raft_consensus.cc:2889] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:48.394639  9095 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:48.399904 13513 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.401401 13583 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:48.403028 13486 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:48.404994  8476 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:48.406271 13565 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:48.406699 13565 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.407063 13565 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.351925 13537 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:48.326015  9093 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:48.314041 13359 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:02:48.433883  9096 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:48.311790  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 81553.7us
I20260709 13:02:48.352311  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:48.347766 13499 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.330688 13509 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.330354 13570 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:48.353686  8502 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:48.354470  9100 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:48.357583  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.452008  9097 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:48.361034  9094 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:48.452459  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:48.378659 13569 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:48.346367 13523 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.474313  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.475203  8428 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:48.478631  8506 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:48.480299  8509 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:48.315999 13519 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:48.427677  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:48.433633  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.433049 13512 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.444478  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.450538  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.452459  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.340845 13581 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:48.453508  9101 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:48.322973  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:48.463029 13569 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:48.468163  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:48.468894  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.608480  9094 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:48.469553  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.463605  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.481482  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.467434  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.611307  8435 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:48.468158  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:48.483068  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.441987  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.487439  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:48.489553  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:48.547030  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.614490  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.544838  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:48.617683  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 294756us
I20260709 13:02:48.619341  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:48.611920  9100 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:48.490265  8503 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:48.548126  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:48.491087  9093 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:48.444339 13459 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.545815  8508 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:48.530448  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:48.489876  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.585440  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.551257 13488 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.450870 13566 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 13:02:48.598881 13498 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:48.599293 13613 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:48.599491 13537 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:48.463371 13486 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 13:02:48.486145  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:48.433403 13578 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.627633  9095 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:48.631711  8577 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:48.655619  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 169568us
I20260709 13:02:48.631379  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:48.632391  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 102086us
I20260709 13:02:48.453368 13572 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 13:02:48.642786  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.656795  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.601539 13561 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:48.647328  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.663777  8428 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:48.647809  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:48.664608  9094 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:48.652822  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.462884 13508 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 13:02:48.667441  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.668124  8433 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
W20260709 13:02:48.630189 13594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.014s	sys 0.044s
I20260709 13:02:48.644351  9097 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: [9.8-12.9]
I20260709 13:02:48.669283 13500 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:48.670817 13500 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:48.670424 13594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.014s	sys 0.045s
I20260709 13:02:48.454591 13272 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:48.677250  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.677126 13565 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.678891  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.675500 13500 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.679525  9095 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:48.679291 13578 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.643057 13544 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:48.551349 13512 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.647353 13543 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:48.684962  8435 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:48.685412  8426 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:48.690248  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.688827  8503 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:48.684273  8428 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:48.657476 13492 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.699617  9094 raft_consensus.cc:2410] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:48.701762  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:48.705504  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.706759  8428 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:48.712236  9094 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:48.714387  9094 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:48.715317  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.715987  9100 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:48.716037  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:48.716768  9097 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:48.726152  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.647112 13459 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.649314 13488 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:48.683738 13539 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.731969  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.742290  8433 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:48.699168 13578 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:48.691613 13543 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.684082 13561 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:02:48.740644  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:48.724447 13508 consensus_queue.cc:1243] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:02:48.745301  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 126028us
I20260709 13:02:48.772974  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:48.728327  8430 raft_consensus.cc:2376] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14. Re-sending same reply.
I20260709 13:02:48.653517 13613 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.749817  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:48.761009  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2495) took 1211 ms. Trace:
I20260709 13:02:48.723966 13291 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:48.765144  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.775983 13291 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:48.776479  8434 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:02:48.775570  8584 rpcz_store.cc:276] 0709 13:02:47.532762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.532944 (+   182us) service_pool.cc:224] Handling call
0709 13:02:47.567528 (+ 34584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.000735 (+433207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.743845 (+743110us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540009a454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:48.744041 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984767744}
I20260709 13:02:48.785362  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:48.787428  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.790412  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.791267  8433 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:48.746667 13345 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.747015 13572 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:48.771631 13543 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:48.800705  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:48.727679 13612 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:02:48.743695 13250 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:02:48.724823 13569 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.857422  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:48.874722  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:48.767058 13083 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:02:48.774349 13305 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:02:48.865962  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:48.775323 13486 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:48.878495  8584 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:02:48.805357  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:48.727838 13492 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.893328  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:48.792625 13508 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:48.766881 13553 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:02:48.886844  8578 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:48.799593 13539 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.896430  8427 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:02:48.918833  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 131792us
I20260709 13:02:48.860776 13544 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:48.856998 13621 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.910748 13603 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.823146 13345 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:48.933501 13558 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:02:48.923193 13508 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:48.926234 13566 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.881209 13291 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:48.963137  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 49358.7us
W20260709 13:02:48.965943 13609 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:02:48.945686 13621 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:48.970607 13607 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:02:48.971071  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:48.985731  8578 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:48.941509 13539 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.973237 13488 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:48.943914 13305 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:48.956800 13624 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:02:48.944885 13620 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:02:48.910066 13486 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:48.947973 13544 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:48.980192 13612 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.977545 13614 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.192s	user 0.000s	sys 0.002s
I20260709 13:02:48.982102 13588 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:48.982136  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:48.963805 13508 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:48.984968  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:48.972242 13459 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.017025  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:48.991079 13305 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:48.989012 13616 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:02:49.022430  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:48.988889 13536 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.002s
I20260709 13:02:49.033181  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:49.017656 13608 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:02:48.988881 13553 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:49.017452  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:49.081856  8575 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 9: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:49.026798 13618 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260709 13:02:49.039155 13488 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:49.098754  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 81418.5us
I20260709 13:02:49.038882 13612 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.096881  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.103120 13305 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.103935 13632 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:02:49.034986 13083 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:49.027217 13566 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
W20260709 13:02:49.099576 13513 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.005s
I20260709 13:02:49.089623 13553 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.115077  8584 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:49.101372 13409 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:49.124495  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:49.124699  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 183599us
I20260709 13:02:49.124774  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:49.123250 13272 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.245393  8582 raft_consensus.cc:2410] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:02:49.125118  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.112299 13516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.030s
I20260709 13:02:49.126483  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:49.292719  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 166315us
I20260709 13:02:49.030772 13512 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:49.127341  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 322060us
I20260709 13:02:49.127948  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:49.093079 13536 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:49.277249  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.304037  9097 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:49.292030 13516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.001s	sys 0.031s
I20260709 13:02:49.310380  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:49.221475 13553 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.323562  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:49.343672  9100 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:02:49.349733  9100 pending_rounds.cc:85] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 9
I20260709 13:02:49.354132  9100 pending_rounds.cc:107] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:49.217036 13083 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.149163 13488 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.307018 13409 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:49.306660 13598 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.292176 13272 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:49.144672 13544 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:49.349606  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 128409us
W20260709 13:02:49.405166 13505 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.084s	user 0.005s	sys 0.008s
I20260709 13:02:49.424638 13566 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:49.447089  9102 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 12. Ops: []
I20260709 13:02:49.447237 13566 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.448375 13569 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.363516 13612 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:49.392843 13643 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:49.450237 13643 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:49.324234 13499 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.450513 13272 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:49.450938 13643 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:49.451148 13499 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.311918  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:49.408670  8577 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 14. Ops: []
I20260709 13:02:49.341924 13634 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.454282  9100 raft_consensus.cc:2889] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:49.454600 13083 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.454833 13634 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:49.321466 13345 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.307610 13492 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.407944 13486 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:49.459422 13634 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:49.452665 13409 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:49.406248 13539 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.459534 13643 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:49.322619 13305 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.461114 13409 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.464373  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1229) took 1069 ms. Trace:
W20260709 13:02:49.465011  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 154729us
I20260709 13:02:49.466049  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:49.448024 13598 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:49.469696  8584 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:49.470685 13598 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:49.472023 13643 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:49.473356 13643 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.473783  8584 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:49.503492 13643 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:49.475271  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.504972  8580 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 13 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:02:49.514602  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.529234  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:49.529553 13345 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:49.530696 13492 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:49.537097 13345 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.537204 13492 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.539912 13345 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.540031 13492 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.543606 13492 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:49.571499  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:49.573171 13492 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:49.579834 13486 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:49.581382 13612 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.580688 13486 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.581912 13612 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.583381 13486 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:49.584674  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:49.585060  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:49.585498  9097 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 13 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:02:49.584041 13612 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:49.586436  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:49.591392  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1223) took 1231 ms. Trace:
I20260709 13:02:49.592041  9096 rpcz_store.cc:276] 0709 13:02:48.359716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.360562 (+   846us) service_pool.cc:224] Handling call
0709 13:02:48.433616 (+ 73054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.434459 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.590861 (+1156402us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b54000e83d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:49.591307 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136045952}
I20260709 13:02:49.451900 13578 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:49.597592 13578 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:49.598733 13578 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.601635 13578 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:49.598588  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:49.607992 13523 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.610973  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:49.585831 13374 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:49.614264 13083 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:49.614528 13374 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:49.616040 13374 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.624243 13083 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:49.626435 13291 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:49.634691  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:49.635905  8427 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:49.465131  9101 rpcz_store.cc:276] 0709 13:02:48.395022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.395852 (+   830us) service_pool.cc:224] Handling call
0709 13:02:48.453333 (+ 57481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.606350 (+153017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.464116 (+857766us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b5400208fd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:49.464301 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131176320}
I20260709 13:02:49.432305  8578 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:02:49.625960 13083 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:49.654732  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:49.656769 13083 consensus_queue.cc:1243] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:49.656908  9101 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:49.657567 13083 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:49.660740 13409 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:49.661290 13409 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:49.661815  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:49.663470 13409 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:49.664912 13499 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.666222 13566 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.667683  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:49.669250  9096 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:49.671694  8510 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:49.685652  9101 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:49.685493  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:49.686822  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:49.687862  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:49.686827  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:49.689468  9101 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.365125 13613 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:49.696519  8510 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:49.697072  9101 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:49.697738  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:49.698360  9101 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:49.699020  8507 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:49.699151  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:49.698354  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:49.700100  8510 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:49.700260  8502 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:49.701992  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:49.704074 13083 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:49.704958 13083 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:49.370322 13536 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.713832 13291 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.714282 13438 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:49.714483 13291 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:49.714870  8427 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:49.716238  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:49.716742 13291 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:49.720309 13572 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.896s	user 0.007s	sys 0.004s
I20260709 13:02:49.721416  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.722987  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.606011 13492 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:49.714813 13438 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:49.761029  8510 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:02:49.767388  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:49.779201 13636 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.779855 13636 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:49.780508 13645 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.355s	user 0.000s	sys 0.000s
I20260709 13:02:49.780745  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.784265 13636 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:49.412537 13635 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:02:49.780499  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.786842  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.787997  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.788641  8581 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:49.789548  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.790270  8581 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:49.790346 13649 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:49.793851 13649 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.794270  8578 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:49.796111 13649 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:49.791122  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.799000 13488 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:49.800611 13500 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.121s	user 0.009s	sys 0.001s
W20260709 13:02:49.800913  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.801054 13500 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.806907  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.813606  8580 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:02:49.720849 13572 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:49.821518 13603 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.869s	user 0.007s	sys 0.001s
W20260709 13:02:49.824671 13543 consensus_meta.cc:287] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.942s	user 0.009s	sys 0.000s
I20260709 13:02:49.826150 13621 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:49.580547 13643 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.871129  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:49.883471  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.013s	sys 0.004s
W20260709 13:02:49.884033  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.013s	sys 0.004s
W20260709 13:02:49.886253 13646 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.132s	user 0.001s	sys 0.002s
I20260709 13:02:49.771997 13374 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:49.896230  8506 raft_consensus.cc:2410] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:02:49.898887  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:49.900180  8502 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:49.908774  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:49.909467  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:49.879068 13492 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.883080 13603 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.917259  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:49.897339 13621 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.931248  8434 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:49.934779  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:49.935700  8504 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:49.779874 13438 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.889030 13543 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.905435  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:49.952008  8504 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:02:49.952741  8504 pending_rounds.cc:85] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 8
I20260709 13:02:49.953104  8504 pending_rounds.cc:107] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:02:49.953480  8504 raft_consensus.cc:2889] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:49.922516 13492 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.960292  8578 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:49.945801 13578 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.929391 13621 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.956846 13438 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.955825 13496 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:49.981879  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 329354us
I20260709 13:02:49.970876 13499 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.997124  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:49.971961 13655 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:49.984939 13496 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:49.984647 13566 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:50.025154  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.068773 13643 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.075522 13491 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:50.076081 13491 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:50.078123  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2216) took 1387 ms. Trace:
I20260709 13:02:50.078578  8577 rpcz_store.cc:276] 0709 13:02:48.690711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.690857 (+   146us) service_pool.cc:224] Handling call
0709 13:02:48.691144 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.453829 (+762685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.077838 (+624009us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b5400349254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:50.078058 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647770880}
I20260709 13:02:50.079196 13570 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:50.077105 13491 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:50.082404  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.083916 13658 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:02:49.972922 13578 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.093017  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.019620 13654 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.095176  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2383) took 2142 ms. Trace:
I20260709 13:02:50.049872 13655 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:50.094928 13654 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:50.102805 13654 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.095777  8429 rpcz_store.cc:276] 0709 13:02:47.948479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.948609 (+   130us) service_pool.cc:224] Handling call
0709 13:02:47.948804 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.359836 (+411032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.090613 (+1730777us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400239e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:50.090882 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":844631808}
I20260709 13:02:50.113550  9095 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:50.113821  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:50.115645  8580 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 13:02:50.117901  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:50.122555 13631 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.190s	user 0.010s	sys 0.007s
I20260709 13:02:50.122830  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:50.125375  9093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1234) took 1712 ms (client timeout 1852 ms). Trace:
I20260709 13:02:50.127755 13565 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.128614 13565 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.130893 13514 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.131582 13514 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.049549 13566 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.134573 13581 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:50.146763 13581 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.135864  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1015) took 1532 ms. Trace:
I20260709 13:02:50.148870  8426 rpcz_store.cc:276] 0709 13:02:48.603753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.675386 (+ 71633us) service_pool.cc:224] Handling call
0709 13:02:48.675685 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.695719 (+ 20034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.135505 (+1439786us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b5400290ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:50.135752 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21870848}
I20260709 13:02:50.129254 13565 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:50.139041 13578 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:50.125967  9093 rpcz_store.cc:269] 0709 13:02:48.428385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.433400 (+  5015us) service_pool.cc:224] Handling call
0709 13:02:50.125135 (+1691735us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b540049cd54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:50.125294 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13405952}
I20260709 13:02:50.006278 13499 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.140245 13571 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:50.051899 13500 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:50.193902  8580 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:02:50.194487  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 71788.4us
I20260709 13:02:50.199301  9096 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:50.194882  8577 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:50.201685  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:50.196552  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.216020  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.216060  8507 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:50.217861  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 312494us
I20260709 13:02:50.027536 13648 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.199s
I20260709 13:02:50.229449  8581 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:50.212322 13634 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:50.236955  8580 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:50.236861  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.235987  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.238225  8507 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:50.238487  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:50.215006 13543 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.220407 13492 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:50.245568  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 357137us
W20260709 13:02:50.238921 13569 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.790s	user 0.004s	sys 0.007s
I20260709 13:02:50.250164  9093 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:50.224115 13291 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:50.251133  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.252332  8509 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:50.253952  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:50.255653  8426 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.257799  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.258668  8433 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 13 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:02:50.254273  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.259294  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.259920  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.259969  8504 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:50.260619  8431 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:50.228372 13621 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:50.267067  9094 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:50.267643  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.247871 13083 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:50.241379 13598 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:02:50.253826 13634 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:50.257244 13643 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.274541  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.277005  8426 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:50.277961  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.278633  9093 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 8.
I20260709 13:02:50.280627  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.279076  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.281222  8428 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:50.282002  8431 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:50.262689 13566 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.283843  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.284991  9094 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:50.285429  8427 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:50.270571 13655 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:50.274060 13581 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:50.287088  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.256625 13291 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.292573  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.297637  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.294147 13621 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:50.296698  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.298125  9101 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:50.301399  8426 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:50.302307  9100 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:50.303943  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:50.304838  9094 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:50.289624 13514 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.282135 13643 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.291091 13566 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:50.437265  9068 connection.cc:256] RPC call timeout handler was delayed by -1.2244003260000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 13:02:50.370914  8505 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:50.402824  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.424468 13488 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.493115  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.518110  8580 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:50.517926  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.426115  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:50.452803 13641 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.022s	user 0.003s	sys 0.000s
I20260709 13:02:50.453907  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:50.425107 13272 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.443948  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:50.520864  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 67027.1us
I20260709 13:02:50.521049 13539 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:50.449200  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.521785 13539 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:50.521530 13238 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:50.522617  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 96635.5us
I20260709 13:02:50.519166  8428 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:50.400842  8431 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:50.523063 13539 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:50.439013 13647 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.641s	user 0.002s	sys 0.006s
I20260709 13:02:50.524902  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:50.349732 13553 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.994s	user 0.010s	sys 0.003s
W20260709 13:02:50.490990  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.467474  9096 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:50.402261  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:50.405124  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.422099  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2392) took 1981 ms. Trace:
I20260709 13:02:50.525920 13553 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.461452  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.528421  8510 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:50.443758  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.529201 13553 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.529561  8501 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:50.431563  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.441565 13496 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.530629  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.416133  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:50.531754  9095 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:50.411931 13509 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:50.326478 13499 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.517776 13488 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.530982  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.395350  9098 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:50.432109  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:50.402050  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.408663  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:50.446735  9099 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:50.523468  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:50.454890  8433 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:50.539561  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.371590  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2501) took 1247 ms. Trace:
I20260709 13:02:50.540982  9100 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.407337  8583 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:50.541613  8583 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:50.522243  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:50.401677  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.547573  8429 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:50.547919  8508 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:50.396524  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:50.391419  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:50.398339  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.538074  9065 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:50.540417  8582 rpcz_store.cc:276] 0709 13:02:49.124423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.124535 (+   112us) service_pool.cc:224] Handling call
0709 13:02:50.371272 (+1246737us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b54000aa0d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:50.371495 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56372096}
I20260709 13:02:50.550514  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:50.383023 13637 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.629s	user 0.001s	sys 0.008s
I20260709 13:02:50.448424  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1217) took 2095 ms. Trace:
W20260709 13:02:50.370129  8503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2201) took 2095 ms (client timeout 1998 ms). Trace:
I20260709 13:02:50.420212 13578 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.407473  8434 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:02:50.535655  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.535501  8427 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:50.561414  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.552140  9102 rpcz_store.cc:276] 0709 13:02:48.352830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.357809 (+  4979us) service_pool.cc:224] Handling call
0709 13:02:48.358118 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:49.447585 (+1089467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.448189 (+1000604us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002bc0d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:50.448365 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2503919488}
I20260709 13:02:50.531858  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:50.395990  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:50.552778  8550 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:50.330726 13305 consensus_meta.cc:287] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.869s	user 0.008s	sys 0.004s
I20260709 13:02:50.349578 13565 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:50.528929  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.551354  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.616741  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:50.552248  8503 rpcz_store.cc:269] 0709 13:02:48.274753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.330447 (+ 55694us) service_pool.cc:224] Handling call
0709 13:02:50.369862 (+2039415us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003c5854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:50.369999 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340236544}
I20260709 13:02:50.559909  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:50.402357  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:50.618319  8426 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.527604  8432 rpcz_store.cc:276] 0709 13:02:48.440362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.440520 (+   158us) service_pool.cc:224] Handling call
0709 13:02:48.465329 (+ 24809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.482244 (+ 16915us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:48.482290 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:48.482900 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.711478 (+228578us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:48.711519 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.711585 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.421153 (+1709568us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b24001713f8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a160d89c4 00007f1a160d6acb 00007f1a16291dc9 00007f1a16291a55 00007f1a16290fb0 00007f1a18f07488 00007f1a18f07be8 00007f1a18edf398 00007f1a18eda76a 00007f1a18ed9bb6
0709 13:02:50.421746 (+   593us) raft_consensus.cc:1685] finished
0709 13:02:50.421783 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.422014 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16384,"raft.queue_time_us":18817,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"spinlock_wait_cycles":29089152,"thread_start_us":68380,"threads_started":1,"wal-append.queue_time_us":189815}
I20260709 13:02:50.619401  8428 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:50.519172  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.429989 13498 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:50.560787 13513 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:50.346624 13508 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.252s	user 0.007s	sys 0.008s
I20260709 13:02:50.350467 13575 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:50.373416 13485 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.406852 13491 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.546590  8583 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:50.568208  8502 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:02:50.645216  8502 pending_rounds.cc:85] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 11
I20260709 13:02:50.645556  8502 pending_rounds.cc:107] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:02:50.645855  8502 raft_consensus.cc:2889] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:50.446098  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.597430  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:50.349298 13291 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:50.516680  9068 connection.cc:256] RPC call timeout handler was delayed by -1.2055003260001058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 13:02:50.649413  9068 connection.cc:256] RPC call timeout handler was delayed by -1.0246003260000407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
I20260709 13:02:50.551704 13566 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.613976  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.567039 13499 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:02:50.635695 13519 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:50.452975 13514 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
W20260709 13:02:50.620358  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 60568.4us
I20260709 13:02:50.623092  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.659554  8430 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:50.659053  8429 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:50.567643 13578 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.562863  8584 raft_consensus.cc:2376] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16. Re-sending same reply.
I20260709 13:02:50.633822  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.519357 13643 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.567221 13509 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:50.567184 13496 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:50.629881  9095 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:02:50.639194  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2609) took 2049 ms. Trace:
I20260709 13:02:50.681670  8505 rpcz_store.cc:276] 0709 13:02:48.589511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.589709 (+   198us) service_pool.cc:224] Handling call
0709 13:02:50.370667 (+1780958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.558718 (+188051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.638941 (+ 80223us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54003c5850. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:50.639122 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4094954880}
I20260709 13:02:50.567039  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:50.567525 13655 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:50.684820  8510 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:50.685595  8426 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:50.633401 13432 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:02:50.642293  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.520998 13272 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:50.563678 13238 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:02:50.564642 13603 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:02:50.651518  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:50.330606 13570 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:50.618999 13503 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.611989  9094 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
W20260709 13:02:50.696419 13438 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.712s	user 0.012s	sys 0.004s
I20260709 13:02:50.634052 13498 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:50.573277 13543 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
W20260709 13:02:50.669771  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 59109.9us
I20260709 13:02:50.716096  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:50.670411  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54565.9us
W20260709 13:02:50.630754 13374 consensus_meta.cc:287] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.718s	user 0.005s	sys 0.008s
W20260709 13:02:50.676366  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 54212us
I20260709 13:02:50.680320 13650 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:02:50.686426  8510 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:50.660596 13519 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.663290 13485 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.697757 13621 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:02:50.679296 13654 consensus_meta.cc:287] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.576s	user 0.016s	sys 0.000s
I20260709 13:02:50.563625  8501 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:50.681169 13496 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.746344 13496 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:50.680958 13305 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:50.711964  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 60554.8us
I20260709 13:02:50.713007 13503 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.750288 13305 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.750670  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:50.750823 13305 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.752174 13503 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.752837  8505 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:50.753037  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.698570 13509 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:50.753835 13581 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:50.754819 13509 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.755483  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:50.720505  8476 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:50.757125 13438 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:50.688580 13250 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:02:50.758352 13492 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:50.758427  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:50.759676 13438 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:50.702467 13570 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:50.760666 13570 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:50.715512 13500 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:50.734586  9098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1231) took 2322 ms (client timeout 2168 ms). Trace:
I20260709 13:02:50.735807  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1403) took 1050 ms. Trace:
W20260709 13:02:50.762284  9098 rpcz_store.cc:269] 0709 13:02:48.411962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.412107 (+   145us) service_pool.cc:224] Handling call
0709 13:02:50.734321 (+2322214us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b540017a054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:50.734482 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4382084480}
I20260709 13:02:50.762627  9097 rpcz_store.cc:276] 0709 13:02:49.685518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.686960 (+  1442us) service_pool.cc:224] Handling call
0709 13:02:50.734489 (+1047529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.734792 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.734819 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:50.734884 (+    65us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:50.734921 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.735007 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.735573 (+   566us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540017a050. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:50.735733 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2408347008}
I20260709 13:02:50.646191 13508 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.754812 13581 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:50.764110 13581 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:50.764505 13581 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.765340 13508 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.673970  8507 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:02:50.758451 13250 consensus_queue.cc:1243] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:50.765780 13305 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.767264  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:50.768263 13305 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.761830 13438 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:02:50.768617 13500 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:50.771602 13500 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:50.772501 13500 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.757824  8476 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.761802 13570 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.774508  8476 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:50.776378  8476 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.776580 13553 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:50.776958 13272 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:50.777103 13643 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:50.778445 13643 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:50.778841 13643 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.780180 13578 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.763698  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.777719 13562 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:02:50.782320 13489 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:50.777091 13553 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:50.784056 13553 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.714946 13598 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:50.759408 13496 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:50.722209 13653 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:50.722518 13545 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:50.737783 13519 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:50.807451  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 295998us
I20260709 13:02:50.782444 13581 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:50.807971  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.006s	sys 0.021s
W20260709 13:02:50.819307  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.007s	sys 0.021s
W20260709 13:02:50.819794  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 572599us
I20260709 13:02:50.794965 13598 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.821836  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.823650  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.824306  8584 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:50.798962 13653 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.826763  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:50.829196  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.831359  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.803979 13438 raft_consensus.cc:2764] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:50.832495  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.835218  8577 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:50.804180 13488 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.838179  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.834787  9097 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:50.840389  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.840799  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.842881  8577 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:50.796654 13654 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:50.843286  8575 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:50.825382 13598 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:50.859910  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.812108  9100 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:50.868907  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:50.869045  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.869045  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.836542 13653 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.871516  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.874344  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:50.872195  8577 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 8.
I20260709 13:02:50.878520  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.881244  8504 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:50.882650  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.884150  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:50.885607  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 334297us
I20260709 13:02:50.885752  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.887856  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.898386  9097 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:50.806154 13498 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:50.889394  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.902462  8578 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:50.890666  8583 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.891225  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.892761  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.896369  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.899482  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.900457  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.903442  9095 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:50.905073  9102 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:50.882047 13374 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.901827  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.886199 13566 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:50.911695  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:50.913707  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.917178  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.917659  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:50.918833  9094 raft_consensus.cc:2410] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:02:50.919776  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:50.920162  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 202936us
I20260709 13:02:50.920830  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:50.921644  8429 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.924178  8576 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:02:50.923813  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 160172us
I20260709 13:02:50.926837  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.916702  8582 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:50.942122  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:50.942669  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:50.945556  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:50.930613  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.922611 13374 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:50.936024  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.909499 13305 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.939716  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.955744 13305 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.956629 13432 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:50.957120 13305 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.957221 13432 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.957726 13432 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.959126 13676 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:50.959553 13676 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.959895 13676 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.963812 13539 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:50.937637  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:50.964893 13581 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:02:50.965700  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.966331 13680 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:50.966207 13238 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:50.966984  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:50.968595  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:50.942746  8583 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:50.939646 13655 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:50.906665 13652 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:02:50.947000  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.930579 13670 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.980167 13670 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:50.948557  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:50.982523  8501 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:50.924121  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:50.931257  8549 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:51.016047  8431 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
W20260709 13:02:51.016155  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 84974.9us
I20260709 13:02:51.016947  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:50.964030  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:51.018054  8433 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
W20260709 13:02:50.970124  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.897330 13304 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:50.940845  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 293572us
I20260709 13:02:50.971946 13677 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:50.972054  8507 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:50.947690  9068 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:50.943536  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 225004us
I20260709 13:02:50.948530 13509 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:50.973312  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2503) took 1671 ms. Trace:
I20260709 13:02:50.973819  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2504) took 1671 ms. Trace:
W20260709 13:02:51.033787  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.961615 13566 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:02:50.970196 13671 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:02:50.946391 13578 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:02:50.948634 13438 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:50.971894 13673 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:02:51.012861  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:51.056881  8432 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:50.963106  8429 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
W20260709 13:02:50.983979 13512 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:02:51.035300  8549 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:51.036031  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.034060  8583 rpcz_store.cc:276] 0709 13:02:49.301998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.302140 (+   142us) service_pool.cc:224] Handling call
0709 13:02:49.311146 (+  9006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.407203 (+1096057us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b54000ceca0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b6dc0 00007f1a193411c0 00007f1a19342231 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c
0709 13:02:50.885471 (+478268us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b58006746d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1929b0aa 00007f1a1931d447 00007f1a19335fe7 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4
0709 13:02:50.973279 (+ 87808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.973739 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145296000}
I20260709 13:02:51.033007  8579 rpcz_store.cc:276] 0709 13:02:49.301548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.301691 (+   143us) service_pool.cc:224] Handling call
0709 13:02:49.323948 (+ 22257us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:49.802287 (+478339us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:49.802621 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.243245 (+440624us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:50.243827 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 13:02:50.243950 (+   123us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:50.244169 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.245583 (+  1414us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.245894 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.332552 (+ 86658us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b48000b1558. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:02:50.334123 (+  1571us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b18003215e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f
0709 13:02:50.334628 (+   505us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b48000b1558. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:02:50.353097 (+ 18469us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b18003215e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1
0709 13:02:50.353685 (+   588us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b18003215e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:50.398746 (+ 45061us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18003215e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:50.668947 (+270201us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b18003215e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419
0709 13:02:50.972997 (+304050us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54003df9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:50.973049 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.973095 (+    46us) raft_consensus.cc:1685] finished
0709 13:02:50.973108 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.973257 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":353870,"prepare.queue_time_us":110929,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":103,"raft.queue_time_us":358431,"raft.run_cpu_time_us":4416,"raft.run_wall_time_us":174675,"spinlock_wait_cycles":347945600,"thread_start_us":435053,"threads_started":1,"wal-append.queue_time_us":480960}
W20260709 13:02:51.043363  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.049804  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:51.058450  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:51.062136  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.062969 13500 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:51.063448  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 161601us
I20260709 13:02:51.071790  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:51.102100 13499 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:51.102699  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2227) took 2472 ms. Trace:
I20260709 13:02:51.107121  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:51.107321  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 69344.8us
I20260709 13:02:51.110410 13489 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:51.124820  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 83305.9us
I20260709 13:02:51.036628 13509 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.035583 13677 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:51.128360  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:51.014513 13543 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:02:51.039528 13570 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.103251  8435 rpcz_store.cc:276] 0709 13:02:48.630300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.700610 (+ 70310us) service_pool.cc:224] Handling call
0709 13:02:48.700892 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.701081 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:50.343258 (+1642177us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18004061e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf
0709 13:02:50.343449 (+   191us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.047456 (+704007us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.102154 (+ 54698us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:51.102239 (+    85us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:51.102316 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.102412 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.102596 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92400,"prepare.queue_time_us":212638,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":74875,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7804,"spinlock_wait_cycles":7243008,"thread_start_us":905265,"threads_started":3,"wal-append.queue_time_us":530110}
I20260709 13:02:51.134357  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:51.133183  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 97976.1us
I20260709 13:02:51.046954 13514 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:51.097733 13488 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:51.163806  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:51.164631  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:51.163719  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:51.165369  9094 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
W20260709 13:02:51.129369 13675 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:02:51.104226 13409 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:51.102738 13499 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:51.130214 13503 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:51.126556 13508 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.047909 13685 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:51.235391  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:51.248417  8501 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:51.135294  9102 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:51.129289 13489 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.149291  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:51.259030  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 109813us
I20260709 13:02:51.066279 13492 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:02:51.066888 13539 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:02:51.134356 13677 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:51.226140  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 84008.2us
W20260709 13:02:51.206867  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 80579.8us
I20260709 13:02:51.193169 13499 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:51.182205  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 112294us
I20260709 13:02:51.172356 13695 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:51.169608 13578 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:51.176656 13498 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:51.179242 13681 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:02:51.260782  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.165966 13514 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:51.180081 13666 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:02:51.129853 13655 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:51.142196 13654 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.163743 13438 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:02:51.134999 13643 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:51.224884 13409 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:51.263307  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 294776us
I20260709 13:02:51.169257 13620 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:51.259080 13672 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:02:51.271287  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:51.284056 13578 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.280069  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:51.134397 13509 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:51.161134 13570 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:51.258661 13685 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:51.297137 13514 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.161978 13519 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.266165 13489 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.289942  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:51.339792  8507 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:51.293655  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2212) took 1086 ms. Trace:
W20260709 13:02:51.296605  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 350618us
W20260709 13:02:51.293035  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 221628us
I20260709 13:02:51.341171  9068 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:51.342511  8398 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:51.340587  8506 rpcz_store.cc:276] 0709 13:02:50.206860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.667487 (+460627us) service_pool.cc:224] Handling call
0709 13:02:50.667792 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.668039 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:51.025244 (+357205us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.293283 (+268039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:51.293351 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:51.293407 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.293478 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.293599 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":292855,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":624,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5014,"thread_start_us":579516,"threads_started":2}
I20260709 13:02:51.346158  8506 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:51.346261  8398 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:51.324604  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.329236  8501 raft_consensus.cc:2376] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15. Re-sending same reply.
I20260709 13:02:51.180403 13670 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:51.331806  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 273450us
I20260709 13:02:51.266321 13238 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:02:51.335192  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74418us
W20260709 13:02:51.335817  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 56491.2us
W20260709 13:02:51.336701  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44896.3us
I20260709 13:02:51.350216 13683 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:51.350669 13671 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.332549 13374 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:51.359285  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:51.371088  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.296957 13650 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:02:51.377031  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:51.377962  8507 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:51.371456  8501 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:51.334956 13578 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.373335  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:51.339500 13685 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.363076  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.302330 13543 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:02:51.339655 13508 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:51.372782  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48243.7us
I20260709 13:02:51.391628 13543 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:51.385561  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2211) took 1180 ms. Trace:
I20260709 13:02:51.394497  8503 rpcz_store.cc:276] 0709 13:02:50.205115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.638623 (+433508us) service_pool.cc:224] Handling call
0709 13:02:50.639075 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.651359 (+ 12284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.651407 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.655756 (+  4349us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.844586 (+188830us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:50.844639 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.858507 (+ 13868us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.385329 (+526822us) raft_consensus.cc:1685] finished
0709 13:02:51.385353 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.385504 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3722,"raft.queue_time_us":5235,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":2403,"thread_start_us":156984,"threads_started":1,"wal-append.queue_time_us":279869}
I20260709 13:02:51.396762  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:51.407382  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:51.408773 13485 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.002s
I20260709 13:02:51.409058 13718 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:51.409210 13708 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:51.409564 13718 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.409986 13718 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.382441 13676 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:51.388989 13374 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:51.401971 13545 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:02:51.412592 13575 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:51.412889 13653 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.000s
I20260709 13:02:51.413161 13575 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.413332 13653 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.414275 13707 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:51.410244 13570 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:51.452212  8435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:02:51.453040  8435 raft_consensus.cc:606] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.453447  8435 raft_consensus.cc:614] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:51.414455  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:51.414362  9093 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
W20260709 13:02:51.424219  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.382275 13566 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:02:51.419495 13621 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:51.415293 13634 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:51.415953 13716 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.419561 13717 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:51.465741  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 58474.6us
W20260709 13:02:51.421036 13598 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.004s
I20260709 13:02:51.371366 13683 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:51.406543 13652 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:51.376319 13620 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:02:51.377296 13670 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:02:51.376264 13503 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:51.451116  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 110021us
I20260709 13:02:51.486213  8580 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 11. Ops: []
I20260709 13:02:51.468106 13717 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:51.489850  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:51.490567 13697 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:02:51.490772 13717 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.492285 13717 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.492893 13519 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:51.485697 13683 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.496397 13680 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:51.496862 13680 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:02:51.498622 13693 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:02:51.465147 13707 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:51.472572 13688 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:02:51.513824  8503 pending_rounds.cc:85] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 8
I20260709 13:02:51.517870  8503 pending_rounds.cc:107] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:02:51.518255  8503 raft_consensus.cc:2889] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:51.471619 13652 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.465169 13634 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:51.523425  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:51.484637 13492 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:51.527999  8507 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.464607 13514 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.489500 13503 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:51.527240  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 164284us
I20260709 13:02:51.529898  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:51.485723 13562 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:51.455250 13508 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:02:51.512868 13716 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.535532  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2215) took 1320 ms. Trace:
W20260709 13:02:51.526935 13672 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:51.536631  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:51.626793  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 90262.7us
I20260709 13:02:51.538818 13503 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.547073  8507 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:51.474107 13598 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:51.521905 13712 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:51.551476  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:02:51.607069  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.531524 13652 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.524384 13519 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.526381 13621 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.618916  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2213) took 1406 ms. Trace:
I20260709 13:02:51.620731  8510 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:51.622182  8505 rpcz_store.cc:276] 0709 13:02:50.217370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.682864 (+465494us) service_pool.cc:224] Handling call
0709 13:02:50.683229 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.753266 (+ 70037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.528684 (+775418us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b5400153e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:51.535470 (+  6786us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159673600}
I20260709 13:02:51.629221  9067 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.630378  8435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:02:51.648378  8435 raft_consensus.cc:606] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:51.545548  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 176441us
I20260709 13:02:51.646447  8504 rpcz_store.cc:276] 0709 13:02:50.212924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.263950 (+ 51026us) service_pool.cc:224] Handling call
0709 13:02:51.618655 (+1354705us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540008e8d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:51.618843 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393308032}
I20260709 13:02:51.538103 13492 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:51.497833 13680 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.648877  8435 raft_consensus.cc:614] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:51.654373  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2239) took 1458 ms. Trace:
I20260709 13:02:51.648866  8505 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:02:51.635924 13688 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:02:51.627461 13700 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.555321 13562 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:51.663059  8330 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57088 (request call id 360) took 56587 ms (client timeout 15000 ms). Trace:
W20260709 13:02:51.663200  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 111799us
I20260709 13:02:51.664005  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:51.664865  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:51.536010 13719 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 13:02:51.682459  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:51.682842  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:51.683344  8429 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:51.655938  8581 rpcz_store.cc:276] 0709 13:02:50.195914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.240615 (+ 44701us) service_pool.cc:224] Handling call
0709 13:02:50.240962 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:50.243469 (+  2507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.243500 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:50.262918 (+ 19418us) log.cc:844] Serialized 52 byte log entry
0709 13:02:50.682675 (+419757us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:50.715579 (+ 32904us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.720881 (+  5302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.720955 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.654136 (+933181us) raft_consensus.cc:1685] finished
0709 13:02:51.654162 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.654315 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122,"prepare.queue_time_us":32449,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":3801,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":6976,"thread_start_us":398471,"threads_started":1,"wal-append.queue_time_us":596998}
I20260709 13:02:51.684221  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:51.684791  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.681720  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:51.686928  8432 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:51.688653  8434 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:51.644256 13712 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:51.695555  8435 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:51.684725  8429 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.652916 13729 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:51.656401 13643 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:51.700739  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 71583.2us
I20260709 13:02:51.637041 13634 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:51.654537 13621 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:51.710654 13711 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:02:51.697048 13725 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:51.620092 13716 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:51.688226 13491 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.035s	user 0.013s	sys 0.000s
I20260709 13:02:51.746905  8509 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:51.747761 13716 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:51.741922  8501 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:51.750686  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1039) took 1395 ms. Trace:
I20260709 13:02:51.751076  8510 rpcz_store.cc:276] 0709 13:02:50.355099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.724198 (+369099us) service_pool.cc:224] Handling call
0709 13:02:51.620559 (+896361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:51.647295 (+ 26736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.750523 (+103228us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540008e8d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:51.750636 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060530560}
I20260709 13:02:51.697265 13519 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:51.716270 13305 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.003s
I20260709 13:02:51.714987  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.717473  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:51.697824 13715 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:51.712888 13700 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:51.759714  8432 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.626628 13707 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.698184 13489 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:51.762213  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48251.6us
I20260709 13:02:51.712332 13718 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.727162 13562 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.727468 13603 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:51.766966 13603 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:51.767094 13272 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:51.767501 13272 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:51.767874 13603 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:51.768440 13598 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:51.768924 13603 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:51.769699  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:51.770728  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:51.770756  8428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:02:51.771360  8434 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:02:51.771476  8428 raft_consensus.cc:606] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.730391  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:51.773921  8428 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: [11.11-13.12]
I20260709 13:02:51.739028 13488 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:51.774452 13488 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.776324 13272 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:51.777396 13272 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:51.758723 13492 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.780614  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:51.663578  8330 rpcz_store.cc:269] 0709 13:01:55.059710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.059907 (+   197us) service_pool.cc:224] Handling call
0709 13:01:58.553933 (+3494026us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5400020710. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621b0b2 00007f1a1f194a89 00007f1a1f12cda6 00007f1a1f0fe088 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc
0709 13:02:51.647340 (+53093407us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:45.518843 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:45.519570 (+   727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:45.519627 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:02:45.519660 (+    33us) tablet.cc:662] Decoding operations
0709 13:02:45.520154 (+   494us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:45.520261 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:45.520288 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:45.520724 (+   436us) tablet.cc:701] Row locks acquired
0709 13:02:45.520777 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:02:45.520941 (+   164us) write_op.cc:270] Start()
0709 13:02:45.521097 (+   156us) write_op.cc:276] Timestamp: P: 1783602165520885 usec, L: 0
0709 13:02:45.521141 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:02:45.604488 (+ 83347us) log.cc:844] Serialized 913 byte log entry
0709 13:02:46.614833 (+1010345us) op_driver.cc:464] REPLICATION: finished
0709 13:02:47.875157 (+1260324us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a162350ac 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a1cd75ef0
0709 13:02:47.936295 (+ 61138us) write_op.cc:301] APPLY: starting
0709 13:02:47.936395 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:47.941129 (+  4734us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:47.941172 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:47.956637 (+ 15465us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:47.956970 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:02:47.957039 (+    69us) write_op.cc:312] APPLY: finished
0709 13:02:47.957326 (+   287us) log.cc:844] Serialized 33 byte log entry
0709 13:02:48.675777 (+718451us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.675865 (+    88us) write_op.cc:454] Released schema lock
0709 13:02:48.675922 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:48.676357 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.676383 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":345493,"reported_tablets":44,"spinlock_wait_cycles":24825728,"child_traces":[["op",{"apply.queue_time_us":1306214,"apply.run_cpu_time_us":63381,"apply.run_wall_time_us":740055,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12479,"num_ops":2,"prepare.queue_time_us":133552,"prepare.run_cpu_time_us":25705,"prepare.run_wall_time_us":223640,"raft.queue_time_us":317512,"raft.run_cpu_time_us":19022,"raft.run_wall_time_us":1278499,"replication_time_us":1093521,"spinlock_wait_cycles":17253632,"thread_start_us":2341186,"threads_started":5,"wal-append.queue_time_us":986422,"wal-append.run_cpu_time_us":21915,"wal-append.run_wall_time_us":3042917}]]}
I20260709 13:02:51.780951  8508 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:51.745548 13634 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:51.705664 13729 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:51.798089  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.807005  8426 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:51.715165  8429 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:51.762965  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:51.809152  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46267.4us
W20260709 13:02:51.764307 13432 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.786s	user 0.011s	sys 0.000s
I20260709 13:02:51.766467 13304 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:51.782521  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2219) took 1231 ms. Trace:
I20260709 13:02:51.811559  8508 rpcz_store.cc:276] 0709 13:02:50.550926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.040169 (+489243us) service_pool.cc:224] Handling call
0709 13:02:51.040461 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:51.781395 (+740934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.782311 (+   916us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b540033b654. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:51.782469 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702152448}
I20260709 13:02:51.783792  8584 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:51.785180  8581 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:51.812340  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:51.787067  8432 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:51.753224 13725 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:51.783510  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:51.757326 13519 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:51.816288  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:51.810070  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.814425  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:51.819531  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.821817  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:51.823454  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:51.823956  8580 raft_consensus.cc:2410] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:51.762596 13700 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.826787  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:51.828763  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:51.825618 13689 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:51.829850 13732 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:02:51.824856 13716 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:02:51.815708 13725 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:51.833379  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:51.822899 13519 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.834568  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:51.836508 13706 log.cc:927] Time spent T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:02:51.836783  8582 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:51.838161  8578 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:51.838493 13496 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:51.840552  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:51.841231  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:51.841745  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:51.842722  8581 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:51.843568  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:51.808671 13655 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:51.844664  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:51.845060 13655 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:51.846933  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:51.847318 13409 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.847515 13655 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:51.764794 13712 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.827455  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:51.788188 13513 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.850803  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:51.852880  8429 raft_consensus.cc:2393] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:51.788074 13650 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:51.845551 13519 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.875941 13650 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.817058 13304 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:51.813825 13719 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:51.877935 13519 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:51.809214 13729 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.878268 13728 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:51.878614 13513 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.879738 13708 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:51.880122 13708 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:51.830248 13689 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.880944 13513 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.763926 13305 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:51.822968 13724 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:51.855192  8508 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.823403 13485 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.851650 13566 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:02:51.848647 13695 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:51.859256  8503 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:51.859794 13621 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:51.860746  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:51.861014 13503 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.861464  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:51.817922 13432 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:51.863935 13509 consensus_meta.cc:287] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 13:02:51.866876 13725 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.891402 13712 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:51.871052 13499 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 13:02:51.874301 13701 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:51.874459  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:51.875169 13438 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:51.887176 13718 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:51.888556  8547 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:51.889081 13683 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.825318 13723 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.891342 13514 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.891849 13305 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.892552 13685 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.894006 13653 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.881006 13689 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:51.898857  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 44453.2us
I20260709 13:02:51.844630 13652 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.905728  8502 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: [13.6-15.7]
I20260709 13:02:51.909351  8580 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:51.910295  8510 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:02:51.941041  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 87123.6us
I20260709 13:02:51.867997 13488 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.943099  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:51.923558  8508 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:51.940943  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:51.907863 13565 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.930171  8506 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:51.944761  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:51.933380  8575 raft_consensus.cc:2368] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12.
I20260709 13:02:51.907847 13695 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:51.913262 13735 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.924431 13508 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.936317  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:51.929345 13250 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:51.959096 13250 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:51.960033 13250 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.961318 13250 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.962462 13735 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.963734  8505 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:51.950350 13695 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.928790 13499 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.967767 13499 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.951152 13305 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:51.938323 13650 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.944504  8502 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
W20260709 13:02:51.932475  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 43989.7us
I20260709 13:02:51.972258  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:51.972579 13432 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:51.974366 13503 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.974778  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:51.975370 13685 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.976855 13685 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:51.977809 13683 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.979563 13652 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.946429  8576 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:51.983219  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:51.936782 13513 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:51.948860  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:51.935149 13701 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:51.987154 13304 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.987941 13701 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.989398 13304 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:51.990754 13689 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.925999 13509 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:51.958346 13578 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.556s	user 0.002s	sys 0.008s
W20260709 13:02:51.986325 13677 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.701s	user 0.002s	sys 0.008s
I20260709 13:02:51.986930 13725 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:51.985404 13685 consensus_queue.cc:1243] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:51.991206 13729 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:51.992483  9100 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:51.993386  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1417) took 1708 ms. Trace:
I20260709 13:02:51.995338  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.039438  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:52.039778  9098 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:52.039430  9093 rpcz_store.cc:276] 0709 13:02:50.284976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.285112 (+   136us) service_pool.cc:224] Handling call
0709 13:02:51.993206 (+1708094us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540058c354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:51.993328 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572836096}
I20260709 13:02:51.996551 13680 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.041563  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.002218 13598 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:52.003814  9097 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:52.004216 13716 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:52.005411  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.045212  9095 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:52.005935 13575 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.006685  9101 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:02:52.014993 13717 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:02:52.052989  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.007776 13708 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:52.009132  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 167957us
I20260709 13:02:52.009286 13496 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:52.009995  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 61201.8us
I20260709 13:02:52.010483 13620 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:51.948635 13565 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.011217  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:51.984817 13513 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.011794 13291 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.011358 13603 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:52.012794 13545 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.083287 13603 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.052069 13716 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.087289 13509 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.087803 13716 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:51.985143 13508 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.014307 13684 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:52.014709  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:52.032384 13578 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.018066  8507 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:52.099164  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.021791  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.100721  8429 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:51.951776  8504 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:02:52.014919 13304 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:52.030179  8426 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:52.107674  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.033411  8431 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:52.029603 13652 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.984537 13621 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.038148  9102 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:02:52.040572  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.999104  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.119309  9099 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:52.119187  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2254) took 1097 ms. Trace:
I20260709 13:02:52.000408 13723 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:52.042734  9093 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:02:52.007642  9096 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:52.055821  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.033807 13677 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:52.068439  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 57311.4us
I20260709 13:02:52.139385  8429 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:52.048803 13704 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:52.078585 13689 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.079867  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:52.144109 13704 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:52.080509  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:52.144799  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:52.075853 13513 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.145076 13704 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.081429 13291 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.093590 13708 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.094266  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:52.156747  8501 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:52.016678  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:52.117224  8510 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:52.157361  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 140745us
I20260709 13:02:52.158587  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.082767  8503 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:52.158988  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:52.119829  8431 rpcz_store.cc:276] 0709 13:02:51.023156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.031560 (+1008404us) service_pool.cc:224] Handling call
0709 13:02:52.031939 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:52.118870 (+ 86931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.119117 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:52.128850  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.161527  9095 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.076339 13496 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:52.141626  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.142338  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.090610 13620 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:52.145552  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.156602  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.095640  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.172940  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.173745  9098 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:52.121275  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.173738  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:52.174180  9100 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:52.176158  9100 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:02:52.177388  9100 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:52.177898  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:52.178440  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2253) took 1234 ms. Trace:
I20260709 13:02:52.178443  9094 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:02:52.178861  8430 rpcz_store.cc:276] 0709 13:02:50.943859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.962172 (+ 18313us) service_pool.cc:224] Handling call
0709 13:02:51.012552 (+ 50380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:51.114558 (+102006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.114591 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:51.114639 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:51.114674 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.178243 (+1063569us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400126454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:52.178283 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.178384 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234090880}
I20260709 13:02:52.179876  9094 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:52.180190  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:52.180802  8435 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
W20260709 13:02:52.180891  8509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2626) took 1930 ms (client timeout 1766 ms). Trace:
W20260709 13:02:52.181321  8509 rpcz_store.cc:269] 0709 13:02:50.250323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.255710 (+  5387us) service_pool.cc:224] Handling call
0709 13:02:52.180741 (+1925031us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54003c5d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:52.180831 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3400516864}
I20260709 13:02:52.172744 13492 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:52.182624 13492 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:52.183799 13492 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.186384  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.187131  9093 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.181820  9094 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:52.190938  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.190718 13620 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.192276  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.196473  9099 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:52.197743  9099 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:52.174293  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:52.198163  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:52.169291  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 112600us
I20260709 13:02:52.075088  8580 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:52.198490  8428 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:52.166682  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:52.229867  8427 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:02:52.230194  8501 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:52.232681  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:52.233212  8575 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.235159  8581 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:52.237179  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.239240  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 48908.6us
I20260709 13:02:52.240505  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:52.246224  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:52.141053 13508 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.157015 13712 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:52.173350 13720 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:52.122786 13652 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.241833  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:52.257997  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:52.259418  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.202106 13514 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:52.275085  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.235348 13432 raft_consensus.cc:2764] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:52.254937  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:52.264217  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:52.130841 13562 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:02:52.266765  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:52.260310  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:52.271489  9095 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:52.260777  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:52.288499  8578 raft_consensus.cc:2393] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:52.131136 13621 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.163479 13566 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:02:52.160072 13509 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.113s
I20260709 13:02:52.295763  8435 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:52.280983 13565 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.272917 13603 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.199721 13491 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:02:52.163617 13655 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
W20260709 13:02:52.289618  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.291839  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:52.278699  8431 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:52.293542  9093 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:52.275007 13304 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:52.278239 13514 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.276983 13717 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:52.251000 13650 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:02:52.261829 13722 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:02:52.305677  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:52.307570  9098 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:52.290012 13488 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.300247 13489 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.278005 13695 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.335043  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:52.336637  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:52.337327  8501 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:52.338383  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:52.340821  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:52.343705 13740 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:02:52.344833  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:52.345363 13621 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:52.346720  8510 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:02:52.321197 13409 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:52.347669 13409 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:52.347770  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:52.345424  8507 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.319659 13304 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.322235 13514 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:52.323239 13717 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.292569 13513 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.351023  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:02:52.355460  8430 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:52.356943  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:52.351840  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:52.358753  8501 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:52.352588  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.360072  8435 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.367271  8507 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:52.348541 13721 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:52.352030 13304 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.350816 13509 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:52.377666  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 46573.1us
I20260709 13:02:52.357911 13717 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.297802 13496 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.379810  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:52.380757 13291 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.349871 13489 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.381537 13650 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:52.388015 13652 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.391697  8575 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:02:52.348595 13409 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.394197 13677 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.354327 13729 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.397567  8435 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:52.446360  8509 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:52.400722  8507 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 8.
I20260709 13:02:52.448134  8583 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:02:52.448575  8583 pending_rounds.cc:85] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 8
I20260709 13:02:52.448822  8583 pending_rounds.cc:107] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:02:52.448850  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 2248) took 1530 ms. Trace:
I20260709 13:02:52.449182  8583 raft_consensus.cc:2889] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:52.368706 13722 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.452706 13513 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.426345  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:52.453724  8575 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 9: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:52.454380  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.455153  9093 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:52.456655  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.457237  9095 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:52.457294  9099 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:52.458891  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.459481  9093 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:52.461807  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:52.462582 13764 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:52.463165 13272 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:52.463642 13272 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:52.463747  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:52.464537 13764 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:52.465024 13764 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:52.464587 13272 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.465386 13764 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.466830 13685 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:52.467231 13685 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:52.468022 13685 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.468487  8429 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:52.468973 13545 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:52.469460 13685 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.469849  8575 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:52.471460  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:52.449378  8427 rpcz_store.cc:276] 0709 13:02:50.918245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.918370 (+   125us) service_pool.cc:224] Handling call
0709 13:02:51.730306 (+811936us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b5800060398. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621af8c 00007f1a1621aef6 0000000000375939 00007f1a1e28e1e0 00007f1a1e3570c4 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:02:52.448647 (+718341us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54003a4654. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:52.448778 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823862784}
I20260709 13:02:52.472750 13676 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.471900  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:52.474495 13305 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:52.474951  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:52.424357  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 178314us
I20260709 13:02:52.429410 13684 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.432078 13539 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:52.434114 13681 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:52.436159  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:52.438311  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:52.438469 13695 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:52.439324 13760 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:02:52.395211 13578 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.491787  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:52.441327 13565 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:52.417519 13509 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.472713  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:52.500140  8583 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:02:52.500691  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:52.502000  8575 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:52.477253  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:52.432068 13489 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.504237  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:52.479913  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 43827.9us
I20260709 13:02:52.506492  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:52.478749  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:52.484920  9100 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:52.484969  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:52.495335  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 189724us
I20260709 13:02:52.495640  9101 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:52.496734  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.508415  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:52.514845  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:52.515527  8429 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
I20260709 13:02:52.515771  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:52.516363  8435 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 8.
I20260709 13:02:52.518599  9098 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:52.521675  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2634) took 1065 ms. Trace:
I20260709 13:02:52.524160  8550 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:52.523749  8504 rpcz_store.cc:276] 0709 13:02:51.455890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.652478 (+196588us) service_pool.cc:224] Handling call
0709 13:02:51.664000 (+ 11522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.104204 (+440204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.521451 (+417247us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540008ded4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:52.521622 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660998912}
I20260709 13:02:52.517001  8476 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:52.526679 13650 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:52.527513 13650 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.528882 13650 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:52.534335  8550 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:52.535455 13650 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:52.536273  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:52.537138 13512 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:52.537768 13650 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:52.539192  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.539789  8429 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.540025 13650 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.544656 13512 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:52.545192 13512 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:52.546833  8429 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:52.546307 13512 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.549037 13512 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.551420 13578 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:52.555492  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.559528 13488 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:52.561265 13578 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:52.561784 13578 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:52.562903 13578 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.477887 13539 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:52.486419 13730 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:52.573662  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:52.573743  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 56823us
I20260709 13:02:52.576575  8476 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:52.578624  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:52.581758  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:52.582521  8433 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:52.586992  8583 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:52.499142 13272 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.494310 13761 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:52.498339 13565 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:52.517632 13491 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:52.522670 13562 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:52.520951 13704 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:52.479336 13652 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:02:52.522866 13695 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:52.568658 13553 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.613606  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:52.591684 13305 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:52.520634 13498 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:02:52.640092  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:52.522526 13492 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:02:52.677229 13509 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:52.678697 13764 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.681211 13764 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.681521 13304 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.687350 13304 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.621163 13704 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:52.639323 13676 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:52.649937 13305 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.701823  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:52.648325 13562 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:52.692600 13291 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:52.734172  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 157700us
I20260709 13:02:52.700093 13704 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.646819 13695 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.645905 13758 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:02:52.648590 13677 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:02:52.672679 13712 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:02:52.699919 13676 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:52.724115 13305 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:52.796307  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 258304us
I20260709 13:02:52.692493 13671 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:02:52.693377 13705 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:02:52.733376 13291 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:52.795413 13509 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.807116 13509 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:52.808799  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.797960  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:52.810118 13761 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:52.811132 13508 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:52.811008  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 244150us
I20260709 13:02:52.811748 13508 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.811197 13761 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.819367  8475 leader_election.cc:400] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12.
I20260709 13:02:52.821502  8475 leader_election.cc:403] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:52.798825 13676 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:52.822540 13496 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:52.825701  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.826084  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.826501 13759 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:52.826689 13757 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:02:52.826911  8430 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:52.827062 13759 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.827934  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.829092  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:52.829244 13759 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.735024 13539 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.811931 13509 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:52.829783 13759 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.820250 13498 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:02:52.828115 13765 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:02:52.812178 13508 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.830611  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.845702  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:52.812628 13291 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.856907  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.859148  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:52.853806  8576 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:02:52.864843  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:52.879493  8501 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.895979  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:52.896983  8502 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
W20260709 13:02:52.937762  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 118538us
I20260709 13:02:52.938376  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1040) took 1112 ms. Trace:
I20260709 13:02:52.936218  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.923931  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:52.940081 13708 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:52.938905  8432 rpcz_store.cc:276] 0709 13:02:51.826216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.826639 (+   423us) service_pool.cc:224] Handling call
0709 13:02:51.826948 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:52.008171 (+181223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.008202 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:52.008787 (+   585us) log.cc:844] Serialized 52 byte log entry
0709 13:02:52.124929 (+116142us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:52.162728 (+ 37799us) log.cc:844] Serialized 14 byte log entry
0709 13:02:52.174440 (+ 11712us) log.cc:844] Serialized 14 byte log entry
0709 13:02:52.446510 (+272070us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b1800458980. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:52.877786 (+431276us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b1800458980. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a18ef5d70 00007f1a18ee9293 00007f1a18edecea 00007f1a18edf23a 00007f1a19349a2a 00007f1a193590bf 00007f1a19359038
0709 13:02:52.937760 (+ 59974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.937843 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.937887 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:52.937898 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.938319 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264258,"prepare.queue_time_us":167931,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":242160,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":180,"spinlock_wait_cycles":114794496,"thread_start_us":115735,"threads_started":1,"wal-append.queue_time_us":129572}
I20260709 13:02:52.942360  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.943426  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.944456  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:52.945185  8432 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.922952  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:52.950526  8427 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 9.
I20260709 13:02:52.840092 13779 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:02:52.955852  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:52.953507  8501 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:52.956697 13708 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:52.955102  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:52.957684 13708 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:52.958623 13708 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.960920  8427 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:02:52.962656 13438 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:52.846377 13562 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.899055  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.969025  9094 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.896080  8510 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:52.971942 13783 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.972469 13783 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.973145  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:52.973752  9101 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.839687 13695 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.977559  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:52.976816  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:52.978627  8502 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:52.985086  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:52.986795  8430 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:52.917444 13509 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:52.989207 13773 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:52.989578 13305 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.989768 13773 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.991819 13305 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.992105 13773 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:52.996297 13578 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.830004 13717 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:52.974550 13570 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12.
I20260709 13:02:52.842460 13759 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:52.984081 13778 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:02:52.985680 13492 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.011545 13723 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:53.014803  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2419) took 1350 ms. Trace:
I20260709 13:02:53.020736  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:53.021481  9101 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:53.027261  8427 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.998745  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:53.028942  8502 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
W20260709 13:02:53.030423  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 328664us
I20260709 13:02:53.028357  8547 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:53.034585  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69766.9us
I20260709 13:02:53.034911  8510 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:53.039490  8432 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:02:53.033171  8400 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:53.052487  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:53.053534  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:53.025854  8434 rpcz_store.cc:276] 0709 13:02:51.664288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.772050 (+107762us) service_pool.cc:224] Handling call
0709 13:02:51.772354 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:51.772712 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:51.773018 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:02:52.001976 (+228958us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b18001027c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a1d21358f 00007f1a16252571 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd
0709 13:02:52.020006 (+ 18030us) spinlock_profiling.cc:243] Waited 9.18 ms on lock 0x7b18001027c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a
0709 13:02:52.036509 (+ 16503us) log.cc:844] Serialized 14 byte log entry
0709 13:02:52.036704 (+   195us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:52.064621 (+ 27917us) log.cc:844] Serialized 52 byte log entry
0709 13:02:52.064874 (+   253us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:52.064922 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.065010 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.088742 (+ 23732us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b18001027c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:52.992918 (+904176us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b18001027c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:53.014578 (+ 21660us) raft_consensus.cc:1685] finished
0709 13:02:53.014601 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.014741 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15611,"prepare.queue_time_us":277,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":15588,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":16631,"spinlock_wait_cycles":120107264,"thread_start_us":37214,"threads_started":1,"wal-append.queue_time_us":37557}
I20260709 13:02:53.054986  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:52.848703 13514 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.057121  8579 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:53.017705 13704 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:53.034230 13707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.017s
I20260709 13:02:53.058691  8504 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:53.061928  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:53.062603  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:53.063818  9095 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:53.067970  9098 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.068745  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:53.069123  9095 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:02:53.069511  9095 pending_rounds.cc:85] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 11
I20260709 13:02:53.069731  9095 pending_rounds.cc:107] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:02:53.069950  9095 raft_consensus.cc:2889] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:53.025735 13723 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:53.071979  8582 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:53.131637  9094 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:53.128898  8427 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
W20260709 13:02:53.124104  8549 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.41.254:45431, user_credentials={real_user=slave}} blocked reactor thread for 52269.6us
I20260709 13:02:53.135488  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:53.135913  8427 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:53.072228 13707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.000s	sys 0.018s
I20260709 13:02:53.139305  8584 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:53.031541 13677 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:02:53.071619 13712 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:53.056762 13784 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:53.067073 13492 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:53.055261 13438 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:02:53.057442 13695 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
W20260709 13:02:53.153496  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 116608us
I20260709 13:02:53.126273 13730 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:53.168278 13650 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.169121 13650 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:53.171857 13650 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:53.172554 13650 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.177577 13409 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:53.178270 13409 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:53.182540 13581 raft_consensus.cc:3055] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:53.183137 13581 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:53.183184 13717 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.185045 13759 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:53.153400  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 125119us
I20260709 13:02:53.071942 13509 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:02:53.162679 13514 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.191781  8547 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:53.208312  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:53.209914  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:53.210839  8582 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 10: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:53.190689 13620 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:53.243445  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:53.185886 13735 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.247352  8575 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:02:53.207396 13744 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:53.203476 13438 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.274585  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:53.271051  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 79371.5us
I20260709 13:02:53.240868 13731 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.280143  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:53.253279 13620 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.281884  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:53.283532  8427 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:53.284407  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:53.285746  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:53.266309 13761 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:53.197527 13492 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.287662  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:53.306948 13717 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:02:53.314908  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:53.276744 13272 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:53.319865 13793 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:02:53.286907 13772 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.321146 13789 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:53.321636 13789 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.307619 13781 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:02:53.322077 13789 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:53.322227 13781 consensus_queue.cc:1243] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:53.326862  8507 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:53.327229 13272 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:53.328397 13272 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.329608 13783 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:53.311699 13759 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:02:53.331264 13759 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:53.331633 13759 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:53.336454  8427 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:53.245985 13787 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:02:53.204802 13723 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.286739 13620 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.349054  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:53.353261  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:53.355204  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:53.355815  9094 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:53.358780 13785 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:02:53.360685 13503 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:53.372067  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:53.279152 13438 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.374666  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:53.375460  9100 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:53.425382  9095 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:53.309581 13508 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.427480  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:53.429579  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44632.2us
I20260709 13:02:53.427428 13491 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:02:53.438736  8581 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:02:53.439239 13438 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:53.439126  8581 pending_rounds.cc:85] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 7
I20260709 13:02:53.439916  8581 pending_rounds.cc:107] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:02:53.440145  8581 raft_consensus.cc:2889] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:53.441629  8581 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:53.333413 13761 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:53.342060 13676 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.366775 13723 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:53.452617  9095 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:02:53.372427 13772 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.465389  9094 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:53.371282 13512 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:53.286907 13731 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:53.446538  9098 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:02:53.474455  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:53.428323 13652 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:53.366997 13735 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:02:53.435412 13704 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.484635 13512 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:53.527372 13794 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:02:53.529376 13512 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:53.530200 13804 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:53.530807 13804 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.533612  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:53.534767  8427 raft_consensus.cc:2368] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:02:53.515275  8432 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:53.543358  8550 leader_election.cc:400] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:02:53.543803  8550 leader_election.cc:403] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:53.483595 13545 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:02:53.546207 13804 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:53.550406 13737 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:02:53.550966 13512 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:53.515034 13778 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:53.576437 13291 consensus_meta.cc:287] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.639s	user 0.002s	sys 0.009s
I20260709 13:02:53.470079 13759 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.587260 13785 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.595017 13291 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.597541 13778 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:53.649524 13785 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.654271 13785 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.604663 13784 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:53.678076  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:53.679039  9095 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:53.690742 13784 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:53.695556 13789 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:53.697618 13578 consensus_meta.cc:287] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
I20260709 13:02:53.698170 13508 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.700017 13291 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.701753  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:53.703320 13778 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:53.712507  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.715530  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:53.718494  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:53.724133  8427 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:02:53.705976 13776 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.890s	user 0.003s	sys 0.001s
I20260709 13:02:53.744673  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:53.774667  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:53.729282 13803 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:53.732801 13562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.010s	sys 0.016s
W20260709 13:02:53.779991 13562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.010s	sys 0.016s
I20260709 13:02:53.779385 13789 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:53.781458  8507 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:53.715677 13492 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.710629 13761 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:53.707738 13730 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:53.712006 13676 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.775315 13716 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:53.729324 13508 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:53.788339  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 72923.2us
I20260709 13:02:53.791379  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:53.795288  8575 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:53.796095  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:53.779946 13803 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.819960  9099 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:53.790838 13730 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.827263  8582 pending_rounds.cc:85] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 11
I20260709 13:02:53.828845  8582 pending_rounds.cc:107] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:02:53.829658  8582 raft_consensus.cc:2889] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:53.830469  8427 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:53.831979  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:53.781947 13704 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.793027 13716 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:53.836864  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2268) took 1322 ms. Trace:
I20260709 13:02:53.816116 13717 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:53.840026  8428 rpcz_store.cc:276] 0709 13:02:52.514790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.515889 (+  1099us) service_pool.cc:224] Handling call
0709 13:02:52.516281 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.577733 (+ 61452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.577778 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:52.593735 (+ 15957us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.682221 (+ 88486us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:52.682261 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.682347 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:53.705425 (+1023078us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:53.832932 (+127507us) raft_consensus.cc:1685] finished
0709 13:02:53.832951 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.836805 (+  3854us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76428,"raft.queue_time_us":70099,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3737,"spinlock_wait_cycles":361421568,"thread_start_us":65000,"threads_started":1,"wal-append.queue_time_us":135952}
I20260709 13:02:53.841456 13717 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.844779 13717 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.847433 13512 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:02:53.850124 13805 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:53.855737 13731 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:53.855878  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:53.856739  9097 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:53.857610  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:53.858995  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:53.859956  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2432) took 1322 ms. Trace:
I20260709 13:02:53.860380  8435 rpcz_store.cc:276] 0709 13:02:52.537835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.538005 (+   170us) service_pool.cc:224] Handling call
0709 13:02:52.538355 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.597730 (+ 59375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.597767 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:52.598266 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.199024 (+600758us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b1800334f60. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:02:53.635969 (+436945us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:53.636027 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.636124 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:53.859691 (+223567us) raft_consensus.cc:1685] finished
0709 13:02:53.859710 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.859902 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85200,"raft.queue_time_us":66699,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":6081408,"thread_start_us":436707,"threads_started":1,"wal-append.queue_time_us":1161753}
I20260709 13:02:53.816591 13508 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.874166 13803 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:53.824901 13620 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:53.898859  8509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2641) took 1565 ms (client timeout 1667 ms). Trace:
I20260709 13:02:53.900254  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2231) took 1994 ms. Trace:
I20260709 13:02:53.875339  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:53.911109  8505 rpcz_store.cc:276] 0709 13:02:51.905336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.906699 (+  1363us) service_pool.cc:224] Handling call
0709 13:02:51.906991 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:51.964061 (+ 57070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.899991 (+1935930us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54003728d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:53.900200 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129768320}
W20260709 13:02:53.912890  8509 rpcz_store.cc:269] 0709 13:02:52.333384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.347528 (+ 14144us) service_pool.cc:224] Handling call
0709 13:02:53.898634 (+1551106us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b54003e58d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:53.898785 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192787328}
W20260709 13:02:53.909677  9065 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.591s (SENT) [suppressed 17 similar messages]
W20260709 13:02:53.890316 13766 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.095s	user 0.000s	sys 0.002s
W20260709 13:02:53.891475 13769 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.157s	user 0.001s	sys 0.001s
W20260709 13:02:53.884420 13771 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.089s	user 0.002s	sys 0.000s
I20260709 13:02:53.877810 13772 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.934455  8581 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:53.939219  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:53.843847 13704 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:53.957553  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 47922us
I20260709 13:02:53.895213 13565 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.947997 13677 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.961333  8503 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:02:53.933538 13676 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:02:53.962520  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:53.886161 13716 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:53.962973 13708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.004s	sys 0.030s
I20260709 13:02:53.970605 13802 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:53.977931 13802 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:53.978367 13802 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:53.985239  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:53.986117  8509 raft_consensus.cc:2368] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10.
I20260709 13:02:53.987007  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:53.969061 13508 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.989432 13717 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:53.990381  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:53.990814  8575 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:53.991477  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:53.991935 13717 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:53.980482 13565 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:53.992944  8575 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:53.994482  8431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 2257) took 1977 ms (client timeout 2187 ms). Trace:
W20260709 13:02:53.994874  8431 rpcz_store.cc:269] 0709 13:02:52.016790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.173433 (+156643us) service_pool.cc:224] Handling call
0709 13:02:53.994320 (+1820887us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540026ff54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:53.994427 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237789952}
I20260709 13:02:53.997037  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:54.018671  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:54.019577  9093 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.966408 13784 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:02:53.975082 13708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.004s	sys 0.031s
I20260709 13:02:53.982008 13716 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:54.011926 13689 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:54.024596 13811 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 13:02:54.025285 13817 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:02:54.030782 13620 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:54.014837 13723 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:02:54.054701 13723 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:54.055188 13723 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:54.055971 13723 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.057126 13723 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.970464 13801 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:02:54.043027  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:54.048623  9095 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:02:54.046334 13689 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.051437  9093 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
W20260709 13:02:54.051617  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53642.2us
I20260709 13:02:54.063886  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:54.029110 13730 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:54.075038 13794 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:54.084103 13794 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:54.085042 13794 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.076588 13620 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:54.086488 13620 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:54.087374  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.088850 13620 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:54.094359 13689 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:54.095779  8579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 874) took 1856 ms (client timeout 2049 ms). Trace:
I20260709 13:02:54.095993  8583 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:02:54.096276  8579 rpcz_store.cc:269] 0709 13:02:52.239406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.240266 (+   860us) service_pool.cc:224] Handling call
0709 13:02:54.095533 (+1855267us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54000cd5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:54.095711 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779997952}
I20260709 13:02:54.098502 13787 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:54.098959 13787 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:54.099735 13787 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.101020 13787 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:54.104779  8398 leader_election.cc:336] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.766s (SENT)
I20260709 13:02:54.105341  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:54.097829  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2530) took 1609 ms. Trace:
I20260709 13:02:54.107040  8583 rpcz_store.cc:276] 0709 13:02:52.487965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.595858 (+107893us) service_pool.cc:224] Handling call
0709 13:02:54.095692 (+1499834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.096507 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.097627 (+  1120us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54000cd5d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:54.097759 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3398181248}
W20260709 13:02:54.117296 13827 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:54.109239 13676 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:54.123701 13830 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:54.125684  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 873) took 1886 ms. Trace:
I20260709 13:02:54.126228  8505 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:02:54.126139  8584 rpcz_store.cc:276] 0709 13:02:52.239093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.239522 (+   429us) service_pool.cc:224] Handling call
0709 13:02:52.239811 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.148783 (+908972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.125443 (+976660us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b54002fc6d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:54.125622 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068167552}
I20260709 13:02:54.128021 13708 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:54.128750 13708 consensus_queue.cc:1243] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:02:54.131403 13689 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:54.131512  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.131878 13689 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:02:54.133141 13824 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:02:54.132828 13689 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.134290 13704 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:54.134692  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.134335  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:54.136665  8509 raft_consensus.cc:2368] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13.
I20260709 13:02:54.137531 13730 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:54.119661 13826 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:02:54.142712 13676 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:54.146649 13721 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.147244 13721 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.149300  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:54.150825  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:54.151095 13767 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.418s	user 0.001s	sys 0.001s
I20260709 13:02:54.151501  9099 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:54.152209 13721 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:54.152393  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1425) took 2156 ms. Trace:
I20260709 13:02:54.152762  9102 rpcz_store.cc:276] 0709 13:02:51.996484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.996635 (+   151us) service_pool.cc:224] Handling call
0709 13:02:51.996939 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.118634 (+121695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.152145 (+2033511us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b54005f3a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:54.152318 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89879424}
W20260709 13:02:54.157231 13814 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 13:02:54.159175 13409 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.160459 13409 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.168773 13689 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:54.170114 13759 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.171608  8435 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:54.174247  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:54.174549  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:54.175100  8431 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.176934 13581 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.174288  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:54.183022 13735 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:54.183544 13735 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.185690 13735 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:54.181746  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:54.189193  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:54.189981  8428 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.194306 13489 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:54.194741 13489 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:54.195531 13489 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:54.196552 13489 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.197500 13539 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:54.198203  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.199692  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:54.200570  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:54.200598  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:54.201169 13811 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.206600 13722 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:54.207274 13722 consensus_queue.cc:1243] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:54.208310  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:54.209393  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:54.210337  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:54.219012  9099 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.211404  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:54.211845  9097 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:54.212740  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:54.215317  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:54.220583  9096 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:54.209757 13769 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.270s	user 0.001s	sys 0.001s
I20260709 13:02:54.221915  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:54.227031  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.218901  9065 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:54.229373  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:54.227743  8505 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:54.231935  9065 leader_election.cc:400] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10.
I20260709 13:02:54.232288  9065 leader_election.cc:403] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:54.229089  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:54.230635  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:54.233994  9096 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:54.229115  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:54.249475  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.239136  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:54.234642  8428 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 9.
W20260709 13:02:54.255882  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.177956 13581 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.257755  8576 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:54.264801  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:54.266633  8507 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:54.268527  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:54.244518  8435 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:54.257858  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.269841  8503 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:02:54.263669  8577 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:54.276829  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 54991.7us
I20260709 13:02:54.278527  8398 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:54.285010  9098 raft_consensus.cc:2410] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:54.285578 13723 raft_consensus.cc:2764] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:54.264111 13545 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.294894 13545 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.297086 13545 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:54.305775  8431 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:54.226166 13783 raft_consensus.cc:2764] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:54.218287 13508 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:54.305770  8507 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:02:54.229868 13565 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:54.229959 13772 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.235219 13728 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.259552 13704 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:54.326318  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 47914.3us
I20260709 13:02:54.332809  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.333038  9099 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:54.333760  8507 raft_consensus.cc:2368] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:02:54.273486 13799 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 9. Current term is 10.
I20260709 13:02:54.344641  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:54.345222  8504 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.280759 13761 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.348443 13761 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:54.350660 13761 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:54.351471 13695 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:54.351876 13695 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:54.352643 13695 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.309257 13721 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:02:54.227762 13680 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:02:54.283491 13676 raft_consensus.cc:2764] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:02:54.338320 13801 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:54.341184  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.371214  8509 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:02:54.341710 13772 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.321698 13811 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.374539 13772 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:54.334549 13565 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:54.376576 13565 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:54.324286 13784 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.343622  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:54.380600  8501 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:54.383898 13782 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.543s	user 0.011s	sys 0.000s
I20260709 13:02:54.302277 13733 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:54.386232 13733 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.386427  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2434) took 1847 ms. Trace:
I20260709 13:02:54.386637 13733 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:54.386811  8429 rpcz_store.cc:276] 0709 13:02:52.538859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.548830 (+  9971us) service_pool.cc:224] Handling call
0709 13:02:52.549442 (+   612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.621056 (+ 71614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.621091 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:52.645764 (+ 24673us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.812544 (+166780us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:52.812592 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:52.812655 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.383303 (+1570648us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:54.386111 (+  2808us) raft_consensus.cc:1685] finished
0709 13:02:54.386132 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.386352 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90465,"raft.queue_time_us":89217,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5899,"spinlock_wait_cycles":307925888,"thread_start_us":108504,"threads_started":1,"wal-append.queue_time_us":188332}
I20260709 13:02:54.361670  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.336293  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:54.390910  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 54702.6us
I20260709 13:02:54.391921  8398 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:54.393078  8398 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:54.323350 13707 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.393812 13707 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.395996 13707 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:54.310084 13545 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.396646 13545 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:54.398741 13545 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:54.399852 13801 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:54.400276 13801 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.400400  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2426) took 2163 ms. Trace:
I20260709 13:02:54.400642 13801 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:54.400820  8426 rpcz_store.cc:276] 0709 13:02:52.236582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.236944 (+   362us) service_pool.cc:224] Handling call
0709 13:02:53.996004 (+1759060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.996338 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.996368 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.996799 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.023323 (+ 26524us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:54.023363 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.023427 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.115186 (+ 91759us) raft_consensus.cc:1685] finished
0709 13:02:54.115209 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.400151 (+284942us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540026ff50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:54.400339 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2206,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"spinlock_wait_cycles":4044404608,"thread_start_us":26151,"threads_started":1,"wal-append.queue_time_us":74698}
W20260709 13:02:54.356768 13792 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.071s	user 0.000s	sys 0.002s
I20260709 13:02:54.354002 13695 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.403466  8398 leader_election.cc:400] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13.
I20260709 13:02:54.408121  8398 leader_election.cc:403] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:54.409404  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:54.372150  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:54.410372  8505 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:54.410274  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.412300  8509 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:54.402195 13705 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:02:54.407786 13409 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:54.414057 13783 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13.
I20260709 13:02:54.414705 13784 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:54.414955 13829 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.390s	user 0.003s	sys 0.000s
I20260709 13:02:54.417513  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:54.418474 13566 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.419389  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:54.409152 13291 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.427927 13707 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.428534  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:54.256773 13802 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.369079 13761 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:54.332832 13508 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:54.517546  8434 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:54.430810  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:54.518734  8428 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
W20260709 13:02:54.518759  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 57703.3us
I20260709 13:02:54.435166  8509 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:54.438627  8510 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:54.460325  8502 pending_rounds.cc:85] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 10
I20260709 13:02:54.522527  8502 pending_rounds.cc:107] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:02:54.522841  8502 raft_consensus.cc:2889] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:54.439288  8429 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:02:54.406965  8501 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:54.443974  8505 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:54.444208  8431 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:54.444141  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.446185  8426 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:02:54.365604  8504 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:54.530647  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:54.536597  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:54.539100  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.048s	sys 0.077s
W20260709 13:02:54.539464  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.048s	sys 0.077s
W20260709 13:02:54.541917  8582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.007s	sys 0.026s
W20260709 13:02:54.542272  8582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.007s	sys 0.026s
I20260709 13:02:54.542996  8584 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:54.546162  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.456472 13779 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:54.552007  8503 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:54.521391 13545 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:54.524585 13721 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.525821 13761 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:54.581041  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.607580  8504 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:54.603044  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:02:54.601917  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 343569us
I20260709 13:02:54.612862  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:54.616436  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:54.620020  8504 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:54.516984 13566 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.553290 13291 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:54.517714 13707 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.581112 13784 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.626006 13545 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:54.626341 13655 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:54.604184 13704 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:54.633126  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:54.622239 13787 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
I20260709 13:02:54.619732 13783 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:54.642045  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.645781  8507 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:54.646643  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:54.643637  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:54.649924  8427 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:02:54.650290  8427 pending_rounds.cc:85] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 11
I20260709 13:02:54.650511  8427 pending_rounds.cc:107] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:02:54.650727  8427 raft_consensus.cc:2889] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:54.651046  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:54.655828  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:54.651773  9068 connection.cc:256] RPC call timeout handler was delayed by -1.3288691839999274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 13:02:54.661758  9068 connection.cc:256] RPC call timeout handler was delayed by -1.1106411320000689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 13:02:54.611338 13721 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.667997  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:54.605345 13779 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.660037 13704 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:54.671969 13758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.839s	user 0.014s	sys 0.013s
I20260709 13:02:54.671216 13783 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:54.670589 13812 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:54.680946  9068 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:54.692546  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2436) took 1661 ms. Trace:
I20260709 13:02:54.693132  8432 rpcz_store.cc:276] 0709 13:02:53.030814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.042923 (+ 12109us) service_pool.cc:224] Handling call
0709 13:02:53.043307 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.535496 (+492189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.692228 (+1156732us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540025a3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:54.692470 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084984192}
I20260709 13:02:54.642503 13650 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:02:54.642320 13794 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:02:54.775347  9065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.019s
W20260709 13:02:54.682791 13758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.850s	user 0.014s	sys 0.013s
I20260709 13:02:54.636293 13291 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:54.789085  9065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.007s	sys 0.020s
I20260709 13:02:54.658895 13671 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:02:54.686252 13799 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:54.679881 13438 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:54.799153  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 530657us
W20260709 13:02:54.799944  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 119070us
I20260709 13:02:54.654870 13655 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:54.817497  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.672246 13787 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.130s
I20260709 13:02:54.654245 13784 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:54.784403 13238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.004s	sys 0.023s
I20260709 13:02:54.775825 13514 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:54.867204 13805 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:54.806178 13797 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:54.845427 13565 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:54.868709 13804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.004s	sys 0.028s
W20260709 13:02:54.865211 13238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.004s	sys 0.023s
I20260709 13:02:54.921798  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2532) took 2326 ms. Trace:
I20260709 13:02:54.661890 13761 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.777079 13812 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:54.922293  8580 rpcz_store.cc:276] 0709 13:02:52.595688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.647645 (+ 51957us) service_pool.cc:224] Handling call
0709 13:02:52.695916 (+ 48271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:52.727884 (+ 31968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.727917 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:54.146413 (+1418496us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b2c0003d068. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:02:54.146949 (+   536us) log.cc:844] Serialized 52 byte log entry
0709 13:02:54.456259 (+309310us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:54.456311 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.457427 (+  1116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.917206 (+459779us) raft_consensus.cc:1685] finished
0709 13:02:54.917227 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.921727 (+  4500us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2981,"raft.queue_time_us":128802,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":15498496,"thread_start_us":308894,"threads_started":1,"wal-append.queue_time_us":523727}
I20260709 13:02:54.864197 13545 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:54.932528 13784 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:54.881716 13514 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:54.936648 13838 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:02:54.926947 13804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.004s	sys 0.029s
W20260709 13:02:54.953478  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.012s	sys 0.049s
W20260709 13:02:54.954281  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.012s	sys 0.049s
I20260709 13:02:54.923965 13508 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:54.955292  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 676026us
I20260709 13:02:54.952442  9065 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:54.917642 13805 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:54.953400 13836 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
W20260709 13:02:54.962998  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 151479us
I20260709 13:02:54.950851 13514 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:54.950213 13797 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.952474 13851 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.972348  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:54.982152  9095 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:54.973908  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:54.983464  9096 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:54.953166 13581 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.968696 13799 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:54.967494 13842 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 13:02:54.957633 13802 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:54.962687 13566 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:54.950871  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 84064us
I20260709 13:02:54.966459 13811 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:55.084625  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2270) took 1748 ms. Trace:
W20260709 13:02:54.991582 13733 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.001s
I20260709 13:02:55.027166  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:55.083930 13489 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.085052  8582 rpcz_store.cc:276] 0709 13:02:53.335871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.825844 (+489973us) service_pool.cc:224] Handling call
0709 13:02:53.826870 (+  1026us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:53.835254 (+  8384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.835300 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:53.840791 (+  5491us) log.cc:844] Serialized 52 byte log entry
0709 13:02:54.542684 (+701893us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:54.542739 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.542827 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.084346 (+541519us) raft_consensus.cc:1685] finished
0709 13:02:55.084380 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.084564 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2789,"raft.queue_time_us":4501,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":28321,"thread_start_us":701328,"threads_started":1,"wal-append.queue_time_us":853236}
W20260709 13:02:55.139350  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 495747us
I20260709 13:02:55.140547  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:55.089962 13707 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:55.149129  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 491996us
I20260709 13:02:55.160578  9096 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:02:55.167788  8476 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.010s	sys 0.008s
W20260709 13:02:55.169353  8476 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.011s	sys 0.008s
I20260709 13:02:54.990646 13797 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.182713  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:54.955775 13438 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.085987 13794 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.173835  8547 leader_election.cc:400] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:02:54.994510 13581 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.190693  8547 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:02:55.177386 13759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.019s
W20260709 13:02:55.195781  8578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.022s	sys 0.025s
W20260709 13:02:55.308211  8578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.026s	sys 0.033s
W20260709 13:02:55.198654  8584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.015s	sys 0.057s
I20260709 13:02:55.129980 13489 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:55.278293 13655 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.130321 13811 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:55.276059 13801 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.875s	user 0.009s	sys 0.004s
I20260709 13:02:55.150754 13733 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:55.281668 13695 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.867s	user 0.001s	sys 0.009s
I20260709 13:02:55.130213 13852 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.341543 13852 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:55.179505  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 521965us
I20260709 13:02:55.297909  8508 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:02:55.343901  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:55.344702  8508 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:02:55.347298 13850 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:02:55.332199 13843 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.417s	user 0.001s	sys 0.001s
W20260709 13:02:55.307459  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 116835us
I20260709 13:02:55.352803  8547 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:55.309192  8584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.021s	sys 0.060s
I20260709 13:02:54.992450 13851 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:55.180632 13705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.011s	sys 0.032s
W20260709 13:02:55.287333 13722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.009s	sys 0.053s
W20260709 13:02:55.308104 13759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.001s	sys 0.019s
I20260709 13:02:55.267475 13794 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.185281 13707 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:55.338267 13801 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:55.340507 13733 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.327407 13508 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.333607 13772 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.334044 13803 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:55.335884 13735 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.357935 13840 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 13:02:55.358677 13722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.009s	sys 0.054s
W20260709 13:02:55.376565 13701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.533s	user 0.011s	sys 0.019s
I20260709 13:02:55.382190 13508 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.365751 13291 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.375756 13805 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:55.382493 13846 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:02:55.378609 13812 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:55.395977 13701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.552s	user 0.011s	sys 0.020s
I20260709 13:02:55.379488 13707 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:55.401386 13779 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.409533 13733 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:55.552314 13733 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:55.553012  9096 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:02:55.286630  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.003s	sys 0.017s
W20260709 13:02:55.554618  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.004s	sys 0.017s
I20260709 13:02:55.554718 13291 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:55.556246 13438 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:55.555974 13291 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.557169 13438 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.558337 13488 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:55.559412 13488 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:55.533526  8426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.011s
W20260709 13:02:55.560672  8426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.000s	sys 0.012s
I20260709 13:02:55.561160 13489 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:55.561229 13492 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.534246  8431 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:55.563438 13733 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.385258 13772 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:55.536585  8504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.035s	sys 0.045s
I20260709 13:02:55.536653  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2454) took 1116 ms. Trace:
I20260709 13:02:55.535291 13888 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.537863  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 184994us
W20260709 13:02:55.302487  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.005s	sys 0.015s
W20260709 13:02:55.539096  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 260100us
W20260709 13:02:55.615988  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.006s	sys 0.015s
W20260709 13:02:55.616606  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 991980us
I20260709 13:02:55.616678  8549 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:55.546689  8506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.006s	sys 0.006s
W20260709 13:02:55.618465  8506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.007s	sys 0.007s
W20260709 13:02:55.371228  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 344139us
I20260709 13:02:55.620100  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:55.620520 13581 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:55.621623  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:55.623121 13858 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:55.623811 13858 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:55.626183 13759 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.626499  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:55.627311 13884 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:55.627117 13759 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.627820 13884 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.628171 13565 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:55.628397 13884 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:55.550943  9065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.007s	sys 0.011s
W20260709 13:02:55.630389  9065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.007s	sys 0.011s
I20260709 13:02:55.631506  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.631750 13565 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:55.632478  9100 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:02:55.536299  8433 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:55.477315 13794 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.478484 13797 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:55.608362  8435 rpcz_store.cc:276] 0709 13:02:54.420356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.428567 (+  8211us) service_pool.cc:224] Handling call
0709 13:02:54.428896 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.429104 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.429128 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.429606 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.772529 (+342923us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:54.772572 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.772642 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.535860 (+763218us) raft_consensus.cc:1685] finished
0709 13:02:55.535910 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.536345 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":342526,"threads_started":1,"wal-append.queue_time_us":560718}
I20260709 13:02:55.620132  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2251) took 1378 ms. Trace:
I20260709 13:02:55.635411 13797 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:55.475955 13801 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:55.635905 13655 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:55.471623 13811 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:55.478101 13851 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.464469 13852 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:55.638585  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.405148 13863 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:02:55.642619 13863 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:55.643023 13863 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:02:55.463198 13864 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:02:55.643625 13772 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:55.468318 13868 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:55.645558 13705 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.561797 13508 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.396374 13735 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:55.646631 13705 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.647173 13863 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:55.591509  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:55.650372 13705 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.651338  9095 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:55.633453 13565 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.591266 13492 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.654259 13492 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.654805  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:55.656179 13735 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:55.656905  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:55.595759  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2452) took 1176 ms. Trace:
I20260709 13:02:55.596786  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.600394  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.601519  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:55.610795  8504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.035s	sys 0.045s
I20260709 13:02:55.612838 13438 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.613004 13888 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.614524 13291 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.625424 13858 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:55.646632  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2457) took 1187 ms. Trace:
I20260709 13:02:55.635561  8506 rpcz_store.cc:276] 0709 13:02:54.241332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.241495 (+   163us) service_pool.cc:224] Handling call
0709 13:02:54.241861 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.680218 (+438357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.680249 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.937490 (+257241us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b2c0005c2d8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:02:54.949151 (+ 11661us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.619318 (+670167us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:55.619433 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.619551 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.619614 (+    63us) raft_consensus.cc:1685] finished
0709 13:02:55.619637 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.620029 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15347,"raft.queue_time_us":100334,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":5432704,"thread_start_us":1056233,"threads_started":2,"wal-append.queue_time_us":504177}
I20260709 13:02:55.658628  8434 rpcz_store.cc:276] 0709 13:02:54.419022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.419171 (+   149us) service_pool.cc:224] Handling call
0709 13:02:55.595300 (+1176129us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b54003f2d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:55.595519 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164327296}
I20260709 13:02:55.625711  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:55.659070  9097 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:55.550450  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1290) took 1341 ms. Trace:
I20260709 13:02:55.637189 13655 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.658746  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:55.670686  9094 rpcz_store.cc:276] 0709 13:02:54.209332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.209452 (+   120us) service_pool.cc:224] Handling call
0709 13:02:54.209750 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.210154 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.210182 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.210674 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.552947 (+342273us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:54.552999 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.553328 (+   329us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.549818 (+996490us) raft_consensus.cc:1685] finished
0709 13:02:55.549865 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.550196 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":960,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":7490,"thread_start_us":341910,"threads_started":1,"wal-append.queue_time_us":592155}
I20260709 13:02:55.669891  8427 rpcz_store.cc:276] 0709 13:02:54.458782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.458914 (+   132us) service_pool.cc:224] Handling call
0709 13:02:54.459249 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.651115 (+191866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.645882 (+994767us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400290ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:55.646389 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437726464}
I20260709 13:02:55.679965  9099 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:55.710620  8508 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:02:55.704306  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1054) took 1048 ms. Trace:
W20260709 13:02:55.700125  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 74631.2us
I20260709 13:02:55.702590 13488 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:55.708781  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2459) took 1179 ms. Trace:
I20260709 13:02:55.759179  8431 rpcz_store.cc:276] 0709 13:02:54.529133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.530315 (+  1182us) service_pool.cc:224] Handling call
0709 13:02:55.708209 (+1177894us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003a2d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:55.708573 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305039744}
I20260709 13:02:55.703200 13655 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.672756 13705 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.776284 13705 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:55.777479 13865 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
I20260709 13:02:55.720593  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:55.779701  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 59228.3us
I20260709 13:02:55.780858  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2545) took 1239 ms. Trace:
I20260709 13:02:55.782110 13603 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:55.782760 13603 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:55.783176 13603 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:55.783227 13861 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:55.761008  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.717605 13671 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:55.784425 13671 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:55.784229 13861 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.781000  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2285) took 1130 ms. Trace:
I20260709 13:02:55.785914 13671 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.786383  8429 rpcz_store.cc:276] 0709 13:02:54.650384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.652230 (+  1846us) service_pool.cc:224] Handling call
0709 13:02:55.606232 (+954002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.606781 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.606821 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.607745 (+   924us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:55.607819 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.607921 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.780674 (+172753us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54003f2d50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:55.780826 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192855936}
I20260709 13:02:55.792160 13861 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.787169 13671 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.787572 13689 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:55.797093 13689 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.798086 13877 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:55.799312  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:55.799734 13689 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:55.800225  8505 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:02:55.788621  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.801273  9095 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:55.693825 13888 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.705376  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:55.802348  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.706811  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:55.789335 13852 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:55.691608  9098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1472) took 1649 ms (client timeout 2002 ms). Trace:
I20260709 13:02:55.710680  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:55.806527 13852 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:55.806340  9098 rpcz_store.cc:269] 0709 13:02:54.042603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.042779 (+   176us) service_pool.cc:224] Handling call
0709 13:02:55.691131 (+1648352us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540049d9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:55.691414 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516441344}
I20260709 13:02:55.809420 13852 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:55.789544  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.790731  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.757138  8476 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:55.797492  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:55.792182  9102 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:55.792342  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2453) took 1372 ms. Trace:
W20260709 13:02:55.811720  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 152253us
I20260709 13:02:55.757054  8426 rpcz_store.cc:276] 0709 13:02:54.655789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.655971 (+   182us) service_pool.cc:224] Handling call
0709 13:02:54.656217 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.924820 (+268603us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:54.951427 (+ 26607us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.561442 (+610015us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.561539 (+    97us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:55.561674 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.703935 (+142261us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54003f2354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:55.703986 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.704217 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26822,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":67042,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":393,"spinlock_wait_cycles":616964480,"thread_start_us":609355,"threads_started":1,"wal-append.queue_time_us":531670}
W20260709 13:02:55.759904  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 144656us
I20260709 13:02:55.801671  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:55.719815 13889 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:55.810559  9093 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:55.719134 13581 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:55.727818  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:55.704600  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:55.708089  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:55.791021  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.812016 13730 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:55.812085 13761 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:55.781387  8578 rpcz_store.cc:276] 0709 13:02:54.541247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.542148 (+   901us) service_pool.cc:224] Handling call
0709 13:02:54.607453 (+ 65305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.624145 (+ 16692us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:54.649831 (+ 25686us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.543825 (+893994us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.544972 (+  1147us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.545259 (+   287us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:55.545359 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.545551 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.650781 (+105230us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b48000b1558. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:02:55.776494 (+125713us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:02:55.780469 (+  3975us) raft_consensus.cc:1685] finished
0709 13:02:55.780495 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.780662 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19367,"prepare.queue_time_us":20369,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":92834,"raft.run_cpu_time_us":19419,"raft.run_wall_time_us":1035113,"spinlock_wait_cycles":11096064,"thread_start_us":855770,"threads_started":2,"wal-append.queue_time_us":690895}
I20260709 13:02:55.674361 13759 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:55.702483  8502 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.007s	sys 0.003s
I20260709 13:02:55.813539  8433 rpcz_store.cc:276] 0709 13:02:54.420084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.420390 (+   306us) service_pool.cc:224] Handling call
0709 13:02:54.420658 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.634358 (+1213700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.791971 (+157613us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400021054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:55.792223 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2564153728}
I20260709 13:02:55.716851 13409 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.826083  8505 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:55.826395  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.825026 13777 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:02:55.832418  8502 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.009s	sys 0.005s
I20260709 13:02:55.831658 13777 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:55.825685  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:55.841964  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:55.835044  8579 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:02:55.832473  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:55.848191  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:55.843427  8580 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:55.845129  8476 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 1 yes votes; 3 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:55.812191 13884 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.845582 13852 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:55.860782  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:55.861755  8578 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:55.862896 13758 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:55.863373 13758 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.863729 13758 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:55.872972 13759 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:55.873472 13759 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:55.873914 13759 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:55.874287 13802 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.875248 13802 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.871342  8508 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
W20260709 13:02:55.879379  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 61572.6us
I20260709 13:02:55.870406 13705 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.897898  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:55.888473 13730 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:55.857720 13889 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.915069 13721 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.918198 13708 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:55.918735 13708 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.919149 13708 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:55.919459  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 93924.9us
I20260709 13:02:55.868930 13409 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.910465  8400 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:55.905125 13438 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:55.924248 13707 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:02:55.927661 13884 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.946697 13603 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.929670  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:55.930181 13514 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.937s	user 0.014s	sys 0.009s
I20260709 13:02:55.931084 13777 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.881724 13704 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 13:02:55.934623 13787 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:55.935541  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:55.942528  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 145223us
I20260709 13:02:55.923019  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2264) took 1463 ms. Trace:
I20260709 13:02:55.947356 13804 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:55.928704  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:55.953188  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44656.5us
I20260709 13:02:55.952042  8476 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:55.955032  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 286044us
I20260709 13:02:55.955996  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:55.957093  8582 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:55.949879 13802 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:55.960485  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:55.967747  8576 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:02:55.958546 13804 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:55.971288 13680 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:55.984355  9068 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:55.986249  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.987593 13884 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:55.988456 13799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.033s	sys 0.028s
W20260709 13:02:55.988910 13799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.033s	sys 0.028s
I20260709 13:02:55.989202 13799 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:55.990525 13799 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:55.986304  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 94335.1us
I20260709 13:02:55.992364  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:55.994529  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:55.995350  9094 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:55.974956 13802 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.998184 13787 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.999956 13721 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:56.000474  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:55.986414 13777 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:55.976850 13438 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:55.998445 13802 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:55.955519  8502 rpcz_store.cc:276] 0709 13:02:54.459507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.459668 (+   161us) service_pool.cc:224] Handling call
0709 13:02:54.460075 (+   407us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:54.523607 (+ 63532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.523650 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:54.529235 (+  5585us) log.cc:844] Serialized 52 byte log entry
0709 13:02:54.998275 (+469040us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:55.770674 (+772399us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18002173c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:55.842558 (+ 71884us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.868537 (+ 25979us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.878744 (+ 10207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.888440 (+  9696us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.905138 (+ 16698us) raft_consensus.cc:1685] finished
0709 13:02:55.905158 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.922944 (+ 17786us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72755,"prepare.queue_time_us":293994,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":1501,"raft.queue_time_us":11661,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":4552,"spinlock_wait_cycles":5092224,"thread_start_us":1052543,"threads_started":2,"wal-append.queue_time_us":681403}
I20260709 13:02:55.979712 13730 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:55.959714 13514 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:55.985370 13680 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:56.017810  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.021272 13680 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.021493  9102 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:56.018918  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.019693  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:56.022429  9097 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.022379  9094 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:56.010959 13689 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:56.024070 13689 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.019506 13705 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.026885 13723 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.027860 13720 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:56.028499 13720 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.031042 13889 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:56.032260  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 62224.3us
I20260709 13:02:56.033316  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:56.003352 13438 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.032387  8433 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:56.026619 13705 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.036018  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:56.011176 13858 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:56.039093  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:56.042423  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.042554 13671 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.045426  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.047132 13848 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:56.047848 13848 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.048296 13705 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.050573 13804 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.051312  8429 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:56.051734  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.052760  8435 raft_consensus.cc:2410] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:56.053035  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.053350 13492 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.053961 13492 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.054330 13802 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.054412  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.051036  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.020895 13730 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:56.039539 13438 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.069090  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.055150  8434 raft_consensus.cc:2376] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13. Re-sending same reply.
I20260709 13:02:56.082633 13671 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:56.087833  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.088279  8432 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:56.088521  9102 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:56.088630 13581 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.089354 13701 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.051753 13804 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.089737 13671 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:56.111295  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:56.067934 13858 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:56.113442 13858 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:56.114639  8503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2256) took 1774 ms (client timeout 2176 ms). Trace:
I20260709 13:02:56.102923  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:56.115299  8503 rpcz_store.cc:269] 0709 13:02:54.339951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.361305 (+ 21354us) service_pool.cc:224] Handling call
0709 13:02:56.114173 (+1752868us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400154854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:56.114386 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323707776}
I20260709 13:02:56.115962  8507 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:56.103607  8584 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:56.104224 13689 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:56.105340 13409 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.106603  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.118171  8434 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
W20260709 13:02:56.119068  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 99158.2us
I20260709 13:02:56.119115  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2659) took 1484 ms. Trace:
I20260709 13:02:56.120587  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:56.121284 13844 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:56.122002 13844 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.125180 13889 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:56.125576 13844 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.128626  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:56.128867  8431 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:56.120729 13508 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.119719  8504 rpcz_store.cc:276] 0709 13:02:54.634439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.636749 (+  2310us) service_pool.cc:224] Handling call
0709 13:02:54.638952 (+  2203us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:55.686416 (+1047464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.686483 (+    67us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:55.687650 (+  1167us) log.cc:844] Serialized 78 byte log entry
0709 13:02:55.951760 (+264110us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:55.951900 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.957042 (+  5142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.118851 (+161809us) raft_consensus.cc:1685] finished
0709 13:02:56.118869 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.119058 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16057,"raft.queue_time_us":281563,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":13682,"thread_start_us":1287474,"threads_started":2,"wal-append.queue_time_us":428865}
I20260709 13:02:56.131098 13492 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.063369 13761 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:56.131242 13508 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:56.132253 13761 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.136329  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:56.137974  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:56.140262 13730 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:56.141332  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:56.142606  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:56.143518  8510 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:56.066612 13514 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:56.157608  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 124431us
I20260709 13:02:56.167537  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:56.167781  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:56.133785 13508 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:56.169402  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:56.171609  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 51148.2us
I20260709 13:02:56.177848  8502 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:56.179138 13409 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:56.179615 13409 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:56.180019 13409 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:56.181505  9097 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:56.184644  9065 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:56.184665  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:56.185523  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:56.199342  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:56.201676  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.200109  8506 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:56.203485  9099 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:02:56.086957 13708 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.208951  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:56.183123 13603 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.211279  8502 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:56.219468  9097 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:56.219035 13720 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.219063  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.170279 13759 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:56.226179  8510 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:02:56.233319  8433 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:02:56.238435  8581 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:56.207260 13787 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.242570 13848 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.243327 13897 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:56.243539  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.243837 13897 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.244199 13897 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.224246 13758 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.242467  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:56.244716  8398 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:56.244217  8426 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:56.208405 13508 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:02:56.259650  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:56.267520  9097 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:56.271466  8576 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:56.275864  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 100284us
I20260709 13:02:56.254334 13761 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:02:56.403683  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 337915us
W20260709 13:02:56.427527  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.429226  8577 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 10. Current term is 12. Ops: []
W20260709 13:02:56.433192  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 594520us
I20260709 13:02:56.427366 13735 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:56.418867 13492 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:56.438464 13492 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:56.440894 13492 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:56.441207  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:56.441576 13863 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:56.443120 13844 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:56.446123  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:02:56.427536  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 220272us
I20260709 13:02:56.446908 13759 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:56.447580  8476 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:56.454665 13844 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:56.455195 13844 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.455582 13844 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.455986  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.459764 13845 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.460747 13508 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:56.463502 13438 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.461239  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:56.465792 13845 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:56.466630 13845 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:56.468786  8476 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:56.471000 13508 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:56.473824 13508 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.476306 13508 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.472177 13566 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:56.476862 13735 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:56.477099 13708 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:56.478670  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:56.471441 13758 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.281805  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:56.485483  9094 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:02:56.505828  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 224445us
I20260709 13:02:56.506839  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:56.489594 13735 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.489974 13566 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:56.533777  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.534734  9102 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:56.509397 13787 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.507551 13508 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:56.477813 13848 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
W20260709 13:02:56.523051 13906 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 13:02:56.541723  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.490214 13761 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:02:56.526409 13735 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.540246 13671 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:56.560882  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.561596  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.553434 13603 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:56.542136 13566 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.549057 13508 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:56.573976 13902 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.097s	user 0.004s	sys 0.000s
I20260709 13:02:56.574535 13720 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.575239  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:56.575436 13720 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.574609 13784 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:56.577905  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.598214  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.600926  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.602268  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.591194  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.565675 13861 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:56.601723  8435 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:02:56.607992  9097 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:56.579104 13508 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:56.560835 13671 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.592085 13701 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:56.633347  9102 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:56.626153  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.642659  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.640743  9098 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:56.646699  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.615350 13884 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:56.614015 13867 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.615103 13707 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
W20260709 13:02:56.629686 13889 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.004s
I20260709 13:02:56.651250 13887 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.651449  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:56.654733 13859 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:02:56.623425 13720 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.584188 13787 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:56.664786 13859 consensus_queue.cc:1243] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:56.665457 13859 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:56.665830 13859 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:56.666913 13859 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:56.675381 13909 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:02:56.644811 13438 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:56.681409  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:56.644439 13704 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.661245 13712 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:56.652451 13884 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:56.701900  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:56.705212  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 140066us
I20260709 13:02:56.703132  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:56.690210 13889 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:56.695128  8433 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:56.653518 13861 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.713081  9098 raft_consensus.cc:2368] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16.
I20260709 13:02:56.709980  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.714799  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:56.696134 13680 consensus_meta.cc:287] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.004s
I20260709 13:02:56.700120 13859 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:56.682427 13867 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:56.708065 13884 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.725829  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:56.729954  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:56.623936 13858 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:56.742161 13918 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:56.742687 13918 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.743108 13918 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.710642 13887 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.734086 13777 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:56.746598 13777 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.747057 13777 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.747443 13887 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.733531  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:56.750371  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:56.751237  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:56.752035 13867 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:56.752409  8400 leader_election.cc:400] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16.
I20260709 13:02:56.752801  8400 leader_election.cc:403] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:02:56.752861 13867 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:56.753459 13867 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:56.757849 13409 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.009s
I20260709 13:02:56.758325 13409 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:56.760563 13409 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:56.761231 13409 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:56.763495 13720 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:56.764060 13720 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.764498 13720 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.767889 13712 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:56.768553 13712 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.768997 13712 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.771791 13671 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.772753 13671 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:56.773809 13861 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.771974 13514 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:56.703933 13844 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.712124 13802 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.784590  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:56.761732 13409 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.786549  8427 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:02:56.782678  9102 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:56.790215  9098 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:02:56.753916 13867 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.796010 13802 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:56.798808  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 82118.4us
I20260709 13:02:56.736002 13858 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:56.720250 13680 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.729647 13704 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:56.804612  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:56.787055 13514 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:56.838667 13514 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.801869  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:56.841164 13787 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:56.741868 13897 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:56.848805  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44368.2us
I20260709 13:02:56.850067  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:56.795331 13409 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.794327 13758 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.857267  8430 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:56.806425 13861 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:56.823876 13916 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.869176 13650 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:56.871642  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 73147us
I20260709 13:02:56.873133 13680 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:56.878204  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:56.887969  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:56.892695 13272 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:56.867264 13889 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:56.867352 13707 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:56.905668  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:56.902402  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:56.884840 13650 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.899689 13603 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:56.868660 13758 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:56.904543 13916 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:56.918619  8575 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:02:56.927646  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:56.909317 13784 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:56.906587 13707 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.930202  8398 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:56.926334  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:56.914402 13650 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.930820  8577 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
W20260709 13:02:56.954713  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.981905  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.027220  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 93668.3us
W20260709 13:02:57.051061  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.067039  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.893533 13861 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.111706  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:56.935089 13707 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.933707 13926 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:57.166340 13887 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.166607 13787 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.148859 13916 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:02:57.171887 13917 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 13:02:57.148995 13927 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
W20260709 13:02:57.148165 13914 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 13:02:57.139488 13844 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.193591 13889 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:56.927538 13858 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.172843 13802 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.182785 13897 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.184508 13758 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.178568 13603 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.239552 13887 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.240485 13787 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:57.212687 13272 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:57.220767 13784 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:02:57.252650 13735 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.674s	user 0.005s	sys 0.005s
W20260709 13:02:57.294531  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 62554.2us
W20260709 13:02:57.306874  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 92423.3us
I20260709 13:02:57.290011 13704 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.304965  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.311659  8427 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.307852 13758 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.308255 13858 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.310156 13940 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:57.319561 13671 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.000s
I20260709 13:02:57.302523 13735 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:57.324839 13508 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.002s
W20260709 13:02:57.339358 13566 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.765s	user 0.006s	sys 0.005s
I20260709 13:02:57.339768 13566 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:57.340771 13910 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.779s	user 0.000s	sys 0.015s
I20260709 13:02:57.342217 13758 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:57.331974 13712 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.006s
I20260709 13:02:57.364552 13933 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:57.341873 13566 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.372362  8427 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:57.373335  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.374503  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:57.375360 13717 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:57.375763 13717 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.317251 13926 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:02:57.334162 13671 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16.
W20260709 13:02:57.373836 13777 consensus_meta.cc:287] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.002s
I20260709 13:02:57.376132 13717 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.391265 13735 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.391810 13650 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.343899 13508 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:57.383678 13720 consensus_meta.cc:287] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.000s
W20260709 13:02:57.396140 13409 consensus_meta.cc:287] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
W20260709 13:02:57.397778 13918 consensus_meta.cc:287] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.654s	user 0.004s	sys 0.005s
W20260709 13:02:57.399091 13884 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.000s
I20260709 13:02:57.398952  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.400218  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.402680 13761 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:02:57.403366 13867 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.003s
I20260709 13:02:57.430333 13867 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.432480 13867 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.404060  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.433851  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.434909  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.435391  8433 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:02:57.436215  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.333407 13940 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:57.439462 13940 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:57.436663  8433 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.424295 13508 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.424388 13650 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.424821 13720 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.337693 13272 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.425527 13884 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:57.350004 13712 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.416468 13777 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.426210 13918 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.427162  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2560) took 1458 ms. Trace:
I20260709 13:02:57.428648  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.429126 13409 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.430011 13761 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:57.409281  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.455909  8435 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.437685 13707 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.450040  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.452484  8583 rpcz_store.cc:276] 0709 13:02:55.968898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.969066 (+   168us) service_pool.cc:224] Handling call
0709 13:02:57.400107 (+1431041us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aeee 0000000000375939 00007f1a1e28e1e0 00007f1a1e3570c4 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:02:57.427074 (+ 26967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8954752}
I20260709 13:02:57.457631  8427 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:57.459221  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.459928 13761 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:57.462010 13785 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.462118  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.462538 13785 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.457059 13650 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.463464 13650 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:57.464772 13785 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.465457 13650 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:57.466773 13848 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.469362  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.472311 13861 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.473021  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.473619  8579 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:57.475376 13712 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.476105  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.476678  8578 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:02:57.477049  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2295) took 1421 ms. Trace:
I20260709 13:02:57.478564  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:57.477514  8430 rpcz_store.cc:276] 0709 13:02:56.055258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.065349 (+ 10091us) service_pool.cc:224] Handling call
0709 13:02:56.097315 (+ 31966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.861202 (+763887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.476739 (+615537us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b5400128254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:57.476974 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727803136}
I20260709 13:02:57.484858  8581 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:57.485536  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:57.486881  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.487725  8501 raft_consensus.cc:2410] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:02:57.488437  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.489020  8501 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:57.491674  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.493007  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.494213  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:02:57.494689  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.496487  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.496898  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.489868  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.498193  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.499682  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:57.497092  8505 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:57.499953  8506 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.499019  8575 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:02:57.500231  8578 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.501834  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.502326  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.502665  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:57.502956  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.503352  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.503738  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.503903  8582 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:57.504037  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.504473  8580 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:57.504776  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.505098  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.505239  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.505342  8582 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:02:57.505996  8580 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:02:57.506383  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.506745  8582 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:57.509233  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.510799  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.511535  8507 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:57.511963 13848 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.512646  8505 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:57.514405 13848 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.516224 13707 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.516934  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.517638  8509 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:57.519953  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.521246  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.521853  8434 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 9.
I20260709 13:02:57.522449  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2548) took 1911 ms. Trace:
I20260709 13:02:57.522871  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:02:57.525137  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.523037  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:57.523464  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45001.5us
I20260709 13:02:57.526867  8428 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:02:57.538208  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:57.538626  8578 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:02:57.523917  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1297) took 1889 ms. Trace:
I20260709 13:02:57.534531  8435 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
I20260709 13:02:57.522806  8584 rpcz_store.cc:276] 0709 13:02:55.702703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.713394 (+ 10691us) service_pool.cc:224] Handling call
0709 13:02:55.713805 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.117048 (+403243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.522232 (+1405184us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54000659d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:57.522383 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739464448}
I20260709 13:02:57.542120  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1493) took 1535 ms. Trace:
I20260709 13:02:57.544900 13852 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.545477 13852 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.547667 13852 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:57.510191 13565 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.549290  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2671) took 1421 ms. Trace:
I20260709 13:02:57.522986 13777 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.523511 13508 raft_consensus.cc:2764] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:02:57.553725  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.556517  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.542526  9093 rpcz_store.cc:276] 0709 13:02:56.006241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.006339 (+    98us) service_pool.cc:224] Handling call
0709 13:02:56.036396 (+ 30057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.051948 (+ 15552us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:56.052248 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.541762 (+1489514us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.541817 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:57.541865 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.541937 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.542068 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1131514,"prepare.queue_time_us":663,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":357543,"threads_started":1,"wal-append.queue_time_us":799888}
I20260709 13:02:57.555061  8550 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:57.562196  8428 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:02:57.564332  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:57.552562 13884 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:57.569581  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:57.555116 13704 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:57.571534  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:57.571771  8502 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.572304  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:57.573450  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.553211  8503 rpcz_store.cc:276] 0709 13:02:56.127678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.146584 (+ 18906us) service_pool.cc:224] Handling call
0709 13:02:56.236047 (+ 89463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.256659 (+ 20612us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:56.412976 (+156317us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.641528 (+228552us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.455027 (+813499us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b1800492460. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:02:57.455160 (+   133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.455211 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:57.455254 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.455320 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.484075 (+ 28755us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b1800492460. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:57.549116 (+ 65041us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b540008f7d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:57.549232 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":803319,"prepare.queue_time_us":108131,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":843096,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":8857,"spinlock_wait_cycles":128747520,"thread_start_us":111215,"threads_started":1,"wal-append.queue_time_us":208706}
I20260709 13:02:57.574551  8509 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.579039  8428 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:57.565156 13492 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.585150  8501 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:02:57.591550  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:57.592135  8577 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.594070  8583 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:02:57.594161  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:57.597293 13949 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:02:57.597493 13943 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.598531 13799 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.598784 13777 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:57.599093 13799 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.601385 13799 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.602200 13897 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.602764 13897 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.596935 13492 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.606201  8584 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:57.607836  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:57.610572  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:57.597345  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.611475  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:57.609388  8502 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:57.539408  9101 rpcz_store.cc:276] 0709 13:02:55.634792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.636262 (+  1470us) service_pool.cc:224] Handling call
0709 13:02:55.636845 (+   583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.637387 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:55.923160 (+285773us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.271376 (+348216us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.252008 (+980632us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b1800360ac0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:02:57.523338 (+271330us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b1800360ac0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:02:57.523491 (+   153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.523538 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:57.523586 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.523658 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.523756 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28985,"prepare.queue_time_us":346279,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":77,"raft.queue_time_us":1273422,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":11402,"spinlock_wait_cycles":22725376,"thread_start_us":539445,"threads_started":2,"wal-append.queue_time_us":682973}
I20260709 13:02:57.612265  8579 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:57.617789  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:57.620909  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:57.624682  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.629062  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.621383 13581 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:57.630568 13701 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:02:57.631667  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 67377.4us
I20260709 13:02:57.601872 13799 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.633695  8583 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:57.575428 13845 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:02:57.638509  8434 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:57.572459 13565 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.621470 13844 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:57.610671 13758 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.640208  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.621611 13919 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:57.630164 13272 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:57.630805 13581 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.596050 13704 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:57.647742  8433 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:57.632364 13777 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:57.645011  8547 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:57.643932  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:57.634403 13943 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:57.637818 13797 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.640316 13689 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.664469 13689 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.664399 13797 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.665881 13581 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:57.666800 13689 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.658694  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:57.659318  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:57.656669 13707 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:57.667515  9093 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:02:57.667671 13704 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.667902 13707 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:57.668399 13707 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.668663  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:57.669257  9093 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.669576  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:57.670331  9094 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:57.612162 13717 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.671180  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:57.672163 13717 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.668412  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:57.673609  9098 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:57.667577  9097 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.646294 13919 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.646399 13844 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.641439 13708 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.662842  8509 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:57.634465 13701 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.664541  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:57.641153 13848 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:02:57.677130  8506 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:02:57.677353  9093 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:57.682528  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:57.681880 13919 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.676000  8577 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:02:57.684587  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:57.707219  9100 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:57.686964  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.709129  8431 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:57.657212 13799 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.712247 13799 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.657793 13777 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.688757 13701 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.664422 13943 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.652505 13897 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.691294  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:57.691445 13797 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.691869 13758 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.692907 13565 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.683204 13844 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:57.694339  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.694133 13708 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.744498 13708 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.694837 13492 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.695344 13707 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:57.698475  9097 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:02:57.734236 13272 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:57.687613 13562 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.746603 13272 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:57.747179 13272 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.748939 13707 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:57.749799  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.751190 13717 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:57.751412  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:57.752594 13717 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:57.753005 13717 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:57.753376 13717 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.753774  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:57.754667  8547 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:57.756098 13859 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:57.756629 13859 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:57.757579 13859 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.758208 13774 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:57.758755 13774 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:57.759622 13774 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.765093  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:57.767496 13785 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:57.768035 13785 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:57.768915 13785 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:57.769330 13943 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.764983 13844 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:57.723387 13777 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.771361 13848 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:57.772054 13925 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:57.772004 13848 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.772552 13925 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:57.773485 13925 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:57.774814  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 154038us
I20260709 13:02:57.776857  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:57.777982  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:57.778934  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:57.779515  8506 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.779279  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:57.780355  8502 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:57.781569  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.781694  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.782377  8427 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:57.783548  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:57.784547  8584 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:57.785538  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:57.779253  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:57.790644  8501 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:57.791090  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:57.787323  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:57.795221  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:57.793093  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:57.797392  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.778820 13603 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:57.801566  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.805244  8503 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:57.786332 13925 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:57.790287 13867 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:57.785614 13861 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:57.794269 13671 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:57.808444  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:57.813314  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.814014  8427 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:57.814640  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.817494  8435 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:02:57.818131 13904 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.199s	user 0.006s	sys 0.010s
I20260709 13:02:57.797818 13937 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:57.823294  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:57.826061 13603 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:57.826689 13603 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.827181 13603 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:57.828063  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.828719  8582 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:57.830214 13801 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.830732 13801 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.832842 13801 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.805423 13804 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:57.834268 13804 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.834709 13804 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:57.844064  8506 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:02:57.795456 13844 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.851687  8502 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:57.812844 13671 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.852666 13848 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.853135 13934 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:57.854684  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:57.855268 13889 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:57.861007 13565 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:57.862546 13923 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:57.863523  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:57.886780  8503 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:57.864292  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:57.865046  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:57.887553  8505 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:57.887715  8507 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:57.842415 13919 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:57.873677  8584 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:02:57.874396  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:57.877959  8428 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:02:57.878831  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1502) took 1629 ms. Trace:
I20260709 13:02:57.824551 13937 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.881294  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.886941  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:57.892601  8502 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:57.890413 13680 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:57.899945 13680 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:57.900449 13680 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.900673 13887 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.902434  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.903713  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:57.903962  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.904601 13861 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.904863  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.905213 13861 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.906253  9101 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:57.892441 13937 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.907557 13861 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.911315 13409 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:57.883551 13671 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.899253  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:02:57.894563 13959 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:02:57.920327  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:57.920544  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:57.921656  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:57.921695  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:57.923116  8434 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:02:57.912792  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.916016  8433 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:57.887588 13889 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.937019  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.937505  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:57.892273  9096 rpcz_store.cc:276] 0709 13:02:56.249342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.249605 (+   263us) service_pool.cc:224] Handling call
0709 13:02:56.271087 (+ 21482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.541120 (+1270033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.541160 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:57.548674 (+  7514us) log.cc:844] Serialized 26 byte log entry
0709 13:02:57.784362 (+235688us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:57.784435 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.784528 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.878526 (+ 93998us) raft_consensus.cc:1685] finished
0709 13:02:57.878556 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.878751 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1212907,"raft.queue_time_us":1155213,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"thread_start_us":235244,"threads_started":1,"wal-append.queue_time_us":303670}
I20260709 13:02:57.938488  8400 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:57.940409  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.939718  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.939992  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.942873  8435 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:57.941020  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:57.944242  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:57.945044  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:57.946466 13938 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:57.946973 13938 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:57.948002  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.948998  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.948024 13938 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.949227  8582 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:57.948673  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:57.948640  8426 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:57.955972  8431 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:57.960040  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:57.962513  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.963706  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.964761  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:57.942359 13774 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:57.965500  8431 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:57.966295  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.966957  8433 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:57.967808  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:57.968538  8433 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:57.957047 13884 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:57.970316 13924 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.965550 13774 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.993671 13774 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.995326  8431 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:57.998332 13272 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:57.892714 13565 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.002486 13565 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.003870 13603 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.007655 13919 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.937460 13409 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.008965  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:57.960383 13759 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:58.009635  8577 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.009935 13759 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.010178 13785 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:57.939673 13923 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.012741 13923 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:57.960510 13707 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:58.013795 13707 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:58.014384  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:58.015180  8583 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:58.015645 13804 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.016103  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.017373  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:57.942138 13801 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:57.956038 13943 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:58.019105 13801 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:58.019281 13943 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.019695 13801 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:58.019883 13943 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.940546 13889 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:58.023563 13845 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:58.024087 13845 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:58.010305 13759 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.961470 13887 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:58.026499 13887 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:58.027456 13887 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:58.030952 13968 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:57.970764 13717 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.034392  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:58.035533  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:58.036525 13884 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:58.037093 13884 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:58.038087 13884 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.039000 13717 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:58.040105  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.055761  8503 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:02:58.075517  8433 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:58.080037  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.080976  8577 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:58.025225 13845 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.074673 13650 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:02:58.083124  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.083837  8509 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
W20260709 13:02:58.085690  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 178845us
I20260709 13:02:58.050470 13804 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.039620 13680 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.094651 13680 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.096410  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:58.081892 13777 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.099319 13671 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.099924 13777 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:58.089519 13845 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.101414 13671 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:58.014761 13707 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.092275 13759 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.103058  8434 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:58.103480  8502 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:58.104209  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.106472  8507 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:02:58.035552 13758 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:02:58.115039  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:58.122794  8432 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:02:58.140687  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 53750.8us
I20260709 13:02:58.141736  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.146595 13801 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.136282 13777 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:02:58.153486  8429 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:58.154752  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:58.155386  8432 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.159849  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.161401  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.166494  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.169723  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.171171  8503 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:58.173046  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.174221 13774 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.174489 13943 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.176478 13774 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.176565 13943 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:58.177479  8583 raft_consensus.cc:2368] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17.
I20260709 13:02:58.178944  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.144583 13603 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.198709  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.195604  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.203685  8503 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:58.196374  8507 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:58.178177 13804 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:58.210777  8426 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
W20260709 13:02:58.202548 13977 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:02:58.213405  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:58.213997  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:58.214248  8429 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.214645  8426 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.156572 13889 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.209806  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:58.162664 13777 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:02:58.206607 13759 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.211826 13804 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.197165 13937 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.355551 13804 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.355945  8428 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:58.357048 13937 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:58.241446 13787 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:58.253361 13971 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:02:58.219650 13801 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.358209 13889 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.362152 13859 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:58.362627 13859 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:58.326723 13777 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:58.363279 13777 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:58.364228 13777 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.365455 13777 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.364714  8327 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 6 to 12, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 12 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:58.407346  8327 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:58.218456 13603 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:58.330075  8429 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:02:58.411474 13603 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.411959 13603 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.412984  8327 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:58.416157  8327 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 6 to 9, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 9 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:02:58.419560  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.340922  8432 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
W20260709 13:02:58.341473  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.341142  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.421219  8505 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:58.345355  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:58.206318 13712 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 13:02:58.422246  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 77011.3us
I20260709 13:02:58.422824 13712 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:58.423405 13712 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:58.423563  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.424611  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.424394 13712 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.425438 13924 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:58.425830 13924 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:58.426687 13924 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.427115 13671 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.427500 13784 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.427908 13924 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.434289 13603 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.435364  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:58.437156 13787 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.440732  8400 leader_election.cc:400] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17.
I20260709 13:02:58.441121  8400 leader_election.cc:403] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.441699 13787 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17.
I20260709 13:02:58.354357  8426 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10.
W20260709 13:02:58.355059 13955 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.734s	user 0.006s	sys 0.003s
I20260709 13:02:58.366933 13758 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:58.445051 13758 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.327539 13272 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.367432 13438 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.446631 13438 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.436645 13603 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.448710 13438 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:58.369596  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 717617us
I20260709 13:02:58.449626  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.451231  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:58.452524  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.373754 13581 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:58.374679 13514 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:58.374821 13952 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.459406  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:58.354275  8581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 897) took 1441 ms (client timeout 1760 ms). Trace:
W20260709 13:02:58.375639  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44410.9us
I20260709 13:02:58.374610 13859 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.375890 13918 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.365485 13723 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.380653  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:58.380877  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:58.381572  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.382915 13799 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.484400  9097 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:58.383635  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:58.384455  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:58.385246  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:58.488093  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 104514us
I20260709 13:02:58.386271 13852 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:58.387647 13701 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:58.374689 13689 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.389423 13804 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.393009  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.394282 13720 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.401508  8501 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:58.403141  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1503) took 2137 ms. Trace:
I20260709 13:02:58.254511 13802 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:58.332912  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.454052  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.461046  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.471720  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.511437  8503 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.511534  9102 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.471119  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:58.473624  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:58.476302  8580 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:58.472045  8581 rpcz_store.cc:269] 0709 13:02:56.912623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.912770 (+   147us) service_pool.cc:224] Handling call
0709 13:02:58.238728 (+1325958us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400348d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:02:58.354213 (+115485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265054464}
W20260709 13:02:58.481756  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.472949  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.481736  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.481882  8426 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:58.488274  9093 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.486426  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:58.485363  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:58.489079 13933 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:58.484426 13952 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.480283 13581 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.492655  8327 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:58.494529 13723 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.489392  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:58.533586  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.495674  8582 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:58.496176  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.534252  9101 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:58.534545  9098 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.507608  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:02:58.472075 13958 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.511309  8505 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:58.471650  8504 raft_consensus.cc:3055] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:58.385761 13897 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.516358  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:58.514467  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:58.517771  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.484185 13962 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.484238 13438 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:58.536091  9094 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:58.536478  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:58.537505 13272 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:58.538077 13272 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:58.538415 13777 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:58.539137 13777 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:58.538961 13272 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.540364 13777 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.523696  8576 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:58.522797  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:02:58.524866  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 52010.4us
I20260709 13:02:58.525930  8427 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:02:58.521049 13933 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:58.545233  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.527100 13801 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:02:58.546044 13933 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.524341 13708 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.547480 13708 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:58.547959 13708 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:58.509091 13982 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:58.489650 13844 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:02:58.509511  9099 rpcz_store.cc:276] 0709 13:02:56.270509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.280561 (+ 10052us) service_pool.cc:224] Handling call
0709 13:02:56.356549 (+ 75988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.548687 (+1192138us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:57.644011 (+ 95324us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.376527 (+732516us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:58.377056 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:02:58.377211 (+   155us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:58.377249 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.377318 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.402912 (+ 25594us) raft_consensus.cc:1685] finished
0709 13:02:58.402934 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.403056 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1784104,"prepare.queue_time_us":105638,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":1751682,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":4258,"thread_start_us":188565,"threads_started":2,"wal-append.queue_time_us":110119}
W20260709 13:02:58.559201  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 71652.8us
I20260709 13:02:58.536505  9093 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:58.549466  8579 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:58.552588  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.507742 13735 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:02:58.535615  8504 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:58.524663 13937 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:58.499572 13799 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.565304  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:58.567102  8429 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:58.560508  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:58.533524 13859 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.511111 13701 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:58.571507  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 48743.2us
I20260709 13:02:58.522169 13919 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:02:58.580452  9097 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:58.549626 13438 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:58.518546 13852 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.553932 13982 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:58.521479 13689 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.594990  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:58.564628 13962 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.563889 13887 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.561529 13930 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:02:58.550630 13712 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:02:58.569947 13801 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:02:58.548906 13708 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.579994  8504 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.566241 13937 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.589380 13438 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:58.596499 13272 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:58.602250  8584 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:02:58.619091  8504 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.619901  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:58.628711  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:58.604614  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.629908  9097 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.598518  9100 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:58.632412  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:58.635294  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:58.558982 13897 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:58.638185  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 83660us
I20260709 13:02:58.589128 13758 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:58.591815 13958 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.644614  8476 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:58.597951 13581 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:58.670114  9102 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:58.671105  8503 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:58.634443 13937 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.607558 13982 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.637475 13962 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.626710 13987 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:58.639978 13887 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:58.689441  9096 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:58.655507 13566 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:58.708772  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.668980 13689 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:58.690302  8476 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.691915 13787 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:58.692444  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.626273 13952 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:58.717792  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:58.718982  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:58.720407  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.721004  8503 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.726123 13784 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:58.726293  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.709865 13712 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:02:58.727707  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.708798 13991 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:58.728883  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.729485  8510 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:02:58.730202 13680 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:58.730741 13680 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:58.719599 13723 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:58.731724 13787 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:58.731611 13680 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.732740 13787 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.733855 13720 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:58.734398 13720 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:58.735123 13852 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:58.700888 13887 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.656518 13565 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:02:58.744220  8583 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:58.737509  8505 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:02:58.703576 13801 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:58.741225  9097 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:02:58.735210 13720 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.704814 13566 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:58.709918 13987 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:58.749790  8432 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:58.749831  8398 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:58.703872 13919 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:02:58.753216  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:58.754101  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.767379  8429 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:58.761404  8503 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:02:58.764183  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:58.770218 13723 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:58.742789 13887 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.770694 13723 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.774255 13723 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.722880 13844 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:02:58.779241  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:58.782982  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.785568 13993 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:02:58.771348 13924 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:58.786542 13924 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:58.787420 13924 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.754573 13801 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:58.826764 13801 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.828199 13801 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.771036 13735 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:02:58.830888  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:58.832403  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:58.774627 13987 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.795745  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.893965  9097 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.699874  8327 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 4 to 8, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 8 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:58.803448 13844 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:58.804013 13565 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:58.764493 13804 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:58.809490  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:58.812247 13799 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:58.812090 13937 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.742529 13952 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:02:58.771504 13991 raft_consensus.cc:2764] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:58.814190 13566 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.814817 13701 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:58.824657  8426 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:02:58.836009 13409 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:58.841082  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:02:58.842571  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 207366us
I20260709 13:02:58.842783  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:58.843214  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 79102.5us
I20260709 13:02:58.845088  9098 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:02:58.932910  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:58.934268  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.934908  9098 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.845460  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.938277  9099 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:58.938426  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 422090us
I20260709 13:02:58.939493  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:58.854905 13514 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:58.856632 13934 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:58.859184 13984 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
I20260709 13:02:58.790104 13897 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:58.964077  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:58.878047  9101 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
W20260709 13:02:58.879191  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.868120  9094 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:02:58.966208 13952 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.966670  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:58.966961 13952 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.967670 13952 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:58.968489 13952 consensus_queue.cc:1243] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:02:58.886206  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 45681.1us
I20260709 13:02:58.969424 13863 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:58.885135  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1247) took 3096 ms. Trace:
I20260709 13:02:58.969729  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:58.970166  9095 rpcz_store.cc:276] 0709 13:02:55.789008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.803395 (+ 14387us) service_pool.cc:224] Handling call
0709 13:02:55.803723 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.804129 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:56.071260 (+267131us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.249750 (+2178490us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b18003d6ae0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a1d21358f 00007f1a16252571 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd
0709 13:02:58.357288 (+107538us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b18003d6ae0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287
0709 13:02:58.561626 (+204338us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.884516 (+322890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:58.884572 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:58.884613 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.884947 (+   334us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.885075 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1088842,"prepare.queue_time_us":429544,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":1119722,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":23192,"spinlock_wait_cycles":39607808,"thread_start_us":1107750,"threads_started":5,"wal-append.queue_time_us":844149,"wal-append.run_cpu_time_us":1212,"wal-append.run_wall_time_us":1001238}
I20260709 13:02:58.885634  9100 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:02:58.972410  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.972658  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:58.973004  9095 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.907780  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:58.919798  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 103296us
I20260709 13:02:58.893159 13951 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:58.946979  9102 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.974888 13951 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.976061 13990 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:58.931766  8427 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:58.910723 13671 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:58.982813 13671 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.984560 13799 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:58.984990 13799 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:58.904188 13844 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:58.985812 13799 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.986163 13844 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.987106 13799 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:58.987962 13844 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.947705  8503 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:58.990741  8503 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:58.991571  8503 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:58.992904  8503 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:58.952121  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.952749  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.995682  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:58.954730  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:58.935590  9096 raft_consensus.cc:2376] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 10. Re-sending same reply.
I20260709 13:02:58.996294  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:58.956971  8501 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:02:58.997069  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:58.997344  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:58.997860  9096 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.998706 13438 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:58.914902 13565 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:58.953882 13934 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:59.000424 13565 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.001227 13438 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:59.004705  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 97061us
I20260709 13:02:59.007052 13712 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:59.007644 13712 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:59.008576 13712 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.011240  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.958735  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:59.012945 13735 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:59.013094 13934 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.014001  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:58.955938 13514 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:58.956553 13720 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.041656 13951 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:58.876533  8504 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:58.968611 13974 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:58.972723  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.973311  9100 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:02:58.905267  8505 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:58.982197 13989 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:59.011441 13680 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.031653 13797 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:59.015413  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.016579  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.017122  9094 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:58.959595  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:58.951784  9097 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
W20260709 13:02:59.019948  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 54013.5us
I20260709 13:02:59.021575  8577 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:59.029212  9102 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:02:59.011319 13784 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:59.032114 13566 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.996148  8327 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:59.032120  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.099253  8579 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:02:59.034528  8584 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:59.021505 13758 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:59.038618 13723 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.041325  8509 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:59.041077 13514 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.107200 13514 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:59.110711  8327 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:58.946384 13409 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:58.993820 13937 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.042135 13720 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.042868  8508 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:59.112579  8327 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:59.049382  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.051749  9095 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:59.113816 13409 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.051098  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:59.114917  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:59.115747  9095 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:59.114943 13720 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.116537  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:59.052955  9098 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:59.066359 13804 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:59.070912 13735 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:59.061509  8503 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:59.014741  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:59.072289  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.088855  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:58.989851 13887 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.096545  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:02:59.128122  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55932.3us
I20260709 13:02:59.128522  9097 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.128899  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:59.053023 13997 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:59.096160  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:59.066248 13925 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.135747 13925 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.103097  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:59.098891  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.106523 13723 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.044355  8510 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:59.138548  9099 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:59.115032 13409 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.118767  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.139494  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.140084  9099 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:59.140288  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.140909  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.141388  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:59.137897 13925 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.142174  9098 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:59.142503  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.052374  8547 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.117609  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.051244 13918 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:02:59.143035  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:59.134994  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:59.141575  9099 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:59.053896  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:59.071581 13797 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:59.134320  9102 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.144961  8507 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:59.103945 13919 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:02:59.191988  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 138172us
I20260709 13:02:59.169698  9097 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:59.143303  9100 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:59.207034  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.208086  9095 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
W20260709 13:02:59.194765  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 142457us
I20260709 13:02:59.210203  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:02:59.195994 13272 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:59.198949  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.144897  9098 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.211374  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:59.211831  9102 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:02:59.217541  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:59.187983 13845 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:02:59.120092 13784 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:59.242578  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.088196 13680 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:59.250860  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.206058 13919 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:59.145948 13863 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:59.229955  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 275299us
I20260709 13:02:59.134161 13932 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.188580 13723 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:59.243431  9097 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:02:59.263238  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.264158  8428 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:02:59.263243  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:02:59.265621  8577 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:59.266808  8430 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:59.247831 13937 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:59.210459 13801 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:59.191854 13735 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:59.206199 13997 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:02:59.263660  8475 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.096s (SENT) [suppressed 13 similar messages]
I20260709 13:02:59.276117  9098 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:02:59.225347  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:59.255296  8433 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:59.256758  8431 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:59.278609  9095 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:59.119755 13758 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.280485  9095 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:59.281424 13758 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.217527 13884 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:59.145356 13804 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.282303  9095 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:59.282421 13884 raft_consensus.cc:697] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:59.283671  9095 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:59.283829 13804 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.257038  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.284008 13884 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.284572  8427 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:02:59.284935  9095 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:59.265834  8429 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.240125  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:59.245191  9102 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:59.230675 13272 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:02:59.291651  9100 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:02:59.292069  9100 pending_rounds.cc:85] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 8
I20260709 13:02:59.277390  9098 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:59.261184  8580 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:02:59.261869 13863 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:59.217163 13797 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:59.297183  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 83847.8us
W20260709 13:02:59.303599  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 63540.9us
I20260709 13:02:59.307106  9097 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:59.292279  9100 pending_rounds.cc:107] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:02:59.308224  9100 raft_consensus.cc:2889] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:59.276715 13581 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:59.312574  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.315310  9099 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 18. Ops: []
W20260709 13:02:59.316162  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.320683  8507 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:02:59.322185  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:02:59.287334 13937 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:59.324564  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.328117  9097 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:59.328706  8577 raft_consensus.cc:2410] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:02:59.301263 13863 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:59.267341 13723 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:59.307753 13982 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.000s
I20260709 13:02:59.310882 13804 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:59.324213  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.363467  8580 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:02:59.354892  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.310602 14010 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:59.358487  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.306813 13801 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:59.326926  9098 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:59.384651  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.355938  8429 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:02:59.323242 13797 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.369094  9096 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:02:59.334398 13438 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:59.380667  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.396759  9097 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:02:59.382596  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.378470  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:59.385830  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 122199us
I20260709 13:02:59.397816  8431 raft_consensus.cc:2368] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17.
I20260709 13:02:59.386145  9100 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:02:59.379647  8433 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:59.393213  9096 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:02:59.402145  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 95381.6us
I20260709 13:02:59.405272  9098 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:02:59.407722  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.327826 13581 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.403868  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.412532  9100 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:59.415143  9097 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:59.416285  9097 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:59.334340 14014 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:02:59.387188 13804 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:02:59.266885  8327 catalog_manager.cc:5697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 4 to 12, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 12 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:59.358616 13272 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.329128 13919 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.421120  9097 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:59.424062  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.428186  8433 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:59.409616 13887 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.359711 13982 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.430724  9095 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:59.321210 13784 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.410240 13438 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:02:59.409663 14015 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:59.409929 13993 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:02:59.437211 14008 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:02:59.437314  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.443753 13982 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.444303  9093 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:59.453682  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:02:59.457743  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50488.4us
W20260709 13:02:59.458472  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.459152  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.395278 13735 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.465411  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.466365 14025 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:59.471801  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.388439 14010 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.473606  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:02:59.479424  8433 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:02:59.457623 13680 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:02:59.474431 14000 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:02:59.488420  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.428360 13801 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.496973 13438 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.497957 14010 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.501649 13581 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.427392 13937 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.504148  8432 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:59.511315  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:59.428948 13997 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:02:59.523074  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.523758  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.529492  8476 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:59.473702 14015 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.504211 13723 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:59.542273  8435 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:02:59.543695  8429 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:59.544047  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:02:59.540838  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 75459us
I20260709 13:02:59.548270  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.534425 13884 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:59.552165 13993 consensus_queue.cc:1243] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:02:59.555625  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.486953 14025 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.495535 13804 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.547499 13603 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.569720  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.570007 14021 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.571707 13603 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:59.574841 14023 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:02:59.605006  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67657.9us
I20260709 13:02:59.609503  8429 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:59.592226 13884 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.586527 14026 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:59.627555  8476 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:02:59.603159 14024 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:02:59.615084  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.631631  8429 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:02:59.616916  8579 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:59.617482  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.618350  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.619089  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.620081  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.620405  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.621414  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.635072  8578 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
W20260709 13:02:59.625887  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.447283 13565 consensus_queue.cc:1175] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ffc86752d264d0c81f68028e6413a91" responder_term: 18 status { last_received { term: 15 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: [17.8-17.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:59.603790 14001 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:59.636511  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.614341 14033 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:59.659052  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.659941  8429 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:02:59.606292 13993 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 13:02:59.643095 14029 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:59.643276 14036 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:59.643869 13671 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.644037 13863 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:02:59.645267 14027 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:02:59.645545 13932 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:59.647614  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.651247  9099 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:59.651929  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:02:59.653136 14032 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:59.654760 14038 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:59.628646 13884 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.656342 13603 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.626811 14026 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:59.658074 13514 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:59.641153  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:02:59.647607  8507 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:59.675779  9102 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:59.681682  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:59.634832 14031 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.734592 13863 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.734674 14031 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.737181 14031 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.738206 13723 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:59.590533 14021 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.639743 14001 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:02:59.742259 14001 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:59.504176  8327 catalog_manager.cc:5697] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 3 to 12, leader changed from <none> to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 12 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.690194 13951 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.723711  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:02:59.725855  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 78315us
W20260709 13:02:59.748437  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 120032us
I20260709 13:02:59.750123  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.728821  8577 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:59.734181 14032 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.741679 14021 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:02:59.737747 14031 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:59.706832 13997 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:59.746551  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.748610  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 67060us
I20260709 13:02:59.728257  8582 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:59.752305  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:59.753587 13993 consensus_queue.cc:1243] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:02:59.765915 13801 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:59.771833  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.695041 14033 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:02:59.730140 13438 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:59.772743  9068 leader_election.cc:400] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17.
I20260709 13:02:59.786254  9068 leader_election.cc:403] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:59.787760  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.767000 13723 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:59.767424 14031 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:59.772964 13897 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.774041 13997 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:02:59.776216 13409 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:02:59.788396 13799 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.002s
I20260709 13:02:59.777870 13801 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:02:59.810223  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.792253 13990 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.806654 13581 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:59.822716  9101 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:02:59.787992 14015 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.826642  9068 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.788493 13993 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:02:59.810721 13997 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.768229 13951 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.785487 14026 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.768498 14032 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.809137 13723 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.856016 13723 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.821961 13409 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.856604 13723 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:59.856688 13923 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:59.857200 13923 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:59.827263 13799 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:59.843719  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:59.809062  8327 catalog_manager.cc:5697] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 2 to 10, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 10 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:59.864943  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:59.876505  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:59.865717  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:59.866370  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:59.867162  8509 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:59.868079  8505 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:59.877903  8509 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:02:59.868438  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:02:59.868968  8504 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:59.821996 13801 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:59.880750 13844 consensus_meta.cc:287] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.892s	user 0.010s	sys 0.004s
I20260709 13:02:59.882891 13409 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.870930  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:59.879136  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:02:59.889922  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:59.891608  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:59.891698  8508 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:02:59.892910  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:59.901300 14031 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.901640  8327 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 6 to 8, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 8 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:02:59.907611  8398 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:02:59.908561  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.902839 14031 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.912523  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:02:59.913618  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:02:59.909641  8509 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.918797  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.870010 13993 consensus_queue.cc:1243] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:59.920109  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:59.921059  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:59.923094  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:02:59.904670  8327 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 8 to 9, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 9 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.923914  8432 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:02:59.925071  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:02:59.930542  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:02:59.931455  8509 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:59.860901 14038 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:02:59.906337 13999 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.908257 13897 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:59.938088  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:59.830948 14001 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.917707 13799 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:59.922887 13797 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.001s
I20260709 13:02:59.936491 14050 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:59.915519 13784 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:02:59.933951 13680 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:59.918006 13925 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:02:59.886868 14033 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:02:59.962513 13884 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.917918 13438 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:59.875990 13723 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:02:59.923523 13735 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:59.926582 13924 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:59.926988 13603 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.936138 14055 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:59.994338 14055 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:59.994247 13603 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:02:59.994839 14055 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.996472 13603 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.997550 14032 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.998641 13438 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.000819 13934 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:00.004346 14055 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.923166 13802 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:03:00.006734 14055 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:02:59.935050 13982 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.934175 13409 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:02:59.938627 13671 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:59.964895 14038 consensus_queue.cc:1243] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:59.986599  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:02:59.986935 13566 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:59.985774  8327 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 9 to 12, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 12 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:59.987561 13735 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:02:59.965029  8509 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:59.989178 13951 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.967960 14057 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.991155 14001 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:02:59.992733 13923 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:02:59.980849  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1507) took 1403 ms. Trace:
I20260709 13:03:00.020607 13925 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:59.965390  8503 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:02:59.948810 13799 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.953083 13797 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.946045 13993 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:59.979565  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.998697  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44342.6us
I20260709 13:02:59.939559 13897 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:00.019148  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:00.024783 14036 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:03:00.023851 13735 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.027362  9093 rpcz_store.cc:276] 0709 13:02:58.577414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.577599 (+   185us) service_pool.cc:224] Handling call
0709 13:02:58.577888 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:59.454327 (+876439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.980496 (+526169us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54004d44d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:02:59.980749 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992093568}
W20260709 13:03:00.007622 14042 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:02:59.984117 13680 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:03:00.016374 13784 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:03:00.011592 13603 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 13:03:00.025906  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 95343.4us
I20260709 13:03:00.033279  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:00.038836  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:00.039577  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:00.041110  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.029980 13845 consensus_queue.cc:1175] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6930e07cbba2484ca2bf800a58acdbb0" responder_term: 14 status { last_received { term: 11 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:00.028507 13799 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:00.051610  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 120901us
I20260709 13:03:00.063068  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:00.067462  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:00.034204 13897 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:00.034289 13720 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:00.071527  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.075558  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:00.074932 13925 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:03:00.079178 14061 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:00.072746  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:00.086473  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:00.087301  8506 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:00.089413  8435 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:00.091178  8427 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:00.092494  8431 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:00.093429  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:00.094049  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.094709  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:00.095016  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:00.095134 13797 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:00.096966  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.098484  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:00.099129  8426 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:00.086606 13925 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:00.102937  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:00.123989  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 51314.7us
I20260709 13:03:00.104390  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:00.138832  9093 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:00.106495  8505 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:03:00.140986  8505 pending_rounds.cc:85] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 9
I20260709 13:03:00.141355  8505 pending_rounds.cc:107] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:03:00.104200  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:00.143491  8504 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:00.094058  8427 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:00.141659  8505 raft_consensus.cc:2889] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.074059 13990 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17.
I20260709 13:03:00.053361 13438 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:00.150509  8431 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:00.091193 13919 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:00.155459 13974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.005s	sys 0.010s
I20260709 13:03:00.165915  8506 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:00.076782 13934 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:00.168869  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:00.141767 13918 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.141986 13777 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.145215 13802 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:00.200726  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:00.186862 13974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.005s	sys 0.010s
I20260709 13:03:00.153414 14038 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.076629 13941 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:00.202127  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 97814.2us
I20260709 13:03:00.223176  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:00.150216 13680 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:03:00.138005 14061 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:03:00.150002 13925 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:00.199533 13581 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.163976 13884 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:03:00.207455 13802 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:00.238211  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 89904.4us
I20260709 13:03:00.207736 14015 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.210175 13990 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:00.250372  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:00.193593 13924 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:03:00.200508 13932 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
W20260709 13:03:00.233757 14009 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:00.232893 13982 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:00.207787 13777 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:00.207832 13918 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:00.255329 13802 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.273955  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.226457 13989 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:03:00.282408  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.284538 14064 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:03:00.286427 14048 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:00.286972 14048 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.287343 14048 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.290834 14046 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:03:00.253818 13581 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.293429 13581 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:00.256807 13863 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:00.305230  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.314908 14021 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:00.315086  9093 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:00.298666  9096 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:00.311492  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2309) took 1046 ms. Trace:
I20260709 13:03:00.295022  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.316788  8582 rpcz_store.cc:276] 0709 13:02:59.264756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.266809 (+  2053us) service_pool.cc:224] Handling call
0709 13:02:59.267071 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:59.768850 (+501779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.311192 (+542342us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54003e0b54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:00.311418 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060207488}
I20260709 13:03:00.306972 14025 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:00.319100  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.319883  9094 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:03:00.321620  8327 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 4 to 10, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 10 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:00.323602  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.323442  8327 catalog_manager.cc:5697] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 4 to 10, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 10 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:00.325675  8327 catalog_manager.cc:5697] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.328152  8327 catalog_manager.cc:5697] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 5 to 9, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 9 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:00.331472 13735 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.330773  8327 catalog_manager.cc:5697] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 5 to 9, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 9 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.332432 13802 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:00.334650  8428 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:00.323956  9093 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:00.336841 13997 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.337985  8504 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:00.341212 13799 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:00.344259 14068 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:00.346446  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:00.346720 13925 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:00.347107  8435 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:00.348145  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:00.349406 13777 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:00.350927  8434 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:00.352108  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:00.352758  8434 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:03:00.354785 14026 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.356273  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:00.358448  8434 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:00.258841 14015 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.364638 13993 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:00.365372 14015 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:00.367889  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.370684  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:00.371363  8505 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:00.373939  8398 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:00.375921  8434 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:00.367475  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:00.312374 13863 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.381870  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:00.383664  8434 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:00.389793  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:00.390563  8507 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.278793 13941 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:00.395216  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:00.396018  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:00.315349 14021 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:00.387511 13993 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:00.397157 13941 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.387312 13990 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:03:00.419327  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.426004  9093 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:00.401166 14015 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:00.431701  8507 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:00.433851  8435 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:00.387909 13777 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:03:00.402288 14071 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:00.435355  8476 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:00.450035  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.450690  9100 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:03:00.450964  9095 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:00.451506  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.452239  9100 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:00.452463  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:00.453119  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.453207  9095 raft_consensus.cc:2376] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11. Re-sending same reply.
I20260709 13:03:00.453733  9097 raft_consensus.cc:2376] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17. Re-sending same reply.
I20260709 13:03:00.456403  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:00.420106 13993 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.395341 13801 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.409364 13565 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:03:00.465407 14037 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:03:00.465991 13997 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:00.466925 13918 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:00.467324 14065 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:00.468596 14053 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:00.469185 14053 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.471829 14053 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:00.471944 13863 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:00.475216 14021 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.476843 14021 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.446399 14071 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:00.479027 14071 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.484474 14057 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:00.485205 14057 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.487663 14057 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:00.431243 13941 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:00.491878  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:00.492935 13951 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:00.401969 14010 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:03:00.507023  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.508807  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:00.514596  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:00.519335  8431 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:00.473701 13987 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:00.529134  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:00.536106  8428 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:00.541013  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:00.525863  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.505520 13565 consensus_queue.cc:1243] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:03:00.551867  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 342754us
W20260709 13:03:00.546262  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 405774us
I20260709 13:03:00.506203 13993 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.555846  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:00.549198  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:00.447048 14015 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:00.561771  9101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1314) took 1708 ms (client timeout 2001 ms). Trace:
W20260709 13:03:00.562215  9101 rpcz_store.cc:269] 0709 13:02:58.853001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.072316 (+219315us) service_pool.cc:224] Handling call
0709 13:03:00.561586 (+1489270us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400526554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:00.561716 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573290752}
I20260709 13:03:00.562775  9096 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:00.563225  9099 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:03:00.563573  9099 pending_rounds.cc:85] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 12
I20260709 13:03:00.563789  9099 pending_rounds.cc:107] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:03:00.563997  9099 raft_consensus.cc:2889] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.565486  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:00.532775 13982 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:00.532526 13951 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:00.534358 13987 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:00.580315  9095 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:00.346740 13802 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:00.586423  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:00.550549 13784 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.631573  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:00.635028  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:00.636199  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:00.637277  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:00.635993  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:00.638935  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:00.640470  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:00.635955  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:00.648366  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:00.649142  8582 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:00.655476  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:00.575832 13581 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.570070 14016 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:03:00.567184 13863 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:03:00.568779 13777 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
W20260709 13:03:00.671656 14079 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:03:00.672367 13932 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.624173 14025 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:03:00.674561 13987 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:00.638296 13784 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.676976 14015 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:00.664647 14061 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.682243 14064 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.683827 14077 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.690541  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:00.752560  9101 raft_consensus.cc:2376] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12. Re-sending same reply.
I20260709 13:03:00.711138 13918 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:00.685645  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.638034 14057 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:00.623924 13930 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:03:00.685664 13897 consensus_meta.cc:287] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
I20260709 13:03:00.674736 14038 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:00.675166  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:00.640043 14046 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:03:00.669561 13799 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:00.729763  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:00.702766 13758 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.727957 13934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.016s	sys 0.042s
I20260709 13:03:00.691664  9100 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:03:00.755125  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 119223us
W20260709 13:03:00.792410  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.757853  9095 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:00.793531  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:00.794042  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:00.667323 13581 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.779364  8432 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:00.781291  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:00.787824  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 112719us
I20260709 13:03:00.798623  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:00.798942  8578 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:03:00.824620 13919 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.003s
I20260709 13:03:00.798094 13758 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.814585 13565 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:00.783792 13438 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.785562 13951 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:00.797559  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:00.809068  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:00.816514 13799 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.855357 13799 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.825150 13581 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:00.800983  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:00.858985  9101 raft_consensus.cc:2368] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13.
I20260709 13:03:00.854205  8426 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:00.862201  8476 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:00.828284  8510 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:00.796108 13934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.016s	sys 0.042s
I20260709 13:03:00.829440  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:00.864713  9095 raft_consensus.cc:2376] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17. Re-sending same reply.
I20260709 13:03:00.831481  8506 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:03:00.800519 14043 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.211s
I20260709 13:03:00.799600 14044 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.151s
I20260709 13:03:00.831641 13723 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:00.756428 14064 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.816529  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:00.834523  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:00.918839  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 84394.8us
I20260709 13:03:00.920414  9067 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:00.920670 14100 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:00.835058 14076 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:00.835104  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:00.836248  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.817102 14035 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.247s
I20260709 13:03:00.818069 13923 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.797652  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:00.789510 14015 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:00.839386 14071 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:00.795198 14048 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:03:00.756085 14061 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.772543 14077 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.781848 14057 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:00.788486 13897 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.800966 14053 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:03:00.840977 13941 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:00.799917  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:00.798951 13801 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:00.821326 13784 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:00.865823  8506 pending_rounds.cc:85] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 6
I20260709 13:03:00.952992  8506 pending_rounds.cc:107] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:03:00.923523  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:00.896037  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 317638us
W20260709 13:03:00.951733  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 151882us
I20260709 13:03:00.953341  8506 raft_consensus.cc:2889] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.890002  8426 raft_consensus.cc:1217] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.8->[12.9-16.11]   Dedup: 12.9->[15.10-16.11]
I20260709 13:03:00.955674  8426 pending_rounds.cc:85] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 9
I20260709 13:03:00.955941  8426 pending_rounds.cc:107] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:03:00.956163  8426 raft_consensus.cc:2889] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.954953  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:00.957108 13925 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.957803 13925 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.959704 14061 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:00.960309 13925 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:00.960247 14048 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.961416  9094 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:00.962656 13897 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:00.963340 14077 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:00.963670 13941 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:00.949286 13581 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.851771 14026 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:03:00.864574 13438 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:00.968238 14083 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 13:03:00.864192 13934 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:00.970537  8510 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:00.971025 13934 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.972612  8579 raft_consensus.cc:2368] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16.
I20260709 13:03:00.970003 13438 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:00.974107  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50673.6us
I20260709 13:03:00.960623 13603 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:00.965723 14071 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:00.987182  9101 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:03:00.917491 13919 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:00.989351 13924 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.995537  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:01.013206  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:00.983469 13897 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.972841 13845 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.015002 13897 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.015246 13845 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.015973 14015 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.945039 13932 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:00.947613 13758 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:00.923949 13723 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:00.972285 14036 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:00.983784 14077 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.963372 14064 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:01.023077  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:01.032371  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:00.883075 13951 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:00.998241 13844 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:01.045548  9101 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
W20260709 13:03:01.051483  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 204873us
I20260709 13:03:01.003805 13919 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:01.054136  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.056767  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.023281 14061 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:01.026222 13799 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:00.995630 13801 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:03:01.063478  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:01.027086 14036 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:01.068010  9101 raft_consensus.cc:2410] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:03:01.050354 14053 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:01.052390 14026 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:01.074314  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.074242  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.019788 13924 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.057121 13919 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.084023  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.141319  8580 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:01.144349  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:01.144847  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.145435  8581 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:01.145769  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.144869  8577 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:01.147076  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.154740  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:01.067183 14064 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.157913  8576 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:01.157816  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:01.158619  9101 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:01.159586  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:01.072156 13932 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.160180  9101 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:03:01.164350  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:01.072476 14036 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.165253  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.067385 14046 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:01.076095 14053 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.163702  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:01.231002  8580 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:01.232328  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:01.233282  8433 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:01.226531  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.149921 13897 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:01.229691  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.078356 14025 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.238068  8584 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:01.238727  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:01.268762  9101 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:01.158633 14048 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:01.226140 14109 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:03:01.227021 14053 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.271021  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.068851 14061 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.140295 14030 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:01.274353 14066 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:03:01.282742 14093 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:03:01.297170  8584 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:01.296509  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:01.283805  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.284680 13989 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:01.268021 14046 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.299808  8432 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:01.301488  8580 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:01.163367 13844 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:03:01.312955  8433 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:01.299113  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:01.307610  8509 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:01.308138  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:01.308501  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:01.315424  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:01.264405 13784 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:01.321460  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:01.317204  9101 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:01.325573 13897 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:01.326296  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.327284  8580 raft_consensus.cc:2410] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:03:01.328642  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:01.328814  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:01.329481  8510 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:03:01.328940  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:01.329530  8584 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:03:01.332882  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:01.334543  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:01.335230  8433 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:01.227171 14064 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.341660  8433 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:01.243680 13932 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.303063 13989 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:01.311148 13991 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.353896  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:01.317534 13923 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.153508 13723 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.357904  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:01.340058 13784 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.273181 14025 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.383774 14026 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:01.310627 14030 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.319765 13603 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:01.399066  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:01.456583 13989 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:01.407431  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74618.4us
I20260709 13:03:01.411988  8582 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:03:01.457953  8582 pending_rounds.cc:85] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 6
I20260709 13:03:01.458099 13989 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.422158  8583 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:01.430245 13924 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:01.430614 13951 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:01.430873 14061 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:01.420533 13923 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.459496 14037 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:01.459995 14037 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:01.460845  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:01.461148 13923 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:01.460945 14037 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.461813 13923 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:01.463156 13923 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:01.465720  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:01.466383 13923 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:01.347482  8432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "435c81d2d1f346bea90c20030455900c"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:03:01.467361 13514 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.467451  8432 raft_consensus.cc:606] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:01.467998  8432 raft_consensus.cc:614] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:01.434957 13932 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:01.401084 13884 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:03:01.427034 14105 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:03:01.413273 14098 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:03:01.437563  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2340) took 1068 ms. Trace:
W20260709 13:03:01.417721 13993 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.845s	user 0.011s	sys 0.000s
I20260709 13:03:01.444680 13671 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:01.447516 13565 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.005s
I20260709 13:03:01.453524 13997 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:01.455971 13735 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:01.456243  9097 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:01.471706 13758 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:01.418872 13991 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.458264  8582 pending_rounds.cc:107] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:03:01.516708  8582 raft_consensus.cc:2889] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:01.466768  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:01.431483 14064 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:01.520422  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 53729.3us
I20260709 13:03:01.473116  8434 rpcz_store.cc:276] 0709 13:03:00.369395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.384694 (+ 15299us) service_pool.cc:224] Handling call
0709 13:03:00.385057 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.530358 (+145301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.530392 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.547349 (+ 16957us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.063153 (+515804us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:01.063301 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.063552 (+   251us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.437307 (+373755us) raft_consensus.cc:1685] finished
0709 13:03:01.437333 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.437495 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135210,"raft.queue_time_us":145011,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12501,"thread_start_us":433564,"threads_started":1,"wal-append.queue_time_us":856445}
W20260709 13:03:01.423179  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 65397.5us
I20260709 13:03:01.457577 13603 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:01.420123 14026 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.470044 13514 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.501948 13565 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:01.472707 13884 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:01.523260  8549 leader_election.cc:400] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13.
I20260709 13:03:01.479786 14124 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:01.528231  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:01.571878  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 48747.2us
I20260709 13:03:01.471201 13923 consensus_queue.cc:1243] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:01.582206  8508 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:03:01.582722  8508 pending_rounds.cc:85] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 11
I20260709 13:03:01.582980  8508 pending_rounds.cc:107] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:03:01.583246  8508 raft_consensus.cc:2889] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:01.583626  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:01.584607  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:01.514173 14037 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:01.575762  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47663.1us
I20260709 13:03:01.502737 13997 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:01.586213  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:01.589272  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1299) took 1009 ms. Trace:
I20260709 13:03:01.589850  9098 rpcz_store.cc:276] 0709 13:03:00.576386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.576493 (+   107us) service_pool.cc:224] Handling call
0709 13:03:00.650402 (+ 73909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.650852 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.650891 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.662070 (+ 11179us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.978654 (+316584us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:00.978709 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.978808 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.585552 (+606744us) raft_consensus.cc:1685] finished
0709 13:03:01.585573 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.585730 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7116,"raft.queue_time_us":103,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":4802,"thread_start_us":272966,"threads_started":1,"wal-append.queue_time_us":409748}
I20260709 13:03:01.586532 13951 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:01.598097 14016 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:01.598558 13951 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.602576 14016 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:03:01.603929 14120 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:01.603665 14016 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.605225 13929 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.607566 13997 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.588541 14078 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:01.610646 14078 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.605799 13929 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.611148 14078 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.612864 13929 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:01.529006 13671 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:03:01.610148 13951 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:01.614647 14103 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.694s	user 0.003s	sys 0.000s
I20260709 13:03:01.571219 13680 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:03:01.501271 13993 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.588274 13777 raft_consensus.cc:2764] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:03:01.622326 14128 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:01.525166 13932 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:01.620939  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:01.571774 13409 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:01.587018 13566 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:01.587204 14061 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:01.607555 13514 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:01.529106 14064 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:03:01.682725 13784 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:01.686080 13993 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:01.670763  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2535) took 1247 ms. Trace:
W20260709 13:03:01.687069  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 334417us
I20260709 13:03:01.687296  8435 rpcz_store.cc:276] 0709 13:03:00.423101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.436138 (+ 13037us) service_pool.cc:224] Handling call
0709 13:03:00.436577 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.576168 (+139591us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:00.659515 (+ 83347us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.915718 (+256203us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.916817 (+  1099us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.955545 (+ 38728us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:00.955605 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.955704 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.669482 (+713778us) raft_consensus.cc:1685] finished
0709 13:03:01.669501 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.670703 (+  1202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129367,"prepare.queue_time_us":86834,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":134602,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":73826,"spinlock_wait_cycles":1619328,"thread_start_us":203459,"threads_started":1,"wal-append.queue_time_us":471788}
I20260709 13:03:01.671416 14025 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:01.616405 14046 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:01.588541 13758 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:03:01.619681 13924 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:01.669831 13720 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:01.674198 13603 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.689931  8510 raft_consensus.cc:2368] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14.
I20260709 13:03:01.692554  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.693717  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.694808  8434 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:01.705348  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:01.720431  8426 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.657214 13932 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:01.673128  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:01.609946 14036 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.706584 13671 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:01.708217 13784 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:01.702649 13919 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.004s
I20260709 13:03:01.711206 13991 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:01.713274 14078 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.714447 14030 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:01.656301 13409 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.715484 14026 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.716544 14125 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.672420 13884 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.656347 13989 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:01.722862  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 64759us
I20260709 13:03:01.725347  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:01.734192  8434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:03:01.787209  8434 raft_consensus.cc:606] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:01.787631  8434 raft_consensus.cc:614] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:01.746783  8426 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
W20260709 13:03:01.759034  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.646749 14128 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:01.758452  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 297641us
I20260709 13:03:01.732090 14124 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.704916 14061 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.773140 13720 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:01.826970 13720 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.827436 13720 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:01.813244 14132 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:03:01.813324 14127 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:01.815258 13409 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:01.822160 14128 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:01.734154 13784 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.722131 13924 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.809690 14078 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:01.835857  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.795217 13989 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.738713 13919 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.731272 13671 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.798142 13566 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:01.839179 14053 consensus_meta.cc:287] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.527s	user 0.002s	sys 0.009s
I20260709 13:03:01.807914 13884 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:01.785373 13982 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:01.785370 14125 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:01.897540  8435 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:01.902014  8427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:03:01.902741  8427 raft_consensus.cc:606] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:01.903055  8427 raft_consensus.cc:614] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:01.807093 14124 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.896502 13735 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:01.927095  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.927812  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.927951  8427 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:01.930869  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.879035 14053 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.934439 14053 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:01.941280 13566 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.880677 13982 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.945147  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.945904  8429 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:03:01.931524  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:01.931753  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:01.874164 13932 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:01.949414  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:01.957741  8426 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:01.949290  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:01.962010  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:01.965484  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:01.975044  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:01.979892  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:01.965713 13581 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.963481 14036 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:01.974843 13990 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:01.987829 14135 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:03:01.988731 14142 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:03:01.994971  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1340) took 1556 ms. Trace:
I20260709 13:03:02.024200  9094 rpcz_store.cc:276] 0709 13:03:00.438866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.445299 (+  6433us) service_pool.cc:224] Handling call
0709 13:03:00.529020 (+ 83721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.961793 (+432773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.994706 (+1032913us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400500854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:01.994903 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993944832}
I20260709 13:03:01.996285  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1333) took 1676 ms. Trace:
I20260709 13:03:02.025386  9099 rpcz_store.cc:276] 0709 13:03:00.320932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.321207 (+   275us) service_pool.cc:224] Handling call
0709 13:03:00.562928 (+241721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.564513 (+  1585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.996065 (+1431552us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400526550. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:01.996223 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555207424}
I20260709 13:03:01.997673 13919 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:01.998494 13581 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:01.999234 13989 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:01.999392 13784 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:02.002161 14104 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.083s	user 0.002s	sys 0.003s
I20260709 13:03:01.984211 13797 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:02.032517  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1302) took 1030 ms. Trace:
W20260709 13:03:02.003388  8431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2527) took 1909 ms (client timeout 1585 ms). Trace:
I20260709 13:03:02.033008  9102 rpcz_store.cc:276] 0709 13:03:01.002611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.477518 (+474907us) service_pool.cc:224] Handling call
0709 13:03:01.477871 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.500597 (+ 22726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.500645 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.518044 (+ 17399us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.862366 (+344322us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:01.862436 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.862533 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.032261 (+169728us) raft_consensus.cc:1685] finished
0709 13:03:02.032286 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.032451 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1944,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":13637,"thread_start_us":245688,"threads_started":1,"wal-append.queue_time_us":361105}
W20260709 13:03:02.033834  8431 rpcz_store.cc:269] 0709 13:03:00.094361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.094473 (+   112us) service_pool.cc:224] Handling call
0709 13:03:02.003181 (+1908708us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b540030eb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:02.003314 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126937472}
I20260709 13:03:02.004379 13982 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:02.004558  8430 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:02.005772 14125 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:02.014782  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.010571  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:02.019682  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1561) took 1031 ms. Trace:
I20260709 13:03:02.002210 14124 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.022482 14061 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:02.031035 13924 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.035072  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.055523  9102 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
W20260709 13:03:02.043205  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.947935 13735 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:02.029551 14010 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 13:03:02.047739 14140 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:03:02.048661  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.072089  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:02.048578  8327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.006s	sys 0.010s
I20260709 13:03:02.032550 13797 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.079721  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:02.052047  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2327) took 1498 ms. Trace:
I20260709 13:03:02.051585 13720 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.020164 13409 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:02.082237  8505 rpcz_store.cc:276] 0709 13:03:00.553808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.553919 (+   111us) service_pool.cc:224] Handling call
0709 13:03:00.554247 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.555513 (+  1266us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:00.559884 (+  4371us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.467734 (+907850us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b180031a6e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:03:01.670675 (+202941us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.691954 (+ 21279us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.692085 (+   131us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:01.692116 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.692180 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.051640 (+359460us) raft_consensus.cc:1685] finished
0709 13:03:02.051783 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.051970 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4719,"prepare.queue_time_us":12258,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":6160,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":11899,"spinlock_wait_cycles":15119744,"thread_start_us":200037,"threads_started":1,"wal-append.queue_time_us":1275015}
I20260709 13:03:02.054435  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:02.023530 14092 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:02.044776 14026 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:02.070842  8579 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 922) took 1484 ms (client timeout 1849 ms). Trace:
I20260709 13:03:02.074753  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.096571  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:02.052750 13919 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:02.076658  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.078372  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.103681  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.104458  9102 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:02.105173  8575 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:02.105458  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.084373  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2324) took 1541 ms. Trace:
I20260709 13:03:02.108820  8577 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:03:02.080814 14137 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.201s	user 0.002s	sys 0.000s
I20260709 13:03:02.115402  8429 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
W20260709 13:03:02.080397  8327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.007s	sys 0.010s
I20260709 13:03:02.107702  8503 rpcz_store.cc:276] 0709 13:03:00.543201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.543758 (+   557us) service_pool.cc:224] Handling call
0709 13:03:00.544165 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.544649 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.544691 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.551798 (+  7107us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.683259 (+131461us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b4800220158. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:03:00.925396 (+242137us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:00.925447 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.925546 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.001416 (+1075870us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:02.084150 (+ 82734us) raft_consensus.cc:1685] finished
0709 13:03:02.084170 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.084299 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":2220,"raft.run_wall_time_us":137208,"spinlock_wait_cycles":131973888,"thread_start_us":301202,"threads_started":1,"wal-append.queue_time_us":348112}
I20260709 13:03:02.086829  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:02.070441 14061 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:02.094830  8579 rpcz_store.cc:269] 0709 13:03:00.586625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.586738 (+   113us) service_pool.cc:224] Handling call
0709 13:03:02.067394 (+1480656us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54000cd5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:02.070782 (+  3388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774280064}
I20260709 13:03:02.112900  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:02.106896  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:02.117286  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1553) took 1134 ms. Trace:
I20260709 13:03:02.118532  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.119374  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.121050  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1558) took 1134 ms. Trace:
I20260709 13:03:02.083642 13797 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.137652  8580 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:02.132298  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:02.130784  8476 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:02.137498  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.138871  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:02.128182  8584 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:02.138810  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1305) took 1111 ms. Trace:
I20260709 13:03:02.147508  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.151126  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:02.151508  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 171679us
I20260709 13:03:02.151818  8575 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.153151  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:02.136009  9101 rpcz_store.cc:276] 0709 13:03:00.986919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.323745 (+336826us) service_pool.cc:224] Handling call
0709 13:03:01.324595 (+   850us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:01.325275 (+   680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.325306 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:01.339432 (+ 14126us) log.cc:844] Serialized 52 byte log entry
0709 13:03:01.626208 (+286776us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:02.120399 (+494191us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.120630 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.120706 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.120746 (+    40us) raft_consensus.cc:1685] finished
0709 13:03:02.120759 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.120987 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349113,"prepare.queue_time_us":379179,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":336,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":269390,"threads_started":2,"wal-append.queue_time_us":379203}
I20260709 13:03:02.149714  8429 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:02.155347  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.156059  9101 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:02.159158  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.159444  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.160147  8577 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:02.161263  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:02.144444  9097 rpcz_store.cc:276] 0709 13:03:01.027424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.515480 (+488056us) service_pool.cc:224] Handling call
0709 13:03:01.517424 (+  1944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.517649 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:02.087816 (+570167us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.136915 (+ 49099us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.138076 (+  1161us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:02.138216 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.138413 (+   197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.138687 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":437928,"prepare.queue_time_us":487375,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":149,"thread_start_us":180594,"threads_started":2}
I20260709 13:03:02.163745  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.103153 13799 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:02.153084  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.165678  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.167991  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.168735  9094 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 10.
I20260709 13:03:02.170528  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.173595  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.179750 13987 raft_consensus.cc:3055] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:03:02.181124  8550 connection.cc:256] RPC call timeout handler was delayed by -1.0159044539999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 13:03:02.182652 14086 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.235s	user 0.004s	sys 0.000s
W20260709 13:03:02.184124 14141 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:03:02.184777 14147 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
W20260709 13:03:02.185954 14096 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.216s	user 0.000s	sys 0.003s
I20260709 13:03:02.186369 13720 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.158288 14061 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:02.192097 14119 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.720s	user 0.003s	sys 0.001s
I20260709 13:03:02.193409  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2612) took 1008 ms. Trace:
I20260709 13:03:02.193509 14046 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:02.152841 14010 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:02.194774 14057 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:02.196874 14089 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.249s	user 0.000s	sys 0.004s
I20260709 13:03:02.199124  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:02.108013 14092 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.125519 13919 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:02.200333 14019 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.165045 14044 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.161031 14037 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:02.270501 14037 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:02.271433  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1557) took 1284 ms. Trace:
I20260709 13:03:02.271593 14037 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:02.271899  9100 rpcz_store.cc:276] 0709 13:03:00.986571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.986694 (+   123us) service_pool.cc:224] Handling call
0709 13:03:00.986997 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:01.022904 (+ 35907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.022935 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:01.043265 (+ 20330us) log.cc:844] Serialized 52 byte log entry
0709 13:03:01.151318 (+108053us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:01.166597 (+ 15279us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.939869 (+773272us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b180025f540. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf 00007f1a19359038
0709 13:03:01.940090 (+   221us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.940302 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.940380 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.191647 (+251267us) spinlock_profiling.cc:243] Waited 7.46 ms on lock 0x7b24002faff8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a160d89c4 00007f1a160d6acb 00007f1a16291dc9 00007f1a16291a55 00007f1a1629109d 00007f1a18ec310e 00007f1a18eda88c 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221
0709 13:03:02.271183 (+ 79536us) raft_consensus.cc:1685] finished
0709 13:03:02.271207 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.271363 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":762969,"prepare.queue_time_us":798190,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":73,"raft.queue_time_us":45708,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":76518,"spinlock_wait_cycles":48497536,"thread_start_us":75539,"threads_started":1,"wal-append.queue_time_us":291821}
I20260709 13:03:02.175066 13799 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.277141 13799 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:02.202095  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.169768 14026 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:03:02.167589 13581 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:02.103168 13409 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.279340  9101 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:03:02.279976 14061 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:02.280443  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:02.281226 13409 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.181143  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2606) took 1103 ms. Trace:
I20260709 13:03:02.281950  8581 rpcz_store.cc:276] 0709 13:03:01.077387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.174970 (+ 97583us) service_pool.cc:224] Handling call
0709 13:03:01.264881 (+ 89911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.480403 (+215522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.480448 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.480517 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:01.480562 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.180902 (+700340us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001176d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:02.180952 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.181085 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495103744}
I20260709 13:03:02.283910  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.203510  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.206821 13844 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:02.206763 14036 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:02.182669 13735 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:02.211687  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:02.285768 13844 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.216796  9097 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:03:02.287020  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.287563  8577 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:02.288213  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.287508  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.224974 13723 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.289397  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.213325  9102 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:02.290867  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:02.291448  9102 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.227613  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.293262  9094 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:03:02.219602  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:03:02.294415  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74906.8us
I20260709 13:03:02.281200  9100 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.296510  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:02.229826  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.239276  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.242673  8575 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:02.219931 13941 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.302969  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:02.249804  8576 rpcz_store.cc:276] 0709 13:03:01.184652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.263458 (+ 78806us) service_pool.cc:224] Handling call
0709 13:03:02.192577 (+929119us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:03:02.192807 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.193040 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.193071 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.193119 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:02.193155 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.193219 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.193347 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2395008}
W20260709 13:03:02.261351  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 181123us
I20260709 13:03:02.309970  8575 pending_rounds.cc:85] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 7
I20260709 13:03:02.310390  8575 pending_rounds.cc:107] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:03:02.310686  8575 raft_consensus.cc:2889] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:02.219206 14133 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:02.220245 13987 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:02.243630 14125 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:02.267259  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.174707 13982 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:02.328723  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.329665  8507 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:02.278615  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:02.331938  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53442.9us
I20260709 13:03:02.285861 14036 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.288395 13844 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.230856  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.298847  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.215813  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:02.336182  8503 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
W20260709 13:03:02.337054  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 121367us
I20260709 13:03:02.258809 14046 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:02.250592  8550 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:02.314960  8584 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:03:02.343029  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.343658  8503 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:02.326145  9102 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:02.315451 14010 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:02.341359  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.322814 14133 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.344576 14144 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:02.351773  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.352833  8503 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:02.353325 14133 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.355257  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.353739  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:02.355614  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 105142us
I20260709 13:03:02.356230  8503 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
I20260709 13:03:02.323017 13566 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:02.314618 14061 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:02.348620 14010 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.310146 13735 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:02.368166  9065 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:02.361208  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:02.373155  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.362975  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1296) took 1807 ms. Trace:
I20260709 13:03:02.377096  9093 rpcz_store.cc:276] 0709 13:03:00.555119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.567998 (+ 12879us) service_pool.cc:224] Handling call
0709 13:03:00.568380 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.568831 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.568870 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.577499 (+  8629us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.883577 (+306078us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:00.883624 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.883698 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.184744 (+1301046us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:02.358104 (+173360us) raft_consensus.cc:1685] finished
0709 13:03:02.358139 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.362891 (+  4752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1284,"raft.queue_time_us":599,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":17782,"spinlock_wait_cycles":8301312,"thread_start_us":218658,"threads_started":1,"wal-append.queue_time_us":332745}
I20260709 13:03:02.380162  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.316201 13941 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.333428 14044 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:02.359673 13566 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:02.316649 14026 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:03:02.372390  9102 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.357874  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:02.365957  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.381004  9093 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:02.367233  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.385991  8503 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 10.
I20260709 13:03:02.344267 13982 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.387777  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.338411 13581 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:02.362376 14078 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:02.300110 14019 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.369644 14010 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:02.340171 14125 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.406697 14044 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:02.406739 14019 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.394373  9065 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:02.381703 13799 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:02.409168  8581 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:02.400557  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.401211 13918 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:02.403855 13581 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.416257  9102 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:02.408213 14019 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:02.441771  9097 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:02.396296 13566 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.437973  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:02.375031 14061 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.370553 13919 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:02.449913  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:02.632229  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.439049  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.648577  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.651522  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1562) took 1492 ms. Trace:
I20260709 13:03:02.645630  9065 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:02.652072  9098 rpcz_store.cc:276] 0709 13:03:01.159364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.647514 (+488150us) service_pool.cc:224] Handling call
0709 13:03:01.656536 (+  9022us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:01.672511 (+ 15975us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:02.110227 (+437716us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.383758 (+273531us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:02.401917 (+ 18159us) log.cc:844] Serialized 52 byte log entry
0709 13:03:02.402124 (+   207us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:02.404333 (+  2209us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.404565 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.404678 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.545978 (+141300us) raft_consensus.cc:1685] finished
0709 13:03:02.546003 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.651444 (+105441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":329923,"prepare.queue_time_us":333188,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":21965,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":213,"thread_start_us":313583,"threads_started":2,"wal-append.queue_time_us":384108}
I20260709 13:03:02.396307 14046 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:02.543043 14158 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:03:02.437120 13918 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:03:02.762588  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.763567  8510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.017s
I20260709 13:03:02.643565 14092 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.800006  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.440582 13581 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.390861 13987 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.817104  9098 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:02.494585  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:02.808435  8510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.000s	sys 0.018s
I20260709 13:03:02.820048  9093 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:02.808807  8504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.017s	sys 0.006s
I20260709 13:03:02.525602 13438 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:02.800021  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:02.821656  8578 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:02.653368 14099 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:02.822777 14099 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.825608 14099 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:02.664407 13941 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.734866 14026 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:02.835978  8504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.017s	sys 0.006s
I20260709 13:03:02.835131  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1564) took 1562 ms. Trace:
I20260709 13:03:02.839593  9098 rpcz_store.cc:276] 0709 13:03:01.273244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.740815 (+1467571us) service_pool.cc:224] Handling call
0709 13:03:02.816948 (+ 76133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.834793 (+ 17845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.835058 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:02.436646 13799 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:02.828625  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 489226us
I20260709 13:03:02.844846  8398 leader_election.cc:400] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14.
I20260709 13:03:02.845172  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:02.845445  8398 leader_election.cc:403] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:02.620244 13797 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.811365 14046 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.857019  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.857776  8429 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:02.436960 14155 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:02.541849 13982 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:02.817548 14057 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.812341 14019 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:02.862733  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.852154 14123 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:02.811280 13884 consensus_queue.cc:1175] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dacb523538a14c7cb335ab9c18f4111b" responder_term: 12 status { last_received { term: 12 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 12 index: 10 } }
W20260709 13:03:02.864023  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.016s	sys 0.052s
W20260709 13:03:02.882893  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.016s	sys 0.052s
W20260709 13:03:02.883219  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 538813us
I20260709 13:03:02.869810  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.876760  9102 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:02.848178 13799 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.827234 14092 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:02.887104  9100 consensus_meta.cc:287] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.592s	user 0.012s	sys 0.000s
I20260709 13:03:02.863067  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:02.852856 14099 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.887538  9100 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:02.857528 14161 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:02.878945  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.894341  8428 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:02.881450  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 523611us
I20260709 13:03:02.889237  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:02.889818  8575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.031s
I20260709 13:03:02.878047 13918 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:02.896925  8575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.008s	sys 0.031s
I20260709 13:03:02.842958 13438 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.876509 14036 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.921463  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.910807  9093 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:03:02.912988  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:02.849248 14026 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.928844 14026 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.931439 13918 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.932901 14061 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:02.924423 13409 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:02.934144 13409 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.936655 13409 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.937295 13409 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:02.892390 13845 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:02.893610 14161 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:02.876755 13982 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:02.942102 14161 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.945844  8429 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:03:02.965906  8548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.002s	sys 0.019s
W20260709 13:03:02.969031  8548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.002s	sys 0.019s
I20260709 13:03:02.973829  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2611) took 1806 ms. Trace:
I20260709 13:03:02.981482  8582 rpcz_store.cc:276] 0709 13:03:01.167427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.167605 (+   178us) service_pool.cc:224] Handling call
0709 13:03:01.264696 (+ 97091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.522885 (+258189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.973562 (+1450677us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540028c3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:02.973754 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292237184}
I20260709 13:03:02.978765 13409 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14.
I20260709 13:03:02.984175 13409 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:02.984565 13438 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:02.978566 14019 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:02.883818 14057 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.979449 14061 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:02.980608 13797 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:02.997522 14057 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:02.942587 13982 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.987471  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2328) took 2418 ms. Trace:
I20260709 13:03:03.009195  8506 rpcz_store.cc:276] 0709 13:03:00.554117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.572188 (+ 18071us) service_pool.cc:224] Handling call
0709 13:03:00.627571 (+ 55383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.954967 (+327396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.972279 (+2017312us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540033b654. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:02.972506 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468065024}
I20260709 13:03:02.996420 14061 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.915563 14099 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:03.014915  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.031771  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.033376  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:03.036682  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:03.043493  8577 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:03.055444 14123 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:03.059543 14099 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:03.061587 13982 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:03.030391 13797 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:03.063283 13797 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.918262 14092 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.078507 13797 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:03.112182 13735 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.130622 13723 consensus_meta.cc:287] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.003s
W20260709 13:03:03.147490  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.154938  8508 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:03.211311  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.212529  8508 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:03.214267  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.162925  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.161532  9094 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:03:03.161188  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.179095  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:03.143841 13735 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.159078 13797 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.158610 13845 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:03.205700  8547 connection.cc:256] RPC call timeout handler was delayed by -1.1644042839999429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:03:03.222877  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.116951 13799 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:03.224937  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 380261us
I20260709 13:03:03.267596  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:03.230559  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.179737 13723 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:03.178689 14099 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:03.264539  8547 connection.cc:256] RPC call timeout handler was delayed by -1.0510042839999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:03:03.220431 14030 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.220366 13918 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.266409  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 381833us
I20260709 13:03:03.173557 13982 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:03:03.271405  8509 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:03.271044  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:03.275220  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:03.275664  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.278069  8508 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:03:03.263311 14173 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:03.220335 13438 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:03.269254 14159 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:03:03.280838  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.281968  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:03.231645 14010 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.794s	user 0.009s	sys 0.003s
W20260709 13:03:03.288049  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.288558  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.288980  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.290242  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:03.278651 14173 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:03.231699 14180 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:03.280328 13982 consensus_queue.cc:1243] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:03:03.269117 13845 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.339999  8508 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:03.526520  8509 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:03.307565 14010 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:03.280151 14030 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:03.432776  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.566324  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.276423 13723 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.384253 14177 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:03:03.273087 13797 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.528725 13799 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:03.309017 13933 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.306823 14061 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:03.293347 14021 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.126s
I20260709 13:03:03.278815 13918 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:03.530006 14046 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.665s	user 0.018s	sys 0.006s
I20260709 13:03:03.532526 13735 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:03.292009 13438 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.525084  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2546) took 2371 ms. Trace:
I20260709 13:03:03.536127 14193 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:03.536566  9093 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.004s	sys 0.021s
I20260709 13:03:03.538522 14189 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:03.270891 13581 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.539911  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2353) took 1531 ms. Trace:
I20260709 13:03:03.592093  8426 rpcz_store.cc:276] 0709 13:03:02.008416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.010239 (+  1823us) service_pool.cc:224] Handling call
0709 13:03:02.022225 (+ 11986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.022453 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:03.066069 (+1043616us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.539335 (+473266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.539397 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:03.539455 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.539540 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.539682 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1039971,"prepare.queue_time_us":1106823,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":33,"thread_start_us":472908,"threads_started":1,"wal-append.queue_time_us":502513}
W20260709 13:03:03.540766  9098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.005s	sys 0.020s
I20260709 13:03:03.524119 13932 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.524940 14173 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:03.539392  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 271881us
W20260709 13:03:03.728494  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.276563 14099 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.530555 14178 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.562695  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:03.733098  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 206530us
I20260709 13:03:03.734376  9099 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:03.563333  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2354) took 1554 ms. Trace:
W20260709 13:03:03.553021 14179 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
W20260709 13:03:03.567677  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 277745us
I20260709 13:03:03.737949  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:03.741200  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 216903us
I20260709 13:03:03.741319  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:03.742532  9099 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:03.743314  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:03.583523  8505 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:03.747143  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:03.747984  8580 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:03.748989  8582 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:03:03.750586  8431 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.003s	sys 0.003s
W20260709 13:03:03.751470  8431 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.003s	sys 0.003s
I20260709 13:03:03.753890  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:03.586582  8433 rpcz_store.cc:276] 0709 13:03:01.154095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.345351 (+191256us) service_pool.cc:224] Handling call
0709 13:03:01.345639 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.345837 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:03.016714 (+1670877us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.499747 (+483033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.524654 (+ 24907us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:03.524723 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.524813 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.524991 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1681789,"prepare.queue_time_us":1671283,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":326554,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":471370,"threads_started":2,"wal-append.queue_time_us":516264}
W20260709 13:03:03.589325  9093 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.004s	sys 0.021s
I20260709 13:03:03.593740 14193 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:03.604434 13918 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:03.606235 13581 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:03.616041 13671 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:03.615968  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2362) took 1391 ms. Trace:
I20260709 13:03:03.733915 13993 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.732796 14026 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:03.635249 13845 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:03.637312 14161 consensus_meta.cc:287] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.695s	user 0.008s	sys 0.000s
I20260709 13:03:03.640746 13438 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:03.641520 14194 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:03:03.579794 14092 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:03.641800  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2330) took 3297 ms. Trace:
I20260709 13:03:03.776656  8430 rpcz_store.cc:276] 0709 13:03:00.344348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.345734 (+  1386us) service_pool.cc:224] Handling call
0709 13:03:02.004344 (+1658610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.037512 (+ 33168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.641603 (+1604091us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b540030eb50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:03.641735 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3813585152}
W20260709 13:03:03.642802 13566 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.000s
W20260709 13:03:03.580128 14176 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
W20260709 13:03:03.643270  8435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 2347) took 1952 ms (client timeout 2119 ms). Trace:
I20260709 13:03:03.777657  8398 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:03.778105  8435 rpcz_store.cc:269] 0709 13:03:01.690941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.693427 (+  2486us) service_pool.cc:224] Handling call
0709 13:03:03.643063 (+1949636us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540026ff54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:03.643201 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408656256}
I20260709 13:03:03.645431  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1579) took 1235 ms. Trace:
I20260709 13:03:03.779397  9102 rpcz_store.cc:276] 0709 13:03:02.410038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.648238 (+238200us) service_pool.cc:224] Handling call
0709 13:03:03.645194 (+996956us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54006130d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:03.645359 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522503424}
W20260709 13:03:03.780014  8427 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.003s	sys 0.006s
I20260709 13:03:03.651183 14124 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:03.657467 13997 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:03.660950  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1127) took 1390 ms. Trace:
I20260709 13:03:03.671617 14123 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:03.672950  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.673993  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.675010  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.675884  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.676501 13919 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:03.677057 14057 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:02.136098  9096 rpcz_store.cc:276] 0709 13:03:00.982501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.982936 (+   435us) service_pool.cc:224] Handling call
0709 13:03:00.983343 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.998431 (+ 15088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.998472 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.017081 (+ 18609us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.475200 (+458119us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:02.114452 (+639252us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.116783 (+  2331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.116914 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.116979 (+    65us) raft_consensus.cc:1685] finished
0709 13:03:02.117002 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.117201 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":479974,"prepare.queue_time_us":529547,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":18158,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":17556,"spinlock_wait_cycles":8015744,"thread_start_us":577428,"threads_started":2,"wal-append.queue_time_us":539193}
I20260709 13:03:03.835021  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:03.835613  9096 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:03.837250  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:03.695149  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.696098 13987 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:03.700197  9094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1356) took 1345 ms (client timeout 1678 ms). Trace:
I20260709 13:03:03.703142  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.705147  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:03.606446 14183 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 13:03:03.711158  9098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.018s	sys 0.033s
I20260709 13:03:03.857909  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1308) took 2573 ms. Trace:
I20260709 13:03:03.858386  9098 rpcz_store.cc:276] 0709 13:03:01.284663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.917931 (+1633268us) service_pool.cc:224] Handling call
0709 13:03:02.972816 (+ 54885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.973207 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.973239 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.980195 (+  6956us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.857431 (+877236us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:03.857493 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.857590 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.857649 (+    59us) raft_consensus.cc:1685] finished
0709 13:03:03.857666 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.857840 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":617,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":5816,"thread_start_us":876741,"threads_started":1,"wal-append.queue_time_us":556297}
I20260709 13:03:03.341789 14180 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.866663  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2620) took 1785 ms. Trace:
I20260709 13:03:03.867203  8581 rpcz_store.cc:276] 0709 13:03:02.081474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.283594 (+202120us) service_pool.cc:224] Handling call
0709 13:03:03.866451 (+1582857us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54000aa5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:03.866593 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286513536}
I20260709 13:03:03.732156 14177 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:03.730783  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2335) took 1429 ms. Trace:
I20260709 13:03:03.871480  8584 rpcz_store.cc:276] 0709 13:03:02.301491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.343802 (+ 42311us) service_pool.cc:224] Handling call
0709 13:03:02.344109 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.763320 (+419211us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:02.831470 (+ 68150us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.284356 (+452886us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.292821 (+  8465us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.293094 (+   273us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:03.308163 (+ 15069us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.730339 (+422176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.730450 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.730512 (+    62us) raft_consensus.cc:1685] finished
0709 13:03:03.730533 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.730710 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67817,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":265472,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":248,"thread_start_us":1227681,"threads_started":3,"wal-append.queue_time_us":680025}
I20260709 13:03:03.743474  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:03.730571 14078 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:03.757431  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:03.758222  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:03.733244 14015 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.733178 13933 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.760169  8426 rpcz_store.cc:276] 0709 13:03:02.224735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.615191 (+1390456us) service_pool.cc:224] Handling call
0709 13:03:03.615499 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.615658 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.615680 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.615717 (+    37us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:03.615755 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.615802 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.615904 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:03.632431 14184 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:03:03.759024  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:03.761055  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2363) took 1532 ms. Trace:
I20260709 13:03:03.949312  8433 rpcz_store.cc:276] 0709 13:03:02.229167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.760011 (+1530844us) service_pool.cc:224] Handling call
0709 13:03:03.760417 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.760633 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.760670 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.760727 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:03.760766 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.760838 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.760986 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:03.633587  9065 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:03.951388  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 317838us
I20260709 13:03:03.764801 14205 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:03.583305  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1090) took 1658 ms. Trace:
I20260709 13:03:03.954207  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.953540  8434 rpcz_store.cc:276] 0709 13:03:01.924689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.924871 (+   182us) service_pool.cc:224] Handling call
0709 13:03:01.925202 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.925445 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:03.017909 (+1092464us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.582699 (+564790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.582931 (+   232us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:03.582998 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.583083 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.583237 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1092165,"prepare.queue_time_us":1203302,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":274688,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":563006,"threads_started":2,"wal-append.queue_time_us":541733}
W20260709 13:03:03.780315  8427 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.003s	sys 0.006s
I20260709 13:03:03.759785 14125 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:03.829921 13438 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:03.781857  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.735405  8432 rpcz_store.cc:276] 0709 13:03:02.008771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.010371 (+  1600us) service_pool.cc:224] Handling call
0709 13:03:02.010802 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.011079 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:03.062249 (+1051170us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.563010 (+500761us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.563062 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:03.563102 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.563163 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.563280 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1006956,"prepare.queue_time_us":1117903,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":162584,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":126,"thread_start_us":500299,"threads_started":2,"wal-append.queue_time_us":568518}
I20260709 13:03:03.748426 14178 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.815270  8507 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:03.830631  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:03.766559 13797 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:03.784680 13566 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.769718 14026 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.785575  8510 rpcz_store.cc:276] 0709 13:03:02.270897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.831860 (+560963us) service_pool.cc:224] Handling call
0709 13:03:02.832268 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.832555 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:03:02.854147 (+ 21592us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.224335 (+370188us) log.cc:844] Serialized 14 byte log entry
0709 13:03:03.660244 (+435909us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b180040bb20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:03:03.660455 (+   211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.660528 (+    73us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:03.660599 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.660690 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.660871 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":401106,"prepare.queue_time_us":131840,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":85,"raft.queue_time_us":438012,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":34293,"spinlock_wait_cycles":81499008,"thread_start_us":369258,"threads_started":1,"wal-append.queue_time_us":678833}
W20260709 13:03:03.990156  8399 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.022s	sys 0.038s
W20260709 13:03:03.991247  8399 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.023s	sys 0.038s
W20260709 13:03:03.841777  9094 rpcz_store.cc:269] 0709 13:03:02.354994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.368516 (+ 13522us) service_pool.cc:224] Handling call
0709 13:03:03.699944 (+1331428us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400208354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:03.700111 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744957824}
I20260709 13:03:03.842798  8502 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:03.774240 14161 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.845656  8430 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:03:03.773857 13845 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:03.995296  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:03.849027  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:03.854914  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2745) took 1625 ms. Trace:
I20260709 13:03:03.997025  8505 rpcz_store.cc:276] 0709 13:03:02.229340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.230552 (+  1212us) service_pool.cc:224] Handling call
0709 13:03:03.854588 (+1624036us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001fc554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:03.854831 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868614016}
W20260709 13:03:03.855952  9097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1321) took 1570 ms (client timeout 1802 ms). Trace:
W20260709 13:03:03.998297  9097 rpcz_store.cc:269] 0709 13:03:02.285272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.287233 (+  1961us) service_pool.cc:224] Handling call
0709 13:03:03.855736 (+1568503us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400560ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:03.855883 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351048576}
W20260709 13:03:03.863284  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.781508 14124 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:03.924432  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 166268us
I20260709 13:03:03.831313 13671 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:03.787225 14128 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:03.767585 13993 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:02.040352  9095 rpcz_store.cc:276] 0709 13:03:00.987878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.445217 (+457339us) service_pool.cc:224] Handling call
0709 13:03:01.445627 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:01.446071 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:01.446110 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.446768 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.576743 (+129975us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:02.019119 (+442376us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.019337 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.019430 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:02.019472 (+    42us) raft_consensus.cc:1685] finished
0709 13:03:02.019484 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.019621 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":379726,"prepare.queue_time_us":428429,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":18501,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":2701,"thread_start_us":172774,"threads_started":2,"wal-append.queue_time_us":167852}
I20260709 13:03:03.957630 13918 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:03.733062 13932 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:03.959896  8508 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:03.783973 14021 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:03:03.856760 13919 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:03.975615  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 216765us
I20260709 13:03:03.989395  9102 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:03.837924  9096 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:03.991513  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:03.993738  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2365) took 1335 ms. Trace:
I20260709 13:03:03.773929 13581 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:04.010269  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 276661us
I20260709 13:03:03.980787 14178 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:03.975014 14099 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:03.977157 14214 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:03.973497 14220 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:03:04.013885  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.955966  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:04.015092  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1310) took 2421 ms. Trace:
I20260709 13:03:03.961066 13990 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.017063  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:03.856609 14057 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:04.020146  8429 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:03.841871 14123 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:04.087000  9102 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:03.958302 14205 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:04.113143  9093 rpcz_store.cc:276] 0709 13:03:01.594205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.963544 (+1369339us) service_pool.cc:224] Handling call
0709 13:03:02.963893 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.964175 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:03.755765 (+791590us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.014751 (+258986us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.014803 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:04.014848 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.014924 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.015041 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":607109,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":352,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":10024,"thread_start_us":1033070,"threads_started":2}
I20260709 13:03:04.079762  8430 rpcz_store.cc:276] 0709 13:03:02.658507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.785552 (+1127045us) service_pool.cc:224] Handling call
0709 13:03:03.845433 (+ 59881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.993375 (+147942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.993661 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.012668 14128 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:04.012919 13671 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:04.116173  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1348) took 2315 ms. Trace:
I20260709 13:03:04.116578  9102 rpcz_store.cc:276] 0709 13:03:01.800850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.079635 (+2278785us) service_pool.cc:224] Handling call
0709 13:03:04.086823 (+  7188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.115903 (+ 29080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.116122 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:03.910838 14177 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:04.034296  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:04.045114  8503 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:04.080827  8502 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:04.078804  8501 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
W20260709 13:03:04.084738  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 73177.2us
I20260709 13:03:04.052145 14161 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.110872  8506 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:04.021934 14192 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.467s	user 0.000s	sys 0.001s
I20260709 13:03:04.053807  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2326) took 1975 ms. Trace:
W20260709 13:03:04.113680  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 330006us
I20260709 13:03:04.112047  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2355) took 2075 ms. Trace:
I20260709 13:03:04.114377 13987 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:04.119047 14128 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.119342 13671 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.087001  8510 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:04.080745  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1349) took 2279 ms. Trace:
W20260709 13:03:04.114624  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 97669.8us
I20260709 13:03:04.120831 14071 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.123332 14099 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:03.961707 13989 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:04.162201  9096 rpcz_store.cc:276] 0709 13:03:01.801599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.079962 (+2278363us) service_pool.cc:224] Handling call
0709 13:03:04.080262 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.080440 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.080475 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.080515 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:04.080549 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.080599 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.080694 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.054390  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:03.958993 13933 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:03.949004 14015 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:04.121572  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:04.159418  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 125204us
I20260709 13:03:04.122244  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.122871  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.166955  8435 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:04.167155  8433 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:04.167804  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.168891  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.123054  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.118127 14205 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:04.170506  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:04.123786  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.171725  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.172158  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:04.172665  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.173311  8578 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:04.159382  8431 rpcz_store.cc:276] 0709 13:03:02.036740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.037012 (+   272us) service_pool.cc:224] Handling call
0709 13:03:02.054676 (+ 17664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.054888 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:03.752295 (+1697407us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.111689 (+359394us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.111740 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:04.111794 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.111867 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.111992 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1049508,"prepare.queue_time_us":1074801,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1947,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2412,"thread_start_us":991828,"threads_started":2}
I20260709 13:03:04.046299 13932 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:03.987118 13438 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.049202 13919 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.023686 14010 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:04.113921 14175 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.079s	user 0.006s	sys 0.020s
I20260709 13:03:04.185993  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.052816 14180 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.186669  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:04.043076 14193 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.131557  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.013338 13845 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:04.150242  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:04.193285  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 80825.4us
I20260709 13:03:04.110152 13918 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:04.084280 14214 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:04.157595  8575 rpcz_store.cc:276] 0709 13:03:02.078284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.309360 (+231076us) service_pool.cc:224] Handling call
0709 13:03:02.309745 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:02.324222 (+ 14477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.324268 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:02.325055 (+   787us) log.cc:844] Serialized 52 byte log entry
0709 13:03:02.897399 (+572344us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:02.965507 (+ 68108us) log.cc:844] Serialized 14 byte log entry
0709 13:03:02.975288 (+  9781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.975369 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.017624 (+ 42255us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b48000b1558. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:03:04.053494 (+1035870us) raft_consensus.cc:1685] finished
0709 13:03:04.053614 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.053748 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17331,"prepare.queue_time_us":67741,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":11490,"raft.queue_time_us":16688,"raft.run_cpu_time_us":13039,"raft.run_wall_time_us":701769,"spinlock_wait_cycles":7673728,"thread_start_us":532292,"threads_started":1,"wal-append.queue_time_us":800781}
I20260709 13:03:04.175055  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:04.198730  8506 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.198982  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.122943  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:04.172286  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.176937  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.177335  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:04.200727  8435 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:04.087288 13581 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.181823  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:04.186496 14175 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.006s	sys 0.020s
I20260709 13:03:04.173000 14099 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:04.176321  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.127717 13680 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:04.186934  8581 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:04.170109 14178 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:04.189285  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.189684  8432 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:04.210898  8434 raft_consensus.cc:2410] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:03:04.155136 13735 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.191839  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:04.211742  8433 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:04.124503 14124 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:04.213853  8506 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:03:04.118487 13990 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.194216  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:04.200786  9096 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:04.171761  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:04.202011  8435 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:04.203727 13845 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.204269  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.193470 13919 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:04.192798 13784 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:04.190996 14207 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.191080 14209 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:04.182251  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.053939 14030 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.201810  9099 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:04.206629  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:04.208204  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.192135 14161 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:04.218410  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46729.3us
I20260709 13:03:04.190902 14171 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:04.219177  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1309) took 2888 ms. Trace:
W20260709 13:03:04.220127  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.180929 14019 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:03:04.176719 13941 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:03:04.177438 13987 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.221235  8431 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:04.249413  9100 rpcz_store.cc:276] 0709 13:03:01.330976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.896005 (+1565029us) service_pool.cc:224] Handling call
0709 13:03:02.896310 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.918881 (+ 22571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.918924 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.950494 (+ 31570us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.211667 (+261173us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:03.211707 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.211779 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.218987 (+1007208us) raft_consensus.cc:1685] finished
0709 13:03:04.219010 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.219123 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23701,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":21333,"thread_start_us":229929,"threads_started":1,"wal-append.queue_time_us":446248}
I20260709 13:03:04.252019  9094 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:04.240733  8433 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:04.222632  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2356) took 2184 ms. Trace:
I20260709 13:03:04.181617 14071 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.205309 14214 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:04.208062 14099 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.266145  8427 rpcz_store.cc:276] 0709 13:03:02.045315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.053181 (+  7866us) service_pool.cc:224] Handling call
0709 13:03:02.053538 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.053824 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:03.956070 (+1902246us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.171066 (+214996us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.222180 (+ 51114us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.222252 (+    72us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:04.222321 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.222420 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.222561 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1129034,"prepare.queue_time_us":1075914,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":4560,"raft.queue_time_us":95453,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":19521,"spinlock_wait_cycles":45264768,"thread_start_us":1065671,"threads_started":2,"wal-append.queue_time_us":285464}
I20260709 13:03:04.210312 14178 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.251093  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:04.235738 14208 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:03:04.222812 13937 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:04.277988  8550 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.919s (SENT) [suppressed 26 similar messages]
I20260709 13:03:04.243389 13989 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:04.318219 13989 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:04.319456 13989 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.280362  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.283411 13993 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.278785 13997 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:03:04.322553 13918 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.328168  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1323) took 1037 ms. Trace:
I20260709 13:03:04.328655  9099 rpcz_store.cc:276] 0709 13:03:03.290300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.743230 (+452930us) service_pool.cc:224] Handling call
0709 13:03:04.327979 (+584749us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54005f3a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:04.328104 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752622336}
W20260709 13:03:04.284312 14226 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:04.285244  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.286201  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.286324  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.287148 13987 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.287002 13937 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:04.288834 14071 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.289286  8426 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.270817 13919 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.290445  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.291172  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:04.247093 13784 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:04.248165 14225 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:04.294562 13941 raft_consensus.cc:3055] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:04.295420 14015 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.296010 13438 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.226691 13735 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.296859 13933 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.201128 14125 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:03:04.249804 14209 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:04.300604 14222 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:03:04.260077 14171 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.271351 14037 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.210489 14177 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.303782 14010 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:04.303619 13581 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:04.282687 14178 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.305913  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:04.368999  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2342) took 1293 ms. Trace:
I20260709 13:03:04.445461  8506 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:04.250123 14207 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:04.307536 14232 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:03:04.282125 13566 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.253579 14161 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:04.312076  9101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1316) took 2284 ms (client timeout 1981 ms). Trace:
I20260709 13:03:04.445396  8576 rpcz_store.cc:276] 0709 13:03:03.075867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.076101 (+   234us) service_pool.cc:224] Handling call
0709 13:03:03.076568 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.076994 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.077032 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.094430 (+ 17398us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.618207 (+523777us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b1800450c40. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:03:03.839669 (+221462us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:03.839710 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.839772 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.368642 (+528870us) raft_consensus.cc:1685] finished
0709 13:03:04.368661 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.368929 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2438,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3036,"spinlock_wait_cycles":44320512,"thread_start_us":221257,"threads_started":1,"wal-append.queue_time_us":1090148}
W20260709 13:03:04.451785  9101 rpcz_store.cc:269] 0709 13:03:02.027277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.165439 (+138162us) service_pool.cc:224] Handling call
0709 13:03:04.311846 (+2146407us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540035e154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:04.311967 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259410304}
I20260709 13:03:04.451668  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.452775  8583 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:03:04.453397  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1565) took 2144 ms. Trace:
I20260709 13:03:04.316573  9065 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:04.453634  8579 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
W20260709 13:03:04.454319  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 137861us
I20260709 13:03:04.455459  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:04.317209 14026 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.213202 13680 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.329705  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:04.344076  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 127988us
W20260709 13:03:04.346788  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.349364  8578 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:04.453842  9101 rpcz_store.cc:276] 0709 13:03:02.309438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.452669 (+2143231us) service_pool.cc:224] Handling call
0709 13:03:04.452938 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.453102 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.453128 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.453164 (+    36us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:04.453193 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.453243 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.453346 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.459195  9101 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:04.459904  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1566) took 2150 ms. Trace:
I20260709 13:03:04.460311  9101 rpcz_store.cc:276] 0709 13:03:02.309694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.458594 (+2148900us) service_pool.cc:224] Handling call
0709 13:03:04.458966 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.459622 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.459841 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.374672  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1315) took 2366 ms. Trace:
I20260709 13:03:04.391103  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:04.467759  9102 rpcz_store.cc:276] 0709 13:03:02.008287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.117368 (+2109081us) service_pool.cc:224] Handling call
0709 13:03:04.118929 (+  1561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.119382 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.119405 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.119911 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.217705 (+ 97794us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:04.217746 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.217807 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.374368 (+156561us) raft_consensus.cc:1685] finished
0709 13:03:04.374395 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.374589 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":97527,"threads_started":1,"wal-append.queue_time_us":246717}
I20260709 13:03:04.349622  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.439098  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:04.439900  8575 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.321918 14123 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:04.400981  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 206826us
I20260709 13:03:04.448479  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1345) took 2651 ms. Trace:
I20260709 13:03:04.470422  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:04.470074  9097 rpcz_store.cc:276] 0709 13:03:01.797242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.014639 (+2217397us) service_pool.cc:224] Handling call
0709 13:03:04.020977 (+  6338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.183337 (+162360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.183395 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.183454 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:04.183509 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.448257 (+264748us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000e83d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:04.448299 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.448425 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372693376}
I20260709 13:03:04.450523  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.469738  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1568) took 2159 ms. Trace:
W20260709 13:03:04.366139 14164 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.483s	user 0.003s	sys 0.022s
I20260709 13:03:04.457366  9099 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:04.478614  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:04.478890  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.479373  9097 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:04.479568  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.479950  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1569) took 2169 ms. Trace:
I20260709 13:03:04.480080  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.480198  8583 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:04.480331  9097 rpcz_store.cc:276] 0709 13:03:02.310536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.471795 (+2161259us) service_pool.cc:224] Handling call
0709 13:03:04.477317 (+  5522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.479742 (+  2425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.479904 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.481099  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.472046  9102 rpcz_store.cc:276] 0709 13:03:02.310253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.469010 (+2158757us) service_pool.cc:224] Handling call
0709 13:03:04.469285 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.469459 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.469483 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.469521 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:04.469548 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.469595 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.469687 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.481439  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.482985  9102 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:03:04.483433  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.419013 13990 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.441589 14010 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.439005 13941 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:04.485994  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:04.602751  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 124225us
I20260709 13:03:04.486560  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1314) took 2478 ms. Trace:
I20260709 13:03:04.604236  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:04.483731  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1573) took 2172 ms. Trace:
I20260709 13:03:04.605206  9102 rpcz_store.cc:276] 0709 13:03:02.311582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.482350 (+2170768us) service_pool.cc:224] Handling call
0709 13:03:04.482657 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.483449 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.483661 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.604607  9093 rpcz_store.cc:276] 0709 13:03:02.008013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.115639 (+2107626us) service_pool.cc:224] Handling call
0709 13:03:04.116015 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:04.116443 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.116475 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:04.116998 (+   523us) log.cc:844] Serialized 52 byte log entry
0709 13:03:04.274730 (+157732us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:04.485979 (+211249us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.486227 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.486321 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:04.486359 (+    38us) raft_consensus.cc:1685] finished
0709 13:03:04.486373 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.486496 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2156,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":10685,"thread_start_us":271636,"threads_started":2,"wal-append.queue_time_us":237026}
I20260709 13:03:04.607841  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1575) took 2295 ms. Trace:
I20260709 13:03:04.487485  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.610194  8581 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:04.608410  9102 rpcz_store.cc:276] 0709 13:03:02.312066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.606726 (+2294660us) service_pool.cc:224] Handling call
0709 13:03:04.607183 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.607424 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.607459 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.607504 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:04.607551 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.607623 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.607767 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.488427  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.489812  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.490918  8426 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:04.441206 14225 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:04.480872  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:04.445725 14037 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.432713 13671 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.529297  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:04.552205  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.677331  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1318) took 2629 ms. Trace:
I20260709 13:03:04.501308  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:04.616004  9102 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:03:04.700973  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2559) took 2515 ms. Trace:
W20260709 13:03:04.713969  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.528793  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:04.765748  8505 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:04.765180  8429 rpcz_store.cc:276] 0709 13:03:02.185709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.951567 (+765858us) service_pool.cc:224] Handling call
0709 13:03:02.951926 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.112278 (+1160352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.700705 (+588427us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003a2d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:04.700907 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2456044288}
W20260709 13:03:04.766134  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.766933  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1577) took 2454 ms. Trace:
I20260709 13:03:04.730195  9096 rpcz_store.cc:276] 0709 13:03:02.048435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.218622 (+2170187us) service_pool.cc:224] Handling call
0709 13:03:04.219006 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.219252 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:04.444442 (+225190us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.676839 (+232397us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.676912 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:04.676975 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.677081 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.677252 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":436099,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":5186,"thread_start_us":418856,"threads_started":2}
I20260709 13:03:04.767412  9102 rpcz_store.cc:276] 0709 13:03:02.312528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.612898 (+2300370us) service_pool.cc:224] Handling call
0709 13:03:04.613293 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.766618 (+153325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.766877 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.764755  8503 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:03:04.627799  8581 pending_rounds.cc:85] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 13
I20260709 13:03:04.576907  8575 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:04.626699  8501 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:04.804986  8577 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:04.804483  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1360) took 1581 ms. Trace:
I20260709 13:03:04.492944 13438 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.712092 13723 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.732734 14161 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.767007  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:04.807349 14225 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:04.698881 14240 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:04.702080 14171 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.496788 14030 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.710479 14057 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.714907 13784 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.615180 13987 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:04.669775 14236 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:04.810161 13987 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:04.810725 13987 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.609036 14026 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.811797 14026 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.728008  8506 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:04.812700 14030 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.814103  8506 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:04.815404  8506 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:03:04.691788 14205 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.816200 14030 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.805696  9102 rpcz_store.cc:276] 0709 13:03:03.223482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.803635 (+1580153us) service_pool.cc:224] Handling call
0709 13:03:04.803975 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.804162 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.804185 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.804223 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:04.804252 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.804304 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.804430 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.611207 13990 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:04.695794  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 256742us
I20260709 13:03:04.492238 14128 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:04.817548  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 50287us
W20260709 13:03:04.653803  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 49690.1us
I20260709 13:03:04.804286  8581 pending_rounds.cc:107] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:03:04.835427 13680 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.835807  8581 raft_consensus.cc:2889] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:04.823606  8547 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:04.840359  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:04.653602  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.824188  8505 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:04.478693 13951 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:04.826517  8509 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:04.806680 13438 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.769064 14010 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.829908 14205 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.769084  9096 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:04.614298 13797 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:04.831542  8503 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:03:04.834566 14026 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.836591  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:04.851082  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1580) took 2090 ms. Trace:
I20260709 13:03:04.852169  9096 rpcz_store.cc:276] 0709 13:03:02.760851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.768341 (+2007490us) service_pool.cc:224] Handling call
0709 13:03:04.768646 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.850819 (+ 82173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.851023 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.852766  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:04.836697 13919 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.849022 13934 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:04.852972 14038 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:04.853534 13919 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:04.853605 13934 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.855453 13934 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:04.855792 13797 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:04.858184 14200 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.255s	user 0.006s	sys 0.002s
I20260709 13:03:04.819950 13993 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:04.858871 13993 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:04.859800 14173 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.860630  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:04.861159 13993 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.861423 13919 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:04.651837  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2548) took 2469 ms. Trace:
I20260709 13:03:04.861897 13919 raft_consensus.cc:697] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:04.836845 14128 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:04.849073 13990 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:04.863552  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:04.489646 14123 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:04.862203  8428 rpcz_store.cc:276] 0709 13:03:02.182564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.922702 (+740138us) service_pool.cc:224] Handling call
0709 13:03:03.646137 (+723435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.646358 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.646394 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.646449 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:03.646496 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.646567 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.651646 (+1005079us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b540026ff50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:04.651760 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662799104}
W20260709 13:03:04.864821  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 668861us
I20260709 13:03:04.866114 13671 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.866734 13797 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:04.849118 14030 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:04.862835 13919 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.867812 14030 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.868326 14030 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:04.492012 13581 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:04.729130 14207 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.614298 14177 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.842754 13951 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:04.664690 13845 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:04.838267 13933 consensus_queue.cc:1059] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:04.848966 13884 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:03:04.854924  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:04.863641 13990 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:04.865708 13934 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:04.842199  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.871101  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:04.805946  8501 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:04.848948  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:04.880131  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.880352  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.881564  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.859817 14238 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:04.883801  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:04.906787  8435 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
W20260709 13:03:04.907949  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59047.2us
I20260709 13:03:04.874806  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:04.893432  9095 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:04.889397 14092 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:04.913439  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:04.901976  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.902056  9096 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:04.897393 13951 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.917151  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:04.881910  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:04.913210 14099 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:03:04.908124 13797 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:04.912184 14026 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:04.907073  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:04.889196 13581 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.916280 14019 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:04.910068  8503 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:03:04.878940  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.961709  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:04.962116  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.962994  8429 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:04.964186  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.894301  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.897670  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.844533 14125 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:04.915813  9093 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:04.896713 14080 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:04.906392 13845 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:04.934146 13934 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:04.936020  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:05.024669  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 88718.9us
I20260709 13:03:04.940019  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.942203 13671 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:04.942873 14207 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:04.943714 14205 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:03:04.943800  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 737225us
I20260709 13:03:04.944334 14174 consensus_queue.cc:1059] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:03:04.904040  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1319) took 2684 ms. Trace:
I20260709 13:03:05.032357  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:05.032255  9100 rpcz_store.cc:276] 0709 13:03:02.219720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.275462 (+2055742us) service_pool.cc:224] Handling call
0709 13:03:04.279472 (+  4010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.279699 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:04.482294 (+202595us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.903584 (+421290us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.903659 (+    75us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:04.903724 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.903812 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.903977 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42335,"prepare.queue_time_us":403872,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":393,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5368,"thread_start_us":580457,"threads_started":2}
I20260709 13:03:05.034497  9100 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:04.969782 14021 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:03:04.921339 14214 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 13:03:04.907235  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:04.960474 13581 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.929086 14102 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:04.973748 14125 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:04.974712  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:04.978785 14246 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.980010  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1138) took 1307 ms. Trace:
I20260709 13:03:04.952220 13989 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:04.919551 14092 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:04.988233  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.991170 14209 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:05.000770  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1143) took 1047 ms. Trace:
I20260709 13:03:04.918185 14206 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.068197  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:05.069053  8501 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.002664  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.003669 14046 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:04.960912 14019 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:05.009817 14230 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:05.011226  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:05.078675  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 234735us
I20260709 13:03:05.016621  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.026626  8435 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:05.027263 13797 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:05.026618  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:05.028549  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:04.949573  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:05.042200  8433 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
W20260709 13:03:05.083722  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 134209us
I20260709 13:03:05.084295  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:05.084506  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:04.959124 14026 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.085091  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:05.047420  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1578) took 2734 ms. Trace:
I20260709 13:03:05.085723  9095 rpcz_store.cc:276] 0709 13:03:02.312753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.707397 (+2394644us) service_pool.cc:224] Handling call
0709 13:03:04.707701 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.911568 (+203867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.047077 (+135509us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400625054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:05.047334 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426544384}
I20260709 13:03:05.050127  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.057869  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:05.055364  8509 rpcz_store.cc:276] 0709 13:03:03.672414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.672576 (+   162us) service_pool.cc:224] Handling call
0709 13:03:04.979815 (+1307239us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540008e3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:04.979942 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323271424}
I20260709 13:03:04.949978 14099 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.065092  8510 rpcz_store.cc:276] 0709 13:03:03.953354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.991247 (+ 37893us) service_pool.cc:224] Handling call
0709 13:03:05.000581 (+1009334us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b54003728d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:05.000702 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17210752}
I20260709 13:03:05.107585  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.108256  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:04.989820  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:05.109401  8505 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:05.025143 14080 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:05.050668 14205 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:05.100582  8578 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:05.101289  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.103709  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:05.106643  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.107296  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.109599  8580 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:05.111377  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.112564  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.160481  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.159391  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.151764  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:05.159482  8429 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:05.039826 13671 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.059350 13989 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:05.043532 14207 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.165112  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:05.195940  8509 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.166764  8505 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:05.169518  9068 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:05.113767  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 85338.7us
I20260709 13:03:05.198329  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:05.173305  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.191763  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.205626  8575 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:05.191994  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.075629 14124 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.193809  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.208005  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:05.207263  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:05.207515  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 1103) took 1045 ms. Trace:
I20260709 13:03:05.208858  8575 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:05.208798  8426 rpcz_store.cc:276] 0709 13:03:04.122153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.122721 (+   568us) service_pool.cc:224] Handling call
0709 13:03:05.167422 (+1044701us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b54003f2354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:05.167555 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204989312}
I20260709 13:03:05.208169  8430 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:03:05.211633  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 289387us
I20260709 13:03:05.075839 14046 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:05.217595  9101 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:05.048058 14214 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:05.113703 14238 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:05.219539  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.060485 14143 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:03:05.078809 14230 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:05.113327 13997 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:05.225674  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.245056  8580 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:05.108628 13797 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.110601 14026 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:05.108982 13934 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:05.229573  8575 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:05.219381  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:05.251485  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:05.194777 14245 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.237210  8431 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:03:05.255137  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.112974 14128 raft_consensus.cc:2764] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:05.231124  8578 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:05.256397 13934 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:05.240302  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.193001 13723 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:05.195304 13989 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.233752 14238 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.252482  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.253449 14078 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:05.251761 14178 consensus_meta.cc:287] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.000s
I20260709 13:03:05.245752 14230 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.476559  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.477280  8582 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:05.249306 13797 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.217887 13845 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.249019 13997 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:05.080142 14206 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:05.065088 14246 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.240077  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:05.265946  8509 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
W20260709 13:03:05.453879  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 284408us
I20260709 13:03:05.269375  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:05.272302  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:05.273290  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:05.494184  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 224859us
I20260709 13:03:05.495105  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:05.496316  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:05.277595  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.277578 14175 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:05.269819 14019 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.287746 14046 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.518218  8435 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:05.518676 14046 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.519155  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:05.520293  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.521108 14246 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:05.521286  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:05.319222  8504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.010s	sys 0.053s
W20260709 13:03:05.522214  8504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.010s	sys 0.053s
I20260709 13:03:05.282014 14205 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:05.370321 13919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.002s	sys 0.018s
W20260709 13:03:05.347582  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 490067us
I20260709 13:03:05.267284  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.527431  8578 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:05.442272  8549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.016s	sys 0.041s
W20260709 13:03:05.529285  8549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.016s	sys 0.041s
W20260709 13:03:05.529582  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 685134us
I20260709 13:03:05.441195  8433 raft_consensus.cc:2410] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:03:05.474373  8575 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:05.498252  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:05.531461  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.499171  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:05.464171 14030 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.003s
W20260709 13:03:05.501385  8400 connection.cc:256] RPC call timeout handler was delayed by -1.2926544629999626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:03:05.476146 14250 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.396s	user 0.005s	sys 0.000s
W20260709 13:03:05.477470 14225 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.669s	user 0.021s	sys 0.001s
I20260709 13:03:05.463307 14123 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:05.462802 14238 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:05.476617 14251 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.250s	user 0.000s	sys 0.010s
I20260709 13:03:05.269352 14161 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:05.511837  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 333772us
I20260709 13:03:05.513181  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.561718  8582 raft_consensus.cc:2410] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:03:05.513336 13934 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:05.516057 14209 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:05.517732 14206 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:05.522753  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:05.534353  8400 connection.cc:256] RPC call timeout handler was delayed by -1.1836944770000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
I20260709 13:03:05.566560  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.485584 14178 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.533571 14213 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.542464  8578 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:05.494422 13997 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.508975 13932 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:05.555954  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 357710us
W20260709 13:03:05.526813 13919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.003s	sys 0.018s
I20260709 13:03:05.566831  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.589210  9100 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:05.590096  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:05.590690  8426 raft_consensus.cc:2376] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15. Re-sending same reply.
I20260709 13:03:05.591737  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.570179 14057 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:05.568416  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.530150  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:03:05.559862  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 60787.4us
I20260709 13:03:05.599511  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:05.599892  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 69839.4us
I20260709 13:03:05.570430  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:05.541934 14207 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:05.542631 14019 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.545197 14030 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:05.575274  8502 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:05.581931  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.555088 14175 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.593014  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.636134  8426 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:05.567611  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.555595 14225 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.601539  9095 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:05.627964  9068 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:05.608084  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:05.594548  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:05.636936  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:05.645393  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50910.8us
W20260709 13:03:05.641535  8501 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.001s
I20260709 13:03:05.643392  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.646229  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:05.663086  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.646919  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:05.645918  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:05.664901  8502 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:05.661577  8501 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:05.665021  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:05.585779 14254 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.672206  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:05.671404  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.673159  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:05.682771  9095 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:05.643627 14080 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:05.679694  8579 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:05.602458 14099 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:05.649802 14177 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.754s	user 0.003s	sys 0.007s
I20260709 13:03:05.680941  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:05.627278 14125 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:05.603998 14014 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:05.685672  9100 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:05.603714 14057 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:05.670207 14078 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:05.604750 13671 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:05.670837 14214 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:05.589354 14213 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.728313  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:05.706635 14057 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:05.666996 13919 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:03:05.702279  8576 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:05.763422  9095 raft_consensus.cc:2410] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 17 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:03:05.709585 14276 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.670311 14277 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:03:05.703773 14161 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.708637 14078 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.749555 13918 raft_consensus.cc:3055] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:05.767395 14099 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:05.801483  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.819306  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:05.820309  9095 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:05.824962  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 292398us
I20260709 13:03:05.828864  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:05.831714  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1570) took 3520 ms. Trace:
I20260709 13:03:05.775756  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2359) took 1245 ms. Trace:
I20260709 13:03:05.840642  8550 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:05.840935  8504 rpcz_store.cc:276] 0709 13:03:04.530779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.531844 (+  1065us) service_pool.cc:224] Handling call
0709 13:03:04.532189 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.532458 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:05.522574 (+990116us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.775367 (+252793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.775427 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:05.775476 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.775552 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.775692 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":198895,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":3160,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8940,"thread_start_us":1147716,"threads_started":2}
I20260709 13:03:05.766095 14246 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:05.803006 14078 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.704885 14256 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.118s
I20260709 13:03:05.801663 13918 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:05.829747  8580 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:05.849033  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1584) took 1834 ms. Trace:
I20260709 13:03:05.857300  9095 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:05.879103  9094 rpcz_store.cc:276] 0709 13:03:04.014659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.960418 (+945759us) service_pool.cc:224] Handling call
0709 13:03:04.975680 (+ 15262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.975940 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:04.976241 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.846915 (+870674us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.846984 (+    69us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:05.847686 (+   702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.848033 (+   347us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.848957 (+   924us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29672,"prepare.queue_time_us":33384,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":160439,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":39331,"thread_start_us":685897,"threads_started":2,"wal-append.queue_time_us":612470}
I20260709 13:03:05.830245 14161 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:05.777066 14260 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:03:05.840392 13723 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:05.887512 14261 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 13:03:05.858155 14174 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:05.799940 14276 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.850229 14246 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.840907 13934 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:03:05.902685 14178 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:05.909143 14174 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:05.933053 14263 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 13:03:05.933753 14030 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:05.919126 14246 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:05.898357 14161 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:05.940299 14269 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 13:03:05.957937 14267 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:05.958628 14161 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:05.958922 14265 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:03:05.959113 14037 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:05.959997 14271 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:03:05.961211 14266 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:03:05.962080 14092 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:05.967694 14230 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:05.954573 14273 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:03:05.947206 14174 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.975953 14246 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.985049 14123 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:05.985852 14123 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:05.985317 14246 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:05.993673 14253 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.479s	user 0.001s	sys 0.001s
W20260709 13:03:05.995618 14274 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:03:05.997216 14262 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.446s	user 0.000s	sys 0.002s
W20260709 13:03:06.001082 14264 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.487s	user 0.001s	sys 0.001s
I20260709 13:03:06.174167 14246 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:06.174589 14102 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:06.175313 14246 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:05.995680 14276 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:03:05.701459  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:06.046669  8429 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.006s	sys 0.010s
W20260709 13:03:06.047379  8432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.007s	sys 0.015s
W20260709 13:03:06.049213  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.681916  8434 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:06.059142  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.065549  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:06.067123  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.031s
W20260709 13:03:06.254901  8400 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.003s	sys 0.007s
W20260709 13:03:06.254894  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.012s	sys 0.031s
I20260709 13:03:06.067520  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2581) took 1011 ms. Trace:
I20260709 13:03:06.073774  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2355) took 1571 ms. Trace:
I20260709 13:03:06.074764  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2758) took 1182 ms. Trace:
I20260709 13:03:06.076068  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2357) took 1547 ms. Trace:
I20260709 13:03:06.057632  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2577) took 1022 ms. Trace:
W20260709 13:03:06.092968  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:06.094502  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 253781us
W20260709 13:03:06.093868  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 440943us
W20260709 13:03:06.097784  8576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 942) took 1811 ms (client timeout 1719 ms). Trace:
I20260709 13:03:06.103432  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 947) took 1815 ms. Trace:
I20260709 13:03:06.104331  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2634) took 1011 ms. Trace:
I20260709 13:03:06.111182  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:06.119678  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:06.125780  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:06.126247  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1576) took 3813 ms. Trace:
I20260709 13:03:06.129276  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:06.131170  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:06.131505  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1571) took 3820 ms. Trace:
I20260709 13:03:05.838099  9099 rpcz_store.cc:276] 0709 13:03:02.310793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.476033 (+2165240us) service_pool.cc:224] Handling call
0709 13:03:04.494859 (+ 18826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.495118 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:04.876817 (+381699us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.831264 (+954447us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.831334 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:05.831395 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.831488 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.831644 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24184,"prepare.queue_time_us":191283,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":188398,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":21988,"thread_start_us":1085824,"threads_started":3,"wal-append.queue_time_us":901168}
I20260709 13:03:06.133284  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1567) took 3823 ms. Trace:
I20260709 13:03:06.135993 13409 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.137764  8502 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:06.139180 13438 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:06.138726 13671 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:06.144904 13884 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:06.146857 14030 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:06.146652 13918 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.150606 14256 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:06.150485 13934 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:06.151670 13990 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:06.162434 14037 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:06.164355 14038 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:05.994306 14245 consensus_meta.cc:287] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.738s	user 0.004s	sys 0.007s
I20260709 13:03:06.277612 14038 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:06.258188  8579 rpcz_store.cc:276] 0709 13:03:05.092808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.092993 (+   185us) service_pool.cc:224] Handling call
0709 13:03:05.107408 (+ 14415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.689434 (+582026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.103686 (+414252us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b5400283054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:06.104084 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304949632}
I20260709 13:03:06.038728  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:05.972219 14225 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.255684  8431 rpcz_store.cc:276] 0709 13:03:05.055798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.081756 (+ 25958us) service_pool.cc:224] Handling call
0709 13:03:06.067060 (+985304us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b54001d38d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:06.067332 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70459136}
I20260709 13:03:06.215397 13937 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:06.259106  9093 rpcz_store.cc:276] 0709 13:03:02.312299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.607476 (+2295177us) service_pool.cc:224] Handling call
0709 13:03:04.607811 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.966757 (+358946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.125492 (+1158735us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400502154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:06.125956 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707719552}
I20260709 13:03:05.983355 14230 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:06.249526  8429 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.006s	sys 0.010s
W20260709 13:03:06.257015  8400 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.004s	sys 0.008s
W20260709 13:03:06.247685  8510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.003s	sys 0.011s
W20260709 13:03:06.263974  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 703068us
W20260709 13:03:06.257722  8576 rpcz_store.cc:269] 0709 13:03:04.286483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.481228 (+194745us) service_pool.cc:224] Handling call
0709 13:03:06.097356 (+1616128us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400283554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:06.097571 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2805704064}
W20260709 13:03:06.251535  8432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.007s	sys 0.015s
I20260709 13:03:06.256984  8433 rpcz_store.cc:276] 0709 13:03:05.035425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.083968 (+ 48543us) service_pool.cc:224] Handling call
0709 13:03:06.057006 (+973038us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400126e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:06.057379 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461035264}
I20260709 13:03:06.259850  9101 rpcz_store.cc:276] 0709 13:03:02.309955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.461187 (+2151232us) service_pool.cc:224] Handling call
0709 13:03:04.461547 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.223388 (+761841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.132711 (+909323us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540017a054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:06.133067 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1738292480}
W20260709 13:03:06.292484  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 210457us
W20260709 13:03:06.289430  8476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.020s	sys 0.012s
W20260709 13:03:06.294075 14262 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
W20260709 13:03:06.301512  8510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.004s	sys 0.012s
W20260709 13:03:06.301968  8476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.021s	sys 0.012s
I20260709 13:03:06.305024  9095 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:06.302284 14238 consensus_meta.cc:287] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.686s	user 0.014s	sys 0.008s
I20260709 13:03:06.311018 14102 raft_consensus.cc:3055] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:06.311551 14102 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:06.311702 14238 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.312875 14102 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:06.318300  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.303723  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1583) took 2488 ms. Trace:
I20260709 13:03:06.292937 14246 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:06.304684  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 179394us
I20260709 13:03:06.318994  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:06.322947 13933 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:06.323098 14095 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:06.316346  9098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.006s	sys 0.037s
W20260709 13:03:06.319743  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 783143us
I20260709 13:03:06.302613 13735 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.325140 13933 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:06.329802 13933 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.331698 13933 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.334771 14245 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.283345 14037 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.338744 14037 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:06.338994  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.346176 14292 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:06.346530 14295 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:06.347204 14292 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.327587  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:06.349833  9098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.006s	sys 0.037s
I20260709 13:03:06.302342 13671 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:06.353436  9068 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.506s (SENT)
I20260709 13:03:06.354010  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1588) took 1506 ms. Trace:
W20260709 13:03:06.354738  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.009s	sys 0.005s
W20260709 13:03:06.355310  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.009s	sys 0.005s
I20260709 13:03:06.347215 14295 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:06.356163 14295 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:06.356523  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 710323us
I20260709 13:03:06.358354 13671 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.362208 13409 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:06.362799 14246 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:06.363554 14246 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.364742 13409 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:06.365545 14213 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.367797 13941 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.258006  8581 rpcz_store.cc:276] 0709 13:03:04.287848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.627031 (+339183us) service_pool.cc:224] Handling call
0709 13:03:04.627528 (+   497us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:05.194602 (+567074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.194628 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:05.211462 (+ 16834us) log.cc:844] Serialized 52 byte log entry
0709 13:03:05.624761 (+413299us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:05.994812 (+370051us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:06.101398 (+106586us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.102402 (+  1004us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.102662 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.102790 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.102972 (+   182us) raft_consensus.cc:1685] finished
0709 13:03:06.102989 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.103221 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":453102,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":1919,"raft.queue_time_us":140313,"raft.run_cpu_time_us":483,"raft.run_wall_time_us":484,"spinlock_wait_cycles":62606592,"thread_start_us":1151743,"threads_started":3,"wal-append.queue_time_us":654896}
I20260709 13:03:06.369444 13941 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.351699 14095 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:06.371192 14095 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:06.374310 13997 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.008s
I20260709 13:03:06.374456  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:06.375772  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:06.377238  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:06.318850  9096 rpcz_store.cc:276] 0709 13:03:03.758415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.918373 (+1159958us) service_pool.cc:224] Handling call
0709 13:03:04.918682 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.919030 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.919059 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.948561 (+ 29502us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.463132 (+514571us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:05.491732 (+ 28600us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.491953 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.492025 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.000353 (+508328us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:06.201157 (+200804us) raft_consensus.cc:1685] finished
0709 13:03:06.220455 (+ 19298us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.246353 (+ 25898us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5596,"prepare.queue_time_us":28298,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":51,"raft.queue_time_us":183898,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":16236,"spinlock_wait_cycles":22378368,"thread_start_us":357814,"threads_started":1,"wal-append.queue_time_us":523747}
W20260709 13:03:06.381086 13951 consensus_meta.cc:287] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.451s	user 0.015s	sys 0.015s
I20260709 13:03:06.354501  9098 rpcz_store.cc:276] 0709 13:03:04.847180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.999352 (+152172us) service_pool.cc:224] Handling call
0709 13:03:05.042041 (+ 42689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.042237 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:05.042491 (+   254us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.353419 (+1310928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.353517 (+    98us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:06.353620 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.353708 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.353952 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2035,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":143751,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":11336,"thread_start_us":1278684,"threads_started":2,"wal-append.queue_time_us":564601}
I20260709 13:03:06.280711 13884 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:06.368837 13671 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.285601 14038 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.259545  9097 rpcz_store.cc:276] 0709 13:03:02.311057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.481163 (+2170106us) service_pool.cc:224] Handling call
0709 13:03:04.612360 (+131197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.833840 (+221480us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:04.834235 (+   395us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.035510 (+201275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.035556 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:05.035602 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.992970 (+957368us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:06.131001 (+138031us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400594a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:06.131087 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.131316 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":580,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":3173,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":12421,"spinlock_wait_cycles":536130688,"thread_start_us":200957,"threads_started":1,"wal-append.queue_time_us":679742}
I20260709 13:03:06.256579  8508 rpcz_store.cc:276] 0709 13:03:04.528162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.528293 (+   131us) service_pool.cc:224] Handling call
0709 13:03:04.528638 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.648177 (+119539us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:04.927367 (+279190us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.533811 (+606444us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.536011 (+  2200us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.601501 (+ 65490us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:06.074917 (+473416us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.075425 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.075553 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.075630 (+    77us) raft_consensus.cc:1685] finished
0709 13:03:06.075649 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.075892 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":688012,"prepare.queue_time_us":736177,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":123,"raft.queue_time_us":250630,"raft.run_cpu_time_us":503,"raft.run_wall_time_us":35453,"thread_start_us":865612,"threads_started":3,"wal-append.queue_time_us":582643}
W20260709 13:03:06.354532  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67183.4us
I20260709 13:03:06.255784  8507 rpcz_store.cc:276] 0709 13:03:04.501757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.501866 (+   109us) service_pool.cc:224] Handling call
0709 13:03:04.609256 (+107390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.609542 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:04.963702 (+354160us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.317702 (+354000us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.446126 (+128424us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.969373 (+523247us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b18003708a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:03:05.996549 (+ 27176us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:06.071547 (+ 74998us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b18003708a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf 00007f1a19359038
0709 13:03:06.072154 (+   607us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.072731 (+   577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.072844 (+   113us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:06.073019 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.073187 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.073453 (+   266us) inbound_call.cc:177] Queueing success response
0709 13:03:06.155586 (+ 82133us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b18003708a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
Metrics: {"mutex_wait_us":245197,"prepare.queue_time_us":1751587,"prepare.run_cpu_time_us":178,"prepare.run_wall_time_us":183,"raft.queue_time_us":156021,"raft.run_cpu_time_us":763,"raft.run_wall_time_us":53356,"spinlock_wait_cycles":262714752,"thread_start_us":610960,"threads_started":2,"wal-append.queue_time_us":512436}
I20260709 13:03:06.256069  8503 rpcz_store.cc:276] 0709 13:03:04.891941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.163856 (+271915us) service_pool.cc:224] Handling call
0709 13:03:05.164206 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.209176 (+ 44970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.209205 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.209645 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.624128 (+414483us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:05.624187 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.624286 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.074196 (+449910us) raft_consensus.cc:1685] finished
0709 13:03:06.074235 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.074536 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53383,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":9366,"thread_start_us":414141,"threads_started":1,"wal-append.queue_time_us":592268}
W20260709 13:03:06.386498  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 62439.8us
I20260709 13:03:06.402277  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2764) took 1487 ms. Trace:
I20260709 13:03:06.413795  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:06.388044  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:06.400924  8428 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:06.418431  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:06.374864 13997 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.365793 14246 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:06.404739  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2382) took 1508 ms. Trace:
W20260709 13:03:06.454638  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 859781us
I20260709 13:03:06.418387  8501 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:06.409096  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2566) took 1468 ms. Trace:
I20260709 13:03:06.471721  8434 rpcz_store.cc:276] 0709 13:03:04.895953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.896109 (+   156us) service_pool.cc:224] Handling call
0709 13:03:04.896488 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.279445 (+1382957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.404215 (+124770us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54003a4154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:06.404515 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805836544}
I20260709 13:03:06.406559 14285 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:06.418601 14014 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:06.540175 14014 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:06.540943 14124 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.324s	user 0.009s	sys 0.007s
W20260709 13:03:06.542578 14010 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.652s	user 0.019s	sys 0.002s
I20260709 13:03:06.543080 14010 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.544456  8505 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:06.546691  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2761) took 1641 ms. Trace:
I20260709 13:03:06.547065  8505 rpcz_store.cc:276] 0709 13:03:04.905632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.197512 (+291880us) service_pool.cc:224] Handling call
0709 13:03:05.197786 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.544903 (+1347117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.546364 (+  1461us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001fcf54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:06.546614 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3096112896}
I20260709 13:03:06.549256  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:06.381681 13951 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:06.491313  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 77669us
I20260709 13:03:06.382402 14270 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:06.494400  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 136763us
W20260709 13:03:06.497077  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 78774.6us
I20260709 13:03:06.497746 14037 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:06.498584 13919 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:06.502386  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:06.505450  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:06.511772  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2564) took 1571 ms. Trace:
I20260709 13:03:06.514781 13918 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:06.519143 13989 consensus_meta.cc:287] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.043s	user 0.011s	sys 0.020s
I20260709 13:03:06.521242 14295 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:06.522324  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 218949us
I20260709 13:03:06.522974 14213 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:06.525352  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:06.527909 13987 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.716s	user 0.018s	sys 0.000s
I20260709 13:03:06.533668 14292 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:06.536970 14078 consensus_meta.cc:287] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.650s	user 0.000s	sys 0.014s
W20260709 13:03:06.538277 14278 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.567s	user 0.000s	sys 0.005s
I20260709 13:03:06.597133  8501 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:06.456732  8510 rpcz_store.cc:276] 0709 13:03:04.914881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.199496 (+284615us) service_pool.cc:224] Handling call
0709 13:03:05.199798 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.200024 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:05.226123 (+ 26099us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.401622 (+1175499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.401724 (+   102us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:06.401859 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.401977 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.402188 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49889,"prepare.queue_time_us":30325,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":50049,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":1075466,"threads_started":1,"wal-append.queue_time_us":1095368}
I20260709 13:03:06.550498  8502 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:06.579857  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.560264 13884 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:06.554519  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:06.574903  8506 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:03:06.600656  8506 pending_rounds.cc:85] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 8
I20260709 13:03:06.580133  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:06.598667  8505 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:06.546917 14046 consensus_meta.cc:287] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.027s	user 0.013s	sys 0.005s
I20260709 13:03:06.472141 14238 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.593678  8428 rpcz_store.cc:276] 0709 13:03:04.940128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.965640 (+ 25512us) service_pool.cc:224] Handling call
0709 13:03:04.965986 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.481712 (+1515726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.511368 (+ 29656us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540037fad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:06.511693 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3298925952}
I20260709 13:03:06.558352 14102 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:06.549926 14026 consensus_meta.cc:287] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.281s	user 0.007s	sys 0.011s
I20260709 13:03:06.600979  8506 pending_rounds.cc:107] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:03:06.575994 14010 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.609725  8506 raft_consensus.cc:2889] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:06.565454 14019 consensus_meta.cc:287] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.916s	user 0.009s	sys 0.004s
I20260709 13:03:06.551535 13997 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.475557  8432 rpcz_store.cc:276] 0709 13:03:04.940636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.191821 (+251185us) service_pool.cc:224] Handling call
0709 13:03:05.192183 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.193346 (+  1163us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:05.464936 (+271590us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.352195 (+887259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.408545 (+ 56350us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:06.408687 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.408832 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.409027 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":377506,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":9011,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":215,"thread_start_us":1070403,"threads_started":2,"wal-append.queue_time_us":488948}
I20260709 13:03:06.561491 14246 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.492554 14285 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:06.604542 13919 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:06.623567  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:06.611179 13797 consensus_meta.cc:287] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.048s	user 0.008s	sys 0.026s
I20260709 13:03:06.623145  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:06.637521  9102 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:06.640179 14270 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:06.640725 14270 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:06.622246  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:06.602839 13989 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.618392 14213 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:06.633447  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2567) took 1692 ms. Trace:
I20260709 13:03:06.600930 13987 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:06.685212  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 79851.2us
W20260709 13:03:06.686830 14298 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:03:06.601943 14078 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:06.687722  9068 leader_election.cc:336] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.632s (SENT)
I20260709 13:03:06.618057 14026 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.709314 14078 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.698127  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:06.711700  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:06.700212 14175 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:06.712703 14175 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:06.690641 13997 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:06.714419 13997 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:06.714823 13997 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:06.715058 14175 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:06.715574 13987 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.717402 14300 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:06.718133 14080 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:06.718920 14057 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.937s	user 0.010s	sys 0.007s
I20260709 13:03:06.719394 14057 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.721583 14057 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.716313 13993 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:06.681950 13797 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.722554 13993 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:06.722978 13993 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:06.724294 13797 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:06.726404 14174 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.008s
I20260709 13:03:06.726881 14174 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:06.728997 14174 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:06.710695  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:06.730330 13581 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.675s	user 0.013s	sys 0.006s
I20260709 13:03:06.730870 13581 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.731897 14010 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:06.733227 13581 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:06.705390 14276 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:06.700913 14123 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.766925  8507 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:06.766847 14213 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:06.703058  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 90540.8us
I20260709 13:03:06.707468 13989 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:06.709403 14026 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.682363 14246 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.770881 14246 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:06.716298  8509 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:06.734144  8502 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:06.735280 13919 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:06.736454  8503 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:06.737102 13941 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.776417 13941 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.779078 13941 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:06.738194  8508 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:06.781571  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:06.783433  9067 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:06.684237  8429 rpcz_store.cc:276] 0709 13:03:04.940925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.193562 (+252637us) service_pool.cc:224] Handling call
0709 13:03:05.193843 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.194363 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:06.322429 (+1128066us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.621034 (+298605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.627098 (+  6064us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:06.627195 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.628906 (+  1711us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.633363 (+  4457us) inbound_call.cc:177] Queueing success response
0709 13:03:06.644160 (+ 10797us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b48002f0358. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
Metrics: {"mutex_wait_us":34944,"prepare.queue_time_us":448701,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":18205,"raft.run_cpu_time_us":2257,"raft.run_wall_time_us":16293,"spinlock_wait_cycles":5735296,"thread_start_us":1261293,"threads_started":2}
I20260709 13:03:06.785476 13989 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:06.790262 14092 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:06.791356 14092 consensus_queue.cc:1243] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:03:06.792212  8582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.053s	sys 0.051s
W20260709 13:03:06.792573  8582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.053s	sys 0.051s
I20260709 13:03:06.793431  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2648) took 1087 ms. Trace:
I20260709 13:03:06.796277 14285 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.753383 13993 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:06.707398 14295 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:06.803624  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2365) took 2094 ms. Trace:
I20260709 13:03:06.804080  8506 rpcz_store.cc:276] 0709 13:03:04.709420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.816161 (+106741us) service_pool.cc:224] Handling call
0709 13:03:04.816493 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.621884 (+1805391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.803286 (+181402us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54001fed54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:06.803549 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4042051456}
I20260709 13:03:06.805423 14038 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:06.809394  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 127394us
I20260709 13:03:06.810241 13951 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:06.815073  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:06.816017  8510 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:06.816391 13993 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:06.814078 14276 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:06.821676  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 87666.9us
I20260709 13:03:06.818416  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:06.781308 14014 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:06.746881  8550 leader_election.cc:336] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.919s (SENT)
W20260709 13:03:06.755362  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.773500 14270 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.793761  8582 rpcz_store.cc:276] 0709 13:03:05.705903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.773350 (+ 67447us) service_pool.cc:224] Handling call
0709 13:03:05.773761 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.774043 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:06.255691 (+481648us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.792978 (+537287us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.793061 (+    83us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:06.793124 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.793229 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.793380 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221953,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":9989,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":989792,"threads_started":2,"wal-append.queue_time_us":478649}
I20260709 13:03:06.784180 14246 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:06.760254  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:06.828503  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1324) took 3536 ms. Trace:
I20260709 13:03:06.830381  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:06.831241  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.829851  9102 rpcz_store.cc:276] 0709 13:03:03.292262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.832519 (+1540257us) service_pool.cc:224] Handling call
0709 13:03:04.832885 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.638086 (+1805201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.814317 (+176231us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400544554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:06.828422 (+ 14105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4073107200}
I20260709 13:03:06.829128 14246 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:06.839834 14246 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:06.704293  8505 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
W20260709 13:03:06.845885  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 103566us
I20260709 13:03:06.847663  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2368) took 1318 ms. Trace:
I20260709 13:03:06.818248 14276 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.849823  8509 rpcz_store.cc:276] 0709 13:03:05.529276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.529414 (+   138us) service_pool.cc:224] Handling call
0709 13:03:05.529704 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.771632 (+1241928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.831218 (+ 59586us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540008d9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:06.847606 (+ 16388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2728038272}
I20260709 13:03:06.847424 14037 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:06.862320  9068 leader_election.cc:336] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.688s (SENT)
W20260709 13:03:06.870846  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 83460.7us
I20260709 13:03:06.853119 14123 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:06.878232  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.880834  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:06.882129  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 121969us
I20260709 13:03:06.856945 14037 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:06.854182 13951 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:03:06.892421  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:06.871210 14205 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:06.898521  8428 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:03:06.898355  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:06.898967  8428 pending_rounds.cc:85] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 10
I20260709 13:03:06.900283  8428 pending_rounds.cc:107] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:03:06.900542  8428 raft_consensus.cc:2889] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.884459 14038 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:06.904276  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 162160us
I20260709 13:03:06.903432  9067 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:06.878170 13581 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:03:06.908494  8432 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:06.915969  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:06.932050  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 77400.4us
I20260709 13:03:06.937304  8434 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:06.933522  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:06.907073 14038 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.948302 13845 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:06.943176  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:06.950130 14256 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:06.951103 14256 consensus_queue.cc:1243] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:06.951642 14256 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:06.951995 14256 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:06.954119 13919 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:06.955472 13919 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:06.955854 13919 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:06.917524 14205 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:06.960827  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:06.936486 13989 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.967288  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:06.965852  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:06.953192 14256 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:06.943194 14270 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:06.988950  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.989425  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:06.991591  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:06.991397  8433 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:06.994273  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:06.994916  8503 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:06.956894 13919 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:06.995469  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 104919us
I20260709 13:03:06.996377  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:06.999179 14285 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.994330  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:07.007088  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.012108 14095 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:07.012580 14095 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:07.012965 14095 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.014603  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.016340  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:07.018527  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:07.018831  8430 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.019450  8427 raft_consensus.cc:2410] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:03:07.019503  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.020345  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.021347  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:07.022047  8435 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:06.983393 14123 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:07.017800  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:06.986786 13989 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.986474 14080 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.033306  8432 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
W20260709 13:03:07.042582  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 109143us
I20260709 13:03:07.025247  8428 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:03:07.037900  8429 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:07.049551  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:07.052322 13581 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:03:07.064252  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 172152us
I20260709 13:03:07.066183  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.032099 14123 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:07.068655  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:07.069263  8428 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.072734  8505 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:03:07.074501  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:07.068104 13993 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:03:07.038450 13997 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.067152 14256 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.112325 14014 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.089568 14175 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:07.114220 14175 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.115399 13951 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:07.115820 13951 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:07.116665 14175 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:07.116907 13951 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.048743 14174 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:03:07.072746 14123 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.108547  8510 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:07.069367 13941 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 13:03:07.109161  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 56151.4us
I20260709 13:03:07.074362 13989 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:07.123950  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46721.6us
I20260709 13:03:07.127182  8505 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:07.098241 14205 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:07.107887 13997 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:07.136900  8503 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:07.070071 13581 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:07.137475  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 52277.7us
W20260709 13:03:07.150694  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48213.3us
I20260709 13:03:07.150548  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.162648  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:07.153394  8430 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:07.154824  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.117939 13797 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.176661  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.176772 13797 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.157979 14270 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:07.179751 14270 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:07.182261  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.158174 14014 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:03:07.183876 14014 consensus_queue.cc:1243] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:07.185676 13989 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:07.187345 13797 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:07.168073 13581 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:07.196923 14310 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:03:07.197178 14038 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.168963 14225 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:07.169242  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:07.169459  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.198045 14225 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:07.198549 14102 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:07.198674  8550 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:07.199076  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.199276 14260 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:07.199648  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:07.200176 14260 consensus_queue.cc:1243] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:07.200532  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:07.200685  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.171267 14078 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:07.201574  8506 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:07.169898  8427 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:03:07.202724 13993 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:07.175917  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.203275 13993 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:07.203586 14174 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:07.203886 13993 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:07.204453 14038 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:07.204949 14038 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:07.205516 14038 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.199174 14225 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.177366  8504 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.151772 14026 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.206460 14225 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.188408 14014 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.206902 14026 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.166937  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.207508 14014 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.208038  8507 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:07.208266  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.204108 14174 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.188774 13919 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.209134  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.209381  8582 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:07.209928  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.156248  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.209136 14174 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.211948  8501 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:07.210968  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.212761  8583 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:07.203125 14255 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:07.213459 14255 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:07.173063 14095 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.203797  8502 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:07.213104  8501 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:07.213725  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:07.221221  8428 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:07.210044  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.214483  8550 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:07.203199 14175 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:07.181824 14270 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:07.230629  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.233633  8581 raft_consensus.cc:2368] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13.
I20260709 13:03:07.233721  8506 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:07.234493 14095 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.234992  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.235250 14095 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.237452  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:07.238296  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.239001 14014 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:07.239820  8583 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:03:07.240175  8583 pending_rounds.cc:85] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 8
I20260709 13:03:07.240479  8583 pending_rounds.cc:107] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:03:07.240514 14295 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:07.240882  8583 raft_consensus.cc:2889] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.241168 14295 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:07.242187 13941 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:07.242527 14295 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.243681 14295 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.245311 14026 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.240195  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:07.246837  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.222s (SENT)
I20260709 13:03:07.247292  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:07.199070 14102 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:07.248723 14102 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.249919 14102 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.252211 14175 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:07.213902 14255 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.255303  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:07.254828  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.256390  8504 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
W20260709 13:03:07.261270  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.261391  9065 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:07.269599  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.270259  8582 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.276175  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.276506  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:07.278229  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.278793  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.289047 13797 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.292335 14038 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.253319 14175 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.293627  8584 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:07.260353 13941 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:03:07.294502  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 62674us
I20260709 13:03:07.295135 13941 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:07.297772  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 60418.4us
I20260709 13:03:07.298623 14128 consensus_queue.cc:1059] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:03:07.299770 14128 raft_consensus.cc:3055] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:07.300169 14128 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:07.300988 14128 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.298676  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:07.271085 13951 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.306270  8428 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:07.283111 14205 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:03:07.309728 14092 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:07.310113  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.283308 14080 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:07.302954 14078 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.311525 14078 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:07.307425  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 52212.5us
I20260709 13:03:07.228361 14246 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.313050  8550 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:07.322085  8504 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:07.323145  8427 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:07.324687 14080 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:07.327466  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:07.320386 14128 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:07.328739 14311 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.151s	user 0.002s	sys 0.002s
I20260709 13:03:07.316267 13937 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:07.330006 13937 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:07.330118 14078 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.330572 13937 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:07.334200 13671 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:07.334441  8547 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:07.335086 13671 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:07.335453 13671 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:07.335652  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:07.335870 14038 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:07.336567  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.336263 13671 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:07.336983  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.337360  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:07.285354 13884 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:07.318140 14014 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.338524  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.308148 13989 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:07.337469  8510 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:07.273077 13993 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.337527 13671 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:07.330572  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 99002.1us
I20260709 13:03:07.357374  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:07.351302  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.353137  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.319350 14276 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:07.354869  8428 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:07.355276  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.355791  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:07.356163  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.361109  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:07.357957  8502 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:07.340144 14260 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:07.370646  8429 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.336592 14038 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:07.374778  8507 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:07.363518 13989 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:07.376616  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:07.377315  8476 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:07.363266 14080 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.329872 14255 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.348418 13884 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.393013  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:07.376538 13989 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.394150  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.394346  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.394776 14014 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:07.372651 14260 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:07.421984  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.394788  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.396028 13918 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:07.396667 14038 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:07.397251 14313 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:03:07.398059 14026 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.400259  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.403605  8505 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:07.396692  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:07.364355 14019 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:07.396083 13993 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:07.422732  8577 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
W20260709 13:03:07.428573  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.434149  8576 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:07.448154  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:07.450479  8578 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:07.462841  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 125557us
I20260709 13:03:07.424786 14260 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.425246 13997 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:07.469394  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:07.471593 14318 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:03:07.472803 13797 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.468290 14175 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:03:07.475184  8577 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:03:07.465921 14080 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:07.480193 14285 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:07.481339 14285 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:07.481711 14285 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:07.482389  8583 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:07.482666 14285 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.484011 14285 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.486836 13884 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.494747 14174 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.497206 14174 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:07.498894  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.499303 14255 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:07.499598 13797 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:07.474550 14319 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:03:07.500176 13797 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:07.502256  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 105648us
I20260709 13:03:07.502550 14276 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:07.503142  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:07.503351 14276 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.505036  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:07.505739 13409 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.506469 14080 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:07.499593 13581 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:07.507464 13581 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:07.507808 13581 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.435405 13735 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:03:07.510818 13993 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:07.474958 14038 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.511260 13993 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:07.512825 13993 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.514035 13993 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.514235 13997 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:07.515286 13997 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.435212 14057 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 13:03:07.518116 14037 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.628s	user 0.006s	sys 0.005s
I20260709 13:03:07.518605 14057 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:07.518565 14037 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.505762 14276 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:07.519054 14057 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:07.520236 14057 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.521500 14057 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:07.523069  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 90300.3us
I20260709 13:03:07.523351 14175 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:07.523773 14175 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:07.524683 13797 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:07.524889 14175 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:07.526602  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 124207us
I20260709 13:03:07.531423  8581 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
W20260709 13:03:07.533316  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.531493  8429 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:07.534798  8582 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:07.535544  8578 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:07.534780  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:07.503504 14246 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:07.521827 14037 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.546999  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:07.551451  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 81415us
I20260709 13:03:07.562011 13937 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.563133  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:07.563751  8428 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.565001 13937 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:07.566129  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 61164.1us
I20260709 13:03:07.566922  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:07.568102  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:07.560323  8509 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:03:07.573078  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:07.546975 13735 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.576138 14213 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.576233 13735 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.546789 14080 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:03:07.578784 14175 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.577847 14038 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.550120  8430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "435c81d2d1f346bea90c20030455900c"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "5ffc86752d264d0c81f68028e6413a91"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:03:07.574036 14326 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:07.582701  8430 raft_consensus.cc:606] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Received request to transfer leadership to TS 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:07.583113  8430 raft_consensus.cc:614] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:07.538552 14205 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:03:07.589285  8428 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:07.589876 14095 raft_consensus.cc:2764] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:03:07.590914 14255 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:07.592940 14255 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.595171  8433 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:07.598299  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:07.599439  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:07.604462 13581 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.607793 13581 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:07.610765 14123 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.612999  8501 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:07.622692  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49703.9us
I20260709 13:03:07.623697  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:07.640769  8475 leader_election.cc:336] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.577s (SENT)
I20260709 13:03:07.641502  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:07.593591 14255 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.657335  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:07.627378 13918 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:07.662294 13918 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.662671 13918 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.664750  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:07.667361  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:07.668087  8435 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:03:07.668965 14246 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:07.669600 14246 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.669988  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.670639  9100 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:07.671706  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.671763  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.672413  9102 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:07.672622  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:07.672958  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.673314  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.673446 14260 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.674163  9098 raft_consensus.cc:2410] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:03:07.674659  8476 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:07.675125  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.675531  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.675657 14260 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:07.675777  9099 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:07.676337  9097 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:07.677119 13997 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.677315  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.678090 14270 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.678242  9094 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
W20260709 13:03:07.678933  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.678663 14270 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.679104 13951 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.679881 13845 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.679694 13951 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.680480 13845 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.660374 14078 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.681442 14078 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:07.682189  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 58582.8us
I20260709 13:03:07.683008 14327 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:07.684629 14327 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:07.653932 14326 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:07.685628 13581 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:07.682256 13941 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.686085 13581 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:07.686548 13581 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.677436  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.686614 14326 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.687801 14037 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:07.688326 14037 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:07.673993  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.689167 14037 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:07.689873  8504 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:07.687357  9101 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:07.686331 13941 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.690893  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.691218  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:07.672622  9100 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:07.672024 14246 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:07.702608  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 76828.4us
I20260709 13:03:07.683292  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:07.676064  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.708696  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:07.722084  8505 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:07.678092  8329 catalog_manager.cc:5697] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 7 to 12, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 12 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:07.726233  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 157032us
I20260709 13:03:07.724691  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.685642 14327 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:07.707934 13884 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:07.741644  8506 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:07.708128 13409 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:03:07.758630 14337 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:07.759476 14337 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:07.760659 14337 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.730180 14327 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:03:07.768827  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 85598.3us
I20260709 13:03:07.746464 13951 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:07.777576  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.776336  9095 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:07.752700 13989 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:03:07.777076 14078 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:07.780697  8475 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.704s (SENT)
I20260709 13:03:07.767848 14260 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:07.787506  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:07.789021  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 71085.3us
W20260709 13:03:07.790277  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 68180.9us
I20260709 13:03:07.772540 13941 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.796546  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:07.765698 14080 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:03:07.808678  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.809883  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:07.811765  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:07.781715 13845 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.813763  8506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:03:07.815388  8506 raft_consensus.cc:606] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:07.815766  8506 raft_consensus.cc:614] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:07.815793  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.820604 14270 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:07.821818  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.790856 14260 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.821959  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.828590  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.837568  8583 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:07.821724  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.823522  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.822580  9095 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
W20260709 13:03:07.831413  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.822939  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:07.840271  9099 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.823251  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:07.824018  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:07.827643  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.827963  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.841995  8433 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:07.842895  8580 raft_consensus.cc:2410] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:03:07.833657  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:07.829330  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.843611  8577 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:03:07.844646  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.844779 13918 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.828265  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.846374  8576 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:07.846863 13918 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.847222  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.847838  8576 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:07.847931 14330 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:03:07.848536 13671 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:07.848639 14255 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:07.849066 13671 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:07.850046  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 72273.2us
I20260709 13:03:07.850346  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:07.850868  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:07.850948  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.851519  8578 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.852483  8475 leader_election.cc:400] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13.
I20260709 13:03:07.852777  8475 leader_election.cc:403] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:03:07.826435  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.853840 14037 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.853942  8579 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.854719 14327 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:07.855690  9098 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:07.855832 14327 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:07.856016  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:07.856629  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:07.829867 14080 consensus_queue.cc:1243] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:07.857254  9098 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:07.858309  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.859200  8509 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:03:07.838647  9100 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:07.860731  8427 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:07.861089  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:07.861325  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:07.861665  9094 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.861919  9100 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.862041 13845 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13.
I20260709 13:03:07.862751 13845 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:07.845724  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:07.851001  9102 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.873906  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:07.875936  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:07.842316  8575 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:07.865284  8435 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:03:07.884701  8431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:03:07.885435  8431 raft_consensus.cc:606] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:07.885859  8431 raft_consensus.cc:614] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:07.886591 14333 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:03:07.881798 14010 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:07.889748  8578 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:07.890326  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:07.885753 14334 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:03:07.864763 14260 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:07.906752  9068 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.722s (SENT)
I20260709 13:03:07.905659  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:03:07.909785  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.877702 14213 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:07.919831  9098 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:07.913424  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:07.921885 13919 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:07.922343 13919 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.922686 13919 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.925005  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.890918 14123 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:07.926367  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.881640 14057 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:03:07.933645  8576 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:07.934491  8502 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:07.935078  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.935685  8508 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:03:07.936728  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:07.937704  8504 raft_consensus.cc:2368] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:03:07.939340  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.940346  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:07.932425  9093 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:03:07.941995  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:07.950513  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:07.951365  9093 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.940498  9095 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:07.956336  9095 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:07.958050  9095 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:07.958958  8509 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:03:07.965830  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.966127  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.966571  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.966897  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.980046  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:07.991271  9102 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 13:03:07.995504  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 88788.5us
I20260709 13:03:08.022763  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:08.023667  9098 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:07.918826 14213 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:08.030905  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 51003.1us
W20260709 13:03:08.085554  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 88000.2us
I20260709 13:03:08.117129  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:07.960868 14270 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
W20260709 13:03:08.090685 14332 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.088s	user 0.006s	sys 0.000s
I20260709 13:03:07.938578 13993 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.118s
W20260709 13:03:08.094748 14345 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:03:08.097446  9093 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:08.099048  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:08.099341  9068 leader_election.cc:336] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.865s (SENT)
I20260709 13:03:08.100813  9102 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:07.931162 14095 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:03:08.110066  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 307526us
I20260709 13:03:08.121668  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.130074  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:08.133188  8509 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:08.135987  9068 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.136078  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.140133  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:08.142970  9096 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:03:08.147351  9095 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:08.148736  8435 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:08.149096  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:08.184497 14246 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:08.185055 14246 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.185503 14246 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.186770  9067 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:08.132510 14010 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:08.188956  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 51202us
I20260709 13:03:08.189726  8547 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.196957  9094 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:08.139102 13884 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:08.200050  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.204505  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:08.206439  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.206763  9102 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:08.137056 14095 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:08.213908  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:08.200430  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 54554.6us
I20260709 13:03:08.207988  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:08.215520  9094 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.146198 14326 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:08.130040 13997 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:03:08.218478  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.215636  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:08.234964  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 45326us
I20260709 13:03:08.238842  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.236754  9095 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:08.241045  9095 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:08.242910  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55375.9us
I20260709 13:03:08.150282 13918 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:08.199366 14057 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:08.249056  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.297467  9098 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:08.298070  9102 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:08.298884  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 83329.6us
I20260709 13:03:08.199503 13845 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:03:08.301977  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 115275us
I20260709 13:03:08.255005 14095 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.304451 14095 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:08.257956  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 158666us
I20260709 13:03:08.265069 13797 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:08.307732 13797 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.308163 13797 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:08.309523  9068 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.000s (SENT)
I20260709 13:03:08.267562 14026 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:08.247370 14337 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:08.310231 14026 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:08.310362  8579 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:03:08.309981  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.311344 14026 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.311966 13989 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.271148 14270 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:08.271788  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:08.274716  8329 catalog_manager.cc:5697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.313951 14270 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:08.314492 14270 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:08.315429  8432 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:08.315585 14270 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.317334 14270 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:08.276729 14175 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.697s	user 0.011s	sys 0.000s
I20260709 13:03:08.277814 13735 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:08.279001 14328 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:08.304437 14255 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:03:08.324896  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.281404 14260 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.283272 13671 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.325693  9102 raft_consensus.cc:2368] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15.
I20260709 13:03:08.326186 13671 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:08.326431 14026 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:08.329023  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:08.242633 14326 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.330431 13989 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:08.330960 13989 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:08.331382 14326 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:08.332345  8427 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:08.332592 14350 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:08.333033 14350 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.333372 14350 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.332056 13989 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.302670 13993 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:03:08.285039 13581 consensus_meta.cc:287] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.002s
W20260709 13:03:08.290184  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 51408.9us
I20260709 13:03:08.293088  8509 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:08.293395  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:08.293562 13941 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.293352  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:08.342283  8584 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:08.295958  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:08.250805 14344 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 13:03:08.302476  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 162421us
I20260709 13:03:08.270623 14037 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:08.312737  8431 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:08.325434  9098 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:08.340355  8547 leader_election.cc:400] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:03:08.296746 14341 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.347554  9094 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:08.348067  8547 leader_election.cc:403] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:08.345072  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:08.298182 13951 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.349408  8503 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:08.354458  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.360566  8582 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:08.361099  8581 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:08.325505 14255 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:08.343555 13581 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.389076  8506 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:08.395533  8427 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:08.396354  8547 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:08.394188  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.236322 14213 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.343796 14057 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:08.401595  9099 consensus_meta.cc:287] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.001s
I20260709 13:03:08.412859  9099 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:08.339977 13918 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.388720 14260 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:08.414007  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.417126  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:08.417692  9096 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.414155 13735 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:03:08.421293  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.422137 13997 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:08.384676 14349 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:03:08.407290  9100 consensus_meta.cc:287] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 13:03:08.430574  9100 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:08.408833  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.409821  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:08.363164  8576 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:08.432322  9097 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:08.353399 14343 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:08.437682  8583 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:08.355670 13845 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:08.435436  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:08.437664  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.453979  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.343624 13941 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.398999 14255 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:08.464118 14359 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:08.468299 14359 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.468514 14255 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.469699 14255 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:08.470582 14359 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:08.470853  9099 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:08.471975  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.473058  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.473616  9099 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:08.454715  9100 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
W20260709 13:03:08.450953 14327 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.595s	user 0.000s	sys 0.011s
I20260709 13:03:08.464690  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.474277  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:08.451383  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:08.452275 14353 log.cc:927] Time spent T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:03:08.410867 14175 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.434041 14337 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:08.453874  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:08.437017  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 92027.7us
I20260709 13:03:08.466219 13845 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.464759 13581 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:08.467485 13941 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:08.465739  9102 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:08.387411 14350 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:08.485141  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 75371.8us
I20260709 13:03:08.485579  9102 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:08.414983 13918 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:08.473618 14213 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:08.452922  8329 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.490914  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.432746 14276 raft_consensus.cc:2764] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:03:08.481231  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.452049 14057 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.404484 14341 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:03:08.482296  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.483713  9096 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:08.482885 14175 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:08.487263  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 153304us
I20260709 13:03:08.502694  8579 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:08.482734 14337 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.474568 13997 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:08.492738  8580 raft_consensus.cc:2368] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14.
W20260709 13:03:08.464589  8327 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32800 (request call id 246) took 30198 ms (client timeout 15000 ms). Trace:
I20260709 13:03:08.493937  8428 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:08.352631 13884 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.529652  8510 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:08.494365  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.496289  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.496276  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:08.415601 13797 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.478842  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.500840  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:08.501894  9100 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:08.407434 13919 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.503573  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:08.502219  8329 catalog_manager.cc:5697] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 7 to 10, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 10 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.506567  9096 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:08.492380 14256 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.544632  9095 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:08.544354  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.545248  8434 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:03:08.550933  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:08.550639 13997 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.551529  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:08.493484 14359 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:08.556893  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.512087  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.521148  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.559175  8432 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:08.521909 14365 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:08.515017  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.522809 14341 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:08.524284  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:08.556910  8577 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:08.526646  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:08.527482  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.528373  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:08.528596  8509 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:08.542409 14342 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:08.551642  8575 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:08.539901  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 43705.6us
I20260709 13:03:08.553267  8431 raft_consensus.cc:2368] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16.
I20260709 13:03:08.508023  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:08.563668  8428 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:08.564015  8430 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:08.564129  8504 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:08.493873 13989 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
W20260709 13:03:08.555126  9068 leader_election.cc:336] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.870s (SENT)
I20260709 13:03:08.511247 14337 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:08.584179  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.562512  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:08.526729  8507 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:08.504895 14175 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.571534  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:08.572826 14368 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.573546 13919 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:08.565966 14341 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:08.574113  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.634228  9100 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:08.562531 13941 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:03:08.637032  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.637352  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:08.637684  8431 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:08.580724  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.555902 14246 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.638749  8329 catalog_manager.cc:5697] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 8, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 8 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:08.584007  8583 raft_consensus.cc:2410] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:03:08.578482  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.605274  8435 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:08.638003  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:08.641047  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:08.605401  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 97463.8us
I20260709 13:03:08.641721  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.642439  9099 raft_consensus.cc:2376] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20. Re-sending same reply.
I20260709 13:03:08.643334  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.606873  8505 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:08.608180  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.544410 13797 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:08.625440  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:08.621465  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.624203  9067 leader_election.cc:400] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14.
I20260709 13:03:08.621593  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:08.647203  9067 leader_election.cc:403] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:03:08.622887  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53447.4us
I20260709 13:03:08.621260  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.640379  9101 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:08.648123  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:08.648804  8579 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:08.649340  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 94250.4us
I20260709 13:03:08.649466  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.584509 14026 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.651114  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:08.625133  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:08.621249  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:08.634624  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:08.620122 14359 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:08.577347  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:08.579080  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:08.653723  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:08.653954  8429 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.654321  8580 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.654086  8426 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:08.583436  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.651173  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:08.656059  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.647289  9095 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:03:08.656049  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:08.620970 14327 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:08.652765  8584 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:03:08.623049  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.659945  8576 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:08.641758  8581 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:08.662128  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:08.665652  9093 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:08.665637  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.664876  9097 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:08.671411  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:08.672442  9099 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:08.636963 14102 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.665443 14038 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:08.650667 14326 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:08.632560 13918 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 13:03:08.682175  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 284952us
I20260709 13:03:08.682346  8575 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:08.682868  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:08.691738  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.694114  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 124757us
I20260709 13:03:08.677018  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.696892  8579 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:08.679741  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:08.684327  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:08.698060  8429 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:08.635700 14205 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:03:08.702674  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:08.705715  8582 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:08.701949  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:08.707834  8475 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.785s (SENT)
I20260709 13:03:08.716359  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.685683 14102 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.709721 14350 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:08.710266  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:08.701913 14038 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:08.653358 14256 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:03:08.777235 14359 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.779408  8576 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:08.718068  9096 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:03:08.780253 14364 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.780817 14364 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.725530 14341 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.783324 14364 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:08.784137 14038 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.786392  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.772971 14343 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:03:08.717759  8329 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 7 to 10, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 10 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.686532 13797 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:08.788009 13797 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:08.788192  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 121300us
I20260709 13:03:08.789008 13797 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.722810  8584 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:08.635286 14365 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.793871 14365 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:08.675834 14368 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14.
I20260709 13:03:08.654369 14360 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:03:08.770364  9102 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:03:08.771775  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44923.6us
I20260709 13:03:08.663389 14026 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.797788 14026 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:08.774451  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 66652.6us
I20260709 13:03:08.721377 14174 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:03:08.769021 14367 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:08.776285 14102 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:08.804235  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.804149  8329 catalog_manager.cc:5697] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 13, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 13 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:08.513440  8327 rpcz_store.cc:269] 0709 13:02:38.271566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.324059 (+ 52493us) service_pool.cc:224] Handling call
0709 13:03:08.464337 (+30140278us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:01.938500 (+     0us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a162350ac 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a1cd7416c
0709 13:03:02.062423 (+123923us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:02.063344 (+   921us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:02.063411 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:03:02.063459 (+    48us) tablet.cc:662] Decoding operations
0709 13:03:02.085365 (+ 21906us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:02.108096 (+ 22731us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:02.111179 (+  3083us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:03:02.188689 (+ 77510us) tablet.cc:701] Row locks acquired
0709 13:03:02.188762 (+    73us) write_op.cc:260] PREPARE: finished
0709 13:03:02.188954 (+   192us) write_op.cc:270] Start()
0709 13:03:02.189218 (+   264us) write_op.cc:276] Timestamp: P: 1783602182188883 usec, L: 0
0709 13:03:02.189263 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:03:02.190122 (+   859us) log.cc:844] Serialized 7878 byte log entry
0709 13:03:03.629737 (+1439615us) op_driver.cc:464] REPLICATION: finished
0709 13:03:04.242659 (+612922us) write_op.cc:301] APPLY: starting
0709 13:03:04.273433 (+ 30774us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:04.997519 (+724086us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:04.997575 (+    56us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:06.694209 (+1696634us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:06.694685 (+   476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:03:06.694745 (+    60us) write_op.cc:312] APPLY: finished
0709 13:03:06.695401 (+   656us) log.cc:844] Serialized 180 byte log entry
0709 13:03:06.837651 (+142250us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:06.886292 (+ 48641us) write_op.cc:454] Released schema lock
0709 13:03:06.894335 (+  8043us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:06.943851 (+ 49516us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:06.946951 (+  3100us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19680,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":565061,"apply.run_cpu_time_us":47301,"apply.run_wall_time_us":2703762,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87647,"num_ops":20,"prepare.queue_time_us":1086485,"prepare.run_cpu_time_us":32802,"prepare.run_wall_time_us":535655,"raft.queue_time_us":525801,"raft.run_cpu_time_us":40728,"raft.run_wall_time_us":395874,"replication_time_us":1390571,"spinlock_wait_cycles":10883456,"thread_start_us":2282151,"threads_started":5,"wal-append.queue_time_us":912448,"wal-append.run_cpu_time_us":40228,"wal-append.run_wall_time_us":2881706}]]}
I20260709 13:03:08.807621  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:08.798156  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.808451  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:08.809039  8428 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.799758  8578 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:08.808377  8426 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:08.801584  8579 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:08.802276  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 143965us
I20260709 13:03:08.802520  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:08.805788  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.810849  8503 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.794325 13989 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.811992  8430 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:08.811831  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.810616  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.772801 13919 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.816244  8579 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:08.816498  8431 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:03:08.848344  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 49554.6us
I20260709 13:03:08.849527  8434 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:08.851128  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:08.854403  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:08.813094  8329 catalog_manager.cc:5697] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:08.855110  8426 raft_consensus.cc:2376] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13. Re-sending same reply.
I20260709 13:03:08.856061  8329 catalog_manager.cc:5697] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:03:08.838014 14360 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.856483  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:08.859751  8430 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
W20260709 13:03:08.857514  8475 leader_election.cc:336] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.812s (SENT)
I20260709 13:03:08.861730  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.808346 14255 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:03:08.871622  8503 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:08.872591  8579 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:03:08.879029  8329 catalog_manager.cc:5697] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 13, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 13 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.871068 13919 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:08.883013  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:08.885505  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.855175 14371 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:08.837921 13989 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:08.887647  8329 catalog_manager.cc:5697] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 12, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 12 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.887511  8430 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:08.930612  8428 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
W20260709 13:03:08.932274  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.931560  9068 leader_election.cc:336] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.077s (SENT)
I20260709 13:03:08.871975 14246 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:08.932780  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.878434 13671 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:08.852300 14337 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:08.936326  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 285226us
I20260709 13:03:08.952111  9100 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:08.958662  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 297882us
I20260709 13:03:08.957763  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:08.959889 14270 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:08.962191 13797 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:08.962391 14367 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:08.963231 14367 consensus_queue.cc:1243] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:08.963764 14367 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:08.964148 14367 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:08.965942  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:08.970739  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:08.871309 14360 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.972971  8575 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:03:08.976102 14343 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:09.001624  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.006336  9095 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:09.010190  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.005558  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:09.012064  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:08.984252 14359 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:09.012665  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:08.985638 13581 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:08.984869 14342 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.970007 13671 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:08.985404 14102 raft_consensus.cc:2764] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:09.022418  9099 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:09.029290  8580 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:09.016010  9068 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.030387  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:09.002241 14343 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.032716  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:09.017553 13581 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:09.033896  9101 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:09.021657 14246 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.017391 14368 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.015378 14359 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:09.024773 14342 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.038976 14337 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.017992 14380 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:09.069204  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:09.040385 13989 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:09.009611 14367 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.042604 14175 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.071132 14342 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.072706  8581 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 12: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:09.044807  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:09.068284 14359 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.035861 14102 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:09.033427 14213 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.002s
I20260709 13:03:09.050081  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:09.050782  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 68761.8us
I20260709 13:03:09.077924  8428 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:09.052084  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 82680.5us
I20260709 13:03:09.052826  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:09.055840 14360 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:09.065552 14276 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:09.065678  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:09.084916  8580 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:03:09.081583  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:09.018466  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 53324.4us
W20260709 13:03:09.039369 14376 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:03:09.060400 14343 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.076908  9095 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:09.091900  8428 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:09.095065  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:09.080673  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:09.059900  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:03:09.234385  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.286577  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:09.286922  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:09.296599  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 210336us
I20260709 13:03:09.297931  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:09.299535  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 239735us
I20260709 13:03:09.300408  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.286880  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:09.305985  9100 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:09.301745  9068 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.321249  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:09.324594  9068 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.287470 14010 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:09.286661 14360 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:09.304981 14255 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:09.335824  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:09.344921 14387 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.287472 14213 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:09.346572 14213 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:09.339010  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 52195.1us
I20260709 13:03:09.349776  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:09.350394 14213 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:09.324323 14246 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:09.352928  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.321408 14342 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.089012 14326 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.246s
I20260709 13:03:09.323012 13989 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:09.320269 13997 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:09.364696  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:09.331763 14388 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.340224 14255 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.328428 14270 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.329300 13735 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:09.361306  8505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2397) took 1438 ms (client timeout 1523 ms). Trace:
W20260709 13:03:09.378109  8505 rpcz_store.cc:269] 0709 13:03:07.917242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.924744 (+  7502us) service_pool.cc:224] Handling call
0709 13:03:09.355176 (+1430432us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540033a754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:09.355367 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503990528}
W20260709 13:03:09.362314  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.304561 13941 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:03:09.334400 14010 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:09.083365 14102 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:09.366346  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:09.304231 14174 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:03:09.370656  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:09.411823  9101 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.362452 14175 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.385208  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:09.414937  8428 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.323593 13581 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.381023  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:09.361445 14387 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:03:09.363871 14342 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.376752 14255 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:09.370728 13671 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:09.365300 14392 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:09.373919 13989 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:09.433846  8428 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:03:09.377892 13997 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:09.440553  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 59596.5us
I20260709 13:03:09.443133  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:09.444085  9098 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:09.414731 13735 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:09.448920  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 82633us
I20260709 13:03:09.449759  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:09.454227  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:09.453977  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:09.457558  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:09.467980 13997 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:09.457118 13671 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:09.414412 14389 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:03:09.480971  8400 leader_election.cc:400] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15.
I20260709 13:03:09.481698  8400 leader_election.cc:403] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:09.451094 14387 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.494957  8580 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:09.470739 14095 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:09.470564 13884 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:09.472532 14392 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.482717 13941 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.496508 14095 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:09.510514  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 82541.3us
I20260709 13:03:09.513727  8580 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:09.515774  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 162903us
I20260709 13:03:09.474195 13409 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:03:09.518846  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:09.515347  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:09.448511 14010 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:09.513940  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:09.505676 14213 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15.
I20260709 13:03:09.508101 13884 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.532913  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:09.511317 14276 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.513348 14095 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:09.514572 14326 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.537672  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:09.539678  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 215135us
I20260709 13:03:09.540548  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.542596  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.495147 14387 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:09.531734 13884 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:09.547411  8503 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:09.550483  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:09.551180  8428 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:09.552786  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:09.553805  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:09.554133  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.554854  8505 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:09.536146 13997 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:09.559954  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:09.539355 14392 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:09.562487  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:09.508854 13989 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.542140 14393 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.548429 14380 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.565287  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.556002 14102 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:09.567108  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.556865 14389 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.539915 14326 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:09.563815 13997 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:09.581462  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.563673 13735 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.582522  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:09.583235 14407 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:09.583832 14406 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:09.584363 14400 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:09.584421 14337 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.585093 14384 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
W20260709 13:03:09.588845 14401 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:03:09.592231 14405 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:03:09.594141 14394 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:03:09.655145 14369 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.947s	user 0.006s	sys 0.000s
I20260709 13:03:09.660931 13581 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:09.666956 14389 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.666644 13997 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.667671 14389 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:09.668052 14389 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:09.668414 14389 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:09.632228 14392 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:09.670159 14392 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:09.670578 14392 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:09.613822 14342 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.602171  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1391) took 1034 ms. Trace:
W20260709 13:03:09.603124 14402 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:03:09.604194 14408 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:09.639386 14400 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:09.740010 14343 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.740900 14400 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.567327 14213 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.604482  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2659) took 1159 ms. Trace:
I20260709 13:03:09.742632  8576 rpcz_store.cc:276] 0709 13:03:08.445541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.680053 (+234512us) service_pool.cc:224] Handling call
0709 13:03:08.680323 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.779792 (+ 99469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.604153 (+824361us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b54000654d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:09.604398 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227052288}
W20260709 13:03:09.605927  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.607849  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2661) took 1132 ms. Trace:
I20260709 13:03:09.578727  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:09.610947  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:09.746570  9098 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:09.567058 14270 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:03:09.573630 14368 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:09.580741 14398 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:09.578419 14102 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.580577 14246 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:09.767196  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:09.627563 14403 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:03:09.640882 14337 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:09.642889 14406 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:09.650386 14078 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:09.573419 14413 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:09.676258  9096 rpcz_store.cc:276] 0709 13:03:08.568075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.568423 (+   348us) service_pool.cc:224] Handling call
0709 13:03:09.601910 (+1033487us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b54004d44d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:09.602098 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149802240}
W20260709 13:03:09.671698  9067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 2.142s (SENT) [suppressed 40 similar messages]
W20260709 13:03:09.697005  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.776119 14407 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:03:09.725370  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 162971us
W20260709 13:03:09.733222 14414 log.cc:927] Time spent T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:03:09.817248  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.626587 14326 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:09.736438 14387 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:09.749459 14351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.004s	sys 0.017s
I20260709 13:03:09.750682 14057 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:09.751792 13735 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.745275  8583 rpcz_store.cc:276] 0709 13:03:08.475314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.488013 (+ 12699us) service_pool.cc:224] Handling call
0709 13:03:09.607608 (+1119595us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b540018c254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:09.607781 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95472896}
W20260709 13:03:09.756963  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 174553us
I20260709 13:03:09.828974  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:09.644088 14411 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.766378  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:09.767982  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:09.768816  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:09.642899  9101 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
W20260709 13:03:09.765799  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 187153us
I20260709 13:03:09.742187 14400 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.761328 14270 consensus_queue.cc:1243] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:09.794385 14420 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:09.777384 14359 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.703s	user 0.011s	sys 0.000s
I20260709 13:03:09.787215  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:09.797240 14393 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.769894 14102 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:09.862771  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2665) took 1371 ms. Trace:
I20260709 13:03:09.779465 14078 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:09.799533 14255 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.799942 13884 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.777688 14213 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.775889 14380 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.787196  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:09.803769  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2380) took 1170 ms. Trace:
I20260709 13:03:09.877843  8582 rpcz_store.cc:276] 0709 13:03:08.633438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.799574 (+166136us) service_pool.cc:224] Handling call
0709 13:03:08.812329 (+ 12755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.812679 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:09.012016 (+199337us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b1800349840. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf 00007f1a19359038
0709 13:03:09.323948 (+311932us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.452525 (+128577us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:09.453125 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.453284 (+   159us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:09.457574 (+  4290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.457679 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.626884 (+169205us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:09.803566 (+176682us) raft_consensus.cc:1685] finished
0709 13:03:09.803586 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.803706 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20912,"prepare.queue_time_us":593876,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":5570,"raft.queue_time_us":39066,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":25569,"spinlock_wait_cycles":12816000,"thread_start_us":369568,"threads_started":2,"wal-append.queue_time_us":131508}
I20260709 13:03:09.777374 14337 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:09.816924  8428 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:09.818662  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:09.859575 13937 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:09.803622 14026 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.831319  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 249927us
I20260709 13:03:09.903950  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:09.805820 14343 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.774751 14389 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.816383 14407 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:09.859376  8510 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:09.906517 14389 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.907411  8510 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:03:09.886889 14393 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:09.837448  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:09.908376 14393 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.825335 13941 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.859472  8508 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.834666 14057 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:09.883054 14078 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:09.883649 14425 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:03:09.884054 14380 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.860395 13409 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:03:09.819725 14095 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:09.827589  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:09.980906  8426 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.826591 14326 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.890044  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 218349us
I20260709 13:03:09.984803  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:09.891207  8503 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:09.987900 14380 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:09.988668 14380 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:09.989120 14380 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.989535 14380 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.990301 14393 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.992230 14057 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:09.992791 14413 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.993319 14413 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.995616 14413 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.996426 14102 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:09.862886 14420 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:09.999706 14095 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:09.999876 14420 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:09.968187 13941 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:09.887193 14213 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:10.000521 13941 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.001940 14213 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:09.900039 13884 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.901633 14255 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.903717 14026 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.906738 14407 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.003180 13941 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.004774 14026 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:09.863395  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:03:10.005187  8581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2382) took 1345 ms (client timeout 1513 ms). Trace:
W20260709 13:03:10.005775  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 142462us
W20260709 13:03:09.909718  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 72362.4us
I20260709 13:03:09.863270  8575 rpcz_store.cc:276] 0709 13:03:08.491676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.692109 (+200433us) service_pool.cc:224] Handling call
0709 13:03:08.692398 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.977668 (+285270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.862494 (+884826us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400282154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:09.862715 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644705536}
I20260709 13:03:09.951011  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:09.952668 14384 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.008567  8509 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
W20260709 13:03:09.955505 14397 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.487s	user 0.004s	sys 0.000s
I20260709 13:03:09.908409  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:10.015746  8575 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:09.863171 14359 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.910431 14406 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:09.860427 14411 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:09.889673 13937 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:10.178071  9094 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
W20260709 13:03:09.827023 14351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.004s	sys 0.017s
I20260709 13:03:09.966998  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:10.178507  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:09.963553 14388 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.003s
I20260709 13:03:09.975154  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:09.978983  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2664) took 1491 ms. Trace:
I20260709 13:03:09.979969  8579 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:10.010818  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:10.005584  8581 rpcz_store.cc:269] 0709 13:03:08.659602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.664451 (+  4849us) service_pool.cc:224] Handling call
0709 13:03:10.004998 (+1340547us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54001a3454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:10.005127 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859566976}
I20260709 13:03:10.014106  8508 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:03:10.014752  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:09.865443 13671 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.171440  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.173949  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 223019us
I20260709 13:03:10.186866  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:10.174685  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 166665us
I20260709 13:03:10.174973  8504 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:10.173393 14276 raft_consensus.cc:2764] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:03:10.177904  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 168860us
I20260709 13:03:10.178177  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.201236  8503 raft_consensus.cc:2410] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:10.181546  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:10.181563  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:10.201882  9099 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:10.183911  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.182359  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:10.184744  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 209674us
I20260709 13:03:10.188571  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:10.181201 13937 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.192040  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:10.192693 14361 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.192943 13671 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:10.194044 14365 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:10.196508  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.197224  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:10.184376  8584 rpcz_store.cc:276] 0709 13:03:08.487689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.686142 (+198453us) service_pool.cc:224] Handling call
0709 13:03:08.714362 (+ 28220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.792196 (+ 77834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.978616 (+1186420us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5400283a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:09.978898 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6462720}
I20260709 13:03:10.200191  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:10.203662  9101 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:10.226613  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 252815us
W20260709 13:03:10.261359  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 72894us
I20260709 13:03:10.260802  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:10.178962 14392 consensus_meta.cc:287] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.000s
I20260709 13:03:10.316877  8507 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:10.333484 13671 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:10.178339 13919 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:10.004768 14368 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:10.317425  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:10.214685  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0664127860000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:03:10.323694  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 123602us
I20260709 13:03:09.982173 14337 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:10.340161  8426 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
W20260709 13:03:10.341416  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 80698.4us
I20260709 13:03:10.347018  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:10.174708 14270 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:10.197831 14389 raft_consensus.cc:2764] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:03:10.351214  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:10.352572  8429 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:10.354499  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:10.360997  8426 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:10.317847  8582 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:10.352607  9065 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:10.177841 13797 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.161s
I20260709 13:03:10.015218 14326 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:10.355144  8577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 973) took 2525 ms (client timeout 2142 ms). Trace:
I20260709 13:03:10.350507  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:10.356920  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:10.258033 14384 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.352576  8549 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:10.198788 14388 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:10.358512  8433 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:10.366202  8507 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:10.324034 14393 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:10.316625 14365 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:10.375927  9101 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:10.349082 14361 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:10.181548 14213 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.173s
W20260709 13:03:10.376161  8577 rpcz_store.cc:269] 0709 13:03:07.824457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.845521 (+ 21064us) service_pool.cc:224] Handling call
0709 13:03:10.349806 (+2504285us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54001a2f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:10.349916 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412498816}
I20260709 13:03:10.351931 14255 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:10.381965  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.377472 13581 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:10.414633  8426 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:10.430315  9099 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:10.410519 14434 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:10.380631  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:10.431161  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78653.8us
I20260709 13:03:10.441035 14351 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:10.441462 14335 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:10.441648 14351 raft_consensus.cc:697] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:10.441946 14335 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:10.442711 14351 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.442917 14335 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:10.444087 14335 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:10.441026 14379 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.445392 14379 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:10.446383  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:10.447029  8426 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:10.447701 14379 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:10.451702 14026 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:10.452288 14026 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:10.453204 14026 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:10.457360  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 76792.4us
I20260709 13:03:10.458839  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:10.459321 14326 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.420840 14365 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:10.377712 14276 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
W20260709 13:03:10.462530  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.434393 14255 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.417793 14364 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:10.474136 13581 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:10.475683 13581 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.354835 14392 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.479857 14392 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.366369 14270 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.482976  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:10.415727 14384 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:10.465961 14379 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.486560 14379 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.487562 14384 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:10.488703 14379 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.464035 14355 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:10.490212 14355 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:10.491432 14355 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:10.463635 13919 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:03:10.494342 14411 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:10.467375 14388 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:10.473142 14255 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:10.463778 14400 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
W20260709 13:03:10.509407  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 130197us
I20260709 13:03:10.471763 14434 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:03:10.521092 14407 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.521677 14371 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.509049 13937 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.522253 14371 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.523976 13937 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.524153  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:10.526786  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:10.527614  8430 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:10.528436  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:10.528659 14367 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:10.530095  8431 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:10.532545  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:10.548822  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:10.533394  8435 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:10.535491  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:10.536484  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.561314  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.563151  8510 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 13:03:10.563584  8510 pending_rounds.cc:85] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 13
I20260709 13:03:10.563809  8510 pending_rounds.cc:107] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 13:03:10.564056  8510 raft_consensus.cc:2889] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:10.564983  8504 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.557551 14326 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.567811 14326 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.570269  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.570891  8507 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:10.571082 14326 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.571744 14337 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:10.574155  9095 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:10.576121  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:10.555512  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:10.574810  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:10.567168 13919 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:10.581171  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:10.584635  9099 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.557452 14327 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.524181 14371 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:10.584894  8400 connection.cc:256] RPC call timeout handler was delayed by -1.2170609640000976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 13:03:10.623556  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:10.624557  9093 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:10.586900  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:10.579473  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:10.572052 14380 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.001s
I20260709 13:03:10.538653 14270 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:10.567168 14038 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:10.629650  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46855.7us
I20260709 13:03:10.642902  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:10.587020 14174 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:10.647716  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:10.521670 14407 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.582991 14361 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:10.655836  8504 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:10.639693  9099 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
W20260709 13:03:10.630509  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 51148.9us
I20260709 13:03:10.583952 14400 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:10.584296 13919 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.648906 14424 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:10.586527 14393 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:10.629277 14437 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.581713 14276 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:03:10.586386 14411 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:03:10.572194 14441 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.124s
I20260709 13:03:10.651440 13884 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:10.721879  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.652591 14213 consensus_queue.cc:1243] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:10.664043 14379 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:10.666420 14400 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.665097 14361 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.630048 14327 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:10.651337 14350 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:03:10.648582 14380 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.678344 14384 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.678754 13919 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:10.747088  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 112528us
I20260709 13:03:10.748344 14384 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.726770 14424 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:10.735383  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:10.739181  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 275934us
I20260709 13:03:10.751120  8431 raft_consensus.cc:2368] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12.
I20260709 13:03:10.751680 14384 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:10.741921  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 423052us
I20260709 13:03:10.751955 14424 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:10.667863 14270 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:03:10.739356 13884 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.739992 14379 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.743117 14400 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:10.731370 14393 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.767352 14407 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:10.780696 13409 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.007s	sys 0.015s
I20260709 13:03:10.762596 14388 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:10.743659 14361 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:10.731755 14437 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.672156 14416 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:03:10.788396 14327 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:10.774231 13884 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:10.790696 14393 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.740051 14057 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:03:10.769492 14441 consensus_queue.cc:1243] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:03:10.780735  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 113506us
I20260709 13:03:10.781049 14379 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:10.795634 14388 consensus_queue.cc:1243] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:03:10.813467 14440 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:03:10.817091  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.793483 13409 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.008s	sys 0.016s
W20260709 13:03:10.823050 14447 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:03:10.823944 14448 log.cc:927] Time spent T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:10.827445 14442 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:03:10.828579 14364 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:10.829037 14364 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:10.830916  9102 raft_consensus.cc:2410] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:03:10.832796  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1622) took 1810 ms. Trace:
I20260709 13:03:10.833143  9102 rpcz_store.cc:276] 0709 13:03:09.022699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.022813 (+   114us) service_pool.cc:224] Handling call
0709 13:03:10.832557 (+1809744us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54006130d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:10.832713 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4074301312}
I20260709 13:03:10.833990 14255 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.838156  8549 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:10.839748  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:10.819897  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:10.810424 14380 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:10.844753  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:10.845415 14174 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:10.845876 14350 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:10.847079 14435 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.872s	user 0.004s	sys 0.005s
I20260709 13:03:10.847509 14102 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:10.848101 14102 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:10.848618 14444 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:10.848984 14102 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.849236 14444 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:10.850255 14389 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:10.850616 14350 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:10.851534 14444 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:10.851634 14350 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:10.854530  9094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1619) took 1849 ms (client timeout 1722 ms). Trace:
W20260709 13:03:10.854993  9094 rpcz_store.cc:269] 0709 13:03:09.005135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.005294 (+   159us) service_pool.cc:224] Handling call
0709 13:03:10.854352 (+1849058us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002f0654. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:10.854463 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2682235136}
I20260709 13:03:10.855329 14365 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.856016  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.856208  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.850703 14389 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.860410  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.862943  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.861860  8507 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:10.871381  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:10.874692  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:10.875412  9102 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:10.857957 14365 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.881633  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:10.864897 14389 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:10.884737  8431 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: [17.8-19.9]
I20260709 13:03:10.886847  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:10.888338  9093 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:10.890383  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:10.866681 14270 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:10.915654 14270 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.919559  8432 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:10.919965  8432 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:10.920718  8432 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.921775  8432 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:10.895140  9096 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:10.902745 14437 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.874431 13671 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:10.906736  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:10.962371  9100 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:10.960783  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 202469us
I20260709 13:03:10.911844 14379 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:10.968204 14379 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.970379  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:10.973027  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.974381  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.975214  8501 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:10.976362  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:10.928503 14341 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:10.931869  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.887593  9097 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:10.934827 14078 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.939121 14359 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:10.992331  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 217610us
W20260709 13:03:10.941188  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.942600  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:10.996016  9102 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 11.
I20260709 13:03:10.842911 14255 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:10.889326  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:10.997756  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:11.000587  9100 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:11.001650  8432 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:10.993854  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.008195  8576 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:10.982847  8398 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:10.989991  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:11.009557  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.010206  8577 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:11.011075  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:11.018652  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:11.020208  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.020466  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.020941  8580 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:10.992024 13671 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.021833 14388 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:11.027316 14388 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.027684 14388 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.018110 13409 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:03:11.031667  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:11.022573 14357 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:03:11.033012 14413 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.033546 14413 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.034160 14416 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.034659 14416 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.035656 14413 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.036906 14416 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.037077 14413 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.996981 13919 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.022804  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:11.039698 14450 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 13:03:11.017396 14379 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:11.040098 13919 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.040334 14379 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.040869  8432 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:11.042398 14379 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:11.044001  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:11.044574  8432 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:11.044770 14010 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.047214 14057 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:11.050473 14270 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:11.055230 14392 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:03:11.053314  8432 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:10.988345 14424 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.056922  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:11.057785 14424 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:11.058349  8504 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:11.037645 14413 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.058449 14424 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:11.026600  8510 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:11.058365  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.059088  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:11.023638  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 134412us
I20260709 13:03:11.058494  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.062878  8581 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:11.024269  8431 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:11.063717  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.065948  8577 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:11.068301  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.069482  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.070113  9102 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:11.070876  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:11.072023  9100 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:11.072919  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.073525  8580 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:11.070041  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.074347  8581 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:11.075246  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.076040  9096 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:11.078015  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:10.992942 14400 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.078805  9097 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:11.089828  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:11.091416  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.091981  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:11.092125  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.026823 13671 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.094385  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:11.059080 14424 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:11.023790 14380 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:11.095201  8580 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:11.099911  9096 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:11.095146  8426 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:11.097131  8583 raft_consensus.cc:2368] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12.
I20260709 13:03:11.070395 14442 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.101858  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:11.103660  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.104555  8577 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:11.041774 14364 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.109663 14424 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.111621  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:11.112188  9100 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:11.113780  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:11.114346  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.115082  9098 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:11.115803 14255 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.116233 14255 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.116562 14255 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.117172 14078 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:11.118088 14462 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:03:11.119161 14355 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:11.119710 14355 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:11.119170 14462 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:11.120615 14355 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.121308 13884 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.115859  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:11.122473  8575 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 17. Ops: []
I20260709 13:03:11.122607  9098 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.124402  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 988) took 2086 ms. Trace:
I20260709 13:03:11.125066 14400 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.095021 14412 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:11.126516 13884 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:11.126339 14412 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.120656 14462 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:11.124795  8579 rpcz_store.cc:276] 0709 13:03:09.037713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.286999 (+249286us) service_pool.cc:224] Handling call
0709 13:03:09.979501 (+692502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.184592 (+205091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.124195 (+939603us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b5400283a50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:11.124332 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501511936}
I20260709 13:03:11.133322  8580 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:03:11.136476  9100 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:11.137466  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:11.137534  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:11.139133  8426 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.140507  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:11.138347  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:11.142314  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:11.151638  9098 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:11.138789  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:11.156782  9100 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:11.162514  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.174697  9102 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:11.176278  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.176641  9096 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:03:11.177488  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.075177 14388 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.128510 14412 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.182672  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:11.188807  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.189968  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:11.190594  9098 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.182790  9096 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:03:11.125869 14400 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:11.182667 14379 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:11.202682  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.182289 13884 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:11.227378 13884 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:11.228412  9102 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:11.228353 13884 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:11.231271 14433 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:03:11.212641  9100 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:11.242681  8577 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:11.243855  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.244881  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:11.248139  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2416) took 1468 ms. Trace:
I20260709 13:03:11.218842  9097 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:11.248723  8505 rpcz_store.cc:276] 0709 13:03:09.779925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.821555 (+ 41630us) service_pool.cc:224] Handling call
0709 13:03:09.831658 (+ 10103us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:09.832228 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.832269 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:10.830880 (+998611us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b2c0005c2d8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:03:10.831276 (+   396us) log.cc:844] Serialized 26 byte log entry
0709 13:03:11.079740 (+248464us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:11.079779 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.079851 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.247751 (+167900us) raft_consensus.cc:1685] finished
0709 13:03:11.247784 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.248072 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145,"raft.queue_time_us":628,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":16214,"spinlock_wait_cycles":62925056,"thread_start_us":248085,"threads_started":1,"wal-append.queue_time_us":414859}
I20260709 13:03:11.224097 14379 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.254487 14379 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:11.257838  8432 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:11.208845 14443 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:03:11.259413 14388 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.108155 14442 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.260501 14357 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:11.260742 14413 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.218513 14380 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.262814 14361 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.263411 14380 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.264572  9093 raft_consensus.cc:2368] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 18.
I20260709 13:03:11.225762 14460 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:11.265326  8431 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: [17.8-19.9]
I20260709 13:03:11.265488 14460 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.265976 14389 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.268008 14389 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:11.268302 14460 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.268610 14389 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:11.220057 14412 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:11.274758  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:11.274936  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:11.275415  8505 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:11.275415  8431 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:11.220139  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:11.224020  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 85747.9us
I20260709 13:03:11.128052 14462 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.245864  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.264943 14361 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:11.277992  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:11.223132  9098 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:11.215090  8426 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:11.227111  9096 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:11.299311  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:11.285135  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:11.286315  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:11.281016  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:11.304528  8579 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:11.305449  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:11.306144  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:11.253667 14255 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.309940  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:11.312496  8506 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.316506  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:11.278050 14057 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.326436  9067 leader_election.cc:400] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12.
I20260709 13:03:11.330497  9067 leader_election.cc:403] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:03:11.328161  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.328889  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:11.336232 14026 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:11.337131  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:11.307600 14412 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:11.339644  8583 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:11.226191 14400 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.311153 14270 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:11.398656  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:11.399115  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67086.2us
I20260709 13:03:11.350808  8579 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:11.318933 14335 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:11.294492 13581 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:03:11.332266 14361 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.501266 14361 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.501791 14361 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.502692 14095 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:11.503137 14095 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:11.503984 14095 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.504977 14095 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:11.430830  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.339308 14057 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.507956 14270 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.508092 14384 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:11.508415 14270 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:11.492285 14465 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.268s	user 0.002s	sys 0.000s
I20260709 13:03:11.508464 14384 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:11.511008 14384 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.512024 14384 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.515627 14270 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.517652 14270 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:11.425904 14442 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.518236 14270 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:11.518968 14057 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:11.519140 14255 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.523245  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:11.524351  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:11.525487 14443 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:11.526180 14442 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:11.526564 14442 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:11.526937 14442 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.527268  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.528702  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:11.529354  8576 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:11.530074  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:11.503150  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:11.530774  8400 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:11.531911  8502 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:03:11.532017  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:11.533237  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:11.413661  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 107628us
I20260709 13:03:11.534418  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.534792  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.535879  8506 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
W20260709 13:03:11.536813  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 199650us
I20260709 13:03:11.539202  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.539856  9098 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 12: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:11.325537 14375 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.540868  9100 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:03:11.541353  9100 pending_rounds.cc:85] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 10
I20260709 13:03:11.541628  9100 pending_rounds.cc:107] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:03:11.541888  9100 raft_consensus.cc:2889] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:11.525871 14443 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:11.543823  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:11.347030 14359 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:11.557138  8432 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:11.550793  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:11.559547  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:11.542054 14460 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:11.400506 14412 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:11.347265 14413 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:11.561028  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.402845 14341 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:11.566990  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:11.568166  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.550132 14080 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.573693 14442 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.579115  8579 raft_consensus.cc:2410] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:03:11.541857 14437 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:11.401228 14434 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.554394 14443 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:11.566859 14441 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.578212 14412 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.559664 14455 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:11.579505 14460 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.542518 14335 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.593562  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.549412 14379 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.548362 14375 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.560806 14078 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:03:11.600816  8435 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:03:11.605962  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.590111 14413 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.608001  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:11.609349  8435 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:11.611312  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.612675  8434 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:11.600221 14460 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:11.610308 14413 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:11.619240  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:11.622232  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.622839  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:11.592284 14080 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.623589  8580 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:11.624423  8432 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:03:11.627939  8581 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:11.632462  8509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2410) took 1874 ms (client timeout 1685 ms). Trace:
W20260709 13:03:11.632957  8509 rpcz_store.cc:269] 0709 13:03:09.758508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.758667 (+   159us) service_pool.cc:224] Handling call
0709 13:03:11.632275 (+1873608us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400153e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:11.632392 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343093120}
I20260709 13:03:11.638314  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:11.642382 14400 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.644244 14379 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.644932 14380 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:11.595736 14441 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.648829  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:11.649495  8578 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:11.650130 14380 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:11.650771 14380 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.651517  8431 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:11.657287  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:11.676673  9099 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:03:11.611099  8435 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.682883  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:11.687705  8577 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:11.690342  8435 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:11.690557  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:11.709187  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.706468  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:11.711700  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:11.699332  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.710134  9099 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:11.689777 13671 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:11.695008 14255 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.600350 14434 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.727546 14393 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:11.713816 14490 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.736374 14442 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:11.736554 14490 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.738941 14490 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:11.739463 14490 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.740268  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:11.740923 14360 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:11.741415 14360 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:11.737805 14434 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:11.742265 14360 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.744139 14335 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:11.729532  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:11.692543 14078 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:11.708323 14455 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:11.745514 14455 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:11.745424 14078 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.746589 14455 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.708135 14388 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.730757  9099 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:11.708695 14095 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:11.732753  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.734081  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.749279 14388 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.725816 14351 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:03:11.695508 14392 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:11.761086  9100 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:11.765872  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.768240  9098 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:11.770351  8580 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:11.771623  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:11.772162 14459 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.946s	user 0.002s	sys 0.005s
I20260709 13:03:11.772754  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:11.773339  8580 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.773547  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2416) took 1360 ms. Trace:
I20260709 13:03:11.749931 14080 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:11.779960  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.773916  8429 rpcz_store.cc:276] 0709 13:03:10.412855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.413062 (+   207us) service_pool.cc:224] Handling call
0709 13:03:10.413393 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:10.584280 (+170887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:10.584311 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:10.627854 (+ 43543us) log.cc:844] Serialized 26 byte log entry
0709 13:03:10.781548 (+153694us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:10.781600 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.781685 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.771565 (+989880us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:11.773250 (+  1685us) raft_consensus.cc:1685] finished
0709 13:03:11.773269 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.773494 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56397,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":23216,"spinlock_wait_cycles":35198720,"thread_start_us":230161,"threads_started":2,"wal-append.queue_time_us":169004}
I20260709 13:03:11.722985 14341 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.786749  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:11.787667  8429 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:11.742318 14413 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.793306  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:11.793902  9099 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.790696  8435 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:03:11.792001  8434 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:11.792213  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:11.795676  8429 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:11.797413  8580 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:11.798825  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:11.810892  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.844466 14213 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:03:11.811682  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1157) took 1186 ms. Trace:
I20260709 13:03:11.791003  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.728046 13671 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:11.843133  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:11.844309  8578 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 20 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
W20260709 13:03:11.844753  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 486886us
I20260709 13:03:11.847926  8579 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:11.869748  9100 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: [11.11-13.12]
I20260709 13:03:11.754392 14255 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.879825  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:11.882146  8432 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:11.866281  8435 rpcz_store.cc:276] 0709 13:03:10.624025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.627920 (+  3895us) service_pool.cc:224] Handling call
0709 13:03:10.628209 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.600696 (+972487us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b5400258120. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b6dc0 00007f1a193411c0 00007f1a19342231 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c
0709 13:03:11.801285 (+200589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.810715 (+  9430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440076544}
I20260709 13:03:11.884195  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.885370  9095 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:11.885854  9100 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:11.881084  8429 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:03:11.901703  8576 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:11.785475 14351 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:03:11.910739  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:11.911197  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.911419  8429 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:11.785650 14350 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:03:11.781643 14095 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.903204  8580 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:11.929301  8580 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:11.904120  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:11.904940  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:11.907099  8427 raft_consensus.cc:2410] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:03:11.780506 14490 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:11.916044  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:11.792941 14341 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:11.946206  9099 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:11.959729  8580 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:11.966380  8580 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:11.902722 13671 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:11.976027  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 60058.6us
I20260709 13:03:11.972493  8435 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 19. Ops: []
I20260709 13:03:11.979537  8435 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:11.981349  9068 leader_election.cc:400] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 11 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12.
I20260709 13:03:12.000950 14351 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:12.002939  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.003425 14443 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:12.007581 14359 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 11. Current term is 12.
I20260709 13:03:12.010188 14255 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.011656 14490 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:11.907790 13884 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:03:11.982197 14380 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:12.015937 14388 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:12.016572 14479 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:03:12.017632  8578 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:12.010293  9102 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:12.021310  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:12.021924  9099 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:03:12.008644 14375 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:12.027602  8429 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:11.907949 14460 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:12.007607 14494 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:12.038988  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:12.042900  8581 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:12.044492  8581 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:03:12.046165  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.046962  8429 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:03:12.049800  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.049820  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67417.8us
I20260709 13:03:12.054363  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:11.971055 14361 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.054173 14443 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:12.062404 14361 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:12.064869  8433 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:12.049296 14384 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:03:12.052958 14494 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.068517 14494 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:12.071125  9097 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:12.001765 14351 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.056949 14375 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.057163 14095 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.058133  8583 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:12.055179 14078 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.039774  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:12.070811 14497 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:03:12.054972 13581 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:12.058135 14412 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.065936 14384 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:12.078115 14270 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:12.086207 14375 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.078630 14460 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:12.037530 14359 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:12.097163 14351 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:12.081600  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 369974us
I20260709 13:03:12.098448 14375 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.101222 14078 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:03:12.085915  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 46147.7us
I20260709 13:03:12.077520  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:12.090766  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 557547us
W20260709 13:03:12.091404  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 556656us
I20260709 13:03:12.106937  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:12.094120 14057 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:12.116750  8580 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: [11.11-13.12]
I20260709 13:03:12.113227  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:12.111856  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2673) took 1120 ms. Trace:
I20260709 13:03:12.119444  8575 rpcz_store.cc:276] 0709 13:03:10.991736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.991869 (+   133us) service_pool.cc:224] Handling call
0709 13:03:10.992191 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.122870 (+130679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.111572 (+988702us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54001176d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:12.111782 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299171072}
I20260709 13:03:12.085206 14355 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:12.113663  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 225652us
I20260709 13:03:12.087014 14464 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.091115 14095 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.095623 14384 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:12.129504  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:12.108816 14449 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:12.135325  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:12.114091 14026 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.114636 14375 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.125059 14359 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:12.142331  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:12.128713 14392 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:12.114421 14357 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:03:12.157411  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:12.158059  9093 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:12.141817  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:12.106626 13581 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.152609  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:12.131285 13993 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:12.137181 14460 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:12.167757  9096 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:03:12.125464 13671 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.137305 14458 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:12.130986 14270 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:03:12.121240 14057 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:12.168357  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.130764 14464 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:12.192346  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50641.5us
I20260709 13:03:12.131141 14355 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.151149 14026 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.176853  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:12.149123 14449 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:12.149762 14434 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.202584 14449 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.202906 14434 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:12.205134 14434 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:12.193059  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:12.206720 14488 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:12.137164 14500 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:03:12.207165 14488 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:12.207868 14057 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.200057 14511 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:12.208102 14488 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.209156 14511 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:12.209510 14488 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:12.193017 14388 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.210392 14388 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.212481 14388 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.199927  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:12.213191  8429 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:03:12.214046  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:12.201572 14412 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.214567  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:12.201741  8431 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:12.190233 14384 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.215170  8430 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:12.209755  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:12.215539 14384 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:12.216096 14078 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:12.216461 14078 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.216775 14078 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:12.217206 14413 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:12.202621 14026 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.212491 14355 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.208398 14500 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:12.221699 14500 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:12.165858 13993 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:12.210175 14511 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.177197 14335 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:12.155054 14375 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.198813  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:12.195669 14458 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:12.228799  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 120473us
I20260709 13:03:12.229596  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:12.233007  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.231297  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:12.237396  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:12.238399  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 131559us
I20260709 13:03:12.230120 14335 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:12.242436  8429 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:12.282724  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:12.283421  8435 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:12.283658  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:12.287233  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:12.222627 14500 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.259398 14375 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.260591 13671 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:12.263574 14507 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:03:12.265062 14512 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:12.264685 14078 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:12.267239 14509 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:12.271005  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2393) took 1031 ms. Trace:
I20260709 13:03:12.222806 13993 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:12.233222  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1642) took 1364 ms. Trace:
I20260709 13:03:12.318292  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:12.319130  8506 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:12.234243 14355 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:12.280562  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:12.320233  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:12.277503  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2672) took 1286 ms. Trace:
I20260709 13:03:12.279217  8433 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
W20260709 13:03:12.281980  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50763.8us
I20260709 13:03:12.287993  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:12.271154 14464 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.258632  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:12.299892  8509 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:12.278789 14388 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:12.280170 14455 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:12.315766  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:12.712025  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:12.318009  8576 rpcz_store.cc:276] 0709 13:03:11.240065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.695145 (+455080us) service_pool.cc:224] Handling call
0709 13:03:11.884409 (+189264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.908483 (+ 24074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.270810 (+362327us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000aa5d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:12.270947 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366836992}
I20260709 13:03:12.320870  8506 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
W20260709 13:03:12.240834  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.322549  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:12.675943 14490 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:12.416823 14458 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.726604  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2395) took 1486 ms. Trace:
I20260709 13:03:12.726933 14080 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:12.727020  8577 rpcz_store.cc:276] 0709 13:03:11.240624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.733599 (+492975us) service_pool.cc:224] Handling call
0709 13:03:11.733991 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.103875 (+369884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.103909 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:12.104389 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.282754 (+178365us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:12.282792 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.282854 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:12.726392 (+443538us) raft_consensus.cc:1685] finished
0709 13:03:12.726413 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.726549 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9850,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":547468,"threads_started":2,"wal-append.queue_time_us":603305}
I20260709 13:03:12.289597 14010 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:03:12.395853  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:12.281780 14412 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.114s
W20260709 13:03:12.686990  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.696224 13993 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:12.419488 14512 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:03:12.415448 14335 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:12.696798  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 376358us
I20260709 13:03:12.289626 13937 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:12.703212 14493 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.379s	user 0.006s	sys 0.003s
W20260709 13:03:12.414542 14515 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:03:12.318567  9094 rpcz_store.cc:276] 0709 13:03:10.868347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.868466 (+   119us) service_pool.cc:224] Handling call
0709 13:03:10.883380 (+ 14914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.883633 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:11.207829 (+324196us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.852592 (+644763us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.232818 (+380226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.232878 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:12.232952 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.233031 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.233161 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79549,"prepare.queue_time_us":605815,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":2050,"raft.queue_time_us":354585,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":10659,"thread_start_us":1314793,"threads_started":4,"wal-append.queue_time_us":282330}
I20260709 13:03:12.321573  8584 rpcz_store.cc:276] 0709 13:03:10.990912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.996868 (+  5956us) service_pool.cc:224] Handling call
0709 13:03:11.640066 (+643198us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:03:11.640295 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:11.640721 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.640760 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:11.641335 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:03:11.921393 (+280058us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:12.244572 (+323179us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.250140 (+  5568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.250217 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:12.250339 (+   122us) raft_consensus.cc:1685] finished
0709 13:03:12.276917 (+ 26578us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.277443 (+   526us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10702,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":5662,"spinlock_wait_cycles":82041088,"thread_start_us":550569,"threads_started":2,"wal-append.queue_time_us":443497}
W20260709 13:03:12.709903  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.714145  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.716773 14497 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:12.722997 14490 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.723881 14441 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:12.711159 14388 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:12.724414  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 401909us
I20260709 13:03:12.729871  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:12.730489  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:12.737525  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:12.714006 14057 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:12.737063 14351 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:12.765441  8475 leader_election.cc:400] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 18.
I20260709 13:03:12.815637  8507 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:03:12.741271 14511 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:12.753080  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.821820  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.822306  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.757936 14488 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:12.814819 14516 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:03:12.815649  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:12.815927  8509 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
W20260709 13:03:12.823257  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.827308  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 66698.9us
I20260709 13:03:12.821386  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:12.844709  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:12.845090  8507 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:12.845532  8509 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:12.850337  8510 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:12.850200  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:12.761011 13937 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:12.854384  9101 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:12.745920 14355 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:13.022809  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.021544  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:13.108523  9094 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:12.770303 14010 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.277s
W20260709 13:03:13.050782 14523 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
W20260709 13:03:13.051607 14526 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:03:12.815722 14464 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.203s
W20260709 13:03:13.052423 14522 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260709 13:03:13.055117 14078 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:12.829181 14351 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.059031  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2435) took 1774 ms. Trace:
I20260709 13:03:13.128628  8508 rpcz_store.cc:276] 0709 13:03:11.284426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.284556 (+   130us) service_pool.cc:224] Handling call
0709 13:03:11.310503 (+ 25947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:11.339440 (+ 28937us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:11.413190 (+ 73750us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.077402 (+664212us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x7b1800475780. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a1d21358f 00007f1a16252571 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd
0709 13:03:12.235137 (+157735us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.243262 (+  8125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:12.243703 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.243860 (+   157us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:12.243915 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.244008 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.058809 (+814801us) raft_consensus.cc:1685] finished
0709 13:03:13.058830 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.058971 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":308102,"prepare.queue_time_us":356090,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":5087,"raft.queue_time_us":308900,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":17914,"spinlock_wait_cycles":19760000,"thread_start_us":469029,"threads_started":2,"wal-append.queue_time_us":595010}
W20260709 13:03:13.130445  8475 connection.cc:256] RPC call timeout handler was delayed by -1.2957319439999537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 13:03:12.763161 14520 raft_consensus.cc:3055] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:12.815465 14519 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.310s
I20260709 13:03:13.093716  8507 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:12.846428 14488 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.846698 14511 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.764570 14497 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.100644  8506 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:13.101343 14462 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.857263 14388 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:12.849787 14441 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:13.159657  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 316771us
W20260709 13:03:13.161128  8475 connection.cc:256] RPC call timeout handler was delayed by -1.2876319439999406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:03:13.161448 14500 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.167593 14542 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:13.174943  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:13.173859  8504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.052s	sys 0.047s
W20260709 13:03:13.199072  8504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.052s	sys 0.047s
I20260709 13:03:13.199124  8508 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
W20260709 13:03:13.178347  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.131302 13845 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.140053 14520 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:13.181169 14026 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:03:13.182240 14534 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:03:13.172789 14080 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:03:13.183699 14488 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.212126 14026 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:13.216107 14488 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:13.216048  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.216749 14488 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.217065  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.217164 14488 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:13.217803  8584 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:13.184367 14490 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.132095 14355 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:13.184839  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1669) took 1047 ms. Trace:
W20260709 13:03:13.186460 14529 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 13:03:13.195727 14511 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.145911 14412 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:13.145932 14350 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:13.145740 14057 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:13.205936  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:13.206920  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.210290  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.207237  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:13.203262  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.209151  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:13.174410 14441 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.218451  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.217818  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:13.236589  8577 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:03:13.185953 14532 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:03:13.220297  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.217257  8583 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:13.184166 14351 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:13.224071  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:13.240517  8576 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:13.226517  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:13.229918  8475 connection.cc:256] RPC call timeout handler was delayed by -1.01223194399995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
I20260709 13:03:13.244787  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:13.231216  8581 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:13.231555  8580 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:13.247059  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:13.231912  8578 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:13.247805  9101 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:13.224056  9097 rpcz_store.cc:276] 0709 13:03:12.137945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.138783 (+   838us) service_pool.cc:224] Handling call
0709 13:03:12.156945 (+ 18162us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:12.188044 (+ 31099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.188088 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:12.188802 (+   714us) log.cc:844] Serialized 52 byte log entry
0709 13:03:12.288068 (+ 99266us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:12.288110 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.288170 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.184618 (+896448us) raft_consensus.cc:1685] finished
0709 13:03:13.184641 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.184783 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3955,"raft.queue_time_us":19333,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4550,"thread_start_us":98857,"threads_started":1,"wal-append.queue_time_us":540735}
W20260709 13:03:13.251047  8550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.007s	sys 0.007s
W20260709 13:03:13.251569  8550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.008s	sys 0.007s
W20260709 13:03:13.255163  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.254956  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:13.256218  9094 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:13.142706 13937 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:13.263748  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.230295 14490 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.265947  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.265890  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:13.228822 14542 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.237250 14350 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:13.296799 14350 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.298393 14350 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.241436 14441 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.239372 14511 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:13.302498 14511 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.305219 14511 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.240727 14464 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:13.201149 14500 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:13.270555 14424 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.011s	sys 0.034s
W20260709 13:03:13.306361 14424 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.011s	sys 0.034s
I20260709 13:03:13.306932 14424 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:13.307950 14500 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:13.216626 14026 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.309247 14026 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.214615 13845 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.316130 13845 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:13.316823 14464 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:13.319476 14464 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.321818 14542 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:13.322604 14464 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.323319 14464 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.326606 14464 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:13.319484  8580 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:13.292153  8576 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
W20260709 13:03:13.334532  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.295401  9101 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
W20260709 13:03:13.284165 14379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.005s	sys 0.003s
I20260709 13:03:13.238852 14412 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.343576  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1171) took 1118 ms. Trace:
I20260709 13:03:13.245854 14057 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:13.350654  8431 rpcz_store.cc:276] 0709 13:03:12.225643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.226601 (+   958us) service_pool.cc:224] Handling call
0709 13:03:12.232605 (+  6004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.235604 (+  2999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.235647 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:12.236152 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.746480 (+510328us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:13.235648 (+489168us) log.cc:844] Serialized 14 byte log entry
0709 13:03:13.235846 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.235918 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.343370 (+107452us) raft_consensus.cc:1685] finished
0709 13:03:13.343400 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.343521 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2314,"raft.queue_time_us":91137,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":3013376,"thread_start_us":891174,"threads_started":2,"wal-append.queue_time_us":600432}
W20260709 13:03:13.342438 14379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.006s	sys 0.003s
I20260709 13:03:13.352638  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:13.353430  8502 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:03:13.360873  9065 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:13.362666  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:13.364637  9065 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:13.343832 13919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.016s	sys 0.009s
I20260709 13:03:13.379930  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:13.380040  8508 raft_consensus.cc:2410] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:03:13.380574  8509 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:13.381588  8509 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:13.383226  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:13.276652 14490 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.359493 14500 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.420473  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.012s	sys 0.009s
W20260709 13:03:13.377384 13919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.016s	sys 0.009s
I20260709 13:03:13.421896  8509 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:13.429025 14364 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.431355 14490 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.326897 14441 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:13.422065  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.012s	sys 0.009s
W20260709 13:03:13.438223  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 588079us
I20260709 13:03:13.342490 14520 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.420663 14541 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:13.435688 14490 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:13.438174 14497 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.453979  8509 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:13.448568 14335 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:13.442476 14511 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:13.456331  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 113925us
I20260709 13:03:13.437136 14500 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.459385 14511 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.464612  8503 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:13.465145 14511 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.465364 14341 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:13.466199 14490 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.467008 14010 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.467525 14010 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:13.466714 14490 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.469118  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2652) took 1782 ms. Trace:
I20260709 13:03:13.469482  8432 rpcz_store.cc:276] 0709 13:03:11.687202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.963370 (+276168us) service_pool.cc:224] Handling call
0709 13:03:11.963714 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:12.021751 (+ 58037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.021779 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.021817 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:12.021845 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.468899 (+1447054us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b5400238f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:13.468945 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.469065 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133052800}
W20260709 13:03:13.466725  8503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2425) took 2611 ms (client timeout 1619 ms). Trace:
I20260709 13:03:13.470556 14335 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:13.470932 14549 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:13.470772  8503 rpcz_store.cc:269] 0709 13:03:10.855032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.855966 (+   934us) service_pool.cc:224] Handling call
0709 13:03:13.466535 (+2610569us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b54001fe854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:13.466638 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5997219584}
I20260709 13:03:13.471289 14521 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:13.471802 14521 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:13.472251  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:13.469798 14490 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:13.470345 14546 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:13.462105  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1194) took 1173 ms. Trace:
W20260709 13:03:13.446511  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 164638us
I20260709 13:03:13.474563  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:13.464244 14500 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:13.474463  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 229806us
I20260709 13:03:13.476660  8504 rpcz_store.cc:276] 0709 13:03:12.288396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.288551 (+   155us) service_pool.cc:224] Handling call
0709 13:03:12.288999 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.289462 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.289503 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:12.289991 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:03:13.199680 (+909689us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:13.199735 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.199826 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.461885 (+262059us) raft_consensus.cc:1685] finished
0709 13:03:13.461903 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.462048 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":787,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":12621,"thread_start_us":908876,"threads_started":1,"wal-append.queue_time_us":1064537}
I20260709 13:03:13.480839  8502 raft_consensus.cc:2410] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:03:13.456033 14520 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:13.482820  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:13.487747  8432 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:13.491595  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:13.492434  8428 raft_consensus.cc:2410] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:03:13.483482  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 118911us
I20260709 13:03:13.484251  8509 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:13.485412  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:13.486088  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:13.480976  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:13.457492 14544 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:13.499258 14544 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:13.501470 14544 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.502287  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:13.502549 14544 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:13.502936  8430 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:13.503024 14544 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:13.503898  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:13.505227 14544 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:13.505462 14505 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.291s	user 0.001s	sys 0.000s
I20260709 13:03:13.506174 14544 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.506685 14544 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.507121 14544 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.508163 14500 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:13.486655  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:13.497296  8433 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:13.472635 14335 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.472776 14549 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.472498 14552 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:13.475715 14497 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:13.502127 13581 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.521193  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:13.522886  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:13.448653 14541 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.527326  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:13.519047 14057 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.528970  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:13.521862  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.000s	sys 0.020s
I20260709 13:03:13.519925 14497 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:13.531193  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:13.534549  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.000s	sys 0.021s
I20260709 13:03:13.521009 14364 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:13.545306  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.547297  9098 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:13.550254  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:13.587486  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.587950  9102 raft_consensus.cc:2410] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:03:13.553114  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:13.589268  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.591738  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:13.528299 14360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.313s	user 0.007s	sys 0.013s
I20260709 13:03:13.617435  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:13.589270  9100 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:03:13.621711  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:13.472582 14521 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:13.626052  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 145128us
I20260709 13:03:13.622347  9100 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:13.587073  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:13.626962  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:13.625312  9102 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:13.627552  9094 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:13.627471  9098 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:13.525168 14555 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:13.525068 14449 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:13.628435  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.628728  8398 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:13.662040  8576 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:13.662675  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:13.629060  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.625018  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 89989.4us
I20260709 13:03:13.528646 14412 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:13.668978  8426 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:13.531841 14519 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:03:13.620963 14360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.007s	sys 0.013s
I20260709 13:03:13.660547  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:13.660806  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.589183 14497 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.536125 13919 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.482730 14546 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.662632  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:13.526535 14500 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:13.705698  9094 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:13.706045  8582 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 21: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:13.670871  8398 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:13.619079 14057 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.521910 14488 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.699185  8583 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
W20260709 13:03:13.679706  8547 connection.cc:256] RPC call timeout handler was delayed by -1.6667425750000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:03:13.733793  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 63001.3us
W20260709 13:03:13.685801  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.621088 14379 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.623378 14558 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.621611 13581 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:13.676549  9098 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:13.707626  8581 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:13.526319 14554 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 13:03:13.701040  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.520854 14552 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.677711 14335 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:13.726058 14559 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.740338  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:13.631167 14555 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:13.747677  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.669723 13671 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.796218 13671 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.682402 14364 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 13:03:13.677779 14557 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:13.708580 14521 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.771158  8581 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:13.739610 14350 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:13.747797 14441 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.807987  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:13.814069  8429 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:13.727849 14412 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:03:13.745631 14563 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.845530  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:13.749523 14351 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:13.806787  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.811223  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.852030  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:13.660291 14458 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.127s
I20260709 13:03:13.763178 14335 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.732949 14500 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.815090  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.858148  8582 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
W20260709 13:03:13.815811 14547 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:03:13.816069 13937 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.867240  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 126839us
I20260709 13:03:13.869234  8547 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:13.822233 14536 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 13:03:13.824366 14546 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.825681 14541 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:13.806342 14557 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.801654 14555 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:13.833724  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.833992  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.835371 14552 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:13.836571  8427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2649) took 2227 ms (client timeout 2224 ms). Trace:
W20260709 13:03:13.837244 14535 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.670s	user 0.002s	sys 0.006s
I20260709 13:03:13.801232 14559 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.743407 14057 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:13.750036 14379 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.815589 14424 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:13.803841 14464 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:13.837859 14538 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.410s	user 0.002s	sys 0.004s
I20260709 13:03:13.840782  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:13.846596  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 179754us
I20260709 13:03:13.848120  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:13.851325  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:13.850909 14554 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:03:13.731645 14560 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
W20260709 13:03:13.816416 14550 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 13:03:13.756742 13581 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:13.902784  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.988662 14379 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:13.969381 14424 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:13.980978 14464 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.887451  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:13.940054  8427 rpcz_store.cc:269] 0709 13:03:11.609488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.609646 (+   158us) service_pool.cc:224] Handling call
0709 13:03:13.836330 (+2226684us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540037fad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:13.836478 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615694720}
I20260709 13:03:13.863792 14335 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:13.756394 14558 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:13.977322  9098 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:14.001278  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:13.936647 14557 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:14.002159  9098 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:14.003410  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:14.004846  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:13.749356 14519 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:03:13.842365 14350 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:13.981040  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2834) took 1302 ms. Trace:
I20260709 13:03:14.008132  8506 rpcz_store.cc:276] 0709 13:03:12.679021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.149240 (+470219us) service_pool.cc:224] Handling call
0709 13:03:13.149592 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.378822 (+229230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.378868 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:13.378935 (+    67us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:13.378979 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.980739 (+601760us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54003e58d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:13.980789 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.980944 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526561024}
W20260709 13:03:13.677690 14026 consensus_queue.cc:1175] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ffc86752d264d0c81f68028e6413a91" responder_term: 12 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:03:13.955579  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 52412.4us
I20260709 13:03:13.857884 14351 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:13.991945  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 256874us
I20260709 13:03:13.990559  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:14.006721  8505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1198) took 1692 ms (client timeout 2156 ms). Trace:
W20260709 13:03:14.020633  8505 rpcz_store.cc:269] 0709 13:03:12.314002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.840442 (+1526440us) service_pool.cc:224] Handling call
0709 13:03:14.006639 (+166197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:13.961813 14102 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:13.963748 14434 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:14.013254  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:14.032809  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:13.991112  9094 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:13.940851 13937 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:14.012356  8550 leader_election.cc:336] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.619s (SENT)
W20260709 13:03:14.014837  9065 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.010s	sys 0.019s
W20260709 13:03:14.039423  9065 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.010s	sys 0.019s
W20260709 13:03:14.039783  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 525588us
I20260709 13:03:14.040321  8577 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:13.990593 14464 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:14.022964  8400 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:14.005632  9098 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:03:13.989612 13581 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:13.990990 14541 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.854166 14563 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.007982 14570 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.012352 14554 consensus_queue.cc:1243] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:14.062690  8584 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:14.178208  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:14.035742 14549 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.180791 13581 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:14.322458  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 144326us
I20260709 13:03:14.323586  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:14.047770 14412 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:14.164045  9095 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:14.178957 14562 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:14.181263  9094 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:03:14.182385 14102 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.185762 14375 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:03:14.186546 14567 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:03:14.187613 14573 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:03:14.181296  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 99684.5us
W20260709 13:03:14.176098  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 143368us
I20260709 13:03:14.196946 14552 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:14.180403 14441 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:14.043489 14434 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:14.113214 14455 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:14.149065 14488 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:14.175333  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:14.178584 14574 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
W20260709 13:03:14.179080  8501 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.007s
I20260709 13:03:14.378520  8501 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
W20260709 13:03:14.379256  8501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1197) took 2065 ms (client timeout 1616 ms). Trace:
I20260709 13:03:14.084131 14379 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:14.044396 14545 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:14.327782 14412 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:14.174667 14462 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:14.035573 14424 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.355326 14573 consensus_queue.cc:1243] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:14.369189  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:14.379740  8501 rpcz_store.cc:269] 0709 13:03:12.313653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.486362 (+1172709us) service_pool.cc:224] Handling call
0709 13:03:14.379169 (+892807us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:14.388917  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.084789 14544 consensus_meta.cc:287] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
W20260709 13:03:14.354229  8550 leader_election.cc:336] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.885s (SENT)
I20260709 13:03:14.431805  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:14.349691 14549 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:14.358180 14255 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:14.431102  9094 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:14.432940 14549 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.432951 14255 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.434046 14255 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.436125 14549 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.436712 14549 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.437181 14549 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:14.440192  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 116676us
I20260709 13:03:14.443553  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:14.445140  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:14.445833  8501 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:14.449326  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 95122.3us
W20260709 13:03:14.454794  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 101629us
W20260709 13:03:14.459638  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 439196us
I20260709 13:03:14.462064  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:14.460181  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 91109.2us
I20260709 13:03:14.467738  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:14.471086  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:14.358139 14102 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.383201 14441 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:14.290863 14541 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:14.499213  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.002s	sys 0.020s
I20260709 13:03:14.383793 14554 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 13:03:14.455709 14545 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:14.497151  8501 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:14.324935 14570 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:14.501513  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.003s	sys 0.020s
I20260709 13:03:14.353924 14562 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:14.477622 14555 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
W20260709 13:03:14.510931  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 982276us
I20260709 13:03:14.479915 14424 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:14.523270  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:14.512960  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:14.516136  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:14.480885 14379 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:14.441442 14462 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.494817 14585 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:14.549962 14585 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.552457 14585 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.552987 14585 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.557673 14455 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:14.535941 14595 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:14.537287 14434 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:14.537377 14570 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.537993 14589 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:14.538401 14539 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:14.538558 14583 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:14.540226 14102 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:14.540688 14568 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:03:14.532119 14375 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:03:14.541033 14490 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:14.541903 14572 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:03:14.542989 14549 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:14.543563 14441 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:14.546406 14541 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:14.533526  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1213) took 1002 ms. Trace:
I20260709 13:03:14.547576 13941 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:14.574292 13937 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.533094  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:14.641078 14577 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:03:14.506166 14057 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:14.562306  8582 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 13:03:14.662201  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 191143us
W20260709 13:03:14.561376  9068 connection.cc:256] RPC call timeout handler was delayed by -1.04799773000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
I20260709 13:03:14.498404 14350 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:14.563879  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.002s	sys 0.018s
I20260709 13:03:14.530115 14558 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:14.532583 14552 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:14.553553 14585 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:14.560534 14458 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:14.602087  8506 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.007s	sys 0.012s
I20260709 13:03:14.509202 14412 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:14.549111 14563 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.580052 14556 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.609350  8503 rpcz_store.cc:276] 0709 13:03:13.676910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.677291 (+   381us) service_pool.cc:224] Handling call
0709 13:03:13.677621 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.677879 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:14.062363 (+384484us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.533212 (+470849us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:14.533264 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:14.533309 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.533369 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.533474 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":676837,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":12423,"raft.queue_time_us":68559,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":744265,"threads_started":2}
I20260709 13:03:14.575453 14500 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:14.609246 14580 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:14.591687 14539 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.454725 14544 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.611320 13941 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:14.598628 14583 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.673522 14458 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:14.579113 14589 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:14.581730 14455 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:14.612120 13919 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.905s	user 0.012s	sys 0.000s
I20260709 13:03:14.695524 13919 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:14.662755  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1674) took 1114 ms. Trace:
I20260709 13:03:14.642329 14375 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.693337 14583 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:14.688879 14412 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.696511 14375 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:14.655156 14497 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.926s	user 0.011s	sys 0.002s
I20260709 13:03:14.698292 14497 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.698797 14375 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.699508  9097 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:14.699959 14590 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:14.700376 14497 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:14.700534 14590 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.702912 14590 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.703509  8502 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:14.703797 14585 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:14.704677 14594 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
I20260709 13:03:14.705242 14583 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.684270 14539 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:14.707840 14583 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.681214 14552 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:14.693094 14458 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.714247 14552 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.716471  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2702) took 1040 ms. Trace:
I20260709 13:03:14.716898  8577 rpcz_store.cc:276] 0709 13:03:13.676516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.676697 (+   181us) service_pool.cc:224] Handling call
0709 13:03:14.716282 (+1039585us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b540028c3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:14.716409 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667492096}
I20260709 13:03:14.718564  8577 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:14.696286  9101 rpcz_store.cc:276] 0709 13:03:13.548037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.548188 (+   151us) service_pool.cc:224] Handling call
0709 13:03:13.548520 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.619485 (+ 70965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.619510 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.667241 (+ 47731us) log.cc:844] Serialized 26 byte log entry
0709 13:03:13.866910 (+199669us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:13.866979 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.867060 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.662438 (+795378us) raft_consensus.cc:1685] finished
0709 13:03:14.662472 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.662674 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":182503,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":113675,"threads_started":1,"wal-append.queue_time_us":382781}
I20260709 13:03:14.720350  8577 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: [16.11-17.12]
I20260709 13:03:14.602777 14490 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:14.656493 14584 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:03:14.565914  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 108051us
W20260709 13:03:14.669231  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.002s	sys 0.018s
I20260709 13:03:14.722136  8501 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:14.670122  8506 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.008s	sys 0.012s
I20260709 13:03:14.674117  8576 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:14.675046  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:14.722514  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:14.722888  8579 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:14.675940  8582 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:14.675825  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:14.679595  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:14.687083 14464 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.002s
I20260709 13:03:14.677610 14357 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:14.679566 14521 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.865s	user 0.011s	sys 0.000s
W20260709 13:03:14.692651  8508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2846) took 1474 ms (client timeout 1569 ms). Trace:
I20260709 13:03:14.735648 14357 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:14.736096  8508 rpcz_store.cc:269] 0709 13:03:13.218269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.236911 (+ 18642us) service_pool.cc:224] Handling call
0709 13:03:14.692452 (+1455541us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54003c5854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:14.692593 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245709696}
I20260709 13:03:14.738387  8504 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:03:14.738770  8504 pending_rounds.cc:85] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 10
I20260709 13:03:14.694336 13941 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.738955 14255 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.739601 13941 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:14.741370 14255 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.738999  8504 pending_rounds.cc:107] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:03:14.742795  8504 raft_consensus.cc:2889] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:14.525719 14555 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:14.745194 14562 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.676884 14057 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:03:14.745622  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1210) took 1215 ms. Trace:
I20260709 13:03:14.619282 14545 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:14.739852 14388 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:14.725459  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1684) took 1170 ms. Trace:
W20260709 13:03:14.724713  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48977.2us
I20260709 13:03:14.727094  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1172) took 1267 ms. Trace:
I20260709 13:03:14.759269  9102 rpcz_store.cc:276] 0709 13:03:13.554870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.627802 (+ 72932us) service_pool.cc:224] Handling call
0709 13:03:13.628074 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.941820 (+313746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.941866 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.976948 (+ 35082us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.513993 (+537045us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:14.514049 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.514123 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.725236 (+211113us) raft_consensus.cc:1685] finished
0709 13:03:14.725260 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.725406 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":210167,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":737932,"threads_started":2,"wal-append.queue_time_us":586237}
I20260709 13:03:14.760811  8431 rpcz_store.cc:276] 0709 13:03:13.460087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.481407 (+ 21320us) service_pool.cc:224] Handling call
0709 13:03:13.490397 (+  8990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.750054 (+259657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.750102 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.765407 (+ 15305us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.108131 (+342724us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:14.108190 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.108302 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.726890 (+618588us) raft_consensus.cc:1685] finished
0709 13:03:14.726911 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.727038 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15179,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":542833,"threads_started":2,"wal-append.queue_time_us":571928}
W20260709 13:03:14.761904  8510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1200) took 2444 ms (client timeout 1816 ms). Trace:
W20260709 13:03:14.762153  8426 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 1163) took 3203 ms (client timeout 2172 ms). Trace:
I20260709 13:03:14.725684  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:14.762436  8510 rpcz_store.cc:269] 0709 13:03:12.323354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.711726 (+388372us) service_pool.cc:224] Handling call
0709 13:03:14.761714 (+2049988us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54000d8ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:14.761835 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316285184}
I20260709 13:03:14.763607  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:14.763944  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1678) took 1212 ms. Trace:
I20260709 13:03:14.764324  8510 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:14.764387  9093 rpcz_store.cc:276] 0709 13:03:13.551499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.551629 (+   130us) service_pool.cc:224] Handling call
0709 13:03:13.585577 (+ 33948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.805826 (+220249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.805858 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:13.805899 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:13.805941 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.763725 (+957784us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400209c54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:14.763774 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.763890 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506027904}
I20260709 13:03:14.765290  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:14.731719 14600 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.725103 14078 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:14.851894  8427 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
W20260709 13:03:14.852627  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 66365.5us
I20260709 13:03:14.732051 14389 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:14.732954 14548 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.571s	user 0.005s	sys 0.006s
W20260709 13:03:14.718586 14520 consensus_meta.cc:287] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.204s	user 0.012s	sys 0.000s
W20260709 13:03:14.718782 14593 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:03:14.748212  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.695750 14544 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.748808  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:14.749480  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:14.756654 14080 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.750356  8504 rpcz_store.cc:276] 0709 13:03:13.530605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.530852 (+   247us) service_pool.cc:224] Handling call
0709 13:03:13.531151 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.743225 (+1212074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.745392 (+  2167us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540008d9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:14.745564 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775536512}
I20260709 13:03:14.737861  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:14.753090  8582 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:14.687866 14462 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.720904  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1215) took 1033 ms. Trace:
W20260709 13:03:14.713351 14557 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.000s
W20260709 13:03:14.765841  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 303861us
I20260709 13:03:14.961290  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:14.962306  8427 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:14.964172  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:14.965073  8504 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
W20260709 13:03:14.771720  9068 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.172s (SENT) [suppressed 25 similar messages]
W20260709 13:03:14.968523  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 196838us
I20260709 13:03:14.969362  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:14.766377  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 307036us
I20260709 13:03:14.971889  8579 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:14.973821  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:14.974962  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:14.975131  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:14.975804  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:14.976820  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:14.977638  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:14.978739  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:14.979333  9094 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:14.762912  8503 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 10.
W20260709 13:03:14.762584  8426 rpcz_store.cc:269] 0709 13:03:11.559175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.559302 (+   127us) service_pool.cc:224] Handling call
0709 13:03:14.761967 (+3202665us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b5400200154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:14.762087 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4849609600}
I20260709 13:03:14.979789  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:14.980742  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:14.773491  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:14.853112  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:14.982074  8431 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:03:14.815318  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.982160  8510 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.724684 14490 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:14.856596  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:14.852270  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:14.745739 14555 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:14.861366  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:14.865840  8550 leader_election.cc:336] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.071s (SENT)
I20260709 13:03:14.732234 14602 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.748486 14357 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:14.749747  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:14.947072  8435 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:15.032100  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:14.851939 14488 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:15.062404 14488 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.064658 14488 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:15.066387 14582 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.537s	user 0.002s	sys 0.000s
W20260709 13:03:15.068281 14335 consensus_meta.cc:287] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 1.057s	user 0.011s	sys 0.000s
I20260709 13:03:15.068739 14335 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.686101 14580 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.070403  8430 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:15.071867 14580 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
W20260709 13:03:15.072449  8584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2412) took 1302 ms (client timeout 1544 ms). Trace:
W20260709 13:03:15.072834  8584 rpcz_store.cc:269] 0709 13:03:13.770255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.771772 (+  1517us) service_pool.cc:224] Handling call
0709 13:03:15.072297 (+1300525us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400349254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:15.072397 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484532608}
I20260709 13:03:15.073838  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:15.074255 14593 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:03:15.075193  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:14.756733 14541 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:14.759904 14562 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.084574 14562 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:15.086272  8428 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:15.087597 14562 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:15.088093  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.088362 14544 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.089111 14544 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.089579  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.090312  8428 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 11.
I20260709 13:03:15.091233  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.092098  8428 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:15.092876 14519 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:15.093429 14519 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:15.093673  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.095675  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:14.937351 14078 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:14.978533  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:14.721719 14589 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.860522  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1677) took 1309 ms. Trace:
W20260709 13:03:14.983260  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 126770us
I20260709 13:03:15.109372  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.108897  9099 rpcz_store.cc:276] 0709 13:03:13.551170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.551341 (+   171us) service_pool.cc:224] Handling call
0709 13:03:13.623147 (+ 71806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.747438 (+124291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.747484 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:13.747541 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:13.747585 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.860237 (+1112652us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54006685d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:14.860302 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.860457 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285275904}
I20260709 13:03:15.110797  8575 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:14.969365  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:14.981379  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:14.984550  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:15.028782  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 162963us
W20260709 13:03:15.112898  8550 leader_election.cc:336] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.092s (SENT)
I20260709 13:03:15.113385  8550 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:15.030879  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.033214  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:14.951617  8508 raft_consensus.cc:2376] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18. Re-sending same reply.
I20260709 13:03:15.034322  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:14.987680  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:14.986887  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:15.035054  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 173547us
I20260709 13:03:14.978255  9100 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:15.037966  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.117220  8435 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:15.033844 14520 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:03:15.117650  8550 leader_election.cc:336] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.151s (SENT)
I20260709 13:03:15.118172  8550 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:15.118209  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:15.038947 14552 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:15.039149  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:15.039376 14602 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.962111 14080 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.046387  8427 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:15.048081  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.124413  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.049331  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2833) took 2371 ms. Trace:
W20260709 13:03:15.125227  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 138464us
I20260709 13:03:15.125466  8507 rpcz_store.cc:276] 0709 13:03:12.678332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.141530 (+463198us) service_pool.cc:224] Handling call
0709 13:03:14.766229 (+1624699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.766470 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.766513 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:14.766574 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:14.766624 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.766701 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.049147 (+282446us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54000d8ed0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:15.049257 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3735430016}
I20260709 13:03:15.050427  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1679) took 1498 ms. Trace:
I20260709 13:03:15.050928 14601 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.188s
I20260709 13:03:15.055962 13671 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:14.747016 14464 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:15.058185 14379 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:14.988060  9093 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:15.137543  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.138365  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:14.958518  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.099406  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:15.139137  8509 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:15.142763  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:15.121541 14560 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:15.101450  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1214) took 1414 ms. Trace:
I20260709 13:03:14.955479  8505 rpcz_store.cc:276] 0709 13:03:13.687784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.021616 (+333832us) service_pool.cc:224] Handling call
0709 13:03:14.022098 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:14.030472 (+  8374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.030523 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:14.044135 (+ 13612us) log.cc:844] Serialized 26 byte log entry
0709 13:03:14.516200 (+472065us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:14.516244 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.516317 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:14.720698 (+204381us) raft_consensus.cc:1685] finished
0709 13:03:14.720718 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:14.720846 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7846,"raft.queue_time_us":114897,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":8868,"thread_start_us":168012,"threads_started":1,"wal-append.queue_time_us":507577}
I20260709 13:03:15.149555  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:15.150671  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:14.947005 14554 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.103576  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.151695  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:14.851951 14057 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.183s
W20260709 13:03:15.112064  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 142768us
I20260709 13:03:15.113039  8434 raft_consensus.cc:2410] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:03:15.158293  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:15.158125 14554 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.158882  8428 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.159829  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:15.160398  8434 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:15.161674  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:15.162472  8577 raft_consensus.cc:2368] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19.
I20260709 13:03:15.134931 14608 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:15.038288  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:15.114257  8503 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:14.936352 14583 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.166s
I20260709 13:03:15.035671  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.121024  8583 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.120374  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:15.138051 14379 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:15.173451  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.174084  8435 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:15.174870  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:15.175575  8435 raft_consensus.cc:2410] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:03:15.121058  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.176313  8584 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
W20260709 13:03:15.122905  8550 leader_election.cc:336] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.194s (SENT)
I20260709 13:03:15.176462  8434 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:15.176795  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:15.127559  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.177542  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.178171  8508 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:15.057667 14458 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:14.857546 14521 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.254s
I20260709 13:03:15.130693  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:14.862205 14600 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:15.118422  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:15.098737 14544 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.119944 14595 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.989923 14557 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:15.083966 14559 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:15.138607  8426 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
W20260709 13:03:15.133029 14511 consensus_meta.cc:287] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.667s	user 0.014s	sys 0.001s
I20260709 13:03:15.249085  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.120934 14552 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.249184  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.249675 14552 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:15.250223  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:15.250766  8504 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.251695 14458 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.254844 14590 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:15.255239 14590 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:15.256036 14590 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:15.257259 14590 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:15.259238 14602 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.262588  8583 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:15.131273 14360 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:15.137739 14601 consensus_queue.cc:1243] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:15.156629  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:15.264914 14335 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.166620  9095 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:15.167944  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:15.265625  8502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1209) took 1736 ms (client timeout 2165 ms). Trace:
I20260709 13:03:15.265960  8503 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:15.266816 14559 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:15.266942  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.267251 14559 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:15.267544  8503 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:15.267628 14559 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:15.268419  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.269037  8503 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
W20260709 13:03:15.099947  8476 connection.cc:256] RPC call timeout handler was delayed by -1.1303601409999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:03:15.270000  8581 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.269816  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.106103 14541 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:15.166401  9097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1423) took 1314 ms (client timeout 1744 ms). Trace:
W20260709 13:03:15.284701  9097 rpcz_store.cc:269] 0709 13:03:13.851690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.851817 (+   127us) service_pool.cc:224] Handling call
0709 13:03:15.166214 (+1314397us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54005b63d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:15.166348 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947279744}
I20260709 13:03:15.145529 14102 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:03:15.124416 14580 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:03:15.126813  9096 rpcz_store.cc:276] 0709 13:03:13.551814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.551955 (+   141us) service_pool.cc:224] Handling call
0709 13:03:13.552265 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.957177 (+404912us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:13.982659 (+ 25482us) log.cc:844] Serialized 14 byte log entry
0709 13:03:14.361651 (+378992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:14.361730 (+    79us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:14.361797 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.050173 (+688376us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54006121d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:15.050222 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.050371 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36114,"prepare.queue_time_us":33523,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":40252,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":30264,"spinlock_wait_cycles":930691968,"thread_start_us":342394,"threads_started":1,"wal-append.queue_time_us":489049}
I20260709 13:03:15.148782 14560 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:15.180194  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 57323us
I20260709 13:03:15.179294  8428 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:15.180395  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2449) took 2895 ms. Trace:
W20260709 13:03:15.299678  8550 leader_election.cc:336] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.216s (SENT)
I20260709 13:03:15.299559  8429 rpcz_store.cc:276] 0709 13:03:12.272308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.284858 (+ 12550us) service_pool.cc:224] Handling call
0709 13:03:12.291001 (+  6143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.814501 (+1523500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.167872 (+1353371us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400001754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:15.168028 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3502169344}
I20260709 13:03:15.300776  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.301442  8429 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:15.302485 14560 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:15.302735  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.303316  8428 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:15.304100  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.304312  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.305138  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.305751  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.307775 14602 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.308296 14602 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:15.310693 14602 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:15.211226  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:14.960876 14539 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.221365  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:15.311527  8435 raft_consensus.cc:2376] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17. Re-sending same reply.
I20260709 13:03:15.312463  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.312675 14539 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.313087  8435 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:15.313453  8575 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:15.313992  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.314769  8435 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:15.314846 14010 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:15.232651 14542 raft_consensus.cc:2764] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:15.315189  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.315621  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.315932  8434 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:15.316378  8435 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:15.316744  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.317183  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.305716  8428 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:15.184762  8427 raft_consensus.cc:2410] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:03:15.311527  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.154918 14375 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:15.229136  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1006) took 1605 ms. Trace:
I20260709 13:03:15.317791  8435 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:15.319274  8580 rpcz_store.cc:276] 0709 13:03:13.624228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.624369 (+   141us) service_pool.cc:224] Handling call
0709 13:03:13.624665 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:13.994781 (+370116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.994815 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:14.000202 (+  5387us) log.cc:844] Serialized 52 byte log entry
0709 13:03:14.564374 (+564172us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:14.564432 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.704141 (+139709us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:15.185883 (+481742us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400283a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:15.185965 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.186042 (+    77us) raft_consensus.cc:1685] finished
0709 13:03:15.186063 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.229075 (+ 43012us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9036,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5066,"spinlock_wait_cycles":826684544,"thread_start_us":276437,"threads_started":1,"wal-append.queue_time_us":565213}
W20260709 13:03:15.230132  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 111809us
I20260709 13:03:15.321758  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:15.322552  8576 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:15.322875  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:15.238188 14341 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.323199 14388 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:15.239183 14080 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:15.224076 14578 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.504s	user 0.001s	sys 0.001s
W20260709 13:03:15.244616 13941 consensus_meta.cc:287] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.003s
I20260709 13:03:15.246277 14464 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:15.323706 14335 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:15.247951  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.324188 14335 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:15.324466  8501 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:15.234911 14379 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.325395  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.324704  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:15.121752 14520 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:15.263620 14424 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.001s
W20260709 13:03:15.264991  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 108467us
I20260709 13:03:15.166455  8510 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:15.340149  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.340893  8510 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:15.270179  8476 connection.cc:256] RPC call timeout handler was delayed by -1.060160140999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:03:15.035045 14455 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:15.342044  8476 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:15.273782  8504 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
W20260709 13:03:15.342564  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.148994  8506 rpcz_store.cc:276] 0709 13:03:13.687474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.009796 (+322322us) service_pool.cc:224] Handling call
0709 13:03:14.010196 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:14.010447 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:14.726017 (+715570us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.101155 (+375138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.101206 (+    51us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:15.101246 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.101306 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.101403 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":429972,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":106,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":10147,"thread_start_us":1062284,"threads_started":2}
I20260709 13:03:15.339727  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:15.275264  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1389) took 1307 ms. Trace:
I20260709 13:03:15.279834  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:15.179817 13993 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:15.346648  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:15.266036  8502 rpcz_store.cc:269] 0709 13:03:13.529384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.530306 (+   922us) service_pool.cc:224] Handling call
0709 13:03:15.265463 (+1735157us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400153e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:15.265567 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485934848}
I20260709 13:03:15.286547  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:15.347417  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 236216us
I20260709 13:03:15.348073  8507 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:15.269054 14607 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
I20260709 13:03:15.289201  8503 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:15.292379  8432 raft_consensus.cc:2410] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:03:15.223202  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.318780  8430 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
W20260709 13:03:15.323091 14606 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:03:15.181068 14078 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.324613 14335 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:15.240082 14604 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:15.248834 14511 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.330149  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.339540 14520 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:15.365756  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 226179us
I20260709 13:03:15.338888 13671 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:15.367233 13671 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.342111  8581 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:15.276715  8431 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:15.367708 13671 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:15.344183  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:15.313871 14412 consensus_meta.cc:287] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.617s	user 0.005s	sys 0.001s
I20260709 13:03:15.347340  8505 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:03:15.343580  9095 rpcz_store.cc:276] 0709 13:03:13.967729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.328481 (+360752us) service_pool.cc:224] Handling call
0709 13:03:15.166360 (+837879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.265784 (+ 99424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.275028 (+  9244us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54005b63d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:15.275196 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925977344}
I20260709 13:03:15.352147  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:15.356055  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:15.356330  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 76575.5us
I20260709 13:03:15.345129 14388 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:15.362946  8428 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:15.362699  8503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:03:15.365931  8429 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:15.317740  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:15.342983 14379 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:15.368153  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:15.371117  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:15.470391  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 102331us
I20260709 13:03:15.355306 14462 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.487769  8503 raft_consensus.cc:606] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:15.488183  8503 raft_consensus.cc:614] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:15.487293  8429 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:15.469002  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1218) took 1091 ms. Trace:
I20260709 13:03:15.488989  8501 rpcz_store.cc:276] 0709 13:03:14.377299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.467952 (+1090653us) service_pool.cc:224] Handling call
0709 13:03:15.468337 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.468561 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.468600 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.468655 (+    55us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:15.468700 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.468791 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.468931 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:15.428259  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.385515  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.367367  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:15.491775  8434 raft_consensus.cc:2410] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:03:15.492512  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 125240us
I20260709 13:03:15.467272 14458 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.502907  8475 leader_election.cc:400] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19.
I20260709 13:03:15.503289  8475 leader_election.cc:403] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:03:15.345927 13993 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:15.513114 13671 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.360231 14591 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:15.504967  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.486665 14057 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:15.523022  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.359639 14542 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:15.360417 14026 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.359977 14601 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.359809 14355 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:15.360140 14488 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:15.362763 14424 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:15.515743  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:15.535441 14609 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:03:15.535795  8580 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:15.516031  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:15.538698  8578 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:15.516345  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.540232 14488 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.540920 14488 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.368698 14552 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.543550 14488 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:15.543794 14552 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:15.535494 14424 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:15.544966 14424 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.523360 14057 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:15.531208 14355 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:15.531540 14026 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:15.552387  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.532554 14601 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.554306 14601 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.550393 14057 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:15.350435 14521 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.157s
I20260709 13:03:15.496668 14602 raft_consensus.cc:2764] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:03:15.470301 13845 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:03:15.362466 14080 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.147s
I20260709 13:03:15.485168  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:15.517529 14589 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.528564  8428 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:03:15.554744 14600 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:15.533085  8584 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:03:15.566545  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 430103us
I20260709 13:03:15.522998 14458 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:15.506477 14462 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.499586  8434 pending_rounds.cc:85] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 9
W20260709 13:03:15.566942  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 81862.6us
I20260709 13:03:15.592262  8434 pending_rounds.cc:107] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:03:15.592574  8434 raft_consensus.cc:2889] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:15.527678 13671 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.569033  8428 pending_rounds.cc:85] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 11
I20260709 13:03:15.593498  8428 pending_rounds.cc:107] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:03:15.593842  8428 raft_consensus.cc:2889] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:15.594587  8580 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:15.532605  8503 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:15.596376  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2856) took 1127 ms. Trace:
I20260709 13:03:15.596737  8503 rpcz_store.cc:276] 0709 13:03:14.469586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.532173 (+1062587us) service_pool.cc:224] Handling call
0709 13:03:15.532440 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.596071 (+ 63631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.596311 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:15.526060 14542 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.569351 14351 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:15.524616 14412 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:03:15.597767  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.597944  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.599826  9065 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:15.597874  8503 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:15.601197 13671 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:15.570904  8583 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:15.556267 14388 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.569550 14591 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:15.617835  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.615368 14591 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:15.619156 14591 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:15.619234  8503 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:15.600785 14542 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:15.604151  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.615514 14488 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:15.601385 14562 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:03:15.647287  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.625000 14541 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:15.599411 14355 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.690964  8576 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:03:15.689257  8433 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.005s	sys 0.006s
I20260709 13:03:15.671860 14552 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:15.694665  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 337411us
W20260709 13:03:15.692682  8433 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.005s	sys 0.006s
I20260709 13:03:15.703428  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.706987  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.711309  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.712232  8576 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:15.684687 14541 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.684959 14511 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:15.676198 14488 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:15.721474  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.729017  8576 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:15.722949  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.731071  8578 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:15.731866  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:15.732539  8578 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:15.723513  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.724378  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.733371  8579 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:15.733920  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:15.725054  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:15.729876  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:15.734998  8547 leader_election.cc:336] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.685s (SENT)
W20260709 13:03:15.736976  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 365889us
I20260709 13:03:15.732638  8433 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:15.751377  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:15.740096  8577 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 21: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:15.747687  8430 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:15.752473  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:15.753281  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:15.725656  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 418349us
W20260709 13:03:15.756423  8550 leader_election.cc:336] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.224s (SENT)
W20260709 13:03:15.757195  8550 leader_election.cc:336] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.259s (SENT)
I20260709 13:03:15.704648 14552 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.739147 14026 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.728226 14541 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:15.778000  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 76208.2us
I20260709 13:03:15.770725  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:15.776291 14589 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.775542 14617 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:15.799229 14618 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.800988 14620 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:15.831821  8435 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:15.836712  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:15.820964 14388 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:15.859970 14455 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:15.860559 14455 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:15.861406 14455 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:15.862959 14552 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:15.871856 14541 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:15.875332  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2671) took 1126 ms. Trace:
I20260709 13:03:15.875741  8432 rpcz_store.cc:276] 0709 13:03:14.748740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.749532 (+   792us) service_pool.cc:224] Handling call
0709 13:03:15.875133 (+1125601us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540025a3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:15.875247 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598521216}
W20260709 13:03:15.877241 14590 consensus_meta.cc:287] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.000s
I20260709 13:03:15.879395 14462 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.882174 14520 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:15.883563  8510 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 21: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:15.884600 14557 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:15.887240 14519 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:15.888463 14519 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:15.821633 14617 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.892974 14617 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:15.894673  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2674) took 1144 ms. Trace:
I20260709 13:03:15.895113  8431 rpcz_store.cc:276] 0709 13:03:14.749803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.987003 (+237200us) service_pool.cc:224] Handling call
0709 13:03:15.894480 (+907477us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54001d42d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:15.894615 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461395200}
I20260709 13:03:15.897080  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1227) took 1187 ms. Trace:
W20260709 13:03:15.897153 14490 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.000s
I20260709 13:03:15.897535  8505 rpcz_store.cc:276] 0709 13:03:14.709937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.150460 (+440523us) service_pool.cc:224] Handling call
0709 13:03:15.896895 (+746435us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54001fc054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:15.897028 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450466560}
W20260709 13:03:15.899441  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 527779us
I20260709 13:03:15.900174  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:15.901252  8476 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:15.855640 14335 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.903112 14464 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:15.903789 14464 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:15.904127 14464 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.904477 14464 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:15.904623 14335 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:15.905339 14559 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.001s
W20260709 13:03:15.906162  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.907621 14554 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:15.906777  8476 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:15.911211  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:15.915351  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:15.803921 14488 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.924930  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:15.928117  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.928526  8584 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:15.930289  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:15.930943  9102 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:15.937084  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.914826 14554 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:15.939662  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.939109  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.972368  8507 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:15.905841 14559 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.977108  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.978279  8507 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:15.889679 14591 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.974395  8505 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:15.974507  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.919410 14590 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:15.987488  8510 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:15.983803  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:15.984092  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:15.988822  9093 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.988999  8508 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:15.985847  9101 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:15.897710 14490 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.990515  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:15.995569  8507 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:15.995739  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:15.996699  9101 raft_consensus.cc:2410] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:03:15.998879  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:15.999440  9100 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.001318  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:16.002319  8550 leader_election.cc:336] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.466s (SENT)
I20260709 13:03:16.002804  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:16.003756  9095 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.006836  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:16.008890  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 238218us
I20260709 13:03:15.990839 14544 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:15.994078 14628 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:03:16.016644  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:16.018170  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.018498  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:16.020701  8398 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:16.024341  9093 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:16.031101  9100 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:15.991511 14590 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:16.035409 14590 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:15.832051 14618 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:15.969357 14589 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
W20260709 13:03:16.053695  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 43761.3us
I20260709 13:03:16.059829  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:16.062187  8505 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:03:16.074622  9100 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:16.076547  8507 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.076885  8505 pending_rounds.cc:85] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 12
I20260709 13:03:16.077242  8505 pending_rounds.cc:107] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:03:16.077484  8505 raft_consensus.cc:2889] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:15.990540 14622 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:03:16.080557  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:16.036298 14078 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:16.083529  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:16.084323  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:16.084991  8575 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:16.081627  9068 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:16.093711  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.086109  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:16.086469  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:16.094518  8578 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:16.095260  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:16.096048  9100 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.087733  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:16.087733  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.089788  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:16.097265  8505 raft_consensus.cc:2410] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:03:16.097465  9099 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:16.097081  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:16.100256  8582 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:16.101699  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:16.102643 14541 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:16.103139 14541 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.103528 14541 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:16.105415  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:16.113708 14541 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.108477  9100 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:16.059041 14335 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:16.115311  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:16.117937  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:16.119040  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:16.119870  9068 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:16.120441  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.122107  9099 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
W20260709 13:03:16.122346  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 101880us
I20260709 13:03:16.124701  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:16.128657  9100 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:16.128798  9068 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:16.125168  8583 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:16.127509  8398 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:16.115809 14560 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.813s	user 0.009s	sys 0.002s
I20260709 13:03:16.138690  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:16.150135  8434 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:16.151362  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:16.151458  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.152045  8434 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:16.152148  8505 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:16.124643  9098 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:16.153183  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:16.163275  8505 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:16.148609  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:16.133723 13671 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:16.153724  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:16.098127 14026 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.143922  9100 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:16.082602 14638 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:16.156486  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:16.133906  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1189) took 1051 ms. Trace:
I20260709 13:03:16.164515  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:16.168663  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:16.169603  9100 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:16.158576  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:16.115011 14631 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.152753  8507 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:16.178938  9100 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:16.179867  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.180517  8507 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:03:16.181002  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:16.181668  8431 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:16.178295  9093 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 19: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:16.181605  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 54178.8us
I20260709 13:03:16.180387  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:16.183112  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:16.183702  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:16.131016 14388 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.184576  8430 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:16.190227  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.188521  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:16.147531 14552 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:16.122454 14644 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.186429  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:16.190961  8507 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:16.191517  8582 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.166653 14623 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.117112 14617 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:16.129208 14335 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:16.199040  9100 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:16.199141  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:16.197819  9065 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:16.127622 14080 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:03:16.192809 14424 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.002s
I20260709 13:03:16.203838  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:16.203755  9100 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:03:16.202064  8577 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:16.168591 14580 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:16.261982  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:16.241825  8505 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:16.217931  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:16.218202  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:16.284514  8507 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.178517 14638 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:16.216957  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:16.271509  8509 raft_consensus.cc:2410] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:03:16.266819  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:16.286140  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 69252.2us
I20260709 13:03:16.274827  8582 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:16.196076 14552 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:16.262801 14542 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.001s
W20260709 13:03:16.215507 14633 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:03:16.161234 14560 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.216727 14629 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:16.267088  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:16.268374  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:16.184278 14642 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.204197 14335 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.309005  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2714) took 1210 ms. Trace:
I20260709 13:03:16.309440  8581 rpcz_store.cc:276] 0709 13:03:15.099042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.099178 (+   136us) service_pool.cc:224] Handling call
0709 13:03:16.308829 (+1209651us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400116cd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:16.308949 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300691328}
I20260709 13:03:16.182647 14026 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.205353 14617 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:16.286880  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:16.272992 14557 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:16.279647 14057 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.004s
I20260709 13:03:16.263304 14388 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:03:16.305997  8507 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:16.305603  8549 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:16.310354  8580 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:16.217341 14623 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.203769 14462 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:03:16.297474 14631 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:16.287017  8505 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:16.341144  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.288246 14638 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:16.335836  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:16.337972  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.352986  8506 raft_consensus.cc:2410] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:03:16.335309  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:16.293229 14552 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:16.313546 14559 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:16.350412  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.312386 14350 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:16.342725  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.266438 14424 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:16.329773 14635 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:03:16.337150 14642 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:16.372969  8505 raft_consensus.cc:2410] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:03:16.389360  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.390182  8505 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:16.350121 14608 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:16.316201 14557 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:16.355715  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.318886  9101 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.306252 14542 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.367429  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:16.395548  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:16.365430  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.350847 14620 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:16.373868 14350 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.350188 14631 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:16.366870 14351 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:16.319293 14617 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.354628 14625 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:16.396185  8507 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:16.329227 14057 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:16.396628  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.294634 14640 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:16.395862  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.397342  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:16.388206 14541 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:16.429104  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.432838  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:16.398430 14637 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:03:16.430768  8504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e2febf027be449183830c318fbd6012"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:03:16.430824  8506 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:16.433621  8507 raft_consensus.cc:2376] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14. Re-sending same reply.
I20260709 13:03:16.438421  8504 raft_consensus.cc:606] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:16.434860  8505 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:16.438993  8504 raft_consensus.cc:614] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:16.388671 14642 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.436849  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:16.396521 14557 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.400497 14350 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:16.459472 14623 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:16.460789 14646 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:03:16.462522 14645 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 13:03:16.427745 14643 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 13:03:16.403075 14639 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:03:16.382624 14379 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:03:16.467866 14379 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:16.468338 14379 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:16.400720 14080 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:16.470230 14080 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:16.470793 14650 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:03:16.471464 14080 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.473134 14080 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:16.400493 14580 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:16.474457 14580 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:16.475600 14580 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.478416  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1220) took 2031 ms. Trace:
I20260709 13:03:16.478853  8501 rpcz_store.cc:276] 0709 13:03:14.447330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.503367 (+1056037us) service_pool.cc:224] Handling call
0709 13:03:15.503738 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:15.777454 (+273716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.777503 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:15.782593 (+  5090us) log.cc:844] Serialized 52 byte log entry
0709 13:03:15.972030 (+189437us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:15.972066 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.972134 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:16.478096 (+505962us) raft_consensus.cc:1685] finished
0709 13:03:16.478125 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.478354 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10957,"raft.queue_time_us":20234,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4605,"thread_start_us":400808,"threads_started":2,"wal-append.queue_time_us":384869}
I20260709 13:03:16.450089  8503 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:16.400336 14620 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:16.434494 14351 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:16.482975 14620 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.483095 14351 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.451090 14642 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:16.487294 14026 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:16.488409 14559 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:16.489104 14559 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:16.456911 13845 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.469189 14379 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.491531 14542 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:16.492434 14379 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:16.493925 14057 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:16.399791 14608 raft_consensus.cc:697] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:16.495723 14608 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.429965 14640 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.498575 14640 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:16.503340 14424 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:16.508159 14464 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.002s
I20260709 13:03:16.508739 14464 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:16.510476 14641 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:03:16.512467  8501 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:16.433173 14625 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.516758 14625 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:16.450079 14589 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:16.522187 14573 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:16.525282 14541 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.526342 14618 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:16.526175 14541 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.458890  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:16.400388 14631 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:16.457631 14651 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:03:16.534082  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 75218.4us
I20260709 13:03:16.538391  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:16.542301 14458 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.950s	user 0.010s	sys 0.003s
I20260709 13:03:16.531064 14589 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:16.540426 14573 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:16.612824 14590 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 13:03:16.613339 14589 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:16.625880 14590 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:16.775817  8508 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:16.401255  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 183388us
I20260709 13:03:16.779925  8398 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:16.579558 14350 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.783676 14541 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:16.785149 14350 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:16.578140 14375 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:03:16.786264 14654 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:16.786813 14654 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.787202 14654 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.627616 14617 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:16.664500  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 377496us
I20260709 13:03:16.674988  8510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:03:16.672335  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:16.793813  8510 raft_consensus.cc:606] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:16.794366  8510 raft_consensus.cc:614] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:16.679911  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:16.600783 14560 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:16.686890 13845 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.800698 13845 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:16.590566 14458 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19.
I20260709 13:03:16.582373 14559 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.683941  8429 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:03:16.619736 14631 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.626497 14642 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:16.806042 14631 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:16.684165  8435 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.808629 14642 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:16.676486  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 138072us
I20260709 13:03:16.761814  8430 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
W20260709 13:03:16.680125  9068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.005s
W20260709 13:03:16.680627  9097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.007s	sys 0.002s
I20260709 13:03:16.684744  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:16.676977  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.682201  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:16.774091 14464 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:16.800920  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2451) took 1863 ms. Trace:
W20260709 13:03:16.675451  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 339511us
I20260709 13:03:16.824412  8434 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:16.826905 14560 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.861702  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:16.832021  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1022) took 1110 ms. Trace:
W20260709 13:03:16.816349  8509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 2849) took 2368 ms (client timeout 2163 ms). Trace:
I20260709 13:03:16.777729 14590 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:16.865150  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 185535us
W20260709 13:03:16.868602  9068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.005s	sys 0.005s
I20260709 13:03:16.872417  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 1016) took 1244 ms. Trace:
I20260709 13:03:16.872885  8584 rpcz_store.cc:276] 0709 13:03:15.628144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.628254 (+   110us) service_pool.cc:224] Handling call
0709 13:03:16.835614 (+1207360us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54000cd5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:16.872189 (+ 36575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618761088}
I20260709 13:03:16.688395 14078 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:16.875708  8426 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:16.878993  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:16.881784  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1691) took 1022 ms. Trace:
W20260709 13:03:16.881071  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 70265.6us
W20260709 13:03:16.882501  9097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.007s	sys 0.003s
I20260709 13:03:16.884605  9094 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:03:16.629528 14638 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:16.887022  8506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:03:16.887733  8506 raft_consensus.cc:606] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:16.888088  8506 raft_consensus.cc:614] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:16.889062 14638 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:16.893213  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:16.898285  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 13:03:16.867071  8509 rpcz_store.cc:269] 0709 13:03:14.448151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.142519 (+694368us) service_pool.cc:224] Handling call
0709 13:03:16.815766 (+1673247us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400154354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:16.816092 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2593096064}
I20260709 13:03:16.882233  9095 rpcz_store.cc:276] 0709 13:03:15.859377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.913816 (+ 54439us) service_pool.cc:224] Handling call
0709 13:03:15.914154 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.004198 (+ 90044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.881228 (+877030us) spinlock_profiling.cc:243] Waited 89.4 ms on lock 0x7b540017acd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:16.881552 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205628288}
I20260709 13:03:16.866569  8580 rpcz_store.cc:276] 0709 13:03:15.721473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.721627 (+   154us) service_pool.cc:224] Handling call
0709 13:03:16.310123 (+588496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:16.330136 (+ 20013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.831426 (+501290us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b5400116cd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:16.831722 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352589568}
W20260709 13:03:16.905516  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 742655us
I20260709 13:03:16.911556  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:16.862707  8427 rpcz_store.cc:276] 0709 13:03:14.936956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.318469 (+381513us) service_pool.cc:224] Handling call
0709 13:03:15.355047 (+ 36578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.355235 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:15.731056 (+375821us) log.cc:844] Serialized 14 byte log entry
0709 13:03:15.982686 (+251630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:15.982760 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:15.982841 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.982922 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.800468 (+817546us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54003a3750. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:16.800693 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":417863,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":45,"raft.queue_time_us":78320,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":82096000,"thread_start_us":612695,"threads_started":3,"wal-append.queue_time_us":91171}
I20260709 13:03:16.916601 14458 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.922870 14560 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:16.924322 14462 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:16.924891 14462 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:16.929783  9065 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:16.931398 14462 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.943845  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:16.944342 14664 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:16.944836  8506 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:16.943856 14462 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:16.950639  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:16.941748  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:16.944869 14664 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:16.952152 14664 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.947187 14560 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:16.955799  8429 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:16.941509 14544 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:16.971609 14544 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:16.169013  8428 rpcz_store.cc:276] 0709 13:03:15.107669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.594792 (+487123us) service_pool.cc:224] Handling call
0709 13:03:15.595125 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.595315 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:15.747607 (+152292us) log.cc:844] Serialized 14 byte log entry
0709 13:03:16.133452 (+385845us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:16.133506 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:16.133547 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.133636 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.133844 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54056,"prepare.queue_time_us":217800,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":67258,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":14166,"thread_start_us":483389,"threads_started":2,"wal-append.queue_time_us":430601}
W20260709 13:03:16.932494  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 150616us
I20260709 13:03:16.958894  8505 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:16.959674 14617 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:16.961496 14591 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:16.961151 14458 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:16.963130  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:16.968037 14654 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:16.969908 14335 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.020s
I20260709 13:03:17.002836  8434 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:17.010901 14335 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:17.013214 14335 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:17.013878  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 86249.1us
W20260709 13:03:17.014865  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 87240.8us
I20260709 13:03:17.019302 14560 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:17.023743  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2865) took 1908 ms. Trace:
I20260709 13:03:17.024158  8503 rpcz_store.cc:276] 0709 13:03:15.115238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.620166 (+504928us) service_pool.cc:224] Handling call
0709 13:03:15.620427 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.482052 (+861625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.023278 (+541226us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54000d93d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:17.023557 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907345152}
I20260709 13:03:16.937870 14520 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.026273  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1704) took 1010 ms. Trace:
I20260709 13:03:17.026852  9101 rpcz_store.cc:276] 0709 13:03:16.015240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.015400 (+   160us) service_pool.cc:224] Handling call
0709 13:03:16.015671 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.395151 (+379480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.025743 (+630592us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b5400508054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:17.026070 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696768896}
I20260709 13:03:17.036299  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:17.036144 13993 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:17.030716 14664 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:16.994171  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:16.982677 14656 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:16.984675  8328 catalog_manager.cc:5697] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 6 to 11, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 11 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:03:16.985823  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:16.989209  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:16.990586  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.992865  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:17.056782  8576 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:17.115298  8426 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:17.055730 14078 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.055505  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:17.047019 14668 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
W20260709 13:03:17.052661 14649 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.655s	user 0.000s	sys 0.001s
I20260709 13:03:17.057492  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:17.063597 14490 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.132001  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:17.133308  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:17.133858  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1697) took 1164 ms. Trace:
W20260709 13:03:17.133971 14557 consensus_meta.cc:287] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.011s
I20260709 13:03:17.050089  8547 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:17.134539 14557 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.134289  9102 rpcz_store.cc:276] 0709 13:03:15.970518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.971459 (+   941us) service_pool.cc:224] Handling call
0709 13:03:15.993456 (+ 21997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:15.993703 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:15.994316 (+   613us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:16.007768 (+ 13452us) log.cc:844] Serialized 26 byte log entry
0709 13:03:16.199068 (+191300us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:16.199121 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.199214 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:17.051636 (+852422us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:17.133386 (+ 81750us) raft_consensus.cc:1685] finished
0709 13:03:17.133408 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.133650 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4310272,"thread_start_us":132222,"threads_started":1,"wal-append.queue_time_us":311437}
I20260709 13:03:17.069963 14555 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:03:17.136758 14555 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:17.137038 14557 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.137248 14555 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:17.116887  8502 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
W20260709 13:03:17.040794 14379 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.014s
I20260709 13:03:17.138623 14555 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:17.139912  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 100811us
I20260709 13:03:17.140657 14555 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:17.142282 14379 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:17.145323  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2450) took 1207 ms. Trace:
I20260709 13:03:17.119403 14664 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:17.120784 14552 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.742s	user 0.008s	sys 0.008s
W20260709 13:03:17.146454  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 110360us
I20260709 13:03:17.146618 14552 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.147791  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:17.148033  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:17.148877  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:17.149659 14462 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.150475 14462 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:17.145773  8502 rpcz_store.cc:276] 0709 13:03:15.937901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.938047 (+   146us) service_pool.cc:224] Handling call
0709 13:03:17.145107 (+1207060us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54001fed54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:17.145260 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908698496}
I20260709 13:03:17.080082  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2455) took 1086 ms. Trace:
I20260709 13:03:17.056692  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:17.121999  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:17.129529  8432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.029s	sys 0.101s
I20260709 13:03:17.130082  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:17.130833  8582 raft_consensus.cc:2368] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15.
I20260709 13:03:17.131286 14335 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.067787 14654 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.042261 14629 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.172739 14629 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.174278 14642 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:17.049867 14662 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.126s
I20260709 13:03:17.176146 14662 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:17.176539 14662 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:17.176649 14511 raft_consensus.cc:3055] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:17.177110 14511 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:17.037811 14640 consensus_meta.cc:287] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.539s	user 0.016s	sys 0.002s
I20260709 13:03:17.178393 14640 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.180783 14640 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.181511  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:17.188421  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:17.189419  8501 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.190812  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:17.191526  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:17.193585 14573 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:17.199723  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 182857us
I20260709 13:03:17.059398  8580 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:17.042933  8476 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.037755 13993 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:17.071743 14080 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.025s
I20260709 13:03:17.162935  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:17.163255  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:17.163795  8579 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:17.164392  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:17.081437 14355 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.040835 13845 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.078927 14539 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.165509 14458 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.166254 14078 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.167114  9094 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:17.167927  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:17.127377 14350 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:17.170590  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 186445us
I20260709 13:03:17.155571  8508 rpcz_store.cc:276] 0709 13:03:15.994101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.996880 (+  2779us) service_pool.cc:224] Handling call
0709 13:03:16.005913 (+  9033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.776568 (+770655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.079774 (+303206us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54003c5854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:17.080021 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769013632}
I20260709 13:03:17.226933  8501 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:17.157887 14462 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:17.211750  8432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.029s	sys 0.101s
I20260709 13:03:17.213692  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:17.121984 14544 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:17.168982  8328 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 8 to 10, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 10 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:17.200739 14629 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.227926  9102 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:17.177575 14662 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.235812  8578 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
W20260709 13:03:17.278004  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44513.9us
I20260709 13:03:17.232939 14462 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:17.232592 14591 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:17.216037 14656 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:03:17.235014 13845 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:17.282222 14552 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.229542 14350 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:17.312077  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:17.310441  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 83582.3us
W20260709 13:03:17.314203  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 164453us
W20260709 13:03:17.313822  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.286262 14080 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:17.280001 14539 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:17.316547  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 323830us
W20260709 13:03:17.319800  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.320242  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.325865  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 283145us
I20260709 13:03:17.233196 14511 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.313822 14662 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:17.325110  8329 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57104 (request call id 384) took 39564 ms (client timeout 15000 ms). Trace:
I20260709 13:03:17.329860 14080 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.326792  9065 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:17.333084  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:17.335498  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2466) took 1023 ms. Trace:
I20260709 13:03:17.335870  8504 rpcz_store.cc:276] 0709 13:03:16.288602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.451581 (+162979us) service_pool.cc:224] Handling call
0709 13:03:16.451945 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.452193 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:16.927374 (+475181us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.286132 (+358758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:17.291476 (+  5344us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:17.298958 (+  7482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.308604 (+  9646us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.311842 (+  3238us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":460295,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":27930,"raft.queue_time_us":4625,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8741,"thread_start_us":745521,"threads_started":2,"wal-append.queue_time_us":347431}
I20260709 13:03:17.342958 14544 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.343838  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:17.350708 14078 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.351387 14539 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.353659 14490 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.358404 14664 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:17.359131 14664 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:17.360126 14664 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.363159  8328 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 7 to 10, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 10 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:17.364838 14573 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.370146  8581 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:03:17.329730 14455 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:17.371188  8576 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:17.371568 14455 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.318552 14608 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.372905 14608 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.376932  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1199) took 1222 ms. Trace:
I20260709 13:03:17.377179 14080 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.378567 14490 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:17.377349  8432 rpcz_store.cc:276] 0709 13:03:16.154693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.155131 (+   438us) service_pool.cc:224] Handling call
0709 13:03:16.155420 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.155631 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:16.159371 (+  3740us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.293459 (+1134088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:17.306192 (+ 12733us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:17.315363 (+  9171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.322596 (+  7233us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.376863 (+ 54267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17383,"prepare.queue_time_us":4037,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3728,"raft.queue_time_us":25855,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4033,"thread_start_us":1070981,"threads_started":1,"wal-append.queue_time_us":763667}
W20260709 13:03:17.379567  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 175768us
W20260709 13:03:17.380286  8550 leader_election.cc:336] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.946s (SENT)
I20260709 13:03:17.380656  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.381388 14573 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:17.382876  8550 leader_election.cc:336] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.996s (SENT)
I20260709 13:03:17.383327  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.383406 14629 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.384140 14573 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:17.385833  8550 leader_election.cc:336] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.219s (SENT)
I20260709 13:03:17.386494  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.387979 14573 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:17.388235  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 92827.7us
I20260709 13:03:17.389245  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:17.390811 14573 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:17.392113  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.393548  8476 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:17.394220  8398 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:17.394778  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.399904  9102 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:17.406517  8579 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:17.390865 14560 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:17.438660  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:17.445247  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 112982us
I20260709 13:03:17.445551  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:17.445703  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:17.446318  8579 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:17.446408  8583 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.447973 14640 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.449086 14640 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:17.455211  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:17.449918 14335 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:03:17.458923  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 62389.1us
I20260709 13:03:17.460201 14629 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:17.459584  8328 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 8 to 10, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 10 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:17.460757 14590 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:17.462723 14591 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.466988 14642 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:17.471071  8583 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:17.437014 14560 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:17.481455 14455 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.492128 14080 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.494836 14350 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:17.495563  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45080.9us
I20260709 13:03:17.495730 14555 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:17.501976 14589 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.505896  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:17.508549  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 176360us
I20260709 13:03:17.509606 14511 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.391891 14573 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.511446  8501 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:17.520097 14591 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.522174  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:17.490533  8576 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:17.543076  8575 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:17.524904  9101 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.525463 14560 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:17.530941  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.512063 14335 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:17.533143  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 252330us
I20260709 13:03:17.536541  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:17.518811  8504 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.548012  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:17.554934  8579 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:17.529870 14590 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:17.562906  9102 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:17.564296  8426 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:17.562647 14559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.024s	sys 0.007s
I20260709 13:03:17.581328  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.571933 14455 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.537582 14642 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.587913 14642 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.590459 14335 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.591588 14335 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:17.331259  8329 rpcz_store.cc:269] 0709 13:02:37.630085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.630371 (+   286us) service_pool.cc:224] Handling call
0709 13:03:17.189959 (+39559588us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:09.087520 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:09.483222 (+395702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:09.496482 (+ 13260us) write_op.cc:435] Acquired schema lock
0709 13:03:09.499817 (+  3335us) tablet.cc:662] Decoding operations
0709 13:03:09.662333 (+162516us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:09.662443 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:09.662468 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:03:09.663521 (+  1053us) tablet.cc:701] Row locks acquired
0709 13:03:09.663568 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:03:09.663729 (+   161us) write_op.cc:270] Start()
0709 13:03:09.663873 (+   144us) write_op.cc:276] Timestamp: P: 1783602189663667 usec, L: 0
0709 13:03:09.663894 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:09.664605 (+   711us) log.cc:844] Serialized 4355 byte log entry
0709 13:03:10.495196 (+830591us) op_driver.cc:464] REPLICATION: finished
0709 13:03:10.762238 (+267042us) write_op.cc:301] APPLY: starting
0709 13:03:10.762341 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:10.902608 (+140267us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:10.902728 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:11.057219 (+154491us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:11.057913 (+   694us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:03:11.057955 (+    42us) write_op.cc:312] APPLY: finished
0709 13:03:11.108521 (+ 50566us) log.cc:844] Serialized 105 byte log entry
0709 13:03:11.113996 (+  5475us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:11.114142 (+   146us) write_op.cc:454] Released schema lock
0709 13:03:11.114191 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:11.114610 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:11.114636 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1454708,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":266773,"apply.run_cpu_time_us":16542,"apply.run_wall_time_us":352340,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50063,"num_ops":11,"prepare.queue_time_us":41802,"prepare.run_cpu_time_us":39320,"prepare.run_wall_time_us":711056,"raft.queue_time_us":510513,"raft.run_cpu_time_us":126694,"raft.run_wall_time_us":238214,"replication_time_us":831113,"thread_start_us":643432,"threads_started":4,"wal-append.queue_time_us":165192,"wal-append.run_cpu_time_us":20808,"wal-append.run_wall_time_us":2281352}]]}
I20260709 13:03:17.596664 14026 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:17.597295 14026 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.598560 14573 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.565305 14662 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:03:17.599483 14552 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:17.600056 14552 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:17.600555 14552 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:17.601254  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:17.600018 14662 consensus_queue.cc:1243] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:17.602550 14590 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:17.605007  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:17.565706 14555 consensus_queue.cc:1243] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:03:17.537729 14589 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:17.578284 14559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.025s	sys 0.007s
W20260709 13:03:17.616247  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 152338us
W20260709 13:03:17.634498  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 68070.1us
I20260709 13:03:17.581841 14355 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.638587  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:17.646718  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:17.648072  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:17.651389  8475 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.744s (SENT)
I20260709 13:03:17.653160  8575 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:17.652383  8508 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:03:17.652601  8503 pending_rounds.cc:85] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 11
W20260709 13:03:17.653337  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.654183  8579 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:17.655068  8503 pending_rounds.cc:107] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:03:17.669080  8503 raft_consensus.cc:2889] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:17.663854  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.671895  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:17.673193 14640 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:17.673759 14640 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:17.673971  8505 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:17.674641 14640 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:17.671145  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 151535us
I20260709 13:03:17.686905 14608 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.688594 14057 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.689352 14057 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:17.699327  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.657977 14355 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:17.718183 14080 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:17.718906 14458 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:17.719436 14080 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:17.684264 13993 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:17.596005  8328 catalog_manager.cc:5697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 3 to 5, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 5 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:03:17.719723 14379 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.723723 14379 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.725198  8328 catalog_manager.cc:5697] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:03:17.730762  8550 leader_election.cc:336] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.859s (SENT)
I20260709 13:03:17.731065 14580 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:17.731392 14057 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.731763 14580 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.732081 13993 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:17.738463  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:17.739441 14580 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:17.741863  8505 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:17.719934 14080 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:17.743206  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:17.742996 14080 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:17.744529 14080 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:17.744205 14591 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.719643 14629 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:17.747049  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.744241 14580 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:17.750161 14589 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.751011 14462 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:17.733346 13993 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.722095 14689 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.704113 14608 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:17.761873  8504 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:17.762715  9101 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:17.765430  9098 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:17.770157  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.770455  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 119084us
W20260709 13:03:17.772445  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 69612.3us
I20260709 13:03:17.761881 14580 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:17.758462 14379 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.775591  8434 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:17.776566  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:17.763440 14654 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:03:17.778317  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:17.778434  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:17.779505 14589 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.779924 13993 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.775025 14580 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.780546 14557 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.784272 14462 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.785365  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:17.786279  8505 raft_consensus.cc:2410] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:03:17.777351 14490 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:17.787143  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:17.787406 14490 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:17.787823 14490 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:17.788389  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 104988us
I20260709 13:03:17.788630  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:17.791512  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:17.792400 14589 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.794675 14589 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.795915 14455 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.796482 14455 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.766798 14026 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.809955  9098 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
W20260709 13:03:17.811679  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.810743  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:17.720382 13845 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:03:17.817902  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:17.818581  8502 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:17.820034  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:17.825034  8508 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:17.827337  9101 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:17.817660 14689 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:17.828377  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:17.773001 14552 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.832216  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:17.832631  8504 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:17.834007  8428 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
W20260709 13:03:17.834352  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.835531 14355 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.818984 14511 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:17.836586  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:17.838498  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:17.838775  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:17.841084  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:17.842419  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:17.843007  9102 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:17.779615 14608 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.824846 14662 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:17.819960 14078 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:03:17.821005 14591 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:17.813161 14350 consensus_queue.cc:1059] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:03:17.820393 14462 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:03:17.831746 14689 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:17.857856  8579 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:03:17.860724 14654 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:17.863729  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 72318.5us
I20260709 13:03:17.866410  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:17.866925  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.866598 14689 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.867762  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:17.868180  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:17.869102  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:17.869544  8432 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:17.870210 14608 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.857097 14662 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:17.870386  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:17.863023  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:17.882493  8328 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 11 to 13, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 13 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:17.863801 14355 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:03:17.867287  8501 raft_consensus.cc:2410] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:17.863554 14455 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:17.884552  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.885840  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:17.885993 14552 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:17.886796 14694 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:17.902010  8429 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:17.891664  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:17.860893 14335 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.854982 14573 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:03:17.894973  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:17.895299  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:17.896853  8504 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:17.868536  8430 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 19: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:17.900784  8428 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.903867  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.887732  9098 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:03:17.904691  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 48957.6us
I20260709 13:03:17.905098  8503 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:03:17.907267  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:17.911373  8502 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:17.915853  8427 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:17.916329 14589 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:17.916752 14589 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:17.917734  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:17.906286 14544 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:17.918778  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:17.919430  8435 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.922175 13845 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:17.922327  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:17.922968 13845 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:17.923179  8509 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:17.923339 13845 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:17.924058  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:17.917765  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:17.925348  8430 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.927788  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.929373  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.930220 14629 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.930049 14654 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.931030 14629 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.932685  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.932823 14654 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:17.934181 14691 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:03:17.935765 14608 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:17.935840  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:17.936729  8432 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.936985 14608 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.937597 14608 consensus_queue.cc:1243] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:17.938777  9097 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:17.938848 14078 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:17.939447 14078 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:17.939275 14335 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:17.940351 14078 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:17.941558  8431 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:17.944240  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:17.945629  8429 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:17.946135  8434 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.944250  8426 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
W20260709 13:03:17.946272  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.918776  8427 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:17.925663  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:17.946635  8426 pending_rounds.cc:85] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 12
I20260709 13:03:17.977536  8426 pending_rounds.cc:107] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:03:17.977826  8426 raft_consensus.cc:2889] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:18.014518  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.902325 14379 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:03:18.022430  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 115222us
I20260709 13:03:18.035405  8430 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
W20260709 13:03:18.037993  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 112431us
I20260709 13:03:18.039328  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:18.026408  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:18.040400  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:18.036613  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:18.038707 14679 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:03:18.018877 14379 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:18.047396  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.085485  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:18.028154 14520 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:18.036708 14026 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:18.042098 14458 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:18.041961 14078 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.019202 14573 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:18.018954 14057 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:18.101521  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 166688us
I20260709 13:03:18.105139  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:18.019152 14355 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.121246  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:18.046106 14552 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.046840 14335 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:18.115458 14580 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.046845 14375 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:03:18.046084 14697 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:18.116209  8434 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:18.133031  8507 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:18.028064 14560 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.129577  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:18.113857 14458 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.104715 14026 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:18.144620  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:18.145534  8504 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.139323  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:18.111681 14573 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.137786  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:18.152117  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:18.158752  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:18.147584  9067 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:18.113638 14555 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:18.119681 14080 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.149752  9095 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:18.163194 14698 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:18.134184 14520 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:18.164503  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.163580 14683 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.185s
W20260709 13:03:18.168569  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 132065us
I20260709 13:03:18.114141 14350 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:18.145424 14458 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.176864  8583 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:18.171453  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:18.140020 13993 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:18.205626 14490 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.217713 13993 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.218303 13993 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:18.219873 14490 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:18.220810  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.170651  8328 catalog_manager.cc:5697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 5 to 9, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 9 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:03:18.224602  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.227351  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:18.228308  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:18.228929 14689 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:18.229624  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:18.190016  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.250777  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.251139  8507 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:18.251382  8429 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:18.252187  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.253136  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.253262  8507 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:03:18.253612  8507 pending_rounds.cc:85] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 11
I20260709 13:03:18.253803  8507 pending_rounds.cc:107] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:03:18.192879  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:18.153352 14573 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.193480  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:18.197024 14692 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:03:18.197376 14704 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:03:18.197999  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:18.198421 14696 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:03:18.176297 14462 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:18.176466 14640 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:18.198853  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:18.201660 14555 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.202687 14026 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.182542 14080 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.171887 14698 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:18.206298  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:18.208149  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74300.9us
I20260709 13:03:18.208691 14631 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:18.197579  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:18.183732 14552 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:03:18.211416 14580 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:18.214507  8550 leader_election.cc:336] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.025s (SENT)
I20260709 13:03:18.183869 14654 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:03:18.184720  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:18.230180 14560 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:03:18.230211  9101 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:18.230629  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:18.183128 14379 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:18.150574 14697 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.142102 14335 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:03:18.140281 14662 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.170341 14520 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.235148  8427 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:18.236047 14700 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:03:18.242601  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:18.225380  8328 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 8 to 11, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 11 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:18.246488  8501 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:18.249046 14458 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.254015  8507 raft_consensus.cc:2889] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:18.277597  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 92965.4us
I20260709 13:03:18.254634  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.255304  8505 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:18.308893 14608 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:18.261099 14462 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:18.261384 14640 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:18.261696  9098 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:18.264067 14026 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:18.265684 14080 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:18.311487  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 285219us
I20260709 13:03:18.266525 14698 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.312601  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:18.267060  9097 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:18.300908  8428 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:18.362205  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.287111 14520 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.363479  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.364681  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.261574  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:18.366160 14462 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.367148  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.367305  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:18.367779  8426 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:18.368659  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.369339 14710 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:18.288002  8506 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:18.369966 14710 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.259678  8432 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:18.273507  8435 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:03:18.370460 14710 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:18.296970 14560 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:03:18.371416  8435 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:18.290886 14458 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:18.284250 14335 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:18.283087 14697 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:18.291079  8509 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 16. Ops: []
I20260709 13:03:18.374477  8432 pending_rounds.cc:85] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 10
I20260709 13:03:18.374876  8432 pending_rounds.cc:107] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:03:18.375186  8432 raft_consensus.cc:2889] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:18.287962  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:18.347535 14713 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.378614 14713 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.365878  8503 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:03:18.276007  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 61539.8us
I20260709 13:03:18.281286 14379 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.377822 14640 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.310994 13993 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.388110 13993 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:18.388729  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 443251us
I20260709 13:03:18.175246  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:18.271448  8430 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:18.390476 14608 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:18.390727 13845 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:18.392707 14589 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:18.394121 14589 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:18.396876  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.399168 14710 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:18.401259 14710 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:18.391418 14608 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.402782 14455 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:18.296818  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:18.293047  8328 catalog_manager.cc:5697] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 4 to 6, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 6 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:18.299664  8504 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
W20260709 13:03:18.280606  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50057us
I20260709 13:03:18.365746  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:18.411171  8428 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:03:18.411098  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 235876us
I20260709 13:03:18.269490  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:18.413166  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:18.413764  8431 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.415171  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:18.417054  8435 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:18.369401  8426 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:18.392643 14698 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.254343  8577 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
W20260709 13:03:18.459863  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.405687 14544 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:18.461687  8503 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:03:18.413232 14713 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:18.463163  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:18.465653  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:18.277877 14580 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:18.462894 14614 raft_consensus.cc:3055] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:03:18.483645  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.484326  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.263442 14555 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:18.480170  8430 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:03:18.470301  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:18.460176 13845 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:18.488714  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:18.489606  9098 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:03:18.491703  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 75432.6us
I20260709 13:03:18.295508 14552 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.179s
I20260709 13:03:18.468256 14544 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:18.495694  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:18.299703 14573 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:18.500610  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:18.503413 14520 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:18.504304  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:18.477702 14557 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:18.458869  8328 catalog_manager.cc:5697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.463248 14631 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:03:18.481127 14614 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:18.445331 14355 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:03:18.510268 14642 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:18.509567  8431 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:18.513270  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:18.542496  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 273085us
I20260709 13:03:18.498678  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:18.474817 14490 raft_consensus.cc:2764] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:03:18.545753 14520 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:18.460903 14335 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:03:18.481510 14629 consensus_queue.cc:1059] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:03:18.547401  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:18.461256 14591 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:03:18.544014  9097 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
W20260709 13:03:18.549309  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 50763.2us
I20260709 13:03:18.522389 14557 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:18.495450 14662 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:18.554765  9068 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:18.558538  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 74869us
I20260709 13:03:18.546840 14642 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:18.566104  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.553504 14511 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:03:18.627851  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.558014 14557 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:18.637521  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69980.1us
W20260709 13:03:18.638092  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 94647.8us
W20260709 13:03:18.600054  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.572427  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:18.582629 14714 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:03:18.582974 14560 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:18.635145 14520 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.568030 14642 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:18.662737 14552 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:18.569269 14614 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.590451 14511 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:18.597805 14462 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:18.669185  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 133622us
I20260709 13:03:18.710970  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:18.663281  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 90925us
I20260709 13:03:18.712867  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:18.696422  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:18.696791  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:18.697468  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:18.700563  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:18.724308  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:18.725096  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:18.697074  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:18.729873  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:18.737517  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:18.733721  8550 leader_election.cc:336] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.734s (SENT)
W20260709 13:03:18.688720 14701 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.512s	user 0.006s	sys 0.003s
I20260709 13:03:18.679563 14614 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:18.687804 14573 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:18.740191  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:18.748700  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 147694us
I20260709 13:03:18.750198  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:18.706580 14490 raft_consensus.cc:3055] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:18.686000 14654 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.686604 14355 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:18.667981 14726 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.705229 14725 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.699204 14608 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:18.752044 14722 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:03:18.699956 14697 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:18.668591 14560 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:18.731350 14689 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.678364 14552 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:18.755815  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:18.731606 14559 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:18.736191 14591 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:18.762625  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:18.663733 14520 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.752544 14490 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:18.808830  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46301.4us
I20260709 13:03:18.809577  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:18.677811 14557 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.744613 14026 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:03:18.791533  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 57852.8us
I20260709 13:03:18.813659  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:18.793736  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 47066us
I20260709 13:03:18.667343 14727 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 13:03:18.801800  8508 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:18.765132 14629 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:18.754612 14335 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.761607 14455 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:18.754106 14462 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:18.763111 14078 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.680401 14511 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.700443 14711 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:03:18.818856  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:18.822642 14490 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.822489 14560 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.823770 14559 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.793758 14725 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.804667 14640 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:18.826362  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:18.827180  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.802871 14591 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:18.836380  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 55441.3us
I20260709 13:03:18.880044  8429 raft_consensus.cc:2410] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:03:18.895932 14520 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:18.806967 14654 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.836892 14689 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:18.906345  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:18.891397  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:18.988693  8579 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:18.804149 14355 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:18.896299 14589 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 13:03:18.875103 14379 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:03:18.819052 14697 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:18.888230 14557 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:18.875653  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:18.904832  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:19.005947  8578 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:18.924463  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:18.956768  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.829873 14026 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:18.985419  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:18.986613  8431 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:18.907889 14730 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:18.906883 14573 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:03:19.022652 14026 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:18.996992  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 187465us
I20260709 13:03:19.023473 14737 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:19.024108 14737 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.024648 14740 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.906445 14552 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.025156 14740 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.025708  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.026420  8430 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:19.030568  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:19.031204  8431 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.034725  8428 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:19.012200 13941 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:19.036114 13941 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:19.036968 13941 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.034760  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:19.039942  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.040985  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 1204) took 1141 ms. Trace:
I20260709 13:03:19.041381  8433 rpcz_store.cc:276] 0709 13:03:17.899737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.899876 (+   139us) service_pool.cc:224] Handling call
0709 13:03:19.040757 (+1140881us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b5400200154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:19.040908 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1444942720}
W20260709 13:03:19.043195 14733 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:03:18.995314  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:18.968015 14591 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:19.052827 14732 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:03:19.009356  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:19.054438 14462 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:19.054837 14462 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:19.055186  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.055667 14462 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.056577  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.056954 14462 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:19.010310 14544 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.012207 14736 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:19.014609 14580 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:19.019614  8582 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:19.057925  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.060025  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:19.068617  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44588.9us
I20260709 13:03:19.071270  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:19.072098  8579 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:19.071444  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:19.073997  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78771.8us
W20260709 13:03:19.075655  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.076172  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:18.975907 14559 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.069687  8431 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:19.079594  8578 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:19.105892  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.108040  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:19.109094  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:19.109364  8426 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:19.109809  8581 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:19.111153  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:19.112061  8578 raft_consensus.cc:2368] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15.
I20260709 13:03:19.113736  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:19.109045 14589 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:03:19.106405 14736 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.005523 14335 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.102s
I20260709 13:03:19.111047 14455 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:19.082911 14580 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.130828  8505 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:19.138353  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:19.167912  8578 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:03:19.140182  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.143039  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:19.145406  8475 leader_election.cc:400] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15.
I20260709 13:03:19.146207  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.170325  8475 leader_election.cc:403] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:03:19.145072  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.132055  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:19.172823  8510 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:03:19.171731  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:19.171748  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.164947  8434 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:19.173987  8430 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:19.175009  8581 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:19.141130  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.175292  8583 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:19.177150  8432 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:19.177179  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.178388  8578 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:19.156291  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:19.180891  8501 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:19.147965  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.119953 14544 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.184973  8429 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:03:19.185609  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53628.1us
I20260709 13:03:19.188623  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:19.120065 14741 raft_consensus.cc:2764] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:03:19.165205 13941 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:19.137077 14490 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:19.124220 13845 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:19.217911  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.123931 14355 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.220039 14355 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:19.220636 14355 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:19.125387 14654 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.139806 14697 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.143174 14559 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:19.141836 14455 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.223376  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:19.224010 14455 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:19.171432 14520 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.226763 14520 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:19.147423 14580 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:19.129372 14557 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
W20260709 13:03:19.199410  8550 leader_election.cc:336] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.776s (SENT)
I20260709 13:03:19.200110  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.118137 14711 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:19.134939 14736 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:19.197180 14629 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:19.183174 14614 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.201638  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:19.136843 14591 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.230952  8581 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:19.232574  8583 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:19.221627 14355 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:19.217181 14555 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15.
I20260709 13:03:19.249121  8434 raft_consensus.cc:2410] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:03:19.122850 14725 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.261963  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:19.263821  8581 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:19.267055 14559 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.267656 14559 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.129390 14738 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
W20260709 13:03:19.230718 14724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.006s	sys 0.007s
I20260709 13:03:19.251389  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.194993 14573 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:19.254535  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.275746  9102 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:03:19.255319  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.238863  9094 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:19.257699  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:19.239050  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.258422  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:19.245350 13845 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:19.257225 14078 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:03:19.261956  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.238721 14711 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.272220  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.250118 14726 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:19.256654 14642 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 13:03:19.260188  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:19.278198  9097 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:19.286705 14742 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:03:19.274509 14724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.006s	sys 0.007s
I20260709 13:03:19.288671  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.290060  8579 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:03:19.287972  8427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.012s	sys 0.008s
W20260709 13:03:19.294920  8427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.012s	sys 0.008s
I20260709 13:03:19.295887  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:19.295876  8575 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:19.297668  9097 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:19.305150  9102 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:19.306115  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.304165  8581 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:03:19.309125  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:19.310686  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:19.311764  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:19.313881 14697 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.314455 14697 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:19.315104  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.315228  9096 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:19.315414  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.316282  9100 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:19.316639 14697 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:19.306754  8429 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:19.319641  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:19.291174 14711 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:19.321794  9097 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:19.321683  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:19.302838 14350 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.350252  8581 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:19.350842  8583 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:19.350802  9094 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:19.364777  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 43670.8us
I20260709 13:03:19.352146  9098 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:19.308444 14608 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:03:19.303953 14642 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.404980 14642 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.322355  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:19.407697  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.323400 14654 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:19.413354  9095 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:03:19.413261  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 159521us
I20260709 13:03:19.417814  8506 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:03:19.418757  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 230214us
I20260709 13:03:19.319231 14741 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.419903  9099 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:19.421849 14747 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:03:19.422397 14350 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.423303  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:19.455039  8429 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:19.365736 14730 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.423411 14559 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:19.424575  8583 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:03:19.318039 14589 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:19.439899  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.321606 14335 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:19.282938 14573 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:19.444015  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:19.490602  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.444242  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.491227  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.491461  8505 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:19.492089  9094 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:19.349435 14726 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:03:19.497318  8434 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:19.445415  8584 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:19.448633  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.364768 14715 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:19.451530  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:19.453377  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:19.453599 14723 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.922s	user 0.003s	sys 0.000s
I20260709 13:03:19.289507 14739 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.243s
I20260709 13:03:19.350217 14698 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.339951 14511 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.123s
I20260709 13:03:19.484223 14560 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.443317 14355 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:19.528671  9098 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:19.541760  8434 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:19.543290  8434 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:19.532276  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.534777  8429 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:19.525753  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.538208  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.550477 14355 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.552502  9094 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:19.555675 14755 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:03:19.556354 14355 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.545346 14026 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.557286 14026 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.559691 14026 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.560442  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.563457  8506 raft_consensus.cc:2410] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:03:19.571647 14350 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.573769  8576 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:19.574141 14591 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:19.446895 13845 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:19.433674 14629 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.527849 14752 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
I20260709 13:03:19.548424 14560 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.584017 14560 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:19.585193 14573 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:19.586735  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.591212  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2491) took 1180 ms. Trace:
I20260709 13:03:19.591732  8502 rpcz_store.cc:276] 0709 13:03:18.410761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.410870 (+   109us) service_pool.cc:224] Handling call
0709 13:03:18.411188 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.467801 (+ 56613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.467832 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.479489 (+ 11657us) log.cc:844] Serialized 26 byte log entry
0709 13:03:18.531071 (+ 51582us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:18.531111 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.531177 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:19.439255 (+908078us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:19.590855 (+151600us) raft_consensus.cc:1685] finished
0709 13:03:19.590882 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.591143 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2044,"raft.queue_time_us":32638,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":9929,"spinlock_wait_cycles":28485376,"thread_start_us":24635,"threads_started":1,"wal-append.queue_time_us":36341}
I20260709 13:03:19.594872  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.595983  9095 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:03:19.596192  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 157218us
I20260709 13:03:19.594053  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:19.599267  9097 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:19.553795  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:19.602341  9102 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:19.537631 14078 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.605600  8430 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:19.610173  9100 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:19.611195  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 65654.1us
I20260709 13:03:19.613266  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.457407 14654 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:19.594704 14761 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.599661 14640 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.639863  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.646939  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2492) took 1190 ms. Trace:
I20260709 13:03:19.651360  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.652515  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.647475  8426 rpcz_store.cc:276] 0709 13:03:18.462015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.468581 (+  6566us) service_pool.cc:224] Handling call
0709 13:03:18.485516 (+ 16935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:19.124274 (+638758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.646652 (+522378us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54003a4154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:19.646865 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434247040}
I20260709 13:03:19.623955 14490 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.676312  8507 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:03:19.680739  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.684908  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.644001 14078 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.690007  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.691807  8426 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:19.685705  8433 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:19.639773 14608 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:03:19.700717  9100 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:19.701367  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.709808  8476 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:19.710566  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 69824.9us
I20260709 13:03:19.712806  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.713222  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.713976  8433 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:19.641156 14761 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:19.749541  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:19.690344 14350 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:03:19.697883 14555 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:03:19.698002 14078 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:19.729030 13845 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:19.752605 14455 consensus_meta.cc:287] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.000s
I20260709 13:03:19.768343  8503 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
W20260709 13:03:19.774858  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 65158us
I20260709 13:03:19.775858  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:19.779651  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.781795 14760 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:19.782401 14760 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:19.782936 14760 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:19.788585 14784 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.789263 14785 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:19.774905 13845 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.809307  9102 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:19.779127 14555 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:19.808246 14698 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.815691  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.823781  9100 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:19.799086 14785 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:19.736042 14654 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.800420 14350 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:03:19.816422 13941 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.614s	user 0.004s	sys 0.008s
I20260709 13:03:19.829782  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:19.827889  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.815683 13845 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:19.830535  9102 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:19.779558 14712 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.208s
I20260709 13:03:19.790681 14455 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.816668 14555 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:19.838320  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.840255  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:19.842307 14769 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:03:19.842476 14555 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.844040 14555 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:19.845786 14078 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:19.834097 14350 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.848762 14350 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.830906 14573 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.850718  9102 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:03:19.853798  8549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.500s (SENT) [suppressed 33 similar messages]
I20260709 13:03:19.789621 14784 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:19.865093  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 128740us
I20260709 13:03:19.825218 14698 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:19.878842 14761 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:19.862432 14573 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:19.881001 14698 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.881343 14573 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:19.882843 14455 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:19.883742  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.884328  9100 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:19.885066  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.885299  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.885694  9100 raft_consensus.cc:2393] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:19.886394  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:19.886510  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.887311  9100 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:19.887516  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.887977  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:19.888630  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.889299  9095 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:19.889475  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:19.886415  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.894099  9097 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:19.899881 14737 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:19.867311  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.868074  8579 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:03:19.870581 14770 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:03:19.875626 14379 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:19.901501  8435 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:19.902328  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.905694  8434 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:19.910972  8428 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260709 13:03:19.915625  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49814.7us
I20260709 13:03:19.926229  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.926414  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.927008  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:19.927114  8501 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:19.927666  8507 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:19.934191  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:19.937039 14350 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:19.937449 14350 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.937775 14350 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:19.942427  8475 leader_election.cc:336] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.534s (SENT)
I20260709 13:03:19.943075  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:19.946480  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:19.949091  8430 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:19.910640  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.950963  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:19.951406  9097 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:19.958457  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.959281  9100 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:19.951493  9095 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:19.988443  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:19.989308  9096 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.992681  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.993935  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:19.910706 14789 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.997363  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:19.994745  8430 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:19.914765 14379 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:19.956576 14794 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:20.009971  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.010614  8430 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:20.011555  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:20.012269  9094 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:20.015087  8430 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:20.023622  9102 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:19.997825 14752 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:19.994302 14793 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.029127  9095 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:03:20.025810  9096 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:20.006495 14794 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.038904  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:20.032208 14711 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.001s
W20260709 13:03:20.057855  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 115462us
W20260709 13:03:20.059803  8475 leader_election.cc:336] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.547s (SENT)
I20260709 13:03:20.060272  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:20.003208 14789 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:20.062660  8475 leader_election.cc:336] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.551s (SENT)
I20260709 13:03:20.065274  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:20.036594 14790 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.038820 14794 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:20.067260  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.069108  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:20.069741  9094 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:20.058187 14748 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:20.065403 14793 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:20.061502 14711 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.071089 14761 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:20.077566 14748 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.078961 14789 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.079437 14711 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.079771 14748 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:20.068027 14790 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:20.072904 14715 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.544s	user 0.015s	sys 0.000s
I20260709 13:03:20.086294  8430 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:20.087177  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.088886  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:20.059543 14752 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.093420  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:20.094658  8430 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:20.066450 13845 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.059758 14379 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:20.097066  8475 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.625s (SENT)
I20260709 13:03:20.097787  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:20.102957 14711 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:20.106308 14350 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.108398 14350 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:20.111109 14752 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:20.111718  9100 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
W20260709 13:03:20.113718 14731 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.152s	user 0.007s	sys 0.000s
I20260709 13:03:20.114221 14555 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:20.115806 14355 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.116081  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.116353 14355 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.117157 14793 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.117285 14761 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:20.117695 14793 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.118151  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 1046) took 1289 ms. Trace:
I20260709 13:03:20.118549  8584 rpcz_store.cc:276] 0709 13:03:18.828498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.828676 (+   178us) service_pool.cc:224] Handling call
0709 13:03:20.117964 (+1289288us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54002fdfd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:20.118095 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894145280}
I20260709 13:03:20.119882 14793 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:20.120831  8580 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:20.117794 14761 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.121040  8431 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:20.114890 14555 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.108121 14760 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.123747 14555 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:20.125160 14760 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.125931  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.126300  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.126665  8434 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:20.126955  8431 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:20.092643 14715 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:20.127614  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.132181  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.132946  8579 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:20.102631  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:20.133834  8430 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:20.134609  8579 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:20.136063  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:20.136148  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.136730  8505 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:20.132248  8428 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:20.139200  9096 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:20.137682  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:20.136822  8579 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:20.142977  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.143462  8579 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:20.144552  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.145596  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.146503  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:20.146709  8577 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:20.149873  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.151150 14573 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:20.151895  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.153234  8575 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:03:20.154158  8427 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:20.154505  8427 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:20.155215  8427 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.156075  8427 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.159545  8575 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:20.160300  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:20.147760 14614 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:03:20.163571 14761 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:20.163734  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:20.164390 14355 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:20.164435  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.165131 14796 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:20.165369  8433 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 11: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:20.165661  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:20.165823 14796 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:20.166271 13845 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:20.166399 14614 consensus_queue.cc:1243] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 12.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:03:20.166531 14791 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:20.147555 14748 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:20.137219 14350 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.169483 14078 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:03:20.174520 14350 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.175455 14784 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:20.144685 13941 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:03:20.168179 14706 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:20.168181  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:20.171429  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:20.179273  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:20.181941  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:20.182003  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:20.177914 14748 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:20.214232  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:20.218904 14748 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.220391 14379 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:20.225723  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.226459 14573 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:20.226531  8507 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:20.177318 14350 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.231616 14715 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:20.232111 14715 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:20.232988 14715 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.234161 14748 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.235549  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:20.237737  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:20.238431  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.239502  8505 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:20.240275  8433 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:20.238370  8502 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.242926  8507 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:20.240629  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:20.246622 14712 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:20.247032 14712 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:20.247190  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:20.247385 14790 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:20.247839 14712 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.249075 14784 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:20.252051  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:20.252615  8428 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:20.253456  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.254072  8430 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:20.256237  8427 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:03:20.256630  8427 pending_rounds.cc:85] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 11
I20260709 13:03:20.256847  8427 pending_rounds.cc:107] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:03:20.257073  8427 raft_consensus.cc:2889] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:20.249292 14712 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.265534  8433 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
W20260709 13:03:20.267434  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 96862.5us
W20260709 13:03:20.267930  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.268649 14355 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:20.268894  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.269362  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:20.269236 14355 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.245445 14706 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:03:20.273613  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 94440.1us
I20260709 13:03:20.255188 14784 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.276346  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:20.262355 14640 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.249604 14748 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:20.282905  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:20.261999 14791 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:20.280265  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:20.281666  8428 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:20.216856 14794 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.284077  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:20.273128 14790 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.287886 14761 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.289099 14555 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:20.289651 14555 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:20.290560 14555 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.291742 14740 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:20.287963 14796 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:20.292651 14796 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.292930 14796 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:20.293617  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.294246  8575 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
W20260709 13:03:20.295157 14804 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:03:20.295905  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.296730  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:20.300395 14796 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.271646 13845 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:20.280014 14760 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.276532 14697 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:20.310259 14697 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.310686 14697 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:20.279810 14715 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.282760 14784 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.320873  8502 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:20.323167  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:20.325807 14790 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:20.326393 14790 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.326480 14706 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.328253 14706 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.302772 14791 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:20.329654 14791 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.317111 13845 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.333402 13845 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.337410  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.338176  8426 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:20.339843 14794 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:20.339967 14760 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:20.341033  8582 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:20.341926 14355 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.344451  8501 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:03:20.285409 14640 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.346669  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:20.348479  8550 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:20.350733  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:20.351581  8501 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:20.352056 14379 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:20.356175  8505 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:20.352128 14811 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:20.353014 14798 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
W20260709 13:03:20.351884  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.356907 14078 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:20.353464 14785 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.366441 14544 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:20.367738 14785 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:20.357823  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.369534  8432 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:20.359221  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:20.363051 14608 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:20.365927 14806 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:03:20.349946  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:20.366727  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.373322  8426 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.373373  8576 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:20.343116 14748 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:20.377003  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:20.381037  8502 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:03:20.381409  8502 pending_rounds.cc:85] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 14
I20260709 13:03:20.381928 14761 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:20.379786 14811 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:03:20.382551 14761 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.382961 14761 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:20.383754 14787 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:20.384157 14787 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:20.334568 13941 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:03:20.386750  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:20.381626  8502 pending_rounds.cc:107] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:03:20.387733  8502 raft_consensus.cc:2889] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:20.387727  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:20.390476  8432 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:20.393214 14511 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.393735 14511 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.396708 14511 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:20.398387  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:20.385394 14614 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:20.390093 14711 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:03:20.421579  8426 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:20.387027 14748 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:20.422776  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:20.425230  8476 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:20.391628 14355 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:20.414167 14760 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:20.426268 14555 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:20.417989 14544 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:03:20.449394 14811 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:20.464357 14796 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.465385 14559 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:20.468586 14689 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:20.470476  9068 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:20.470773  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2453) took 1422 ms. Trace:
I20260709 13:03:20.471977  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:20.471156  8581 rpcz_store.cc:276] 0709 13:03:19.048332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.416817 (+368485us) service_pool.cc:224] Handling call
0709 13:03:19.417129 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:19.537926 (+120797us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:19.550699 (+ 12773us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.697458 (+146759us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:19.697509 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:19.697555 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.470569 (+773014us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000659d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:20.470613 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.470720 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20362,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":32,"raft.queue_time_us":91063,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"spinlock_wait_cycles":277294848,"thread_start_us":146426,"threads_started":1,"wal-append.queue_time_us":236121}
I20260709 13:03:20.432588 14793 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:03:20.422435 14350 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:03:20.413367 14761 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.488720  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.465770 14559 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:20.493628 14559 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.494660 14559 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:20.496292  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.497023  8584 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:20.441473 14026 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:20.498443  8581 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:20.461616 14787 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.488763 14552 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.434247 14355 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.489409  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:20.504019 14355 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.504474  9096 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:20.504434  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:20.488766  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:20.491816  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:20.505474  8575 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.498879 14026 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:20.499506 14640 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.501145  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.514259 14748 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.488061 14740 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:20.522646 14740 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.523185 14740 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.454542 14511 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.525148 14511 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.531189 14608 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:20.531797 14608 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:20.532840 14608 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.535130 14697 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.485280  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:20.539002  9095 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.456044 14555 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.547501  8506 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:20.547720  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:20.548846  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:20.549506  8578 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:20.456334 14760 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:20.555652  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:20.556360  8506 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:20.568929  8504 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:03:20.570600  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 145449us
I20260709 13:03:20.570011  9095 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:20.554960 14555 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:20.556833 14787 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:20.577975  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:20.558506 14697 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:20.587914  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.576211 14608 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:20.597077 14455 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:20.605782 14455 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.608003 14455 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.615386 14730 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.616077 14730 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.618537 14730 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.619172 13845 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:20.621146 14740 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.623040 13845 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:20.625551 14511 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:20.625665 13845 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:20.626297 13845 consensus_queue.cc:1243] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:20.627471 13845 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:20.630175 14760 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.630841 14740 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:20.582444 14711 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:20.637656  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 161225us
I20260709 13:03:20.583762 14811 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:20.645294  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:20.645871  8428 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:20.646456  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:20.649086  8506 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:20.597748 14654 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:20.651126  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:20.638880 14511 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.601068 14640 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:03:20.640656 14725 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:03:20.669512 14350 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:20.670316 14350 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.672115 14811 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.652732 14761 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:20.685016  8428 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:20.686190  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:20.689335  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:20.690975  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 104143us
I20260709 13:03:20.595841 14026 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.692664  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:20.719374  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.683146 14350 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.659055 14654 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:20.725257  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 100754us
I20260709 13:03:20.728659  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:20.729552  8579 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:03:20.677891 14555 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.715938 14817 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:20.681172 14511 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.740208  9100 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:20.742201  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:20.740574  8429 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:20.745502  8433 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:03:20.717424 14784 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.774701  8427 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:20.774920  8575 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:20.775899  8434 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:20.777820  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:20.763270  8435 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 20: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:20.742120  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.778798  8581 pending_rounds.cc:85] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 10
I20260709 13:03:20.779111  8581 pending_rounds.cc:107] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:03:20.779320  8581 raft_consensus.cc:2889] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:20.782498  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.782866  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.783565  8575 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:20.786600  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:20.741724 14761 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.783329  8434 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:20.788120  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:20.788951  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.740764 14790 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.738646 14821 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.791311  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.762496 14745 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:20.792553 14820 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:20.755620 14817 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:20.822094  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.823395  8575 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:20.824230  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:20.795467  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:20.802179  8431 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:20.800683 14824 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.811049  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.810809  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:20.812906 14825 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.814103 14822 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:20.815007 14748 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:20.802958 14557 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.844223  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2458) took 1794 ms. Trace:
I20260709 13:03:20.819645  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:20.828173  8435 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:20.824465 14821 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:20.836731  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.843482  9068 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:20.844691  8583 rpcz_store.cc:276] 0709 13:03:19.049942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.535486 (+485544us) service_pool.cc:224] Handling call
0709 13:03:19.542443 (+  6957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:19.862173 (+319730us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:19.874696 (+ 12523us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.949201 (+ 74505us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:19.991849 (+ 42648us) log.cc:844] Serialized 26 byte log entry
0709 13:03:19.991987 (+   138us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:19.992017 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.833992 (+841975us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b540009a954. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:20.834067 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.834125 (+    58us) raft_consensus.cc:1685] finished
0709 13:03:20.843982 (+  9857us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.844155 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5071,"prepare.queue_time_us":11980,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":26897,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":46411,"spinlock_wait_cycles":190149760,"thread_start_us":310880,"threads_started":2,"wal-append.queue_time_us":164270}
I20260709 13:03:20.803267 14830 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.820976 14745 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:20.870411  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50827.8us
I20260709 13:03:20.874285  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:20.874672 14748 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:20.881415  9102 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:20.875207 14833 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.876120  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:20.880717  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:20.875026 14520 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:20.879824  8435 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:20.877038 14462 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.886561 14830 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.925176 14830 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:20.925724 14830 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:20.883525 14745 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:20.884735 14560 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:20.932127 14836 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:20.933485 14759 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.512s	user 0.003s	sys 0.000s
I20260709 13:03:20.935060  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:20.936146 14823 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:03:20.938113 14817 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.842717 14631 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:03:20.929708 14544 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:20.961159  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:20.961776  8431 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:20.962062  8577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2461) took 1521 ms (client timeout 1543 ms). Trace:
W20260709 13:03:20.954634  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 228035us
W20260709 13:03:20.995522  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.962616  8577 rpcz_store.cc:269] 0709 13:03:19.440871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.527777 (+ 86906us) service_pool.cc:224] Handling call
0709 13:03:20.961826 (+1434049us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b540028c3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:20.961963 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384626048}
W20260709 13:03:21.001142  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 109253us
I20260709 13:03:21.005895  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:21.014159  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:20.875376 14827 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:03:20.885674 14557 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:20.937870 14761 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:20.914804 14724 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 13:03:21.015630 14823 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.864967 14825 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.843003 14824 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:20.930341 14462 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:21.052174  8506 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:20.887941 14833 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:21.055882  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1709) took 1804 ms. Trace:
I20260709 13:03:21.057507  8431 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:21.057670  9099 rpcz_store.cc:276] 0709 13:03:19.251640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.251813 (+   173us) service_pool.cc:224] Handling call
0709 13:03:19.262015 (+ 10202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:19.447733 (+185718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.055676 (+1607943us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b54000eae54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:21.055830 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8601344}
I20260709 13:03:20.998291 14544 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.065546  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1433) took 2564 ms. Trace:
I20260709 13:03:21.066079  9101 rpcz_store.cc:276] 0709 13:03:18.490977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.497067 (+  6090us) service_pool.cc:224] Handling call
0709 13:03:18.534235 (+ 37168us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:18.544578 (+ 10343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.544608 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:18.545219 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 13:03:19.147447 (+602228us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b18004639c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:03:19.230273 (+ 82826us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:19.524262 (+293989us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.524531 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.524603 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.932639 (+1408036us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:21.055615 (+122976us) raft_consensus.cc:1685] finished
0709 13:03:21.055636 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.055762 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4204,"prepare.queue_time_us":409042,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3677,"raft.queue_time_us":7146,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":6895,"spinlock_wait_cycles":34946176,"thread_start_us":349588,"threads_started":2,"wal-append.queue_time_us":875273}
I20260709 13:03:21.043730 14654 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.072680  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:21.084877  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:21.086692  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 200022us
I20260709 13:03:21.087709  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:21.080054 14520 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:21.068089 14555 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:21.073789 14784 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:21.108309  8431 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:21.044848 14823 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.111498  8435 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:21.117627 14520 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:21.120247 14520 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:21.090220 14654 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:21.143810  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.145212  8504 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:21.150676  8427 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:21.154055 14844 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:21.163094 14817 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:03:21.195081 14844 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.197184 14844 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.197795 14838 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.198321 14838 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.200310 14838 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.200472  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1051) took 2295 ms. Trace:
I20260709 13:03:21.200837  8580 rpcz_store.cc:276] 0709 13:03:18.904784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.040788 (+136004us) service_pool.cc:224] Handling call
0709 13:03:20.120463 (+1079675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.121211 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.200223 (+1079012us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002fdfd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:21.200351 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2482276224}
I20260709 13:03:21.201479 14824 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.123596 14748 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:03:21.110581 14843 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:21.189982  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 102396us
I20260709 13:03:21.120240 14462 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:21.212083  9067 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:21.182147 14712 consensus_meta.cc:287] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.914s	user 0.008s	sys 0.004s
I20260709 13:03:21.190570 14827 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.190186 14750 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.216895  8584 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
W20260709 13:03:21.212651 14841 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:03:21.179797 14557 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:21.215411 14843 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:21.234742 14654 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:21.230720 14736 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:21.246529  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:21.247699  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:21.235845 14511 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:21.250746  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 236687us
I20260709 13:03:21.251432 14836 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.254231  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:21.255038  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:21.232993 14827 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.259085  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.259646  8504 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:03:21.259130  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:21.259900  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:21.260303  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 148013us
I20260709 13:03:21.256868 14736 raft_consensus.cc:2764] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:03:21.262961  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:21.257205 14557 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.264117  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.266355  8506 raft_consensus.cc:2410] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:03:21.268272 14788 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.404s	user 0.004s	sys 0.000s
I20260709 13:03:21.268857 14843 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.260090 14825 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:21.270195 14557 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.270566 14557 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:21.270897 14355 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.766s	user 0.014s	sys 0.000s
I20260709 13:03:21.271302 14355 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:21.245236 14654 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.273185 14745 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.275147 14827 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:21.269264 14851 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:21.273488 14654 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:21.276077 14834 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:03:21.278687  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:21.279619 14823 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.280009  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:21.280583  8429 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.281787 14817 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:21.293624  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.294478  8506 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:21.299489  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:21.283588 14711 consensus_meta.cc:287] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.000s
I20260709 13:03:21.305685  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:21.273409 14355 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:21.262730 14752 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:21.262900 14833 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:21.309242  8398 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:21.311667  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.316460  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.318184  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:21.291342 14817 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:21.316829  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:21.320358  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:21.321482 14855 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:21.321978 14838 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:21.322119 14511 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:21.322371  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.318573 14836 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:21.322662  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.323372 14827 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:21.323431 14573 raft_consensus.cc:3055] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:21.304459 14654 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:21.314646 14711 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.349056 14557 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.346232 14573 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:21.324111 14848 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:21.350478 14852 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:03:21.337745 14559 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.350889 14573 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.352123 14573 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.324219 14845 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:21.324891  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1725) took 1732 ms. Trace:
I20260709 13:03:21.314978 14752 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:21.319664  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:21.338855  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.337472 14817 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:21.340010  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.358929  9101 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:21.340377  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.341712  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.342890  8508 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:21.359735  9096 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:21.355978 14752 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.343613  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:21.362118  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.362301  9097 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:21.362941 14853 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:21.363919 14849 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.205s	user 0.001s	sys 0.002s
I20260709 13:03:21.343868  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.345889  8503 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:21.346935  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.348860  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.352834  8505 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.352736  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.342779 14855 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.346578 14833 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.355610  9098 rpcz_store.cc:276] 0709 13:03:19.592690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.592803 (+   113us) service_pool.cc:224] Handling call
0709 13:03:19.593117 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:19.593342 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:21.202826 (+1609484us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b1800455800. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf
0709 13:03:21.203007 (+   181us) log.cc:844] Serialized 14 byte log entry
0709 13:03:21.323865 (+120858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:21.323922 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:21.323967 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.324717 (+   750us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.324839 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16989,"prepare.queue_time_us":112988,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":2127,"raft.queue_time_us":17216,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":3297536,"thread_start_us":219210,"threads_started":2,"wal-append.queue_time_us":139861}
I20260709 13:03:21.323418 14591 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:03:21.381731  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.386579  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.369710  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.370190  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:21.389413  9100 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.370584 14511 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:21.366885  8501 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:21.371263 14557 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.373602  9094 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 22: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:21.369131  9099 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:21.375921  8429 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:21.388170  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.353477 14836 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.371845 14844 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.366487 14845 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.398748  8505 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:21.426334  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.434708  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:21.375900 14855 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.423611  9093 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:21.423540  9101 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:21.444331  9097 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:21.444430  8427 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:21.426245  8501 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:21.423655  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.445693  9098 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:21.403591 14689 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.401206 14511 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.431406  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.447093 14740 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:03:21.450441 14860 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.060s	user 0.000s	sys 0.004s
I20260709 13:03:21.455240  9093 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:21.455410 14520 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:21.390646 14833 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.458225  8475 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:21.425904  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:21.467289 14745 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:21.478634  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.485695 14379 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:21.486392  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.486554  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:21.487995  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.390326 14726 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 13:03:21.509075  9101 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:21.491865  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:21.494176  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:21.510594  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.510942 14740 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:03:21.501708  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 75860us
I20260709 13:03:21.499526  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.511242  9094 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:21.513501  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:21.506719  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:21.516336  8435 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:03:21.516631  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:21.494488 14511 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.522693  9093 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:21.519666  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:21.523917  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.510056  8501 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.524566  9099 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:21.529299  8433 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:03:21.501188 14026 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.446439 14844 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.522315 14853 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:21.512117 14793 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:21.508678 14462 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.561019  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:21.535185 14848 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:21.530570 14726 consensus_queue.cc:1243] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:03:21.498816 14689 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.569550  9094 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:21.508443 14379 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:21.524174 14724 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:21.574594  9101 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:21.584686  8501 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
W20260709 13:03:21.591956  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 133780us
I20260709 13:03:21.594488  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:21.565062 14853 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.597447  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:21.598486  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:21.599949  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.605060  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.522575 14745 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:03:21.609028  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:21.609354  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.610473  8508 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:21.610837  9101 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:21.586809 14848 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.635262  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:21.637948  8502 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:21.592010 14724 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.563845 14026 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.645069  9101 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:03:21.604322 14853 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.648398  9101 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:21.657054  9094 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:21.638458 14848 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.662703  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:21.587190 14462 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:21.675726  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78350.4us
I20260709 13:03:21.644143 14724 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.653213 14355 raft_consensus.cc:2764] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:21.683422 14520 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:21.677418 14871 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:21.685549 14711 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:21.698673 14836 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:21.689110 14026 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.700721 14844 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.701297 14871 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.703680 14871 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.706316 14752 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:21.706756 14866 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:21.687415 14793 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:21.711073  9100 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:21.711429  8508 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:21.714440  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.714313 14793 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:21.715543  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.720005  9094 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:21.673610 14855 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.678134 14379 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.707736 14711 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:21.731026  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1300) took 1080 ms. Trace:
I20260709 13:03:21.730829  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:21.731475  8505 rpcz_store.cc:276] 0709 13:03:20.650752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.650890 (+   138us) service_pool.cc:224] Handling call
0709 13:03:21.730872 (+1079982us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540008f2d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:21.730972 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612314368}
I20260709 13:03:21.732523  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:21.733008 13845 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.733944  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:21.770347 14874 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:21.771029 14874 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:21.771523 14874 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.774370 14761 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:21.775801  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:21.776244 14869 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:03:21.777098 14833 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.705811 14817 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:21.798780  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:21.730222 14711 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:21.821085  8506 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:03:21.822124 14853 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.824246 14853 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.827450 14817 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:21.828282 14761 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:03:21.830665 14864 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:03:21.832506 14871 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:03:21.815147 14379 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.839697 14689 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.841001 14752 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:21.817567 14793 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:21.817984 14876 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:21.842506 14462 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.854106 14544 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.866298 14730 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:21.866734 14730 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:21.867477 14730 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.870342  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1234) took 1116 ms. Trace:
I20260709 13:03:21.870736  8430 rpcz_store.cc:276] 0709 13:03:20.753534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.753641 (+   107us) service_pool.cc:224] Handling call
0709 13:03:21.278806 (+525165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.278980 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:21.279010 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:21.279051 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:21.279081 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.279130 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.870161 (+591031us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54003f1950. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:21.870284 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207041792}
I20260709 13:03:21.876364 14874 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.881143  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:21.896780 14855 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.898352 13845 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:21.901203  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1449) took 1037 ms. Trace:
I20260709 13:03:21.901657  9095 rpcz_store.cc:276] 0709 13:03:20.863725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.863873 (+   148us) service_pool.cc:224] Handling call
0709 13:03:20.864294 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:21.073194 (+208900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:21.073225 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:21.073718 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:03:21.252521 (+178803us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:21.252559 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.900853 (+648294us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b54005014d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:21.900900 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.900940 (+    40us) raft_consensus.cc:1685] finished
0709 13:03:21.900952 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.901151 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8618,"raft.queue_time_us":45301,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":57390336,"thread_start_us":278147,"threads_started":2,"wal-append.queue_time_us":202664}
I20260709 13:03:21.910404  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.915102 14823 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:21.916867  9101 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:21.918174  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:21.915561 14823 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.922609 14823 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.923187 14355 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:21.923899 14355 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:21.924988 14355 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.868566 14724 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:21.929064 14724 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:21.930052  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.930158  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.930377  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:21.938087  8505 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.933034  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:21.942497  8508 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:21.944730  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:21.945257  8508 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:21.948253  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:21.951781  8505 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:21.932912 14874 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:21.969296  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.969513  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:21.966558 14544 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:22.039783  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:21.937680 14511 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.044713  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:22.045370  9098 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:21.981408 14544 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.048693  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:22.049292  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:22.050252  9101 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:21.943801 14711 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.037374 14824 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:22.053224  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:22.058251  9101 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:22.058714  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:22.059816 14824 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:22.079041  9102 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:22.081408 14845 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:22.086514 14748 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:22.127957 14748 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:22.128919 14748 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:22.089015 14850 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.930s	user 0.013s	sys 0.000s
W20260709 13:03:22.131203 14882 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:03:22.132131  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2475) took 1354 ms. Trace:
I20260709 13:03:22.132798  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:22.132493  8578 rpcz_store.cc:276] 0709 13:03:20.777877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.778657 (+   780us) service_pool.cc:224] Handling call
0709 13:03:20.778927 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.779260 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:20.882190 (+102930us) log.cc:844] Serialized 14 byte log entry
0709 13:03:21.071002 (+188812us) log.cc:844] Serialized 14 byte log entry
0709 13:03:21.071205 (+   203us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:21.077543 (+  6338us) log.cc:844] Serialized 26 byte log entry
0709 13:03:21.077683 (+   140us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:21.079607 (+  1924us) log.cc:844] Serialized 14 byte log entry
0709 13:03:21.079839 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.080238 (+   399us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.278613 (+198375us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b1800078520. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1
0709 13:03:21.481267 (+202654us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b1800078520. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:03:21.865239 (+383972us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b1800078520. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:03:22.088389 (+223150us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:22.131926 (+ 43537us) raft_consensus.cc:1685] finished
0709 13:03:22.131947 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.132077 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10421,"prepare.queue_time_us":876754,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":2047,"raft.queue_time_us":11031,"raft.run_cpu_time_us":518,"raft.run_wall_time_us":45554,"spinlock_wait_cycles":82613504,"thread_start_us":173694,"threads_started":2,"wal-append.queue_time_us":239390}
I20260709 13:03:22.135013 14654 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:22.129921 14748 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:22.135403 14654 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.135893 14654 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.146710 14730 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:22.127589 14821 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:22.155181 14654 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.099961 14823 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.105970  9100 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:22.107781  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:22.157487  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49796us
I20260709 13:03:22.157831 14823 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:22.158406  9065 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:22.108812  8505 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:22.085644  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:22.160169  9098 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:22.160512  9101 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.163566  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:22.164377  8505 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.166541 13845 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:22.168794  8433 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:22.169507 13845 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:22.111042 14511 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:22.114224 14544 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:22.182806  8427 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:22.114835  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:22.116293 14711 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:22.116921 14725 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.117343  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:22.117811 14824 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.126252 14883 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:22.126612  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.071789 14355 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:22.112340 14848 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.177099  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:22.179774  8505 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:22.191486  9101 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:22.199302  8504 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:22.160410  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:22.213147  8432 raft_consensus.cc:2368] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15.
I20260709 13:03:22.186110 14748 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:22.216341  8476 leader_election.cc:400] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15.
I20260709 13:03:22.202512  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.205343 14725 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.218199  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:22.210577  8433 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:22.219624  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:22.215492  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:22.218780 14725 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:22.221061 14455 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:22.221560 14455 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:22.206704 14544 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.222442 14455 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.222473 14544 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.225149 14544 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:22.211679 14355 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.207126 14026 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:03:22.227571 14355 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:22.219014 14689 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:22.219156 14823 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:22.229089 14823 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.229513 14823 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.182065 14845 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:22.230315 14845 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:22.230827  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:22.231415  8504 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:22.212352  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:22.235297  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:22.236218  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:22.239490  9102 raft_consensus.cc:2368] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14.
I20260709 13:03:22.240483  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:22.233009 14520 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:03:22.231196 14845 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.243568 14544 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:22.243664 14855 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:22.245478 14748 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:22.262091  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.214316 14883 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.265652  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.263020  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:22.266736  8503 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:22.250041 14853 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:22.275620  8435 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:22.272559 14853 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.274363 14843 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:22.256647 14830 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:03:22.274391 14640 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:22.274221 14544 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:22.271236 14855 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.289744  8400 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:22.292253  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:22.293087  8430 raft_consensus.cc:2368] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12.
I20260709 13:03:22.294306  8476 leader_election.cc:400] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12.
I20260709 13:03:22.294608  8476 leader_election.cc:403] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:03:22.283986 14853 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:22.278182 14557 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:03:22.300035  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:22.300697  9101 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:22.297425 14748 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.287844 14654 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:22.280471 14760 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:03:22.314289 14589 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.300062 14724 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:22.323164 14544 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.316445 14640 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:22.295032 14833 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:03:22.357931  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:22.357182  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:22.358376  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:22.359203  8504 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.359777  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:22.360065  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:22.360935  8428 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:22.364670  8428 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:22.350302 14640 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:22.322662 14589 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.420683  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:22.353701 14724 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:22.419592 14892 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:03:22.451860  8434 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:03:22.427719 14894 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:03:22.486589 14887 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:03:22.488215  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2520) took 1904 ms. Trace:
W20260709 13:03:22.486589 14893 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:03:22.494159 14883 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:22.488638  8426 rpcz_store.cc:276] 0709 13:03:20.583888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.584038 (+   150us) service_pool.cc:224] Handling call
0709 13:03:20.584413 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.593640 (+  9227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.593685 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.594277 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.078684 (+1484407us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b1800439360. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:03:22.243134 (+164450us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:22.243167 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.243232 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:22.487872 (+244640us) raft_consensus.cc:1685] finished
0709 13:03:22.487907 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.488148 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15054,"raft.queue_time_us":10224,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6466,"spinlock_wait_cycles":50230912,"thread_start_us":164284,"threads_started":1,"wal-append.queue_time_us":1660702}
I20260709 13:03:22.495958 14589 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:22.497135 14895 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:03:22.474754 14848 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:22.503334 14897 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:03:22.505832 14724 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.536474  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:22.542744  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:22.543648  8433 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 12.
I20260709 13:03:22.545431  8503 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:03:22.551023  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:22.548518 14355 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 11. Current term is 12.
I20260709 13:03:22.545315 14823 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:22.587375  8475 leader_election.cc:336] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 2.082s (SENT)
I20260709 13:03:22.588109  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.605948  8504 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:22.608247  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:22.609236  8435 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:22.611730  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.612728  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.612867  8475 leader_election.cc:336] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 1.543s (SENT)
W20260709 13:03:22.613596  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.614454  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:22.614912  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.560258 14823 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:22.616828  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:22.641537  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:22.642588  8578 raft_consensus.cc:2410] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:03:22.643252  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:22.643504  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:22.644061  8575 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:22.644654  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:22.645287  8575 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:22.678766  8575 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:03:22.680751  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:22.687391  8583 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:03:22.606262 14711 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.688982  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:22.690259  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:22.691040  8580 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:22.693589  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:22.694410  8584 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:22.698418  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:22.699247  9097 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.702642  8578 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 11.
I20260709 13:03:22.704958  8576 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:03:22.705910  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:22.718622  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:22.719399  9100 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:22.720079 14898 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:03:22.720293 14557 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:22.720714 14557 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:22.721071 14557 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:22.630888 14715 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:22.631242 14784 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:22.724933  8575 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 13.
I20260709 13:03:22.646926 14818 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.665727 14078 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.751848  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:22.666114 13941 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.752792  8435 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:22.756286  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:22.759122  8575 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
W20260709 13:03:22.753540  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 136766us
I20260709 13:03:22.761570  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:22.766337  8583 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:22.682543 14552 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:22.753916  8549 connection.cc:256] RPC call timeout handler was delayed by -1.1545783550001261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
I20260709 13:03:22.755725 14715 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.787685 14715 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:22.788864 14855 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:22.790231  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.791482  8575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "337d7e57df5f492daf49939f167561a0"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:03:22.792092  8575 raft_consensus.cc:606] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.792412  8575 raft_consensus.cc:614] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:22.762611 14791 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:22.770490 13941 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.766150 14748 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:22.765527 14078 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.796180 13941 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:22.796936 14078 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:22.771034 14837 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:03:22.802182 14573 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:22.755710 14785 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:22.803453  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:22.803745  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:22.804369 14821 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:22.770768 14350 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.782737 14379 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:22.806150  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:22.806367 14350 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.806565 14379 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:22.807471 14899 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:03:22.808698 14379 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:22.805400  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:22.807366  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:22.771970 14848 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:22.794401 14791 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:22.802691 14573 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.812618 14614 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.815374 14726 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:22.815577 14711 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:22.819018  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:22.820274 14640 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.821058 14715 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.821760 14078 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:22.808565 14350 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:22.764549 14818 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.820225  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:22.830390  9097 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:22.803421 14785 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.836176  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:22.838732  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:22.845988  9100 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:22.762560 14784 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.809777 14855 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:22.831370 14725 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.838716 14791 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:22.776539 14552 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.845479 14614 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.867888 14715 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:22.841774 14726 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:22.909173  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 89031.2us
I20260709 13:03:22.913161  8577 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:03:22.918345  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 216522us
I20260709 13:03:22.920568  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:22.910168  8428 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:22.926729  8475 leader_election.cc:400] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14.
I20260709 13:03:22.927047  8475 leader_election.cc:403] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:22.927886  8549 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:22.930256  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.872881 14855 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:22.931547  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.943562  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.948468  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.949832  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:22.929862 14711 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 13. Current term is 14.
I20260709 13:03:22.932823 14811 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:22.932605 14379 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:22.930377 14640 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:22.963923 14026 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:22.967622  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:22.982385 14026 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:22.982820 14026 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:22.983191 14026 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:22.972615  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 195273us
I20260709 13:03:22.908715 14725 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.932636 14589 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:22.940665 14631 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:23.002339 14631 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.005100 14631 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:22.950906 14712 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:23.010715 14907 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:03:23.011642 14712 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:23.012626 14906 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:23.012722 14712 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:23.013687 14712 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.979647 14379 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.018791 14379 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:23.019574 14725 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:23.023029 14784 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:23.025851 14557 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:23.028513 14909 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:03:23.028558 14557 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.029672 14904 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:03:23.033631 14573 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:23.018330 14712 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.036149  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.037344  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.038457  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:23.039144  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.038378 14712 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.040535 14614 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.041363  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.042479 14715 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.043779 14785 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:22.980698 14853 consensus_meta.cc:287] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.000s
I20260709 13:03:23.044505 14853 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:23.046365 14853 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:22.980131 14726 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.047727 14726 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:22.975730 14811 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:23.050365 14811 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.051290  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.052033  8426 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:23.053388  8434 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:22.962993 14355 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:23.054347 14355 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:23.054775 14355 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.013906 14855 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:22.974891 14555 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:03:22.943364 14511 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:23.060792 14511 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.062789 14511 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:23.015681 14552 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:23.065375  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.066483  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.039238  8432 raft_consensus.cc:2368] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:03:23.070254  8429 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:23.077082  8577 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:22.985894  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:23.083120  8576 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:03:23.111014  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 161239us
I20260709 13:03:23.085875 14026 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.128683 14026 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:23.128948  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 143109us
I20260709 13:03:23.130568  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:23.133396  9093 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:23.138377  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.139212  8576 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:03:23.140870 14026 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:23.145857  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:23.146843 14791 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.148460  8575 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:23.164274  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:23.164515  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:23.189419  9098 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:23.189879  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.154277 14852 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:23.161468 14848 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:23.160539 14917 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.213191  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:23.168195 14589 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:23.209877  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.200320 14852 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:23.210311  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.210628  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.218199  9099 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:23.219862  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.195291 14614 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:23.213291  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.208951  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.220556  8581 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:23.165664 14821 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:23.221319  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.221825  9096 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
W20260709 13:03:23.227133  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.211725  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.228523  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:23.211757 14791 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.219854 14852 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.236202  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:23.239388  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:23.242825  8508 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:23.240327  8580 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:23.240588  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:23.241382  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:23.244424  8507 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:23.243884  8510 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:23.231597 14837 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.233047 14614 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:23.254747  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.258462  8581 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:23.241935 14078 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:23.220088 14589 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.271785  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:23.273469  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:23.303692  8433 raft_consensus.cc:2410] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 17 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 13:03:23.305107 14811 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.217157 14917 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.312093  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:23.275625  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:23.332590  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 247438us
I20260709 13:03:23.274704  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:23.283207  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:23.249910 14748 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.298341  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:23.229277 14821 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.334522  8476 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:23.335484  8575 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.289885 14573 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.290200 14078 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.290143 14919 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.335333  8509 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:23.346889  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:23.348237  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:23.353691  8503 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:23.354620  8550 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:23.337487  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:23.349787 14931 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:23.345319  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 71067.6us
W20260709 13:03:23.335500  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 248412us
I20260709 13:03:23.334726  8510 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:23.370013  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.370710  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:23.372028  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:23.373319  8503 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
W20260709 13:03:23.376044  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 235654us
I20260709 13:03:23.395066  8575 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:23.260769 14837 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.397286  8502 raft_consensus.cc:3055] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:23.401477  8502 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:23.398972  8506 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:23.399137  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:23.343513 14712 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:23.346239 14350 raft_consensus.cc:2764] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:03:23.352761 14078 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:23.407755 14520 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:23.409282 14837 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:23.410439 14712 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:23.381989 14931 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.410529 14715 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:23.393625 14640 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:23.411329 14589 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.412381  8502 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.414217 14811 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.418874  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:23.346725 14929 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:23.425745  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.425999  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.430572  8506 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:23.458539  8578 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:23.458570  8581 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:23.430972 14712 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.476539  9098 raft_consensus.cc:2368] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14.
I20260709 13:03:23.422252 14520 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.432566 14355 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.492249  8504 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:23.492695 14821 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:23.430925 14724 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:23.495282  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.495922  8580 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:23.496748  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:23.441450 14918 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.298s	user 0.004s	sys 0.000s
I20260709 13:03:23.449573  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.498473  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:23.499083  8576 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.366856 14919 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.399387 14853 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:23.347196 14748 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.502581 14853 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:23.503984 14748 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
W20260709 13:03:23.504993 14927 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:03:23.423575 14830 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:23.497774  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:23.506178 14922 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:23.506388 14830 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:23.506845 14830 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:23.422868 13941 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:23.511336  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:23.478856  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.512902  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.500546  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:23.511843 14920 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.278s	user 0.000s	sys 0.000s
I20260709 13:03:23.514904  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.516963  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.514079  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:23.359320 14573 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.456734 14640 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:23.521019 14640 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.478044 14876 consensus_queue.cc:1059] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:03:23.523417 14876 consensus_queue.cc:1243] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:23.525352 14931 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:23.526201  8583 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:23.517532  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:23.527518  8575 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:23.517514  8584 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:23.529407  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.522826  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.529981  8584 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 11.
I20260709 13:03:23.530794  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.531687  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:23.532096  8584 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.532651  8576 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:23.533931  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:23.534639  8576 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.536751  9095 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:23.427682 14848 raft_consensus.cc:697] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:23.551461  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:23.581586  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 182534us
I20260709 13:03:23.582587  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:23.583853  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 239577us
I20260709 13:03:23.601554  8427 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:23.608350  8429 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:23.624347  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.626796  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.643644  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.678822  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.679042  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.679629  8582 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:23.496873 14355 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.489717 14760 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.480469 14712 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.549338 14917 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.682767  8581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:03:23.802469  8581 raft_consensus.cc:606] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:23.715464  8584 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
I20260709 13:03:23.803089  8581 raft_consensus.cc:614] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:23.747502  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 49511.3us
I20260709 13:03:23.806071  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:23.529299 14520 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:23.812633  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 458023us
W20260709 13:03:23.695478  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 332647us
I20260709 13:03:23.814147  8583 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:23.813704  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:23.721400  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 343254us
I20260709 13:03:23.692894  8575 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
W20260709 13:03:23.820272  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 397510us
I20260709 13:03:23.459520 14614 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.822397  8576 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:23.823510  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:23.814913  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 171714us
I20260709 13:03:23.549682 14589 consensus_queue.cc:1059] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.277s
I20260709 13:03:23.680483 14855 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:23.830900 14379 consensus_meta.cc:287] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.807s	user 0.008s	sys 0.003s
I20260709 13:03:23.835646  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2768) took 1019 ms. Trace:
I20260709 13:03:23.877775  8549 leader_election.cc:400] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14.
I20260709 13:03:23.719703 14711 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:23.878265  8501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:03:23.879477  8549 leader_election.cc:403] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:23.877183  8577 rpcz_store.cc:276] 0709 13:03:22.816379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.700480 (+884101us) service_pool.cc:224] Handling call
0709 13:03:23.835033 (+134553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:23.835254 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:23.835290 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:23.835341 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:23.835385 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.835448 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.835583 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:23.879694 14711 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.850059  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2775) took 1011 ms. Trace:
W20260709 13:03:23.851864  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 454611us
I20260709 13:03:23.880883  8578 rpcz_store.cc:276] 0709 13:03:22.842232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.848751 (+1006519us) service_pool.cc:224] Handling call
0709 13:03:23.849431 (+   680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:23.849642 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:23.849677 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:23.849731 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:23.849775 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.849842 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.849966 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:23.855988 14873 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.005s	sys 0.015s
W20260709 13:03:23.882066 14873 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.006s	sys 0.017s
I20260709 13:03:23.776422 14934 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.879122  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2776) took 1035 ms. Trace:
W20260709 13:03:23.884047  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 70445.7us
I20260709 13:03:23.890364  8576 rpcz_store.cc:276] 0709 13:03:22.846689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.533674 (+686985us) service_pool.cc:224] Handling call
0709 13:03:23.879064 (+345390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:23.884856  8582 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:23.831717  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1477) took 1136 ms. Trace:
I20260709 13:03:23.895965  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2774) took 1078 ms. Trace:
I20260709 13:03:23.887599  8581 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:23.888752  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.899008  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.898749  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:23.883303 14811 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14.
I20260709 13:03:23.823525 14760 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.901013  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.901647  9095 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:23.893563 14784 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:23.902792 14711 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.903818  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:23.904403  8435 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:23.904019 14078 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.905331 14919 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.905722  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:23.906620  8429 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:23.907823 14932 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
W20260709 13:03:23.909276 14923 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:03:23.899475  9065 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:23.894655  8550 leader_election.cc:400] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:03:23.911360  8550 leader_election.cc:403] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:23.845839  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 440728us
I20260709 13:03:23.896472  8582 rpcz_store.cc:276] 0709 13:03:22.817989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.846678 (+1028689us) service_pool.cc:224] Handling call
0709 13:03:23.884472 (+ 37794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:23.895419 (+ 10947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.895909 (+   490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:23.910533  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:23.895363  9101 rpcz_store.cc:276] 0709 13:03:22.695231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.695465 (+   234us) service_pool.cc:224] Handling call
0709 13:03:22.695723 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.695916 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:22.717945 (+ 22029us) log.cc:844] Serialized 14 byte log entry
0709 13:03:23.436698 (+718753us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b180039a120. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:03:23.831215 (+394517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:23.831295 (+    80us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:23.831359 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.831473 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.831645 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9447,"prepare.queue_time_us":51471,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":89513,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":2710,"spinlock_wait_cycles":32402304,"thread_start_us":513668,"threads_started":2,"wal-append.queue_time_us":268618}
I20260709 13:03:23.930145  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:23.914153  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 90696.2us
I20260709 13:03:23.931013  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:23.931366 14026 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.931979 14026 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.932401  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:23.933347  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.934978  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.915179  8581 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:23.935990  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:23.936709  9095 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:23.934003  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:23.938437  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:23.934043  9101 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:23.931998  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:23.925876  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:23.946481  8582 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:03:23.946188 14026 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:23.947185 14026 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:23.915958  9065 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:23.916992  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:23.912988 14853 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:23.934758 14904 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.012s	sys 0.004s
I20260709 13:03:23.932574 14945 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:23.966032 14026 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:23.877035 14379 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.945909 14726 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:23.971649  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.098665  8503 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:23.920495 14784 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:23.915630 14919 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
W20260709 13:03:24.110795  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 172407us
I20260709 13:03:23.912598 14934 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.960664 14715 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:24.098819 14026 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:23.934566 14355 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:23.920329 14944 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:24.135510  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 201586us
I20260709 13:03:24.153496  8501 raft_consensus.cc:606] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Received request to transfer leadership to TS dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:24.145429  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:23.968116 14904 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.013s	sys 0.005s
I20260709 13:03:23.963867 14785 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:23.971529 14945 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:23.963416 14824 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.192s
I20260709 13:03:24.087926 14853 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:24.153191  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:23.959950 14511 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:24.086208 14078 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.176847  8580 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:24.099012 14874 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.960888 14936 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.228s
I20260709 13:03:23.962985 14924 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.190s
W20260709 13:03:24.225359  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.888808 14848 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.111323 14760 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:24.159785 14852 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.904s	user 0.010s	sys 0.009s
I20260709 13:03:23.950031 14640 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.152230 14355 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.972347 14931 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.201s
I20260709 13:03:24.162153 14944 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.096225 14845 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
W20260709 13:03:24.231855  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 78738.3us
I20260709 13:03:24.217465 14951 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.203186 14945 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:24.194608 14919 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:24.194628 14873 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.201833 14948 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:24.245352  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 89488us
W20260709 13:03:24.249356  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 133190us
I20260709 13:03:24.175340 14785 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.249732  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:24.208767 14511 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:24.224242 14917 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:24.236828 14925 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:24.258383 14573 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.236725 14853 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:24.245878 14355 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:24.244450 14557 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:24.227195 14874 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:24.292222 14947 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:03:24.279620 14873 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.295718 14940 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:24.248953 14944 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.275303 14958 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:24.278036 14931 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:24.286577 14785 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:24.292263 14963 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:03:24.353904 14824 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:24.286444 14511 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:24.246172 14852 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.341635 14931 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:24.359282  9093 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:24.359165 14931 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.360018 14852 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:24.360419 14931 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.275504 14919 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:24.297123 14925 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.363554 14925 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.336858  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:24.351048 14942 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:03:24.353061 14978 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:24.335016 14830 consensus_meta.cc:287] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.001s
I20260709 13:03:24.353632 14725 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:24.335485 14940 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:24.298611 14937 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
W20260709 13:03:24.349439 14965 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
I20260709 13:03:24.298645 14726 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:24.404259  8430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.001s	sys 0.005s
W20260709 13:03:24.404975  8430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.002s	sys 0.005s
I20260709 13:03:24.392881 14957 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:24.408404 14957 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.411473 14957 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:24.384212 14852 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:24.413086 14852 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.413305 14944 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.414884 14855 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:24.415299 14852 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:24.415380 14855 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.402864 14725 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.415865 14853 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.417382 14725 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.419036 14640 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.258610 14951 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:24.423497  8509 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:24.418530 14725 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.424422 14951 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:24.424664 14725 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.426998 14725 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:24.427912 14724 consensus_meta.cc:287] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.934s	user 0.007s	sys 0.003s
I20260709 13:03:24.428750 14724 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:24.367569 14837 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.429697 14837 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.432484 14837 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:24.342855 14985 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:24.433830 14985 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.434221 14985 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:24.403805 14978 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:24.438131 14978 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:24.441457  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2497) took 1409 ms. Trace:
I20260709 13:03:24.441932  8575 rpcz_store.cc:276] 0709 13:03:23.031910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.884230 (+852320us) service_pool.cc:224] Handling call
0709 13:03:23.884855 (+   625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:23.908068 (+ 23213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:23.908199 (+   131us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:23.908663 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:03:24.215456 (+306793us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:24.215663 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.215785 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:24.441199 (+225414us) raft_consensus.cc:1685] finished
0709 13:03:24.441223 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.441385 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13199,"raft.queue_time_us":14617,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":306240,"threads_started":1,"wal-append.queue_time_us":516282}
I20260709 13:03:24.444067  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:24.444734  8575 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:24.445617  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:24.455487  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2553) took 1409 ms. Trace:
I20260709 13:03:24.399904 14830 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.456986 14940 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.458640 14919 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:24.467037  8575 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:24.468247  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:24.285965 14948 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:24.470047  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:24.465040  8431 rpcz_store.cc:276] 0709 13:03:23.046426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.048175 (+  1749us) service_pool.cc:224] Handling call
0709 13:03:23.068068 (+ 19893us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:23.068387 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:23.068418 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:23.068828 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:03:23.398249 (+329421us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:23.398291 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:23.398361 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:24.454095 (+1055734us) raft_consensus.cc:1685] finished
0709 13:03:24.454124 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.455180 (+  1056us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b540026ff50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:24.455418 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":963,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6649,"spinlock_wait_cycles":44797696,"thread_start_us":329004,"threads_started":1,"wal-append.queue_time_us":900367}
I20260709 13:03:24.484627  8432 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:24.485813 14830 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.487429  8325 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 12 to 15, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 15 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:24.488209 14511 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.489207  8325 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 11 to 14, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 14 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:24.494377 14940 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.493860  8325 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:24.480826  8575 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:24.511224  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1073) took 1246 ms. Trace:
I20260709 13:03:24.511726  8575 rpcz_store.cc:276] 0709 13:03:23.264361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.510308 (+1245947us) service_pool.cc:224] Handling call
0709 13:03:24.510694 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.510878 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.510901 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:24.510945 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:24.510975 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.511037 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.511162 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:24.518860 14379 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.519542 14944 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:24.521627 14712 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.001s
I20260709 13:03:24.522599 14785 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.545909 14934 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.555717 14990 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:24.506014 14557 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.556702 14785 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.556289 14990 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.559036 14990 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.562951 14948 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:24.560199 14818 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.517874 14945 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.564493  9098 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:24.565608 14945 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:24.570880 14874 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.561005 14557 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.574553 14985 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:24.575604 14925 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:24.577569 14520 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.000s
I20260709 13:03:24.578079 14520 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:24.578181 14726 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.580358 14520 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:24.528744 14712 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.586937  8576 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:24.587323 14511 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:24.588068 14925 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:24.588155  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1065) took 1326 ms. Trace:
I20260709 13:03:24.588783  8576 rpcz_store.cc:276] 0709 13:03:23.261341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.897646 (+636305us) service_pool.cc:224] Handling call
0709 13:03:23.897906 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.587336 (+689430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.587888 (+   552us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400066dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:24.588100 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584180480}
I20260709 13:03:24.622325 14855 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.625262 14855 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.630134 14948 raft_consensus.cc:993] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: : Instructing follower dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:03:24.630861 14711 raft_consensus.cc:1081] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Signalling peer dacb523538a14c7cb335ab9c18f4111b to start an election
I20260709 13:03:24.631817  8509 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:24.632884  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.634161  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.634567  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.635106  8510 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:24.635205  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.635744  8506 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:24.635926  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:24.636638  8510 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:24.636536  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:24.637068  8506 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.637677  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.638348  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.638777  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.639364  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.640033  8505 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:24.640755  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.641341  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:24.642330  8507 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:24.643805 13941 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:24.643968  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:24.645017 13941 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:24.645496 13941 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:24.645844  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:24.646837 14350 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:24.647306  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:24.647614 14350 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:24.648226 14919 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:24.648706 14919 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.646519 13941 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:24.649104 14919 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.649962 13941 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:24.667043  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:24.668241 14379 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:24.671526  8547 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:24.672501 14379 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:24.675434  8547 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:24.682344  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.682456  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.684043  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:24.684970  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:24.686311  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:24.687042  8433 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:24.689257  8430 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:24.691468  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:24.695639  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2498) took 1616 ms. Trace:
I20260709 13:03:24.614465 14925 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:24.693439 14026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.011s	sys 0.022s
I20260709 13:03:24.703620  8433 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
W20260709 13:03:24.711064 14026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.011s	sys 0.022s
I20260709 13:03:24.715422  8506 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:24.696125  8577 rpcz_store.cc:276] 0709 13:03:23.079607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.102596 (+1022989us) service_pool.cc:224] Handling call
0709 13:03:24.153013 (+ 50417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.153326 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.153355 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.176241 (+ 22886us) log.cc:844] Serialized 26 byte log entry
0709 13:03:24.526844 (+350603us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:24.694043 (+167199us) log.cc:844] Serialized 14 byte log entry
0709 13:03:24.695242 (+  1199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.695336 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:24.695393 (+    57us) raft_consensus.cc:1685] finished
0709 13:03:24.695410 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.695559 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39839,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":126443,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11887,"thread_start_us":427996,"threads_started":2,"wal-append.queue_time_us":266301}
I20260709 13:03:24.718226  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 1067) took 1456 ms. Trace:
I20260709 13:03:24.718837  8583 rpcz_store.cc:276] 0709 13:03:23.261937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.511104 (+249167us) service_pool.cc:224] Handling call
0709 13:03:24.718004 (+1206900us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5400116cd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:24.718153 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32749440}
I20260709 13:03:24.728802  8547 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:24.732383  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:24.733244  8433 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:24.694968 14784 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:24.710621 14379 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:24.677259 14919 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.754846  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:24.770270  8577 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:03:24.772902  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1077) took 1507 ms. Trace:
I20260709 13:03:24.773343  8577 rpcz_store.cc:276] 0709 13:03:23.265559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.731715 (+1466156us) service_pool.cc:224] Handling call
0709 13:03:24.769940 (+ 38225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.772563 (+  2623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.772833 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:24.776295  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:24.775926  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 484369us
I20260709 13:03:24.719040 14985 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:24.779349  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:24.780180  8430 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 21: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:24.782044  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:24.774952 14982 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:24.793620  8577 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:03:24.798529 14956 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:03:24.803717 14919 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.804376  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:24.852000 14026 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:24.852291  8506 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.852612 14026 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:24.804797 14976 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:03:24.769438 14916 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.810672 14988 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:24.811667  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:24.814427  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:24.817423  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1072) took 1554 ms. Trace:
I20260709 13:03:24.713201 14350 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:03:24.862983  8582 rpcz_store.cc:276] 0709 13:03:23.264060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.947269 (+683209us) service_pool.cc:224] Handling call
0709 13:03:23.947586 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:23.957442 (+  9856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:23.957490 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:23.967519 (+ 10029us) log.cc:844] Serialized 52 byte log entry
0709 13:03:24.594267 (+626748us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:24.613054 (+ 18787us) log.cc:844] Serialized 14 byte log entry
0709 13:03:24.627990 (+ 14936us) log.cc:844] Serialized 14 byte log entry
0709 13:03:24.628251 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.628324 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:24.817200 (+188876us) raft_consensus.cc:1685] finished
0709 13:03:24.817223 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:24.817364 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24851,"prepare.queue_time_us":20295,"prepare.run_wall_time_us":34,"raft.queue_time_us":11964,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":76521,"spinlock_wait_cycles":136532352,"thread_start_us":474531,"threads_started":1,"wal-append.queue_time_us":614910}
I20260709 13:03:24.716828 14925 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.822444  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:24.824625  8579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.004s	sys 0.033s
I20260709 13:03:24.865921  9097 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
W20260709 13:03:24.866375  8579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.004s	sys 0.033s
I20260709 13:03:24.820298  8433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
 from {username='slave'} at 127.0.0.1:52372
I20260709 13:03:24.867055  8433 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.867452  8433 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:24.869408 14026 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:24.855357 14982 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:24.780963 14355 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:24.856958  8400 connection.cc:256] RPC call timeout handler was delayed by -1.2609552400000439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2383s for a response
W20260709 13:03:24.891054  8400 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.195:41653 timed out after 2.082s (SENT) [suppressed 11 similar messages]
W20260709 13:03:24.858705  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.895869  8506 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:24.897799  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:24.902673  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:24.907017  8504 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:24.880643 14350 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:24.866058 14916 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.907855 14919 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:24.912284 14511 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:24.911870 14350 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:24.914186 14984 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:24.867558 14988 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.919262 14784 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:24.959192 14026 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.962534 14026 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:24.973337  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60466 (request call id 26) took 1087 ms. Trace:
I20260709 13:03:24.973769  8501 rpcz_store.cc:276] 0709 13:03:23.877891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.878103 (+   212us) service_pool.cc:224] Handling call
0709 13:03:24.964611 (+1086508us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54003732d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a19339853 00007f1a1e30760a 00007f1a1788d7d4 00007f1a1788d762 00007f1a1788d691 00007f1a1788d60c 00007f1a1788c8c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:24.964727 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629526400}
I20260709 13:03:24.978685  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:24.980955 14026 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:24.991324  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.991169 14995 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.979442  8428 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:24.955785 14964 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:24.955237 14919 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:24.993997 14995 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.022912  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:25.024029 15003 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:03:25.024406  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:25.025329  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:25.028577  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1756) took 1610 ms. Trace:
I20260709 13:03:25.040232  8575 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:25.056370  8502 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:25.063620 14873 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:25.077327  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 186299us
W20260709 13:03:25.125041  8400 connection.cc:256] RPC call timeout handler was delayed by -1.1902030209998884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:03:25.092123  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.981012 14986 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:03:25.093950  9093 rpcz_store.cc:276] 0709 13:03:23.418062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.418192 (+   130us) service_pool.cc:224] Handling call
0709 13:03:23.418482 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.359696 (+941214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.028349 (+668653us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54002f0654. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:25.028516 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2163158912}
I20260709 13:03:25.129987  9102 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:25.131386  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 56873.4us
W20260709 13:03:25.134606  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.005044 15001 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 13:03:25.004339 15007 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:25.136130  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:25.138970 14725 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:25.139256 15005 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:25.141158  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:25.158746  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:25.141731 14980 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.142197 14855 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:25.144349 14995 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:25.145404 14930 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:25.147503  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:25.163715  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:24.959131 14511 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.163975  8434 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:25.150008  9096 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:24.972385 14784 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:25.128995 14917 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.174379 14511 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:25.166790 14978 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:24.899943  8433 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:25.201292  8430 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:25.187992  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.189922  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.190301  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.198761  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:25.203913  8507 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:25.204130  8510 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 21: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:25.156757 14631 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.958984 14984 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:25.167258 14990 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:25.222291  8433 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:25.200601 14978 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:25.249962 15009 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:03:25.205905 14853 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:25.249594  8582 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:25.249871 14811 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:25.208505 14873 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:25.076558 14964 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.235839 14355 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.260295  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:25.273917  8582 raft_consensus.cc:2376] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17. Re-sending same reply.
I20260709 13:03:25.275357  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.249053  8501 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:25.166721 15005 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.266386  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.179709 14855 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.225687 14990 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:25.267877  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1075) took 2002 ms. Trace:
I20260709 13:03:25.280043  8576 rpcz_store.cc:276] 0709 13:03:23.264959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.591118 (+1326159us) service_pool.cc:224] Handling call
0709 13:03:24.591471 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.591846 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.591872 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.592415 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:03:24.825028 (+232613us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:24.825079 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.825167 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:25.267581 (+442414us) raft_consensus.cc:1685] finished
0709 13:03:25.267611 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.267805 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":231000,"threads_started":1,"wal-append.queue_time_us":318514}
I20260709 13:03:25.278052  8577 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:25.252724 14978 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:25.257302 14948 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:25.293758  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:25.295077  8582 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.151865 14350 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:25.179863 14980 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.180421 14930 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:25.285522  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.300382  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.175423 14982 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.309917 14855 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.310359 14988 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.312117 14980 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:25.314204  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 66648.5us
I20260709 13:03:25.367878  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:25.316624  8434 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:25.318306  8502 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:03:25.369722  8502 pending_rounds.cc:85] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 11
I20260709 13:03:25.369860  8582 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:25.321105  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1071) took 2058 ms. Trace:
I20260709 13:03:25.322389  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1082) took 2055 ms. Trace:
I20260709 13:03:25.372253  8583 rpcz_store.cc:276] 0709 13:03:23.267149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.730910 (+1463761us) service_pool.cc:224] Handling call
0709 13:03:24.731269 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.814458 (+ 83189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.814509 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:24.814572 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:24.814610 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.322160 (+507550us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b54000aaad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:25.322209 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.322334 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190702976}
I20260709 13:03:25.373687  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.374329  8583 raft_consensus.cc:2376] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16. Re-sending same reply.
W20260709 13:03:25.322860 15002 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
I20260709 13:03:25.266827 14811 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:25.288005 14990 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:25.324795 15013 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:03:25.325834 15006 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:03:25.226832 14631 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.331002  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1074) took 2066 ms. Trace:
I20260709 13:03:25.389626  8575 rpcz_store.cc:276] 0709 13:03:23.264663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.513162 (+1248499us) service_pool.cc:224] Handling call
0709 13:03:24.527328 (+ 14166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.094144 (+566816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.330655 (+236511us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b5400283a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:25.330920 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178941184}
I20260709 13:03:25.391350  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.391955  8575 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:25.313766  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1348) took 1169 ms. Trace:
I20260709 13:03:25.392645  8504 rpcz_store.cc:276] 0709 13:03:24.144283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.146733 (+  2450us) service_pool.cc:224] Handling call
0709 13:03:24.147052 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.907494 (+760442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.313527 (+406033us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54003e58d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:25.313707 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1747370240}
I20260709 13:03:25.203941 14917 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.339749  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:25.344679  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.344452  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:25.399500  9099 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:25.345278  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:25.400827  9098 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:25.345471  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:25.346665  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:25.348066  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:25.402889  9101 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:25.279232 14916 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:25.370229  8502 pending_rounds.cc:107] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:03:25.410594  8502 raft_consensus.cc:2889] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.411339  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2958) took 2063 ms. Trace:
I20260709 13:03:25.411652  8502 rpcz_store.cc:276] 0709 13:03:23.347933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.348046 (+   113us) service_pool.cc:224] Handling call
0709 13:03:23.397133 (+ 49087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.152510 (+755377us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b58008b3dd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1929b0aa 00007f1a1931d447 00007f1a19335fe7 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4
0709 13:03:25.055816 (+903306us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b540026e920. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b4a1d 00007f1a1929b1a4 00007f1a1931d447 00007f1a19335fe7 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419
0709 13:03:25.411103 (+355287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.411285 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672956160}
W20260709 13:03:25.318897  8580 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 1081) took 2051 ms (client timeout 1703 ms). Trace:
W20260709 13:03:25.412729  8580 rpcz_store.cc:269] 0709 13:03:23.266826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.497552 (+230726us) service_pool.cc:224] Handling call
0709 13:03:25.318535 (+1820983us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54001a3454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:25.318672 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509270272}
I20260709 13:03:25.303490 14948 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.421532  8576 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:25.416627 14964 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.425719  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.428318  8580 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:25.429337  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:25.415118 14972 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.444711  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1076) took 2179 ms. Trace:
I20260709 13:03:25.445178  8584 rpcz_store.cc:276] 0709 13:03:23.265274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.735750 (+1470476us) service_pool.cc:224] Handling call
0709 13:03:24.736118 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.736537 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.736581 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.737174 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:03:24.918633 (+181459us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:24.918691 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.918783 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:25.444379 (+525596us) raft_consensus.cc:1685] finished
0709 13:03:25.444432 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.444629 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":902,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":22559,"thread_start_us":126563,"threads_started":1,"wal-append.queue_time_us":313999}
I20260709 13:03:25.449481 14784 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:25.450320 14818 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.450830 14818 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:25.468051 14948 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.469815  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2482) took 2828 ms. Trace:
I20260709 13:03:25.470263  8579 rpcz_store.cc:276] 0709 13:03:22.641254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.644107 (+  2853us) service_pool.cc:224] Handling call
0709 13:03:22.644409 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:23.097167 (+452758us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:23.128159 (+ 30992us) log.cc:844] Serialized 14 byte log entry
0709 13:03:24.152747 (+1024588us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b18000a35a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:03:24.878977 (+726230us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.879471 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:03:24.879607 (+   136us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:24.879659 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.879747 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:25.469510 (+589763us) raft_consensus.cc:1685] finished
0709 13:03:25.469608 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.469751 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128423,"prepare.queue_time_us":27209,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":124603,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":16125,"spinlock_wait_cycles":57158016,"thread_start_us":1056742,"threads_started":2,"wal-append.queue_time_us":1763018}
I20260709 13:03:25.472450  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:25.473580  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:25.475137 14930 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:25.496106  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.497243  8579 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:25.498402  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.370659  8581 rpcz_store.cc:276] 0709 13:03:23.263076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.936867 (+673791us) service_pool.cc:224] Handling call
0709 13:03:23.937157 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.518439 (+581282us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:24.518760 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:03:24.627937 (+109177us) log.cc:844] Serialized 14 byte log entry
0709 13:03:24.628163 (+   226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:24.628225 (+    62us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:24.628281 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.058577 (+430296us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b1800337660. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f
0709 13:03:25.059888 (+  1311us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b48000b1558. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:03:25.320789 (+260901us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54001a4354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:25.320861 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.321048 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13249,"prepare.queue_time_us":257918,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":20029,"raft.queue_time_us":3223,"raft.run_cpu_time_us":3811,"raft.run_wall_time_us":440399,"spinlock_wait_cycles":1499337344,"thread_start_us":93068,"threads_started":1,"wal-append.queue_time_us":259992}
I20260709 13:03:25.379783  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:25.380364  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.504374  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:25.504904  8583 raft_consensus.cc:2410] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:03:25.379840  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:25.270711 14873 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.384002  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:25.384287  8501 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:25.395592 15005 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.396281 14631 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:25.382457 14938 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:25.402647  9093 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:25.404953  8577 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:25.406584  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:25.501560  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.502629  9095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.177s	sys 0.262s
W20260709 13:03:25.502940  9067 connection.cc:256] RPC call timeout handler was delayed by -1.1325592459999143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3069s for a response
W20260709 13:03:25.536158  9095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.177s	sys 0.263s
W20260709 13:03:25.536325  9067 connection.cc:256] RPC call timeout handler was delayed by -1.0722592459999305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31360000000000005s for a response
I20260709 13:03:25.376596  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.537472  8582 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:25.504961  8581 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:25.539224  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:25.540741  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:25.505493  8579 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:25.543433  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.545044  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.515697 14964 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:25.508595  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:25.512048  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 132391us
I20260709 13:03:25.552055  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:25.444168 14715 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:25.493824 14784 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:25.477850 14917 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.478523 14972 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:25.532245  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 368589us
I20260709 13:03:25.561931  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:25.562618  8501 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:25.244979 14919 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.538882  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:25.571895  8582 raft_consensus.cc:2376] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17. Re-sending same reply.
I20260709 13:03:25.573038  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:25.547398  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.545841  8579 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:25.582494  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.584039  9093 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:25.553752  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:25.562914  8432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 1268) took 1941 ms (client timeout 1905 ms). Trace:
I20260709 13:03:25.563144  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:03:25.584690  8432 rpcz_store.cc:269] 0709 13:03:23.623295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.624060 (+   765us) service_pool.cc:224] Handling call
0709 13:03:25.562681 (+1938621us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540037fad4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:25.562826 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976556928}
I20260709 13:03:25.585922  8583 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:25.562914  8501 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:25.587312  8501 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:25.588289  8501 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:25.587292  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:25.566406  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:25.583442  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:25.590538  9099 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:25.583400  8579 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 12.
I20260709 13:03:25.597476  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:25.597833  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:25.598349  9094 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:25.597988  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:25.597488  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 268378us
I20260709 13:03:25.600378  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:25.602187  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:25.603106  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:25.609871  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:25.611650  8581 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:25.611683  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:25.619561  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:25.621140  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:25.563660 14988 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:25.630329  9100 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:25.624779  8579 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:25.636186  8501 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:25.600786 14855 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:25.637970  8577 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:25.610584 14725 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:03:25.619643 14995 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:03:25.611215 14874 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:25.565526 14715 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.580024 14784 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.741747  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2961) took 1461 ms. Trace:
I20260709 13:03:25.676625  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:25.734360  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:25.679175  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:25.738351 14964 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:25.675558  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 334894us
I20260709 13:03:25.747642  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.682829  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.764106  8510 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:25.700480  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:25.765234  8508 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:25.686659  8577 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:25.760071  8507 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:25.759465  8503 rpcz_store.cc:276] 0709 13:03:24.280229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.280706 (+   477us) service_pool.cc:224] Handling call
0709 13:03:24.281070 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.281324 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.281360 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.052266 (+770906us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b2c0005c2d8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:03:25.052677 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.502127 (+449450us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:25.502183 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.503003 (+   820us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:25.741354 (+238351us) raft_consensus.cc:1685] finished
0709 13:03:25.741384 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.741666 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10876288,"thread_start_us":449048,"threads_started":1,"wal-append.queue_time_us":601795}
I20260709 13:03:25.726953  8550 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:25.623385 14954 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:25.776130  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 173082us
I20260709 13:03:25.796520  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:25.625809 14811 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:25.674948 15017 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:03:25.674340 15019 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:25.623299 14996 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.176s
I20260709 13:03:25.803231 15019 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.803679 15019 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:25.665892 14980 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:25.805037 14980 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:25.805454 14980 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:25.734624 14873 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:25.800401  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 73553.6us
I20260709 13:03:25.806517 14873 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:25.620746 14977 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.186s
I20260709 13:03:25.807229 14917 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:25.808501 14873 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:25.809064 14873 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.711912 14631 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:25.813819 14873 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.814313 14873 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:25.814370  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2496) took 2819 ms. Trace:
I20260709 13:03:25.814787  8578 rpcz_store.cc:276] 0709 13:03:22.995435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.885296 (+889861us) service_pool.cc:224] Handling call
0709 13:03:23.885677 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:23.891830 (+  6153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:23.891874 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:24.912669 (+1020795us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b2c0003d068. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:03:24.919876 (+  7207us) log.cc:844] Serialized 52 byte log entry
0709 13:03:25.293296 (+373420us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:03:25.311340 (+ 18044us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.313308 (+  1968us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.313814 (+   506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.314051 (+   237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:25.814165 (+500114us) raft_consensus.cc:1685] finished
0709 13:03:25.814186 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.814316 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5201,"prepare.queue_time_us":19748,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":69,"raft.queue_time_us":5958,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":21103,"spinlock_wait_cycles":14184192,"thread_start_us":332446,"threads_started":1,"wal-append.queue_time_us":560346}
I20260709 13:03:25.816817 14873 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:25.818783 14873 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:25.819185 14715 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.733585 14978 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.827137 14990 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.828436 14978 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.829085 14964 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:25.829317 14990 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.829535 14964 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.829937 14964 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:25.833679 14984 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:25.834381  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.835101  8503 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:25.836032  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.834481  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.837018  8509 raft_consensus.cc:2410] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:25.837258  8501 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:25.838186  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.843887  8501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:60466
I20260709 13:03:25.844520  8501 raft_consensus.cc:606] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:25.844847  8501 raft_consensus.cc:614] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:25.846176  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.846736  8503 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:25.849880  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:25.850417  8501 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:25.851608  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:25.625245 14455 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 13:03:25.838786  8508 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:25.653106 14855 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:25.853948  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.842260  8398 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:25.854818  9099 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:25.872997  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:25.871078  8501 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
W20260709 13:03:25.880632  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 261186us
I20260709 13:03:25.795779 14954 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.836061 14980 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:25.888356  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:25.853235 14917 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:25.890322  8398 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:25.863579 14811 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.876958 14855 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:25.881956 14959 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:25.900692  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:25.889446 14954 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:25.904290  8398 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:25.894243 14985 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:03:25.909243 14959 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:25.916337 14959 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:25.916806 14985 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:25.899052 15028 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:25.900656 14355 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:25.902388 14977 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:25.890818 14990 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:03:25.898548 14725 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:03:25.902354 14811 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.918515 14972 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:25.925619  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 312668us
I20260709 13:03:25.924743 14824 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:25.961726  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 351890us
I20260709 13:03:25.965814  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:25.930128 15028 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.984200 15028 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:25.985327  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:25.988453 14995 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:25.991832 14988 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:25.993376 14988 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.957413 14977 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:25.997931 14631 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:03:26.004081 14631 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:26.004571 14631 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.004974 14631 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:25.965093 14824 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:26.011247  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 107046us
W20260709 13:03:26.008665  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.018121  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.018827  8577 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:26.021214  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:26.021981  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.022360  8430 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:26.023662 14930 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:26.023825 14785 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:26.023923  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:26.012557 15026 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:26.024947  8430 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:26.024853 15026 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:26.027436 15026 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:26.023082 14919 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:26.028586  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.029631  8428 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:26.030367  8432 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:26.012161 14824 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.052291  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.054347  8434 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:26.051183  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.055138  8430 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:26.056736  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.058878  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:26.062776 15022 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:26.063484  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.064111  8428 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:26.065403 14919 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:25.981384 14917 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:26.068169  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 167544us
I20260709 13:03:26.077843  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:26.022655 15025 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:26.080735  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:26.084398  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 99135.9us
I20260709 13:03:26.085215  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.086473  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.094091  8428 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:26.098871  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.097363  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:26.092082  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:26.116998  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.112649  8429 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:26.093904  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.117918  8579 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:26.121438  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.113235  8432 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:26.112275  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.081108 14980 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:26.138667  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:26.144524  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.094892 14948 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:26.151432  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 61880.9us
I20260709 13:03:26.090512 15032 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:26.141762 15034 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:26.156534 15034 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:26.156906 15034 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:26.158246 14631 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.160548  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.163121 14712 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.163542 14631 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:03:26.137079 14725 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:26.172034  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.172700  8579 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:26.097571 15027 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:26.159174 15019 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.184113  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.152024 14972 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:26.189369  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.090145 15025 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.205713  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.228945  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.229575  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:26.232738 14818 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:26.190999 14972 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:26.238791 14972 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:26.239814 15025 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.176679 15027 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:26.242961  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:26.096990 14977 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.249536  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:26.249346  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.265359  8435 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:26.182866 14725 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:26.278743  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.279371  8432 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:26.174800 15041 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 13:03:26.286106  8426 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:03:26.219873 14988 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:26.282920  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.283968  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:26.291584  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 179386us
I20260709 13:03:26.292840  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.299238  8550 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.268361 14916 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:26.263974 15027 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.303362  8428 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:26.304036  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:26.280061 14818 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:26.241595 14631 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:03:26.276963 15049 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:26.183427 15042 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:03:26.308118  8435 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:26.241205 14964 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:26.284379 15051 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.305095  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.351547 14355 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:26.336819 14948 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:26.371212 14925 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:26.350553 13941 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:26.434293  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.334328 14725 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:26.338272 15008 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.190s	user 0.005s	sys 0.002s
I20260709 13:03:26.372485 15054 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:26.302570 14916 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.284792 15050 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:26.344031 14511 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:26.383931  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.466305 14511 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:26.467203  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:26.384855  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.386663  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:26.387089  8577 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:03:26.468160  8575 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:26.387603  9099 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:26.468576  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.469614  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:26.470208  8576 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.387773  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.389237 15028 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:26.325742 15041 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:03:26.390205  9095 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:26.390779  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.391417  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.479113  9094 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:26.391224 15034 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:26.392145  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.392783  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:26.392835 15019 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:26.408682  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.493287  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:26.409598 14784 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.410379 14919 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.412424 14811 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.413465  8430 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:03:26.359952 15024 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:03:26.329953 14818 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:26.301795 14988 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.365005 14855 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:26.432866  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:26.445235  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:26.448277 14959 consensus_meta.cc:287] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
I20260709 13:03:26.422049 14972 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:26.461674  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.464006  9068 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.469681  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:26.442768 14355 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:26.514537  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44925.8us
I20260709 13:03:26.515462  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:26.520069  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 56190.2us
I20260709 13:03:26.523904  8575 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:26.492034 14996 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:03:26.491392  9098 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.465340 15032 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:26.465435 14916 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:26.463276 14982 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:26.462893 15054 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:26.414738 15049 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.465807 15050 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:26.558130  8575 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:26.503742  8508 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:26.455487 14948 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.476657 15028 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:26.523948 15019 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:26.443023 15051 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:26.529511  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:03:26.481966  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 209271us
I20260709 13:03:26.507889 14726 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:26.543586  8432 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:26.547026  8509 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:26.552760  9100 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 13: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:26.446743 14631 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:03:26.552505 15029 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:26.495347 14991 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.523590 14985 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:26.567909  9098 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:26.602437  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.603633  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.570122  8576 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:26.607136 15031 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:26.607686 15031 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.608089 15031 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:26.608610 15060 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.609174 14936 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:26.609922 14936 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:26.610423 14936 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:26.570693  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 262661us
I20260709 13:03:26.612002  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.612298  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:26.548069 14958 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:26.562318 15050 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:26.599970  8578 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.614996  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.616370  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.617096  9097 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:26.552963 15054 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.618425  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.620435  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.621131  8578 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:26.623957  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.625240  9097 raft_consensus.cc:2410] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:03:26.625984 15055 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:26.626457 15055 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:26.626945 15055 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:26.628152  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.629297 14785 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.629896 14785 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.632287 14785 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.635208  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.635370  9095 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:26.635470  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.636477  9097 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:26.640095  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 110686us
I20260709 13:03:26.513358 14959 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.641532  8580 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:03:26.641925  8580 pending_rounds.cc:85] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 10
I20260709 13:03:26.642192  8580 pending_rounds.cc:107] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:03:26.642434  8580 raft_consensus.cc:2889] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:26.642765  8580 pending_rounds.cc:107] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:03:26.642997  8580 raft_consensus.cc:2889] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:26.598223 14824 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.005s
I20260709 13:03:26.646571  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:26.650280  8581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.003s	sys 0.020s
I20260709 13:03:26.596606 15032 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:26.651769  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2500) took 1386 ms. Trace:
I20260709 13:03:26.562724 14982 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.603791 14946 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:26.595242 14996 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:03:26.658166  8583 rpcz_store.cc:276] 0709 13:03:25.265435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.601227 (+335792us) service_pool.cc:224] Handling call
0709 13:03:25.601665 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:25.604529 (+  2864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.604590 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:25.605131 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:03:25.926191 (+321060us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:25.926460 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 13:03:25.954792 (+ 28332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.954870 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.359375 (+404505us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:26.641441 (+282066us) raft_consensus.cc:1685] finished
0709 13:03:26.651531 (+ 10090us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.651697 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":545,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":42089,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":16317,"spinlock_wait_cycles":7755648,"thread_start_us":317475,"threads_started":1,"wal-append.queue_time_us":397680}
I20260709 13:03:26.660725  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.644729 15059 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.662431  8433 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:26.671847  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.665092  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.644896 14726 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:26.677166  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:26.670866  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.672601  9099 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:26.679596  9099 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:26.673309  9098 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:26.671042  8579 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:26.675155  8504 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:26.652424 15005 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:26.657928 15032 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:26.700390  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:26.683185  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 161494us
W20260709 13:03:26.659926  8581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.003s	sys 0.021s
I20260709 13:03:26.663097 14873 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:26.680235  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 215366us
I20260709 13:03:26.706056  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:26.731500  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.609182 15060 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.613288 14958 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:26.713840  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:26.730885  8507 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:03:26.739253  8507 pending_rounds.cc:85] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 11
I20260709 13:03:26.739501  8507 pending_rounds.cc:107] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:03:26.739784  8507 raft_consensus.cc:2889] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:26.730746  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.671000 14964 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:26.708253  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:26.737555  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.737964  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.741313  8504 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:26.742272  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:26.652642 14824 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.746205  9065 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:26.762753  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48981.5us
I20260709 13:03:26.762817 15034 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:26.770547  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 124503us
I20260709 13:03:26.771309  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:26.772013  8581 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.682873 15005 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:26.772248  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:26.783324  9101 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:26.604921 14991 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.784397  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:26.603385 15029 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.785492  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:26.786098  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.793534  8429 raft_consensus.cc:2368] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18.
I20260709 13:03:26.743444 14818 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:26.657756 15028 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.799306  9097 raft_consensus.cc:2376] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21. Re-sending same reply.
I20260709 13:03:26.800226  8434 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:26.801424  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.802196  8431 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:26.770764 14938 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:26.770920 14925 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:26.678225 15059 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.768597 15071 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:26.784499 15005 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:26.814801  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.740170 14873 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.825067  9067 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.830459  8581 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:26.769234 14724 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:03:26.832561  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:26.839952  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 173518us
I20260709 13:03:26.842288  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.798449 14855 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:26.803242 14964 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:26.741499 15027 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.803037 14972 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:26.788291 14995 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:03:26.868574  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:26.869186  9094 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:26.805716 15039 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:03:26.832772 14726 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:26.848791  9102 raft_consensus.cc:2410] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:03:26.789631 14631 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:03:26.859440  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:26.860118  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:26.860738  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:26.860508 14711 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:26.861543 14925 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:26.831998 15061 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:26.832190 14614 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.861891  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:26.862074  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:26.862576  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:26.863369  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:26.863922  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:26.846321 14938 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:26.844074 14988 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.856572 14964 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:03:26.876523 15057 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:03:26.844038 15028 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:26.806285 14818 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:26.892168  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:26.907680  8506 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:26.916590  8577 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:26.903169  8584 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 13:03:26.908638  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:26.910530  8507 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:26.867671  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:26.847693  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:26.935364  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 87751.2us
I20260709 13:03:26.942687  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:26.898370 15068 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:03:26.946722  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:26.903461 14964 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:26.879098 15051 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:26.906714 14954 consensus_meta.cc:287] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.986s	user 0.011s	sys 0.000s
I20260709 13:03:26.894335 14824 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.865984 15049 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.896575 15027 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:26.898358 14873 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:26.952649  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 206552us
I20260709 13:03:26.893504 14958 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:26.905931 14711 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:26.894867 14982 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.899735 14991 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.905751 14995 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:26.912869 15029 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.908282 14959 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.945874 15082 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:26.878733 15074 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:03:26.985364 15005 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.987226 14818 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:26.987454 15005 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.900944 14938 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.962339 14954 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.990592 14954 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.949819 14724 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:26.866739 14455 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.088s
I20260709 13:03:26.934788 14614 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.997107 14614 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.903949 14936 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.885957 15031 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.999526 15031 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:26.965276 14711 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:27.000867 14711 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:27.002233 14711 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.963970  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:26.957382 15039 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:26.981527 15060 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:26.951916 15038 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:03:26.901125 15061 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.997360 14948 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.019265 15072 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:26.885957 15050 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.016512 15082 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:27.038306 15061 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:27.040748 15082 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.044173 15055 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:27.042766 15054 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:27.047245 15055 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:27.104661  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:27.084357  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:27.084710  8502 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:26.962781 14511 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:26.952919  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:27.109457  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1271) took 1018 ms. Trace:
I20260709 13:03:27.107758  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:27.084131  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:27.086014  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:27.114318 14916 consensus_meta.cc:287] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.005s
I20260709 13:03:27.097070  8583 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:27.119284  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2779) took 1065 ms. Trace:
I20260709 13:03:27.111050 14355 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:27.100219  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 136214us
I20260709 13:03:27.101387 14726 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.101504  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:27.128798  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:27.132056 14936 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:27.136195 15050 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:27.138015  9094 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:27.138324 15074 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:27.138845  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:27.141193  8426 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:27.152892 14948 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:27.153111  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:27.170676  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:27.172447 14350 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:27.174130 15041 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:27.177189  9095 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:03:27.177454  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 224533us
I20260709 13:03:27.186563  8430 rpcz_store.cc:276] 0709 13:03:26.056297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.056443 (+   146us) service_pool.cc:224] Handling call
0709 13:03:27.118722 (+1062279us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54003f2d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:27.119063 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818236288}
W20260709 13:03:27.189692 15069 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.399s	user 0.004s	sys 0.000s
I20260709 13:03:27.204347  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1270) took 1114 ms. Trace:
I20260709 13:03:27.204947  8433 rpcz_store.cc:276] 0709 13:03:26.090160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.091373 (+  1213us) service_pool.cc:224] Handling call
0709 13:03:26.091629 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.672270 (+580641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.200885 (+528615us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54003629d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:27.204133 (+  3248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312303360}
I20260709 13:03:27.204377  9102 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.193898  9096 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:27.165769  8434 rpcz_store.cc:276] 0709 13:03:26.090442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.090580 (+   138us) service_pool.cc:224] Handling call
0709 13:03:26.090854 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.800987 (+710133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.108986 (+307999us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54001d47d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:27.109295 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630981888}
I20260709 13:03:27.210355  9099 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.212766  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:27.213618  9097 raft_consensus.cc:2393] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:27.213999  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:27.214881  8581 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:27.215564  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:27.216325  9100 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:27.217304  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:27.218530  8510 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:27.219241  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:27.219797  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2987) took 1071 ms. Trace:
I20260709 13:03:27.220250  8508 rpcz_store.cc:276] 0709 13:03:26.137238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.137420 (+   182us) service_pool.cc:224] Handling call
0709 13:03:26.137820 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.558655 (+420835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.196064 (+637409us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400154854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:27.208377 (+ 12313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841114496}
I20260709 13:03:27.220788  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:27.221624  8575 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.222147 15074 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.225067 15074 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:27.226079  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:27.227705 15059 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:27.229920  8325 catalog_manager.cc:5697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 6 to 11, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 11 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:27.231268  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:27.234246 15071 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:27.234753 15071 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:27.236330 15071 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.238369  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:27.239598  9096 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:27.195622  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:27.222671  9094 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:27.229724 15037 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:27.241237  8510 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:27.239863  8427 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:27.193734 14355 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:27.237814 15071 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:27.242493  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:27.250708  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:27.233395  8325 catalog_manager.cc:5697] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:27.254691 15032 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.256610 15032 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:27.258150 14853 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.260039 14978 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.261392 14977 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:27.263947  8577 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:27.265362  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:27.208614 15041 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:27.278379  8581 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
W20260709 13:03:27.278621  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 89960.6us
I20260709 13:03:27.280166  9065 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:27.282312 14995 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:27.284184 15041 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.244534 15037 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:27.194375 14936 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.294229  8325 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 10 to 16, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 16 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.302156  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:27.298867  8429 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:27.303296  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 2976) took 1459 ms. Trace:
I20260709 13:03:27.304337  8509 rpcz_store.cc:276] 0709 13:03:25.844166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.844277 (+   111us) service_pool.cc:224] Handling call
0709 13:03:26.390871 (+546594us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:03:26.391038 (+   167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.585954 (+194916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.302785 (+716831us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400059bd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:27.303093 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361299200}
I20260709 13:03:27.247282 14916 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.310851  9093 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:27.313572 14916 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:27.316099  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:27.308606  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:27.323909  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.324484  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.329169  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:27.330451  8580 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:27.331563  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:27.332542  8580 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:27.340348  9099 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:27.316607 15041 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.347424  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:27.349344  8583 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:27.350633  8583 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:27.351711  8576 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:27.353084  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.361758  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 52364us
I20260709 13:03:27.386541  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:27.389364 15028 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:27.382560  8476 leader_election.cc:400] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18.
I20260709 13:03:27.295235 15037 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.416978  8476 leader_election.cc:403] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:27.418674  9102 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:27.421015  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:27.423765  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:27.424492  8584 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.428104 15054 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:27.346853 14873 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:03:27.434214 14511 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.434332  8580 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:27.421842  8578 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:27.417863  8575 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:27.314304 14936 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.446158  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:27.417712  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:27.449358  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:27.454669 14873 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:27.455174 14873 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:27.456348 14873 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:27.449373  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:27.346210 14726 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.457854 14873 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:27.477476 15083 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:27.477923 14938 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.478181 15083 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:27.473824 15050 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:27.476756  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 155031us
I20260709 13:03:27.449972 14715 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
W20260709 13:03:27.494302  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 80785.2us
I20260709 13:03:27.496001  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:27.496915  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:27.505308  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:27.505089  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 133085us
I20260709 13:03:27.507442  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:27.505621  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:27.499027 15037 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.508046  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.481693 15083 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:27.514366 15083 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.518802  9097 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.524052  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:27.525331  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:27.533515  9102 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:27.529366  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:27.517944 14726 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:27.538164 14948 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:27.539430 14948 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:27.539348  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:27.539922 14948 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:27.541114 14948 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:27.542778  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 68529.1us
I20260709 13:03:27.543340  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.543768  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.544723 14916 raft_consensus.cc:2764] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:03:27.546608 14948 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:27.560151  9097 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:27.565843  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:27.571852  8582 raft_consensus.cc:2410] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:03:27.552430 15028 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:27.580426  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 261812us
I20260709 13:03:27.525265 14853 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:03:27.585551  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:27.574548 14715 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.585819 14930 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.509420  8325 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:27.597884  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.600234 14990 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:03:27.607508  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:27.596721  8328 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57098 (request call id 371) took 59934 ms (client timeout 15000 ms). Trace:
I20260709 13:03:27.614825  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:27.611624  8510 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 12.
I20260709 13:03:27.604873 14936 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:27.581410 15082 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:03:27.626739  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:27.632916  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.630903  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 188324us
I20260709 13:03:27.634433  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:27.637228  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.600843 14930 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:27.608058 14995 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:03:27.620133 14715 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:27.647394 14995 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:27.647915 14995 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:27.649227 14995 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.651650 14995 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:27.654183 15097 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:03:27.637857 14936 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:03:27.664650  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 86113.1us
I20260709 13:03:27.670507  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.680835  8427 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:27.644105 14978 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:03:27.695149 15042 raft_consensus.cc:2764] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:27.696201 14938 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18.
W20260709 13:03:27.708964  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.693107 14936 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.727767  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:27.728567  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.729907  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.731070  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 69042.7us
I20260709 13:03:27.665632  8325 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 10 to 11, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 11 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:27.734068  8427 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:27.737169  8507 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:27.745260 14726 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:27.745853 14726 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:27.747041 14726 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.748492 14726 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.761210  8584 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
W20260709 13:03:27.762946  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 89491.2us
I20260709 13:03:27.763134  9065 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:27.757149 15101 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:03:27.762203 14785 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:27.767474  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:27.768523  8575 raft_consensus.cc:2410] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:27.766129 14785 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:27.772648 14785 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.773265 14930 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:27.774173 14977 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:27.774369 14990 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:27.774600 14977 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:27.774794 14990 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:27.775676 14977 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:27.775846 14990 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:27.777060 14977 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:27.773806 14785 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:27.778412  8582 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2512) took 2501 ms (client timeout 2577 ms). Trace:
W20260709 13:03:27.778832  8582 rpcz_store.cc:269] 0709 13:03:25.276851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.572723 (+295872us) service_pool.cc:224] Handling call
0709 13:03:27.778190 (+2205467us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b540018c254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:27.778343 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4501273984}
W20260709 13:03:27.779402  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.780587 15019 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:27.781176 15019 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:27.783649 15019 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:27.787433 14980 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:27.787868 14980 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:27.785943  8426 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:27.796193 15032 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:27.777078 14990 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:27.799697  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:27.800865 14930 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:27.801246 14930 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.790863 14980 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:27.801564 14930 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.802525 14980 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:27.817690  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:27.818537  8577 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:27.819182  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.820973 13845 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:27.822207  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.822963 13845 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:27.824198  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:27.825016  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:27.826956  8577 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:27.831076  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:27.832357 14853 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:03:27.833321  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.835850 14853 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:27.838186  9096 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
W20260709 13:03:27.792380 14711 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.012s
I20260709 13:03:27.849169  8325 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 9 to 12, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 12 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:27.852211 14930 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.851894  8325 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 13 to 16, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 16 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:03:27.858707 14964 consensus_meta.cc:287] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.907s	user 0.009s	sys 0.009s
I20260709 13:03:27.859465 14964 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.871289 14936 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:27.614435  8328 rpcz_store.cc:269] 0709 13:02:27.630111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.651504 (+ 21393us) service_pool.cc:224] Handling call
0709 13:02:27.854063 (+202559us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a9090 00007f1a19347f3a 00007f1a1f0fe1cc 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc 00007f1a1d6bc392 00007f1a1767a48c 00007f1a176798c6
0709 13:03:27.557011 (+59702948us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:19.012687 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:19.013328 (+   641us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:19.013392 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:03:19.013414 (+    22us) tablet.cc:662] Decoding operations
0709 13:03:19.014523 (+  1109us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:19.014624 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:19.014658 (+    34us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:03:19.318416 (+303758us) tablet.cc:701] Row locks acquired
0709 13:03:19.367614 (+ 49198us) write_op.cc:260] PREPARE: finished
0709 13:03:19.485692 (+118078us) write_op.cc:270] Start()
0709 13:03:19.535476 (+ 49784us) write_op.cc:276] Timestamp: P: 1783602199449696 usec, L: 0
0709 13:03:19.542605 (+  7129us) op_driver.cc:348] REPLICATION: starting
0709 13:03:19.562938 (+ 20333us) log.cc:844] Serialized 4411 byte log entry
0709 13:03:19.952231 (+389293us) op_driver.cc:464] REPLICATION: finished
0709 13:03:20.145718 (+193487us) write_op.cc:301] APPLY: starting
0709 13:03:20.145816 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:20.169088 (+ 23272us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:20.169208 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:20.328388 (+159180us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933ae28 00007f1a1cd75581 00007f1a1cd74d58 00007f1a1cd799f1 00007f1a1cd799a9 00007f1a1cd79939 00007f1a1cd79901 00007f1a1cd78b2d 000000000038f354 000000000038f199
0709 13:03:20.353481 (+ 25093us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:20.353835 (+   354us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:03:20.353908 (+    73us) write_op.cc:312] APPLY: finished
0709 13:03:20.354307 (+   399us) log.cc:844] Serialized 105 byte log entry
0709 13:03:20.354487 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:20.354618 (+   131us) write_op.cc:454] Released schema lock
0709 13:03:20.354684 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:20.355094 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:20.355121 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":227383,"reported_tablets":45,"spinlock_wait_cycles":11236608,"child_traces":[["op",{"apply.queue_time_us":153809,"apply.run_cpu_time_us":17220,"apply.run_wall_time_us":209367,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50063,"num_ops":11,"prepare.queue_time_us":199654,"prepare.run_cpu_time_us":25971,"prepare.run_wall_time_us":1330374,"raft.queue_time_us":67916,"raft.run_cpu_time_us":26000,"raft.run_wall_time_us":234372,"replication_time_us":320765,"spinlock_wait_cycles":34389760,"thread_start_us":269741,"threads_started":4,"wal-append.queue_time_us":203634,"wal-append.run_cpu_time_us":15787,"wal-append.run_wall_time_us":1601291}]]}
I20260709 13:03:27.849222  8502 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:27.883677 13845 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:27.889330  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 131664us
I20260709 13:03:27.895110  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:27.895993  8427 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:27.897809  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 66877.3us
W20260709 13:03:27.901015  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 76906.9us
W20260709 13:03:27.901309  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 177704us
I20260709 13:03:27.898797  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:27.907042  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.917960  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:27.911005 15071 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.004s
I20260709 13:03:27.907967 14930 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:27.907421 14964 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:27.924233 14785 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:03:27.905737 14936 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:03:27.925766  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:27.927038  8507 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:27.932265  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:27.932374  8509 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:27.919456 14978 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:27.934105  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:27.934438  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.934705  8433 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:27.936014 15041 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:27.939599  8428 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:27.949219  8427 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:27.948182 14873 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:27.938452 15041 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:27.951851  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:27.957396  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 55738.3us
I20260709 13:03:27.959853  8398 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:27.954880 15041 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:27.961649  8433 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
W20260709 13:03:27.963743  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44952us
I20260709 13:03:27.964715  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.965677 14964 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:27.968343  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:27.970134 14715 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.971735 14715 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:27.969070 14930 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:27.976766 14511 consensus_meta.cc:287] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.004s
I20260709 13:03:27.977442  9100 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:27.959129 14873 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:27.978475 14873 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:27.978927 15042 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.979414 15042 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:27.986470 15042 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:27.996062  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:27.995645 14946 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:27.998085 14946 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.001978 14946 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:28.004245 14785 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:28.005507 14978 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:28.005914 14785 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.009124 14785 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:28.009430  8509 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:28.011140  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50840.2us
I20260709 13:03:28.013675  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:28.014606  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:28.015247  8505 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:03:28.015695  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:28.017202 15050 consensus_queue.cc:1059] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:28.018131 15042 raft_consensus.cc:3055] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:28.018472 15042 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:28.019479  8505 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:28.020432  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.019438 15042 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.021984 15042 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:28.022905 15050 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:28.024473 14511 raft_consensus.cc:3055] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:28.024919 14511 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:28.025906 14511 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.027433 14511 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.036105  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:28.036835  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 78683.3us
I20260709 13:03:28.038987  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:28.040625  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 76058.5us
I20260709 13:03:28.042253 14785 raft_consensus.cc:2764] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:03:28.042358  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:27.979550 14873 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.047586  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.046380  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:28.037792 15083 raft_consensus.cc:2764] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:03:27.956594  8325 catalog_manager.cc:5697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:28.049192 14930 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:28.056988 14930 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.040062 14853 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:03:28.072057  9100 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:28.060655 15019 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:28.070863  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:28.059639 14930 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:28.057361 14715 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:28.078507  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:28.052682 15037 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:03:28.086521  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:28.088194  9097 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:28.088367  9093 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.089609  9095 raft_consensus.cc:2393] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:28.092415 15028 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:28.093410  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:28.079099 14785 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:28.094249  9097 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:28.094292 14990 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:28.094862 14990 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:28.095068 14785 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.095999 14990 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.090950 15019 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:28.098939 15019 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.059787 14964 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
W20260709 13:03:28.106443  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.063045 15041 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:28.117417  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.121973  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 59086.9us
I20260709 13:03:28.119284 15106 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:28.123843 15106 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:28.124927 15106 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.092227 14715 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:03:28.123956  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 46255.4us
I20260709 13:03:28.128528 14990 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:28.123124  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.137485 14715 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.138124  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:28.138473 14785 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:28.103988  8325 catalog_manager.cc:5697] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 12 to 14, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 14 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:28.148844 15071 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:28.149562 15071 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.149398  8325 catalog_manager.cc:5697] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 10 to 13, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 13 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.150833  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.147396  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:28.152827 14853 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:28.153352 15108 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:28.153508 15041 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:28.153652 14853 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:28.154803 14853 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.152820  8325 catalog_manager.cc:5697] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:28.157864  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:28.157745 14785 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:28.166138  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.166428  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:28.162009 14964 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:28.162735  8325 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.171204  8325 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 13 to 19, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 19 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:28.181318  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 58398.7us
W20260709 13:03:28.186478  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.188810  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.190630  9093 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
W20260709 13:03:28.215137  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.216313  8509 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:28.188262  8325 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 12 to 14, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 14 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:28.222512  8547 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:28.230801  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 138766us
I20260709 13:03:28.217893 15071 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:28.238418  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:28.229271 14511 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:28.243733  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.245731  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:28.246414 14930 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:28.232563 14938 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.250435 14938 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:28.253491 14938 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:28.235111 15041 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:03:28.254971 15041 consensus_queue.cc:1243] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:03:28.255040  8325 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 9 to 14, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 14 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:28.255988 15041 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:28.256526 15041 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:28.238615 14964 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:28.260094  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:28.256992  8325 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 10 to 13, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 13 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.275029 15110 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:28.276329 15028 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:28.277565  8577 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:03:28.280162  8577 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: [15.12-17.13]
W20260709 13:03:28.280583  8400 connection.cc:256] RPC call timeout handler was delayed by -1.1957385859999476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:03:28.281515  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.283197  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:28.283713  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.284101  8575 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 20: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:28.285669 15042 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:28.285768  8579 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:28.286268 15042 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.286823  8582 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:03:28.287205  9102 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:03:28.286897 15032 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:28.275743 15110 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:28.288448 14946 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:28.288820 14946 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:28.289752 14946 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.290841  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.258405 14511 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.258570 14964 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.237200 14715 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:28.249716 14930 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:28.297364  9095 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:28.298050 14946 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.290762 15110 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:28.302459  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:28.316195  9093 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:28.316426  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:28.320885 15109 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:28.323462 14964 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:28.304526  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:28.323817 14995 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.003s
I20260709 13:03:28.324229  8429 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:28.324648  9100 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:03:28.325941 14511 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:28.327817 15113 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:28.305356  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:28.330463  8430 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
W20260709 13:03:28.332358 15112 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.073s	user 0.000s	sys 0.002s
I20260709 13:03:28.296800  8325 catalog_manager.cc:5697] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 4 to 13, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 13 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:28.334619  9094 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:28.334249  8325 catalog_manager.cc:5697] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 9 to 12, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 12 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:28.306182  8434 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:28.307670  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:28.335965  9102 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:28.337606  9100 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:28.338195  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:28.308705  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:28.339970  9097 raft_consensus.cc:2410] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:03:28.340909 14954 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.341339 14954 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.341673 14954 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.342290 14711 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:03:28.342684  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 68419.3us
I20260709 13:03:28.343640  8547 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.343885 14711 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:28.344493 14711 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:28.345764 15042 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:28.257892 15041 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.345543 14711 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.336009  8325 catalog_manager.cc:5697] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 2 to 12, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 12 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:28.348398  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:28.362684  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 46356.1us
I20260709 13:03:28.350574 15110 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:28.352243  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:28.352342 14930 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:28.368597 15041 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:28.315151  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.353611 15028 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:28.355031  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:28.356578 14873 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:28.356940  8428 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:28.358093 14978 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.358584 14977 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:28.359627  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.359890  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:28.362902  8502 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:28.350016 14715 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:28.365883  8429 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:28.366525 14785 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:28.367252 14350 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:28.371344  9093 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:28.376467  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:28.380867 14873 consensus_queue.cc:1243] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:28.381296 14978 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:28.383626  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.389904  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:28.419245  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59416.7us
I20260709 13:03:28.420287  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:28.419423  9065 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:28.406545 14350 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:28.422631  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 67684.6us
I20260709 13:03:28.408238 15110 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:28.410534 14936 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:28.425647 14938 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:28.423578 14995 raft_consensus.cc:2764] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:03:28.424273  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:28.415014 14964 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.418648 14930 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:03:28.424902  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 65368.3us
I20260709 13:03:28.414758 14980 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:28.422669 14977 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.438647 14954 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:28.439025  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 65303.2us
I20260709 13:03:28.439633 14978 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:28.440730  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:28.442373  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.430372  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:28.433540 14930 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:28.426193 14350 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:28.431947 14964 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.441865 14954 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:28.457474 14930 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:28.445246 15019 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:28.459507 15019 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:28.459915 15019 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:28.460354 14948 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:28.468715 14948 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:28.469815  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 45638.1us
I20260709 13:03:28.482584 15106 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:28.483242 15106 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.455945 14964 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:28.487106  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:28.492686  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 103946us
I20260709 13:03:28.456537 14853 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:28.539446  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.448244 14978 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.091s
W20260709 13:03:28.556334  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 126051us
I20260709 13:03:28.558145 14948 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:28.538801 15106 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:28.566603  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 78452.8us
I20260709 13:03:28.568836  8547 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.571136 15131 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:28.577200 15131 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:28.578580  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.579231  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.581331  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.572400 14946 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.587095 14946 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.588881 14980 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:28.589572 14946 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:28.575350 14785 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:28.596446  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:28.598407  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 59041.6us
I20260709 13:03:28.599915  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:28.600632  8502 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:28.568398 15041 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.574107 14954 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:28.614545  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.615849 14873 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:28.616291  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.616894 14873 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:28.617270 14873 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:28.623407  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 43711.3us
I20260709 13:03:28.624230  8547 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.625844  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:28.627475 13845 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:28.627851 13845 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:28.617630 14873 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:28.628517  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 61367.2us
I20260709 13:03:28.602522 14726 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:28.639349  8429 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:28.610872 14954 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:28.626502 14936 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:28.649011 15110 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:28.649444 15110 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:28.649818 15110 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:28.649905 14938 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:28.630295 14946 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:28.604269 15041 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.632833 14726 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:28.643802 14954 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:28.671411  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.686185  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.657433 13845 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:28.711256  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 92876us
I20260709 13:03:28.660109 14946 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:28.741935  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 72452.5us
I20260709 13:03:28.743781 15041 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:28.744272 14946 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:28.748423 14350 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:28.640651 14980 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:03:28.755713  8547 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:28.756824  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:28.758260  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 85204.7us
I20260709 13:03:28.760528 15134 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:28.770503  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:28.771697  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.777040 13845 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:28.754956 15042 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.795873 15019 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.761071 15131 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.798254  8429 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:28.800264 14350 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:28.801301 15019 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:28.802471  8428 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:28.803148  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 61111.3us
I20260709 13:03:28.765273 14785 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:28.807369  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:28.797650 14511 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:28.808293  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:28.809010  8507 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:28.808712 14511 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:28.810446 15140 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:03:28.816757  8502 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:03:28.818609  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:28.830072  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:28.836988  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:28.835754  8577 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:28.843487  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:28.842866  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:28.843845  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:28.844305  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:28.845316  8507 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 13:03:28.845536  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 227990us
I20260709 13:03:28.847200  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:28.849396  8584 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:28.850198  8510 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:28.801363 15083 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:03:28.836493 15041 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.836699 14350 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:28.861546  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:28.862080  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:28.862368  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:28.863065 15037 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:28.818470 14785 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:03:28.866103 15019 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:28.866595 15137 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:28.859817  8577 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:28.871274  8429 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:28.875069  8506 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:28.864871 14511 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:28.878820  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 82328.7us
I20260709 13:03:28.830670 14964 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:28.893826  8508 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:28.885493  8579 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:03:28.830260 15131 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.816967 15042 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.874493 14936 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:28.932004  8505 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
W20260709 13:03:28.934276  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 92726.8us
I20260709 13:03:28.919670  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:28.921005  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:28.922389  8506 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:28.900612  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:28.882993 14350 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:28.926754  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:28.903522 15139 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:28.883201 15037 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:28.930401  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:28.929411 15148 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:28.867566 14726 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:28.947180  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.949492  8501 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 13: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:28.880815 15041 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.955019  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:28.956925  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 69858us
I20260709 13:03:28.910262 14873 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.962705  8508 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:28.895990 15137 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.923548 15136 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:03:28.963929  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.951673 14946 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.922339 15110 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.946517 15139 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:28.966418  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74885.7us
I20260709 13:03:28.946336 14954 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:28.982666 15154 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:28.991745 15141 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:28.991961 14785 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:28.992898  8582 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:28.952080 15146 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:03:28.992586 14785 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:29.015611  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:29.017819  8509 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:28.956029 15148 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.017206 14726 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:29.023166 15083 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:29.026301  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:29.021215 14930 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:03:29.068027  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 167478us
I20260709 13:03:29.052876 15019 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:29.079764  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 158837us
W20260709 13:03:29.083662  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 153347us
I20260709 13:03:29.021829 14853 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:03:29.055794 14964 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.087762 14946 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.020044 15150 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 13:03:29.094064  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.072860 14930 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:29.106634  8575 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:29.109562  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.031520 15153 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:03:28.991777 15154 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.116623 15151 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:29.126416 15144 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:03:29.136035 15155 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:29.136940 15155 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:29.138176 15155 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.091917 15131 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:29.090963 14977 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:29.144554  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:29.145629 14946 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:29.146209 14946 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:29.147140 14946 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.149679 15162 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:29.150250 15162 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:29.154721 15162 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:29.154785 15110 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:29.155769 14930 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.157436 14930 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.158249 14350 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:29.159962 15041 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.099653 14785 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:29.082756 15042 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.092550 15083 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:29.172343  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:29.174603  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 148376us
I20260709 13:03:29.179122 15137 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:29.084692 15019 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:29.194154 14873 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:29.144544 15154 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:29.196331  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50560.5us
I20260709 13:03:29.167865 15148 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:29.213855  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:29.215049  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.215231  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:29.216885  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.217235  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.217593  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:29.217901  8576 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:29.219452 14990 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:29.219892 14990 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:29.220777 14990 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.224136 14954 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:29.226583  8578 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:29.227782  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.228506  8502 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:29.221889 14990 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.195703 15153 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.232518 15153 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:29.234694 15153 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.235735 15037 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:29.235920 14980 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:29.236287 14980 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:29.195518 15042 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:29.237097 14980 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.238322 15019 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.188616 15083 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:29.247450 15083 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.248169 15148 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:29.248660 15148 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.244283  8429 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:03:29.244625  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.250485  8509 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:29.250725 15148 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:29.251225 15148 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.250918 15139 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.245049  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.245252 14980 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:29.245926  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:29.254297  8507 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.253099  8508 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:29.257874  8429 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 19. Ops: []
I20260709 13:03:29.253949 15042 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.258886 15042 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.266062  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:29.266803  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.264941  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:29.269440  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.266556  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.270206  8509 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:29.270445  8582 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:29.271358  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:29.272172 15151 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.272830  8579 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:29.273455 15042 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.286405 15042 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:29.286918 15042 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:29.287207  8431 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:29.287807 15042 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.290138 14511 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:29.253974 15139 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.276152  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.277423  9065 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:29.278607  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.301302  8429 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:29.301920  8547 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.291543 14946 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:29.303526 14946 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:29.304064  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.304646 15137 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:29.304313 14946 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.305157 15137 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:29.305711  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:29.305994  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.305734 14946 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.306778  8510 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:29.307579 15137 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:29.282832 15146 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:29.282974 14873 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:29.284210  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:29.285637  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:29.251644 15148 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.285828  8427 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:03:29.275193  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:29.293819  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:29.264371 14726 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.318320  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:29.342749  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 67642.4us
I20260709 13:03:29.330966  8507 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
W20260709 13:03:29.343958  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.344422  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.331466  8430 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.342602  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:29.334481  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.346724  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.336760  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.339246  8427 pending_rounds.cc:85] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 13
I20260709 13:03:29.342689  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:29.347576  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 70212.5us
I20260709 13:03:29.349345  8428 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:29.304391 15158 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.350772  8510 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:29.351074  8582 pending_rounds.cc:85] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 11
W20260709 13:03:29.352155  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 68018.3us
I20260709 13:03:29.352751  9065 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:29.355396  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:29.355810  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.355878  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.350982  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.357941  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:29.359910  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:29.354369  8582 pending_rounds.cc:107] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:03:29.361665  8582 raft_consensus.cc:2889] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:29.320348 15146 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:29.347361  8427 pending_rounds.cc:107] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:03:29.351854  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.362330  8427 raft_consensus.cc:2889] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:29.354717  8501 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:29.368453  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.351137 15154 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:29.376377  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.377468 15164 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:29.377599 15155 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:29.377727  8427 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:03:29.378100 15155 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.378553 15155 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:29.380712 15172 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.107s	user 0.000s	sys 0.003s
I20260709 13:03:29.381749 15156 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:29.382232 15156 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:29.382313 14995 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:29.382669 15156 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:29.383711 15146 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.384860 15146 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:29.372442 15154 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.386425 15154 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:29.387768 14946 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:29.388180 14946 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:29.362370 15041 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:29.389846 15041 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.390233 15041 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.390908 15148 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.362747 15158 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.393004 15158 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:29.395186  8431 raft_consensus.cc:2410] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:03:29.350903 14726 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:29.395381 15155 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.395865 15161 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:29.396492 15161 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:29.397415 14726 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.397619 15155 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.398149  8504 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:03:29.398862 15156 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.404378  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.372625  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.389075 14946 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.401906  8429 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:29.400199  8428 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:29.378014 15164 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:29.421905  8426 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:29.421790  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:29.422638  8577 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.422849  8430 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:29.397367 15161 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.413493  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:29.417829  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.418617  8575 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:29.421540  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:29.423831  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:29.430462  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.430198 15155 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.437346  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:29.437953  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.447187  8426 raft_consensus.cc:2410] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:03:29.449172  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:29.449761  8579 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.451316  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.423663 15164 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:29.453791  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.453581  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.455498  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.456444  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:29.456130  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 80923.2us
I20260709 13:03:29.459205  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.459813  8433 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:29.461009  9099 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:29.458467  8432 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:29.464392  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:29.465803  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.435989 14954 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:29.423847 15158 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
W20260709 13:03:29.480523  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.463591  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.453580 15141 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:29.487174  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:29.486512  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.490906  8433 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:29.431016 14873 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:03:29.482992  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.498431  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:29.489861  8577 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:29.486352  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.435961 14938 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:03:29.501917  8550 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.477669 14936 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:29.499779  8504 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:29.506511  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:29.481127 14954 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:29.486474 15129 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:29.539870  8428 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:29.541226  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:29.543514  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 62381.2us
I20260709 13:03:29.455981 15155 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.492050 15157 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:29.542711  8426 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
W20260709 13:03:29.563354  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.484169 15145 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:03:29.568316  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.567327  8577 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:29.567498  9095 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:29.569023  8584 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:29.507761 15134 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:29.503721 15156 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.512327 15037 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.587914  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:29.576399  8583 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:29.576519  8580 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:29.503262 15167 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:29.578200  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:29.579141  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.580330  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.588685  9095 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:29.590371  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:29.594497  9100 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:29.595326  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:29.595582  9094 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:03:29.593817  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:29.564687 15136 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:29.584951  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:29.590583  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:29.590798  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:29.542229 15129 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:29.571321 15166 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:29.592986  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.614048  8575 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:29.614889  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.615515  8575 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:29.615875  9100 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:03:29.616451 15177 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:29.616803  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:29.613128 15168 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:03:29.584824  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.620800  8581 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:29.613073 15129 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.624125  8398 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:29.615170  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:29.605299  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.622761  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:29.618467  9100 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:03:29.605726  9101 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:29.597654 15167 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.637936  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.647518  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:29.650264  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 106086us
I20260709 13:03:29.652271  9102 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:29.599721 15136 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:29.654901  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.609795 14990 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:29.658303  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 149625us
I20260709 13:03:29.660888  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.661671  9093 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:29.664352  8400 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:29.667076  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.667616  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.670230 15178 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:29.673446 14990 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.675806 14990 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:29.677134 14978 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:29.678296 15019 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:29.656769 15156 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.680264 15156 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.681345 15041 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.682287 14726 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:29.682415 15156 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:29.647374 15106 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:29.658762 14511 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.682999  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:29.687136  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.669667  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:29.631968 14954 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.651263 15167 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:29.694054  8576 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:29.662912 15136 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.694721  8581 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:29.691813  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:29.701751  9098 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:29.703698  8431 raft_consensus.cc:2410] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:03:29.704278 15139 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:29.704703 15139 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.705046 15139 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:29.693856 15106 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.706574 15106 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.707453 15041 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.708529  9098 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
W20260709 13:03:29.709276  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.699728 15156 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:29.711262 15155 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:29.689855 15148 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:29.698732  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:29.717000  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:29.697317  9068 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:29.718915  8580 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.719693  8576 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
W20260709 13:03:29.713012 14930 consensus_meta.cc:287] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.001s
I20260709 13:03:29.677080 15154 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:29.740644  8581 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:29.744520 14978 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:29.750154 14990 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:29.742288  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.751012  8508 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:29.743085  8578 raft_consensus.cc:2410] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:03:29.751991 15174 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.368s	user 0.000s	sys 0.004s
I20260709 13:03:29.750263  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:29.757217  8580 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:29.723191  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.759152  8579 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:29.725981 14954 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:29.757972  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:29.731096 15179 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:29.765242 14946 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:29.766162  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 141436us
I20260709 13:03:29.722548 15145 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:29.770061  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:29.763413  9068 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:29.721800 15129 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.783157  9068 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:29.785588  9099 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:03:29.786084  9099 pending_rounds.cc:85] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 12
I20260709 13:03:29.786352  9099 pending_rounds.cc:107] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:03:29.786597  9099 raft_consensus.cc:2889] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:29.760718 15155 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.788379  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:29.767692 14978 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:29.790119  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:29.770354 15179 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:29.807057 15179 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:29.808605  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:29.771421 15041 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.791805  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:29.791112  9099 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:29.810350 15041 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.811379  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:29.812491  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:29.774899 15165 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.039s
W20260709 13:03:29.789543  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 138250us
I20260709 13:03:29.815177  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:03:29.816298  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.817303  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:29.817906  9099 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:03:29.818948 15154 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.819598 15148 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:29.819998  9099 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:29.794180  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:29.793643 15184 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.137s	user 0.001s	sys 0.002s
I20260709 13:03:29.825634  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:29.800447  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:29.806592 15037 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:29.812554 15041 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:29.791471 15145 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:29.796310  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:29.797060  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:29.827692  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:29.820111 15148 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:29.830313  9099 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:03:29.829926  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 46833.3us
I20260709 13:03:29.829382  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:29.830612  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 133136us
I20260709 13:03:29.787068 14511 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:29.833309  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:29.834592  9096 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:29.837846  8504 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:29.842655  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:29.793007 14978 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.826375 14726 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:29.843935  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:29.827672 14711 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:29.817763 15106 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:29.821058 15201 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:29.854790  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 84818us
I20260709 13:03:29.826997 14964 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:03:29.869480  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:29.871657  8427 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:29.870442  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:29.820544 14936 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:03:29.849486 14978 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.885037  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:29.850080 15155 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:29.860185 14995 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:29.860435 15146 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:29.860491 15042 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:29.853432 15161 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.890676  9093 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:29.849319 15167 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.909302  8504 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:29.898437  8428 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:29.900260 15041 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:29.918586  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:29.889385 14726 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:29.892282 15155 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.901335 15178 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:29.933632  9094 raft_consensus.cc:2368] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18.
I20260709 13:03:29.915241 15042 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.936872  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:29.944084  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 97873us
I20260709 13:03:29.918952 14511 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.948174  8577 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:29.889155 15019 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 13:03:29.954350  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.957921  8428 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:29.964620  9102 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:29.933966 15155 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:29.972224  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:29.934276 15178 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:29.956231 15181 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:03:29.943636 14711 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.923355 15139 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:29.950124 15042 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:29.951541 15165 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:03:29.961133  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 90793.7us
W20260709 13:03:29.960829  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 97917us
W20260709 13:03:29.967618  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 78870.1us
I20260709 13:03:29.959419 15202 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:29.910452 15145 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:29.946970 14726 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 21 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:29.922479 15161 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:29.954540 14511 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:29.992278 15178 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:30.001130  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:30.001927  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:30.027948  8433 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:30.028100  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:30.003973  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:30.029057  8579 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:30.005004  8434 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:29.974135 15192 raft_consensus.cc:2764] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:03:29.978646 15201 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:30.011237  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:30.013434  8580 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:29.922228 15148 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.016324  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:30.017982  8430 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:03:30.020351  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:30.000578 15129 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:29.965318 15136 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.036760  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:30.044432  8579 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:30.050454  8501 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.044970  8434 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:03:30.051383  8434 pending_rounds.cc:85] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 12
I20260709 13:03:29.997720 14964 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:03:30.048767  8432 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:30.049764  8584 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:30.051631  8434 pending_rounds.cc:107] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:03:30.049077  9096 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:30.055307  8434 raft_consensus.cc:2889] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:30.053777  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:30.059489  8504 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:30.060248  8433 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:30.065624  8429 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:03:30.000342 14711 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.066047  8429 pending_rounds.cc:85] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 12
I20260709 13:03:30.046949 15019 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.042447 14938 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:30.069357  9095 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:30.070757  8429 pending_rounds.cc:107] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:03:30.068884  8575 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:30.015758 15202 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.075621  8429 raft_consensus.cc:2889] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:30.079838  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 307607us
I20260709 13:03:30.067377 15106 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:30.090539  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.092442 15198 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:03:30.090541 15168 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.094362 15168 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.084985 15204 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:30.109197 15199 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:03:30.074787 15206 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:03:30.073860 15192 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
W20260709 13:03:30.154428  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 58998us
I20260709 13:03:30.087981 15019 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.084816 15134 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:03:30.103911 15167 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.172371  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:30.144392 14995 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:30.173230  8580 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:30.175796  8584 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:30.178174  8578 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:30.100308 14726 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.205340  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:30.206272  8581 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:30.186640 15019 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.154073 15204 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.216426  9097 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:30.216828 15204 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.182700 14995 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.218758 15202 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:30.220201 15155 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.220788 14995 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.214072  8580 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
W20260709 13:03:30.236542  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 149881us
I20260709 13:03:30.137424 15201 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:30.210343 15164 consensus_meta.cc:287] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.000s
I20260709 13:03:30.183472 15139 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.237504  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:30.261379  8578 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:30.269600  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:30.265357 15136 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:30.273790 15161 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:30.278460 15221 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:30.264848 15164 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:30.296857  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 249403us
I20260709 13:03:30.282506 15155 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:30.298444  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:30.292506 14995 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:30.307818  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:30.309028  9100 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:30.312480 14978 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.314643 14978 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.315804 15210 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.316306 15210 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.318194 15222 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:30.284282 15179 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.295053 15165 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:30.337262  8426 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:30.338755  8501 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
W20260709 13:03:30.338014  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 245781us
I20260709 13:03:30.342262 15225 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:30.342993 15225 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.345584 15225 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:30.305408 14873 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:03:30.401190  9098 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 16: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:30.399124  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46709.7us
W20260709 13:03:30.404858  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 65283.3us
I20260709 13:03:30.310223 14938 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:03:30.441121 15225 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:03:30.310920 14995 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.445775  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:30.446440  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:30.450794  8579 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:30.452384  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:30.330832 15042 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.445225 15222 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.441403 15041 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:30.461071 15205 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:30.461848 15229 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:03:30.462438 15196 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:30.462991 15196 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:30.463846 15196 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.448925 15210 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.467957  9102 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:03:30.472827 15164 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.479218 14711 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.483657 15042 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.470045 15041 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.490842  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:30.491683  9102 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:30.455171 15145 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:30.503539 14511 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:30.506767 15212 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.428s	user 0.001s	sys 0.003s
I20260709 13:03:30.507223 15189 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:30.507656 15189 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:30.508456 15189 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.509717 15189 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.510710 15179 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.470255 15222 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.513245 15222 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.523448  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:30.502557 15145 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.454282 15165 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.522163 14938 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:30.548391  9094 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:30.517128 14980 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.517385 15041 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:30.547685 14938 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.546715 14995 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.548584 15145 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:30.560212 15235 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:03:30.573483  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:30.591281  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:30.574072 15178 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.517s	user 0.004s	sys 0.006s
I20260709 13:03:30.574753  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:30.576501  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:30.574096  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:30.578683  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:30.585579  9095 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:30.572724  8508 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:30.592815  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:30.603595  8475 leader_election.cc:400] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18.
I20260709 13:03:30.606132  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:30.560719 14980 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.611940 15209 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:30.625320 15209 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:30.625730 15209 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:30.626533 14980 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.609120 15141 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 13:03:30.627694 14938 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.628098 15222 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:30.628625 15222 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.612118 15227 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:30.613603 15215 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:03:30.613947 15139 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:03:30.615347  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:30.604509 15178 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.604174 15190 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:30.613404 15146 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:03:30.613538 15185 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:30.638301  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:30.602712 15225 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:30.637431  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:30.638911  8575 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.640027  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:30.644598  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:30.645898  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:30.646375 15178 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.646579  9094 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:30.636608 14995 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:03:30.638748 15190 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.649451 15190 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:30.654289  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:30.656147  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:30.654920  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:30.654614  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:30.652122  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:30.660408  8583 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:30.659544  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:30.660921  8578 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:30.661167  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:30.661767  8579 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:30.640918 15225 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.668308  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:30.641204 14980 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:30.667606  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:30.671846  8435 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:30.640630 15185 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:30.673797 15222 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:30.674566 15185 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.675873 15185 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:30.680586 15215 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.681139 15215 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.683362 15215 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.659478 14726 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.684082 14726 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.686076 14726 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.671125  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:30.692370 14726 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:30.692541  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:30.692819 14726 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.693194 14726 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:30.693321 15165 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:30.693814 15165 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.694258 15165 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:30.694859 15216 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.630s	user 0.002s	sys 0.000s
I20260709 13:03:30.696007 15225 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:30.700860  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:30.703394  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:30.634622  8576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:03:30.704933  8576 raft_consensus.cc:606] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:30.705289  8576 raft_consensus.cc:614] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:30.708727  8575 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:30.726460 15209 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.728643 15209 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.731478  8583 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:30.731707 15192 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.738188  8583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:03:30.738783  8583 raft_consensus.cc:606] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:30.739118  8583 raft_consensus.cc:614] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:30.728309 15145 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.706111 14980 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:30.752425  8507 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 23: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:30.746702 15203 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.748034 14980 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:30.766613  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:30.768654  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:30.769718 15225 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.753130 15168 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:30.761545 15195 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.747013 15192 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.780393  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:30.784822  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:30.787983  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:30.789296 15164 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:03:30.765642 15203 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.795718  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:30.778692 15227 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.799875  9068 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:30.788525 15178 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:30.789676 15179 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:30.808539 15202 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:30.820015 15179 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:30.821020  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:30.783617 15167 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:03:30.827278  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:30.828143  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:30.858286  8430 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 20: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:30.850147  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:30.859407  8501 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:30.849726  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:30.861074  8504 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:30.863991  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:30.868830  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:30.869642  8583 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:30.874009  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:30.850298 14511 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.878753  8501 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:30.832623  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:30.804315 15206 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:30.832871  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:30.836488 15190 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.837854  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:30.789433 15155 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:03:30.838784 15196 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:30.839138  9102 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:30.841114  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:30.891894  8509 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:30.841727  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:30.842377  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:30.844141  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:30.783210 15195 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.846761 15179 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.849004 15192 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.805011 15164 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:30.852820 15203 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:30.855314 15225 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.803890 15161 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:30.849090  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:30.885165  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:30.890738 15221 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:30.902997 14995 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:30.903208 15221 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.905400 15145 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:30.907011 15195 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.908707 15164 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:30.909125 14726 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.910423  8431 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 23: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:30.910454 15190 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.881119 15206 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:30.913020 15247 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:03:30.912788 15206 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.913573 14785 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.890543 15178 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:03:30.890388 15232 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.916759 15232 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.917197  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:30.917810  8508 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:30.886207 15227 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:30.919482 15227 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:30.920240 15227 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:30.921613  8502 raft_consensus.cc:2368] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:03:30.922693 14785 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.924928 14785 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:30.925935  9097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1811) took 1378 ms (client timeout 1757 ms). Trace:
W20260709 13:03:30.926379  9097 rpcz_store.cc:269] 0709 13:03:29.547357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.547588 (+   231us) service_pool.cc:224] Handling call
0709 13:03:30.925757 (+1378169us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54002b8c54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:30.925852 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269627776}
W20260709 13:03:30.927278  8549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.757s (SENT) [suppressed 18 similar messages]
W20260709 13:03:30.889634  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48296.5us
I20260709 13:03:30.928282  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:30.929057 15106 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:30.929558 15106 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:30.929853  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:30.930550  8579 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:30.930789 15106 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.892830  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:30.932263  8503 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:30.932772 15221 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.930819 15164 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.887636 14511 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:30.871798 14980 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.938980  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:30.940704  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:30.940838  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:30.941567  8583 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:30.944430  8575 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:30.947283  8579 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:30.948276  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:30.952675  8435 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:30.963994  8576 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:30.855466 15210 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.969421  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:30.976462  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 49211us
I20260709 13:03:30.970091  8503 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:30.978560  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:30.980449  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:30.983780  8501 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:30.892062 15141 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:30.988006 14350 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:30.989315  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:30.991169 14350 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.991567  8583 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:30.929497 15165 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.999398  8508 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:30.975693 15155 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:30.968662 15202 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:31.009474  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:30.976874 14726 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:31.008889  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2837) took 1220 ms. Trace:
I20260709 13:03:30.983035 15185 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:31.017669 15165 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:30.987253 15210 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:31.025471  8509 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:31.026418 15210 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:31.028838 14711 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:31.029278 14711 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:31.032059  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:31.010147 15155 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:31.034612 15155 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:30.999662 15141 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.040328 15141 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.012706  8582 rpcz_store.cc:276] 0709 13:03:29.777919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.779067 (+  1148us) service_pool.cc:224] Handling call
0709 13:03:29.779348 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.085144 (+305796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.085172 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.089308 (+  4136us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.285545 (+196237us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:30.293904 (+  8359us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.929832 (+635928us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b18001792c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:03:30.985059 (+ 55227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.985142 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.985960 (+   818us) raft_consensus.cc:1685] finished
0709 13:03:30.997912 (+ 11952us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.998125 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":345594,"prepare.queue_time_us":8117,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":613,"raft.queue_time_us":352699,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":7935,"spinlock_wait_cycles":5579648,"thread_start_us":186527,"threads_started":2,"wal-append.queue_time_us":214045}
I20260709 13:03:31.021313  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:31.013484 14954 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.047026  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:31.048041  8584 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:31.044832  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:31.049021  8583 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:03:31.050132 14511 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:31.052630  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:31.052913  8427 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:31.053248  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:31.054091  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:31.067526  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:31.068339  8426 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:31.067430  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.055821  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:31.071792 14511 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:31.073215 14511 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:30.997489 15201 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:03:31.079839  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:31.078338 15165 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:31.082739 15165 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.084798 15165 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.086930 14980 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.067785 14954 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:31.089392 14954 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:31.069564 15185 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.090775  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:31.092020 15185 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.092868 15218 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:31.096158 15146 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:31.096541 15146 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:31.097429  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2839) took 1094 ms. Trace:
I20260709 13:03:31.097805  8577 rpcz_store.cc:276] 0709 13:03:30.003121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.003236 (+   115us) service_pool.cc:224] Handling call
0709 13:03:30.003518 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.119644 (+116126us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:30.158213 (+ 38569us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.628996 (+470783us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b18002a0520. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9
0709 13:03:30.775794 (+146798us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b18002a0520. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:03:30.968692 (+192898us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.987650 (+ 18958us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.987832 (+   182us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:30.987876 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.987960 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:31.097232 (+109272us) raft_consensus.cc:1685] finished
0709 13:03:31.097253 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.097376 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176737,"prepare.queue_time_us":38516,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":264021,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":34983,"spinlock_wait_cycles":53347840,"thread_start_us":107177,"threads_started":1,"wal-append.queue_time_us":740155}
I20260709 13:03:31.099689  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:31.090297  8433 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:03:31.102270  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:31.109573  8426 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:31.113039  8576 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:31.097350 15146 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.125912  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1533) took 1350 ms. Trace:
I20260709 13:03:31.126173  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:31.126782  8584 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:31.127065  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:31.126355  9098 rpcz_store.cc:276] 0709 13:03:29.775677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.775969 (+   292us) service_pool.cc:224] Handling call
0709 13:03:31.125724 (+1349755us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b5400669254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:31.125849 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397942656}
I20260709 13:03:31.134922  8583 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:31.136861  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:31.137689  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:31.138244  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:31.159802  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:31.161020  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:31.161577  8576 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:31.172286  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:31.173328  8578 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 23: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:31.138304  8502 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
W20260709 13:03:31.178866  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45473.7us
I20260709 13:03:31.067420 15232 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.067972 15209 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:31.187176  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:31.179744  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:31.190884  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:31.192255  8503 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:31.193336  8576 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:31.127686 15083 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:31.195976  8547 leader_election.cc:400] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:03:31.201421  8584 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:31.201807  8547 leader_election.cc:403] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:03:31.158196 14954 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.215180  8476 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.157562 14936 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:31.222517  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.221830  8430 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:31.222337  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.045389 14711 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:31.243965 14350 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.244867  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:31.242727  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:31.199085 15251 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:03:31.239748  8433 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:31.195760 15232 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.128906 15215 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:03:31.256565  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.214212 14930 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17.
I20260709 13:03:31.198562 15148 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:31.258852  8430 raft_consensus.cc:2410] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:31.255311  8432 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:31.257457 15232 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.261219 15254 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:03:31.261531  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:31.274065  8503 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:31.262283  8510 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:31.198454 15157 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:31.162739 15155 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.266130  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:31.275713  8505 raft_consensus.cc:2368] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19.
I20260709 13:03:31.194855 15209 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.254590 15019 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:31.268610  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 164084us
I20260709 13:03:31.238633 14936 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:31.272830  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:31.254755 15228 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:31.271373  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.280228  8508 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:31.282429  8433 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
W20260709 13:03:31.284588  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 70090.9us
I20260709 13:03:31.287128  9068 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:31.288673  8476 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.289518 15195 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:31.290392  8547 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:31.291122 15221 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:03:31.290802  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 189495us
I20260709 13:03:31.291591 15221 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.291652  8547 leader_election.cc:400] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19.
I20260709 13:03:31.292062 15221 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:31.252033 14954 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.237474 15260 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:03:31.292081  8547 leader_election.cc:403] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:31.308709  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:31.308184 14350 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19.
I20260709 13:03:31.275970 15157 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.340013 14350 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:31.300031  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.254745 15230 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:31.304708 14511 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:31.340544 14350 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.346736 14350 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:31.346788  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46802us
W20260709 13:03:31.345171  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46208.9us
I20260709 13:03:31.350483  8577 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:31.286392 15019 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.353976 15232 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.354555 15232 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:31.354965 15019 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.355669  8584 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:31.338105 15157 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:31.273370 15148 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.371347  8398 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:31.342401 15196 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:31.287139 14938 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:03:31.311406 15203 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:03:31.379691 14350 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.362749 15185 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:31.361795 15215 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:31.410964 15215 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:31.413204 15215 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:31.370141 15260 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:31.414331 14350 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.397672 14980 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:31.398190 15276 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:03:31.409839 15262 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:31.355005 15232 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.397030  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:31.420529 15260 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.434645  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:31.442620 14980 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:31.443486 15268 consensus_queue.cc:1059] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:31.447296  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.449548  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:31.452574  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.455874  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.455996  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.457720  8433 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:31.458503  8432 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:31.460022  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:31.460659  8432 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:31.464877 14350 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.465370 14350 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:31.467199 14350 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:31.469563  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.470712  8435 raft_consensus.cc:2410] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:03:31.471333  8432 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:31.472407  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.473083  8427 raft_consensus.cc:2368] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19.
I20260709 13:03:31.475700  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.367568 15189 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:03:31.477936  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.480655  8433 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:31.350529 14936 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.430307 14726 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:31.498384 15042 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.477892 15215 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:31.500949 15215 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.501348 15215 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:31.501401 14954 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:31.502615 15263 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:03:31.414805 15196 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:31.504966 15261 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:03:31.506927 15196 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.543303 14350 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:31.544148 14350 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.431569 15201 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:03:31.547426 14511 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:31.547791  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 199803us
I20260709 13:03:31.550374 14511 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.558308  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:31.559180  9098 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:31.561288  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:31.572809  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:31.573486  8433 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:31.548838 15154 raft_consensus.cc:3055] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:31.575340 15154 raft_consensus.cc:740] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:31.575709 15275 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:03:31.575910  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:31.576212 15154 consensus_queue.cc:260] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.577363 15154 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:31.578227  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:31.578732 15148 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:31.578938  9100 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 13: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:31.579510 15209 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.580375  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:31.580685  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:31.580960  8506 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:31.582569  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:31.652621  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45168.1us
I20260709 13:03:31.652778  8510 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:31.584093 14350 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.586944  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:31.659926  8506 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:31.543843 14726 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.661644  8577 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:03:31.662501  9100 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:31.542407 15042 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.589143 15155 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:31.719461 15278 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:03:31.712203  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:31.670192  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:31.723388  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53378.3us
I20260709 13:03:31.724292 15230 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:31.725901  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.730708 15230 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:31.727988 15042 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:31.733739  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.734524  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:31.735134  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.735339  8577 raft_consensus.cc:2368] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:03:31.735811  8506 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:03:31.663733 15279 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:31.737998  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.738957  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:31.743499 14511 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:31.743996  8550 leader_election.cc:400] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19.
I20260709 13:03:31.744136 14350 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:31.744944  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:31.743587  8510 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:31.746176  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:31.745529 15042 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:03:31.748586 15269 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:31.749728  8507 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 13:03:31.753589  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.669299 15136 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:31.755337 14511 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:31.755862 14511 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:31.755771  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.746136 15230 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:03:31.759516 15215 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:31.760327 15230 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:31.760555  8430 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:03:31.760721 15230 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.761106 15230 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:31.762128  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:31.762318 15215 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:31.766268  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:31.766932 15274 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:31.767656  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:31.738517 15154 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.756922 15136 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:31.772042  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:31.769796  8547 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:31.758607 14511 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.656715 15221 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:31.741869 15155 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:31.782328  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:31.783960  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:31.786101  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.791354  8578 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:31.792671  8509 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:31.793403  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:31.793537  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:31.776589  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.756147 15232 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.802220  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:31.801357  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:31.807137 15291 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:31.779552 15215 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:31.779649 15019 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:03:31.808686  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.767473 15274 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:31.817680  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.827438  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:31.867627 15294 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:31.752588 15279 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.789744 14726 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:31.868832 15282 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:31.800944 15286 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:31.869526 15288 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:31.874111 15221 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:31.781286 15154 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:31.768136 15139 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 13:03:31.888585  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 79754.5us
I20260709 13:03:31.893627  8578 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:31.930702 14350 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:03:31.935045  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 133756us
I20260709 13:03:31.990875  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:31.913897 15228 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.002s
I20260709 13:03:32.015164 14350 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:32.008181  9067 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:31.971535 15155 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:31.971191 15286 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:32.002947 15019 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:32.020714 15291 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:32.057161  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 311622us
W20260709 13:03:32.057993  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 288243us
W20260709 13:03:32.091259  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 305192us
I20260709 13:03:32.021122 15221 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:32.022853 15148 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.020375 15228 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:32.014308 15215 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 23 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:32.130771 14511 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:32.135416 14511 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:32.137799  8505 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:32.053638 15286 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:32.053331 15269 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:32.146234 15281 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:32.020174 15282 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:32.149467 14511 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:32.155802 15279 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:32.160290 15154 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:32.173259 14936 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.175670 15179 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:32.220965 15179 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:32.175702 15274 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:32.176265 15215 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:32.130805 15155 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:03:32.022433 15288 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:32.225493 15288 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:32.181852 15136 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:32.182567 15296 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.227514 15296 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:32.183104 15269 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:32.230727 15269 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:32.232231 15269 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:32.187122 15019 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:32.102555 15042 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:32.188192 15260 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:32.140193 15148 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:32.238473 15042 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:32.239682 15042 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:32.240697 15148 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:32.191232 15228 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:32.151131 15282 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:32.197297 15255 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.002s	user 0.017s	sys 0.004s
I20260709 13:03:32.209456 15161 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:32.243243 15161 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:32.245869 15161 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:32.247134 15296 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:32.318279 15157 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.003s
I20260709 13:03:32.345501 15307 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:32.346115 15307 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:32.265857 15230 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.000s
I20260709 13:03:32.347886 15230 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:32.350265 15230 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:32.341360 15157 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:32.352746 15157 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:32.318995 15225 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:32.348204 15307 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:32.334256 15286 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:32.442889 15218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.028s	sys 0.033s
W20260709 13:03:35.197569 15218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.998s	user 0.031s	sys 0.033s
W20260709 13:03:32.956602 15314 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
W20260709 13:03:34.805938  8364 debug-util.cc:398] Leaking SignalData structure 0x7b080033a660 after lost signal to thread 7338
I20260709 13:03:34.863628  9096 raft_consensus.cc:1240] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:34.864341  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:34.866355  8476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.911s	user 0.017s	sys 0.062s
W20260709 13:03:34.910943  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.199719  8476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.244s	user 0.018s	sys 0.062s
W20260709 13:03:34.915298 15019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.661s	user 0.011s	sys 0.021s
I20260709 13:03:35.200736 15167 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:34.927987  8547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.609s	user 0.012s	sys 0.029s
I20260709 13:03:34.931380  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1156) took 3271 ms. Trace:
I20260709 13:03:35.201277 15167 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.201843  8584 rpcz_store.cc:276] 0709 13:03:31.659495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.659636 (+   141us) service_pool.cc:224] Handling call
0709 13:03:31.666859 (+  7223us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:31.668011 (+  1152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.668056 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:31.734276 (+ 66220us) log.cc:844] Serialized 78 byte log entry
0709 13:03:31.922518 (+188242us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:32.044400 (+121882us) log.cc:844] Serialized 14 byte log entry
0709 13:03:32.318470 (+274070us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b1800324100. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287
0709 13:03:32.318611 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.318690 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.318741 (+    51us) raft_consensus.cc:1685] finished
0709 13:03:34.931082 (+2612341us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.931286 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26688,"prepare.queue_time_us":49949,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":285152,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":42024,"spinlock_wait_cycles":45357440,"thread_start_us":190144,"threads_started":2,"wal-append.queue_time_us":513813,"wal-append.run_cpu_time_us":2207,"wal-append.run_wall_time_us":1005005}
I20260709 13:03:34.976289  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:34.977121 14350 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.643s	user 0.010s	sys 0.022s
I20260709 13:03:35.203828  9094 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 12.
W20260709 13:03:35.204223 14350 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.068s	user 0.011s	sys 0.022s
I20260709 13:03:34.982786 14511 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:35.204878  8547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.886s	user 0.013s	sys 0.029s
I20260709 13:03:35.204780 14511 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:35.205192  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 3.07591e+06us
I20260709 13:03:34.989928  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:35.201853 15019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.947s	user 0.012s	sys 0.022s
I20260709 13:03:35.027154 14995 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:35.206534 14995 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.207891 15203 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.208408 15203 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.209105 14995 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.209439 14350 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:35.209616 14995 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:35.034548  9067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.985s	user 0.034s	sys 0.042s
I20260709 13:03:35.209905 14350 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:35.210428  9067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.161s	user 0.034s	sys 0.042s
I20260709 13:03:35.210610 15203 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:35.210733  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 3.16069e+06us
I20260709 13:03:35.211201 15203 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.051522 15286 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:35.071810 15178 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.211719  9067 leader_election.cc:400] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:03:35.212111  9067 leader_election.cc:403] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:35.212076 15178 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.213025 15258 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:35.075719 15221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.897s	user 0.010s	sys 0.009s
W20260709 13:03:35.213924 15221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.036s	user 0.010s	sys 0.009s
I20260709 13:03:35.213925  9100 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:35.214277 15221 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:35.215307 15221 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:35.081534 15164 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.214s	user 0.013s	sys 0.031s
W20260709 13:03:35.218842  8473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.154s	user 0.071s	sys 0.095s
W20260709 13:03:35.219285 15164 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.352s	user 0.013s	sys 0.032s
W20260709 13:03:35.219444  8473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.155s	user 0.071s	sys 0.095s
W20260709 13:03:35.102953 15037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.717s	user 0.013s	sys 0.046s
W20260709 13:03:35.220391 15037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.834s	user 0.013s	sys 0.047s
W20260709 13:03:35.105283  9068 connection.cc:256] RPC call timeout handler was delayed by -1.9701259060000211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 13:03:35.221184  9068 connection.cc:256] RPC call timeout handler was delayed by -1.9684920999999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:03:35.114828  8550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.988s	user 0.018s	sys 0.020s
I20260709 13:03:35.221927  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:35.222558  8550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.095s	user 0.018s	sys 0.020s
I20260709 13:03:35.224288 14511 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.225387 14511 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:35.130416 15254 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:35.226272 15254 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:35.227191 15254 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.228474 15254 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:35.192072 15192 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:35.229453 15192 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.231622 15192 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:35.194339 15145 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:35.232460 15145 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.234625 15145 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:35.195210  8583 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:35.237610  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2867) took 3437 ms. Trace:
I20260709 13:03:35.196681 15161 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:35.199613  9093 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:35.211699 14350 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.203321 15167 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:35.212594 15286 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:35.213502 15258 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.081707 15260 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.221007  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:35.126180 15202 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:35.241135  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:35.242192 14350 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:35.244125  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:35.244059 14995 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.244731 15178 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:35.246356  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:35.237959  8583 rpcz_store.cc:276] 0709 13:03:31.799913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.801421 (+  1508us) service_pool.cc:224] Handling call
0709 13:03:31.801679 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.235531 (+3433852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.237356 (+  1825us) spinlock_profiling.cc:243] Waited 3.39 s on lock 0x7b5400155754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:35.237551 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7803758336}
I20260709 13:03:35.238368 15161 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:35.249001  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.976289  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:35.278803  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1159) took 3606 ms. Trace:
I20260709 13:03:35.019615 15273 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:35.242910  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:35.275518  9096 raft_consensus.cc:2376] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13. Re-sending same reply.
I20260709 13:03:35.287315  9099 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:35.290889  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:35.104496  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1420) took 4237 ms. Trace:
I20260709 13:03:35.280563  9100 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:35.279202  8581 rpcz_store.cc:276] 0709 13:03:31.672778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.737246 (+ 64468us) service_pool.cc:224] Handling call
0709 13:03:31.737529 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.017444 (+279915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:32.017490 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:32.017547 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:32.017597 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.278575 (+3260978us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400283f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:35.278623 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.278747 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643244928}
I20260709 13:03:35.275482  9102 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:35.288534 14350 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:35.276467 15202 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:35.292287  8504 rpcz_store.cc:276] 0709 13:03:30.866739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.091754 (+225015us) service_pool.cc:224] Handling call
0709 13:03:31.092121 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.139221 (+ 47100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.139263 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.180062 (+ 40799us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.101168 (+3921106us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b18002d2200. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:03:35.102588 (+  1420us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:35.102628 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.102694 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.104174 (+  1480us) raft_consensus.cc:1685] finished
0709 13:03:35.104193 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.104416 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89781,"raft.queue_time_us":66324,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":13486,"spinlock_wait_cycles":16094592,"thread_start_us":1210,"threads_started":1,"wal-append.queue_time_us":3904138}
I20260709 13:03:35.249034 15037 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.299590 14511 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:03:35.300835 15221 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:35.313478  9094 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:35.276180 15260 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.308287 15330 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.314352 14350 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.305646 15328 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:35.323846  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:35.313448 15221 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.326314 15258 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:35.326875 15258 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:35.327117 15221 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:35.327337 15258 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:35.327867 15323 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:35.328419 15323 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:35.329489 15258 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.322458 14350 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:35.211680 15203 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:35.331151  9096 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:35.294193  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:35.330940 14350 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:35.338435 15164 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:35.339246 14995 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:35.340133  9093 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 23: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:35.338975 15164 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.281885 15286 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.340421  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:35.343438  9095 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
W20260709 13:03:35.346660  8547 connection.cc:256] RPC call timeout handler was delayed by -1.9251972230000547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
I20260709 13:03:35.347584  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:35.334669 15167 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.313318 15037 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.350286 14350 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.285826 15273 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.351025  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:35.360565  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:35.363559 15273 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.365257 15203 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.366216 15286 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:35.371141 15323 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:35.341022 15330 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:35.374410  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.349406 15221 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.352000 15321 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.340651 15328 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:35.349493 15258 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:35.354195  9095 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:35.410104  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:35.411103  8578 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:35.410177  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:35.392613 15330 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:35.422825 15330 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:35.423364 15330 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.423746 15321 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.358974 15167 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.427287  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:35.413184  8582 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:35.463361  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:35.424176 15328 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:35.376356  8476 connection.cc:256] RPC call timeout handler was delayed by -2.5323914030000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 13:03:35.466797  8476 connection.cc:256] RPC call timeout handler was delayed by -2.2524345900000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 13:03:35.474869  8582 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:03:35.473897  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 185241us
I20260709 13:03:35.425546 15164 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.483618 15336 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:35.484181 15336 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:35.486267 15321 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:35.486886 15167 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.425933 15258 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.489473 15336 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:35.489835 15258 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:35.481331  9098 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:35.481205  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:35.490067 15336 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.495446  8577 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:03:35.466387 15161 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:35.480306  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:35.474752 15260 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:35.495015  8582 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 13:03:35.501868  8476 connection.cc:256] RPC call timeout handler was delayed by -1.9940175770000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260709 13:03:35.502276  8476 connection.cc:256] RPC call timeout handler was delayed by -1.9347345900000619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
W20260709 13:03:35.495136 14936 consensus_meta.cc:287] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 3.273s	user 0.019s	sys 0.010s
I20260709 13:03:35.505388 15037 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:35.505632  8549 connection.cc:256] RPC call timeout handler was delayed by -2.9645781719999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 13:03:35.425686 15221 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.515157  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:35.516170  8549 connection.cc:256] RPC call timeout handler was delayed by -2.904626685999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 13:03:35.501681 15330 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:35.517628  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:35.525161  8507 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
W20260709 13:03:35.517349  8549 connection.cc:256] RPC call timeout handler was delayed by -2.5744850149999365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 13:03:35.514561 15258 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.521467 15324 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.521392  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:35.529368  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:35.529441  8510 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:35.517899 15037 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:35.524247  8576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.754s	user 0.069s	sys 0.155s
I20260709 13:03:35.533542  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:35.526355  8549 connection.cc:256] RPC call timeout handler was delayed by -2.5022798659999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 13:03:35.531152  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:35.534509  8509 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
W20260709 13:03:35.535267  8549 connection.cc:256] RPC call timeout handler was delayed by -2.3935179819999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
I20260709 13:03:35.531032 15324 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:35.498103 15336 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:35.543913  8501 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:35.545990  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:35.516775 15335 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.546718  8508 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:35.551514  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:35.528271 15221 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:35.633586  8576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.864s	user 0.070s	sys 0.155s
I20260709 13:03:35.544554 15157 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:35.639945  8549 connection.cc:256] RPC call timeout handler was delayed by -2.1279644559999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 13:03:35.640352  8549 connection.cc:256] RPC call timeout handler was delayed by -2.1107026710000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 13:03:35.640640  8549 connection.cc:256] RPC call timeout handler was delayed by -2.1016040839999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 13:03:35.640888  8549 connection.cc:256] RPC call timeout handler was delayed by -1.4678913649999004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 13:03:35.644264  8508 raft_consensus.cc:2410] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:03:35.533653 15258 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.646198  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:35.544914 15037 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.546458 15202 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.673439 15336 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:35.689836 15345 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.548879 15335 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:35.660162  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:35.873502 15339 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:35.874910  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.914280  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.645669 15157 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.028589  8504 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:36.027369 15161 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.030678 15161 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.010602 15339 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:35.992412 15345 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:36.104230 15037 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.276011  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.282757  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.286677 15345 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.287783 15324 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:36.288978 15202 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.276368  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.291117 15339 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.291965 15157 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.303357 14350 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:36.230460  8504 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:36.275484  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.305846  8508 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:36.336823  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1562) took 1475 ms. Trace:
I20260709 13:03:36.348133  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.156009 15335 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.316789 15258 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.349212  8508 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:36.352334  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.328370 15339 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.353708  8509 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:36.356043  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:36.356537 15269 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 4.124s	user 0.010s	sys 0.030s
I20260709 13:03:36.360025 15179 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.361299 15179 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:36.362259 15339 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:36.362862  8364 debug-util.cc:398] Leaking SignalData structure 0x7b080009de00 after lost signal to thread 8367
W20260709 13:03:36.363749 15277 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 5.007s	user 0.039s	sys 0.042s
I20260709 13:03:36.364766 15339 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.365732  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1424) took 4979 ms. Trace:
I20260709 13:03:36.366147  8505 rpcz_store.cc:276] 0709 13:03:31.385840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.385954 (+   114us) service_pool.cc:224] Handling call
0709 13:03:31.386273 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.138223 (+751950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.365464 (+4227241us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b540005a0d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:36.365647 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727582464}
I20260709 13:03:36.370746  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.371431  8580 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
W20260709 13:03:36.375154 15042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.113s	user 0.027s	sys 0.026s
W20260709 13:03:36.375752  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.246s	user 0.009s	sys 0.032s
I20260709 13:03:36.382117  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.382859  8581 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:03:36.384199  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:36.384688  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:36.384967  9096 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:36.385278  8581 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:36.346513 15324 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:03:36.386724  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 726591us
I20260709 13:03:36.386758  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:36.388725  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:36.390471  9096 raft_consensus.cc:2410] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:03:36.399358  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:36.400342  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:36.400436  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:36.400969  9096 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:36.401479  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.401698  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:36.402093  8508 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:03:36.402360  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.404580  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.405279  8505 raft_consensus.cc:2410] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:03:36.402976  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.406073  8509 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
W20260709 13:03:36.403483  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.274s	user 0.010s	sys 0.032s
I20260709 13:03:36.404462  9096 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:36.405821  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:03:36.407117  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 4.27812e+06us
I20260709 13:03:36.403714  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.410334  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:36.411083  9096 raft_consensus.cc:2393] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:36.408306  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:36.416148  8476 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.600s (SENT) [suppressed 7 similar messages]
I20260709 13:03:36.403805 15232 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:36.405181  8578 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:36.418387  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:36.397670 15042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.136s	user 0.028s	sys 0.026s
I20260709 13:03:36.419265  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:36.419415  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:36.421820  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:36.423683  8547 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:36.424851  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:36.430784  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:36.420058 15232 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:36.431670  8581 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:36.420681 14350 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:36.425554 15037 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:36.435844 15037 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:36.420321 15201 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:36.430428 15321 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:36.430574 15351 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:36.433554  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:36.397848 15324 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.440049 14350 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.437222 15037 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:36.435030 15232 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:36.455034  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 44200.2us
I20260709 13:03:36.456516  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:36.437438 15321 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:36.438211 15351 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.446861 15201 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:36.447021 15221 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:03:36.464474  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45326.3us
I20260709 13:03:36.469334 15324 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.472708 15357 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:36.473196 15357 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.473526 15357 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:36.482230  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:36.485180  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:36.464946 15351 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:36.487125 15352 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:36.487562 15352 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.487887 15352 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:36.490280 15221 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:36.491333 15221 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.495421 15042 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:36.495918 15042 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:36.496333 15042 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:36.497228 15347 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.100s	user 0.000s	sys 0.002s
I20260709 13:03:36.463982 15321 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:36.498574  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2588) took 4732 ms. Trace:
I20260709 13:03:36.498982  8576 rpcz_store.cc:276] 0709 13:03:31.768221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.768966 (+   745us) service_pool.cc:224] Handling call
0709 13:03:31.769347 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.634097 (+3864750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.634127 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:35.639777 (+  5650us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.877993 (+238216us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:35.878066 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.878139 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.496675 (+618536us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:36.498261 (+  1586us) raft_consensus.cc:1685] finished
0709 13:03:36.498283 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.498495 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":679,"raft.queue_time_us":189807,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":31385,"spinlock_wait_cycles":3817344,"thread_start_us":4076260,"threads_started":2,"wal-append.queue_time_us":697153}
I20260709 13:03:36.502291 15179 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:36.502653  9096 raft_consensus.cc:2410] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:03:36.504678 15352 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:36.506232  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.508184  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:36.507467  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.512578  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.513276  8501 raft_consensus.cc:2368] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:03:36.517474  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:36.518217  8510 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:36.522267 15360 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.522876 15360 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:36.525013  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800306b00 after lost signal to thread 8459
I20260709 13:03:36.526003  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.529570  8501 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:36.533799  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.546379  8510 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:36.522887 15283 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:36.551772 15283 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:36.552692 15283 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.553687  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2823) took 5099 ms. Trace:
I20260709 13:03:36.554010  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.554381  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.554157  8430 rpcz_store.cc:276] 0709 13:03:31.454003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.454169 (+   166us) service_pool.cc:224] Handling call
0709 13:03:31.454550 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.760947 (+306397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.553373 (+4792426us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400239454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:36.553599 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703230848}
I20260709 13:03:36.555306  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.555982  8509 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:36.556499  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3073) took 1362 ms. Trace:
W20260709 13:03:36.556207  9100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1559) took 1695 ms (client timeout 1991 ms). Trace:
I20260709 13:03:36.546836  8505 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:36.548317 15232 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.556757  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.562361  8579 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:36.564361  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1166) took 1154 ms. Trace:
W20260709 13:03:36.557376  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800137180 after lost signal to thread 8534
W20260709 13:03:36.565469  8364 debug-util.cc:398] Leaking SignalData structure 0x7b080027e5a0 after lost signal to thread 8535
I20260709 13:03:36.555275  8510 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:36.557796  8503 rpcz_store.cc:276] 0709 13:03:35.193859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.555803 (+1361944us) service_pool.cc:224] Handling call
0709 13:03:36.556070 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.556231 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.556253 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.556293 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:36.556326 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.556375 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.556454 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:36.557230  9100 rpcz_store.cc:269] 0709 13:03:34.860320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.989652 (+129332us) service_pool.cc:224] Handling call
0709 13:03:36.556047 (+1566395us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b54005479d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:36.556151 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17522048}
I20260709 13:03:36.564754  8579 rpcz_store.cc:276] 0709 13:03:35.410096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.535117 (+1125021us) service_pool.cc:224] Handling call
0709 13:03:36.546862 (+ 11745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.564061 (+ 17199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.564295 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.553712 15283 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:36.568586 14954 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:36.576331 15351 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.578814  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.579602  8505 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:03:36.583246  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1830) took 1343 ms. Trace:
I20260709 13:03:36.582118  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.571579 15201 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:36.590154  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.616101 15146 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:36.590847 15190 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.617031 15042 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.594511 15161 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.618577  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1167) took 1208 ms. Trace:
I20260709 13:03:36.618642  8501 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:36.619437 15042 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.620282  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.620801  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2604) took 1117 ms. Trace:
I20260709 13:03:36.620885  8501 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:36.621282  8504 rpcz_store.cc:276] 0709 13:03:35.508421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.514899 (+  6478us) service_pool.cc:224] Handling call
0709 13:03:36.620603 (+1105704us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b5400154354. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:36.620703 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176620928}
I20260709 13:03:36.621788  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.622967  8504 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:03:36.623189  8501 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:36.597236  8509 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:36.598719  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.598270 15352 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:36.601438  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.624730  8505 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:36.624948  8510 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:36.601909 15351 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.602788  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.603799 15321 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:36.604123  9093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1836) took 1362 ms (client timeout 1803 ms). Trace:
I20260709 13:03:36.626085  8503 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
W20260709 13:03:36.626286  9093 rpcz_store.cc:269] 0709 13:03:35.241987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.246136 (+  4149us) service_pool.cc:224] Handling call
0709 13:03:36.603930 (+1357794us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b54005b6b54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:36.604067 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149999872}
I20260709 13:03:36.581082 15037 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:36.626894  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1560) took 1766 ms. Trace:
I20260709 13:03:36.627298  9098 rpcz_store.cc:276] 0709 13:03:34.860589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.330287 (+469698us) service_pool.cc:224] Handling call
0709 13:03:35.338162 (+  7875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.494517 (+156355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.626637 (+1132120us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400526554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:36.626806 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326748032}
I20260709 13:03:36.628628 15037 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:36.337427  9097 rpcz_store.cc:276] 0709 13:03:34.861056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.639353 (+778297us) service_pool.cc:224] Handling call
0709 13:03:35.648245 (+  8892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.648491 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:36.110318 (+461827us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.336433 (+226115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.336488 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:36.336552 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.336631 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.336765 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":688617,"raft.queue_time_us":107,"thread_start_us":678222,"threads_started":2}
I20260709 13:03:36.583693  9099 rpcz_store.cc:276] 0709 13:03:35.240306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.242676 (+  2370us) service_pool.cc:224] Handling call
0709 13:03:36.582917 (+1340241us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b54006130d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:36.583194 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9224448}
I20260709 13:03:36.612435  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2587) took 4846 ms. Trace:
I20260709 13:03:36.643792  8577 rpcz_store.cc:276] 0709 13:03:31.765833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.766116 (+   283us) service_pool.cc:224] Handling call
0709 13:03:31.766424 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.495871 (+3729447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.612177 (+1116306us) spinlock_profiling.cc:243] Waited 3.73 s on lock 0x7b5400349254. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:36.612377 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8575179008}
I20260709 13:03:36.608371  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1162) took 1199 ms. Trace:
I20260709 13:03:36.645162  8583 rpcz_store.cc:276] 0709 13:03:35.408845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.409002 (+   157us) service_pool.cc:224] Handling call
0709 13:03:35.409460 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.475283 (+ 65823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.475317 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:35.479863 (+  4546us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.499122 (+ 19259us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:35.499164 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.607988 (+1108824us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b54000668d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:36.608036 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.608080 (+    44us) raft_consensus.cc:1685] finished
0709 13:03:36.608096 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.608311 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8813,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":895,"spinlock_wait_cycles":128408832,"thread_start_us":18887,"threads_started":1,"wal-append.queue_time_us":51277,"wal-append.run_cpu_time_us":1562,"wal-append.run_wall_time_us":1002493}
I20260709 13:03:36.619037  8575 rpcz_store.cc:276] 0709 13:03:35.410403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.422161 (+ 11758us) service_pool.cc:224] Handling call
0709 13:03:35.422506 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.490832 (+ 68326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.490864 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:35.490907 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:35.490949 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.618367 (+1127418us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b54000663d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:36.618408 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.618526 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156660480}
I20260709 13:03:36.617033 15190 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.631614 15321 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.648922 15362 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:36.649577 15362 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.650753 15148 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:36.652140 15362 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:36.649605 15202 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:36.653007 15202 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.594203 15360 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.655977 15202 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:36.623311  8504 pending_rounds.cc:85] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 13
I20260709 13:03:36.661219  8504 pending_rounds.cc:107] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:03:36.661559  8504 raft_consensus.cc:2889] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:36.649144 15190 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.609632 15232 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.595701 15357 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:36.693953  8364 debug-util.cc:398] Leaking SignalData structure 0x7b080037d480 after lost signal to thread 8608
W20260709 13:03:36.719272  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 70500.6us
W20260709 13:03:36.729594  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.777886  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 294337us
W20260709 13:03:36.802920  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 82619us
I20260709 13:03:36.803866  9065 leader_election.cc:400] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:03:36.805140  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:36.806924  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.808190  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:36.810622 15357 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.810787  8508 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:36.367930  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:36.808266 14936 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:36.813988 14936 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:36.815472  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:36.816056  8503 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:36.816540 14936 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.807782  9065 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:36.820200 14711 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:36.822260 15202 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:36.822685 15202 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:36.823062 15202 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:36.827437  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.828980 15206 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:36.831710  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08000da560 after lost signal to thread 9126
I20260709 13:03:36.831467 15202 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:36.832026  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08003ffb60 after lost signal to thread 9127
I20260709 13:03:36.829566  8503 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:36.833676  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:36.808997  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:36.834709  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:36.808378  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:36.835330  8510 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:36.835637  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 135465us
I20260709 13:03:36.838197  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:36.839169  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1920 after lost signal to thread 15265
W20260709 13:03:36.839493  8364 debug-util.cc:398] Leaking SignalData structure 0x7b080039d2c0 after lost signal to thread 15266
W20260709 13:03:36.839794  8364 debug-util.cc:398] Leaking SignalData structure 0x7b080032bec0 after lost signal to thread 15271
W20260709 13:03:36.840101  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08002e1be0 after lost signal to thread 15276
W20260709 13:03:36.840503  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1360 after lost signal to thread 15289
I20260709 13:03:36.840480  8475 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:36.834725  8504 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:36.842610  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:36.843820 15366 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:36.844408 15366 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:36.845422 15366 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.848548 15313 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:36.848743 15289 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.849432 15215 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.849644 15019 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.849200 15313 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.850176 15215 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:36.850353 15019 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.852152 15313 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.852316 15215 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.852743 15313 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.853232 15313 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:36.849285 15289 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.854121 15083 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:36.854622 15083 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.855542 15313 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.855799 15289 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.856200 14350 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:36.856593 14350 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.856772 15083 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.856976 14350 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:36.858601  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.860425  8427 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:36.860752 14980 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.862188  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.862308  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.863410  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:36.863863  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.861750  8431 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:03:36.864534  8426 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:36.865757 15153 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:36.865994  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 407977us
I20260709 13:03:36.866174 15209 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:36.866452 15153 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.867306 15209 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:36.869444 15153 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.870102 15269 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:36.870651 15269 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.872112  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.861804 15165 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:36.873052  8427 raft_consensus.cc:2410] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:03:36.873433 15165 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.866367 15276 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:36.874667 15276 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:36.875584 15165 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.876789 15276 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.877224 15269 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.849208 15227 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.877797 15227 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.869690 15209 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.880393 15227 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.853408 15106 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:36.881243  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1563) took 2019 ms. Trace:
I20260709 13:03:36.881043 15106 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:36.883190 15106 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.861198 14980 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.885452 14980 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.834817 15202 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:36.881579  9101 rpcz_store.cc:276] 0709 13:03:34.861333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.522077 (+660744us) service_pool.cc:224] Handling call
0709 13:03:36.583203 (+1061126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.583408 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:36.599882 (+ 16474us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.871084 (+271202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:36.871127 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:36.871182 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.871238 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.881080 (+  9842us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54006130d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:36.881191 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16686,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":213,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":2439622400,"thread_start_us":270443,"threads_started":1,"wal-append.queue_time_us":268416}
W20260709 13:03:36.895069  9094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1829) took 1655 ms (client timeout 2069 ms). Trace:
W20260709 13:03:36.895738  9094 rpcz_store.cc:269] 0709 13:03:35.239985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.242137 (+  2152us) service_pool.cc:224] Handling call
0709 13:03:36.894903 (+1652766us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b5400594a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:36.895006 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87587584}
I20260709 13:03:36.853255 15019 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:36.902732  8510 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
W20260709 13:03:36.903450  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 61972.6us
I20260709 13:03:36.914690  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.915316  8580 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:36.916272  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.916389  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.917039  8575 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:36.918569  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.919503  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:36.922956  8475 connection.cc:256] RPC call timeout handler was delayed by -1.3251092430000426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:03:36.924077  8430 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:36.924091  8577 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:36.925182  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.926255  8583 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 21: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:36.928330  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.929093  8503 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:36.927071  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.920467 14350 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:36.849242  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:36.910559 15363 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.932416  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.933894  8547 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:36.923846 15287 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:36.935000  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.949811  8426 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 20: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:36.949977  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:36.932006  8427 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:36.935082  8580 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 24: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:36.938423  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.945269  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.934597  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.951282  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.951751  8584 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:36.951903  8577 raft_consensus.cc:2393] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:36.952466 15232 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:36.952975 15287 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:36.953164 15232 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:36.953492 15287 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:36.954161 15232 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:36.957911 15321 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:36.941056  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.939590  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.939488  8429 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:03:36.937220  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 88058.4us
I20260709 13:03:36.931025  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2599) took 5355 ms. Trace:
I20260709 13:03:36.941505  8435 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:36.930439  8431 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:36.930480  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:36.964658  8510 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:36.947973  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 81098.2us
I20260709 13:03:36.948403 14350 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:36.967393  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.968154  8575 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:36.929776  8504 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:36.930738  8508 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:36.952569 15258 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:36.963274  8502 rpcz_store.cc:276] 0709 13:03:31.575599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.576978 (+  1379us) service_pool.cc:224] Handling call
0709 13:03:31.577267 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.607587 (+ 30320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.607618 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.525098 (+4917480us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b2c0005c2d8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:03:36.533294 (+  8196us) log.cc:844] Serialized 26 byte log entry
0709 13:03:36.902660 (+369366us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:36.902696 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.903255 (+   559us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.903296 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:36.903310 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.930970 (+ 27660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18634,"raft.queue_time_us":40760,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":37917568,"thread_start_us":354651,"threads_started":1,"wal-append.queue_time_us":298378}
I20260709 13:03:36.940456  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.970455  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:36.975136  8426 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:36.975801  9065 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:36.971627  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.977090  8430 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:36.977867  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.975030  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.974073  8575 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:36.977835 14350 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:36.973331  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.982277  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:36.982965  8502 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:36.966886  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:36.970727  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:36.979187  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:36.937932 15192 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.943675 15154 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.023707  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.024749  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.025367  8433 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:37.026202  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.027233  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.026769  8429 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
W20260709 13:03:37.031064  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 60411.2us
I20260709 13:03:37.031872  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.006906  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:36.941085 15202 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:36.941334 15153 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.010831  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.016160  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.016728  8510 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:37.022403 15192 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:37.034165 15179 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:36.974475 15357 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:03:36.948675 15339 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:03:37.038288 15154 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:36.974620 15258 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.042001 15360 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:37.042665 15335 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:37.067534 15323 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:37.032388  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53285.4us
I20260709 13:03:37.089366  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:36.988652  8426 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:37.046330 15366 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:03:37.046768  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 71046.6us
I20260709 13:03:37.092084  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:37.093262  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:37.050195  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.093881 14350 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:37.094743  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.092832 15285 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:03:37.096216  8476 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.096854 15154 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:37.097381  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:37.097575  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.098193 15369 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:37.098591 15161 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.098958 15369 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:37.057247  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.099380 15369 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:37.099746 15369 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:37.100095  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.100826  8429 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:37.099913 15287 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.101606  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.102178  8431 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:37.102643  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.103111  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.031798  9067 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:37.070220  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.104252  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:37.104738  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 73026.4us
I20260709 13:03:37.105247  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.105326  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.055356  8427 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:37.105948  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.106568  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.107143  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.107650  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.108259  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.108723  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.108888  8431 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:37.109048  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.073750  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.078586  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.079541  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.081264 15153 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:37.084213 15179 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:37.079804  8502 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 24.
I20260709 13:03:37.080066  8581 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:37.079576  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.080322  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.081283  9102 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:37.081667  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.082252  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.084362  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.109858  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.110102  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.125134  8583 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 20: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:37.125231  8435 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:03:37.125890  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.126492  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.126783  8426 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:37.127341  8576 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 21: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:37.086177  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.127934  8428 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:37.087008  8584 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:37.043059  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 76250.6us
I20260709 13:03:37.088011  8507 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:37.089977  8577 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:37.014251 15321 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:37.056404  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:37.133695  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.134985  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 66431.2us
I20260709 13:03:37.135367  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:37.135848  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.132973  8433 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
W20260709 13:03:37.139496  8507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2609) took 1610 ms (client timeout 1945 ms). Trace:
I20260709 13:03:37.139947  8582 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:37.103231  8429 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:37.061326  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.105608  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:37.144192  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.130915 14350 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:37.087546 15258 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:37.131368 15360 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:37.114660  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:37.089740 15335 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:37.153851  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:37.139911  8507 rpcz_store.cc:269] 0709 13:03:35.528985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.529106 (+   121us) service_pool.cc:224] Handling call
0709 13:03:37.139349 (+1610243us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400059bd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:37.139446 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3582642432}
I20260709 13:03:37.108297 15145 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:37.144382  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.157655  8435 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
I20260709 13:03:37.158430  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.145473  8429 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:37.143847  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:37.147251  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.109784  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.147845  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.160708  9099 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:37.149693  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.150535  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.151940  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.142526  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.152552  8476 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.119558  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:37.131275  8575 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:37.110879 15357 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:37.147696  8328 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 15 to 16, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 16 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.064419 15202 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:37.153723  9097 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:37.155686  8430 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:37.101924 15192 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.163724 15339 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.134467 15179 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:37.178764 15206 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:37.178599 15339 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.174616 15357 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.179751 15357 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:37.180677 15339 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:37.182232 15153 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.183144 15155 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:37.092906 15225 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:37.187147 15225 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.189668 15225 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:37.190279  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 70797.5us
I20260709 13:03:37.190943  9065 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:37.191741  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:37.092828 15366 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:37.197389  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.198431  8475 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.199555  8475 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.159121  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:37.162048  8400 connection.cc:256] RPC call timeout handler was delayed by -4.4115684910000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 13:03:37.200302  8579 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:03:37.200395  8400 connection.cc:256] RPC call timeout handler was delayed by -4.1379684909999241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 13:03:37.200733  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:37.162052  8431 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:37.162245  8428 raft_consensus.cc:2410] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:03:37.163431  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.157025 14350 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.164078  8426 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 19: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:37.166281  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.166843  8476 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:37.168551  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.203052  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.203416  8584 raft_consensus.cc:2410] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:03:37.168691  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.194778 14511 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:37.203904  8476 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:37.204169 14511 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:37.204536 14511 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.205608  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.205866  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.206259  8582 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:37.195533  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:37.200775  8400 connection.cc:256] RPC call timeout handler was delayed by -3.8397036940000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260709 13:03:37.163810  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:37.207283  8400 connection.cc:256] RPC call timeout handler was delayed by -3.7947036939999634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260709 13:03:37.207324  8475 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:03:37.207823  8400 connection.cc:256] RPC call timeout handler was delayed by -3.7947036939999634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
W20260709 13:03:37.208184  8400 connection.cc:256] RPC call timeout handler was delayed by -3.5553036940000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 13:03:37.208488  8400 connection.cc:256] RPC call timeout handler was delayed by -3.4428036939999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 13:03:37.208817  8400 connection.cc:256] RPC call timeout handler was delayed by -3.4428036939999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 13:03:37.207217  9099 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:37.211616  8502 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:03:37.156692 15335 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:37.218739  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.219002  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.114715 15323 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.213920  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.214993  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.266340  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.215250  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.267170  8433 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:37.267743  8426 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:37.151464 15372 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:37.268889  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.269670  8426 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:37.217303  8476 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.219900  9098 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:37.271351  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.272750  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.209728  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:37.154220 15285 raft_consensus.cc:2764] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:03:37.143435 15148 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:03:37.157315 15145 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:37.209211  8400 connection.cc:256] RPC call timeout handler was delayed by -3.3897036939999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 13:03:37.317396  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:37.273831  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 64171us
I20260709 13:03:37.277042  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.208762 15042 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:37.209169 15287 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:37.282280  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.215736 15363 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.283243  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.289347 14980 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:37.194732 15202 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:37.208819 14711 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:37.213245 15185 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:37.143600 15321 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.296510  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.208577 15366 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:37.302278 15225 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:37.197065 15260 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:37.220844 15288 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:37.198287 15161 raft_consensus.cc:2764] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:03:37.213871 15192 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.090s
I20260709 13:03:37.303793  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:37.391928  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 88216.2us
I20260709 13:03:37.392869  8550 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.209360 15206 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:37.304323 15232 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:37.304445 15372 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.309068  8431 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:37.310532 14511 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.282444  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.214607 15153 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.322789  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:37.400950  8426 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
W20260709 13:03:37.224843  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.214383 15339 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:37.325213  8434 raft_consensus.cc:2376] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20. Re-sending same reply.
I20260709 13:03:37.383744 15185 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:37.353123  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.327775  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:37.291253 15155 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:03:37.305923 15274 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:37.416937 15274 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.417341 15274 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:37.417609 15321 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:37.418172 15321 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:37.418484 15321 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.418797 15321 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:37.324687 15042 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.383354  8433 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:37.376379 14938 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:37.350420  8506 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:03:37.349846 15295 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:03:37.403411 15153 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.403847 14511 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:37.406003 15339 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:37.409577 15323 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:37.410393 15232 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:37.411332  8428 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:37.412773 15179 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:37.415391  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 87730us
I20260709 13:03:37.391119 15288 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.421682  8426 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:03:37.421459 14990 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:37.458572 14990 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:37.459021 14990 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:37.416061 15185 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:37.426270 15042 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:37.460963  8431 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:37.366789 15360 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:37.399151 15260 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:37.434245  8506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2603) took 5662 ms (client timeout 1803 ms). Trace:
I20260709 13:03:37.399029 15372 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.448263  8433 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:37.470721 15295 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:37.472215 15366 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.473304  9101 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:37.474560 15260 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.475849 15335 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:37.462913  8506 rpcz_store.cc:269] 0709 13:03:31.771538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.771752 (+   214us) service_pool.cc:224] Handling call
0709 13:03:37.433993 (+5662241us) spinlock_profiling.cc:243] Waited 5.58 s on lock 0x7b54001fc054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:37.434135 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12826890496}
I20260709 13:03:37.438163 15339 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:37.478726  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 286164us
I20260709 13:03:37.477299 15185 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:37.415167 15357 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.512635 15357 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.512791 15042 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.483882 15287 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:37.449066 15232 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.461376 15288 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:37.573541  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.573683  8579 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:37.573539  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:37.574913  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:37.575101  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:37.575513  8510 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:37.575815  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:37.576496  8502 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:37.575857  8501 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:37.487406 15179 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.416229 15145 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:37.497044 15321 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.497339 15258 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.502149 14938 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:37.502454 15335 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.506794 15202 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.508195 15369 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.482143 15274 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:37.611836 15274 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.514305 15372 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.611967 15369 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:37.515756 14990 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.613816 15285 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:37.615499 14990 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:37.517537 15185 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.616837 15372 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:37.520982  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 342197us
I20260709 13:03:37.592187 15153 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:37.521414  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 338734us
I20260709 13:03:37.619580  8583 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:37.620666  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.621356 15386 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:37.520135 15339 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:37.622182 15148 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:37.623371  8501 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:37.564065  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:37.561664  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 344418us
I20260709 13:03:37.625898 15321 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:37.569080  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:37.572019  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.627827 15202 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.578516  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:37.581007  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:37.582374 15042 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:37.597136  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:37.570875 15287 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:37.556627  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 236201us
I20260709 13:03:37.514616 15366 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:37.623909 15339 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.624068 15179 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:37.623920 15148 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:03:37.630064  9068 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.834s (SENT)
I20260709 13:03:37.636957 15386 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:37.658607  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.658977  9099 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:37.659230  9095 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:37.659266  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.637691 15145 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.662987  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.657784  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.642323 15042 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.666289  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.668900  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.669088  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.651372 15372 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.649780 15161 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.653167 15386 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.664582 15179 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.677858 15386 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.664978 15225 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:37.678262 15258 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:37.679131 15225 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:37.658713 15202 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.682013 15202 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.667815 15385 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:37.683912 15202 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.683773 15385 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.673089 15287 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.687650 15287 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.688422 15397 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:37.689760 15397 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:37.675022 15372 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.690521 15397 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:37.691526 15397 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:37.691897 15372 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.693866 15385 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.350507  8328 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 9 to 12, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 12 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.730418  8328 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 11 to 20, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 20 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:03:37.454720  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.734002  8328 catalog_manager.cc:5697] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:37.446888  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:37.737735  8328 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 8 to 13, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 13 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:37.739001  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 292070us
I20260709 13:03:37.740933  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:37.740456  8328 catalog_manager.cc:5697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 10 to 19. New cstate: current_term: 19 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:37.750265  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:37.751828  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.753068  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.754274  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.754370  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.755434  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:37.757820  8328 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:37.850440  8434 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:37.851087  8328 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 10 to 17, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 17 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:03:37.767477  8325 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32800 (request call id 247) took 30241 ms (client timeout 15000 ms). Trace:
W20260709 13:03:37.783215  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.790443  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 171051us
I20260709 13:03:37.792412  8501 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:37.792517  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.796407  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.853144  8328 catalog_manager.cc:5697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 14 to 18, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 18 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:03:37.800464  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.800879  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:37.802202  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 163854us
W20260709 13:03:37.803968  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 410989us
I20260709 13:03:37.815842  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.816160  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:37.816893  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.886s (SENT)
I20260709 13:03:37.817307  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.818166  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.669790  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.819357  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.822453  9099 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:37.824062  9100 raft_consensus.cc:2410] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 21 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:37.825171  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:37.831111 15276 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:37.832253 15292 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:37.894397  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.901921  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.902488  9094 raft_consensus.cc:2368] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 23. Current term is 24.
I20260709 13:03:37.903283  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:37.903731  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.834252 14990 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:37.904459  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:37.904673 14990 consensus_queue.cc:1243] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 19.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:03:37.905162  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:37.905313 14990 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:37.905733 14990 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:37.908690  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:37.676878 15161 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.910926  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.910928 15258 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:37.837756 15179 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.912369 15161 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:37.871901  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 121874us
I20260709 13:03:37.821929  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.913863  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.672617 15042 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.840565 15232 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:37.894357 15276 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:37.903921  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.911346  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.912307  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.883028  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.886590  9101 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 19: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:37.883329  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.915139  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.875540  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.929352  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:37.935130  9102 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:37.915175 15179 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:37.931303  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.940747  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.938535  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.915118 15019 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:03:37.944599  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:37.946732  9094 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:37.940337  9093 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
W20260709 13:03:37.953877  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45335.9us
I20260709 13:03:37.943835  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:37.955665  9100 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:37.959198  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.972102  9097 raft_consensus.cc:2410] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:03:37.974285  9101 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.978341  8508 raft_consensus.cc:2368] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22.
I20260709 13:03:37.978459  9096 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:37.978906  9096 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:37.979921  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 163265us
I20260709 13:03:37.980219  9096 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.980639 15276 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:37.981642  9096 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:37.982838  8434 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:03:37.983117 15161 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:37.985049  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 91045.2us
I20260709 13:03:37.979972  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.987608  8508 raft_consensus.cc:2410] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:03:37.986094  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:37.972093  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:37.990386 15258 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:37.990655  9099 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:37.991986  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.992247  8550 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:37.993103  8503 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 21: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:37.993495  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.993908  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:37.995700  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:37.996217  8508 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:37.997272  8501 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:37.997628  8508 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:37.994388 15258 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:37.998554 15258 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.999099 15258 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:37.995041  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:38.002672  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:38.003163  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:38.004298 15399 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:38.004595 14350 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:38.004926 15399 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:38.005568 15399 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.006711 14990 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.006608  8328 catalog_manager.cc:5697] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:38.008397 14990 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.008929 15161 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:38.010751  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:38.012249  8582 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:38.013177  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:38.013366  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:37.854228  8325 rpcz_store.cc:269] 0709 13:03:07.525899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.538345 (+ 12446us) service_pool.cc:224] Handling call
0709 13:03:37.767189 (+30228844us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:28.839253 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:28.991478 (+152225us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:28.991548 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:03:28.991572 (+    24us) tablet.cc:662] Decoding operations
0709 13:03:29.127602 (+136030us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:29.127689 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:29.127719 (+    30us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:03:29.129482 (+  1763us) tablet.cc:701] Row locks acquired
0709 13:03:29.129532 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:03:29.129697 (+   165us) write_op.cc:270] Start()
0709 13:03:29.129840 (+   143us) write_op.cc:276] Timestamp: P: 1783602209129632 usec, L: 0
0709 13:03:29.129876 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:03:29.207679 (+ 77803us) log.cc:844] Serialized 8696 byte log entry
0709 13:03:29.490935 (+283256us) op_driver.cc:464] REPLICATION: finished
0709 13:03:29.753666 (+262731us) write_op.cc:301] APPLY: starting
0709 13:03:29.753776 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:30.223457 (+469681us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:30.233522 (+ 10065us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:30.681081 (+447559us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:30.681526 (+   445us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:03:30.681594 (+    68us) write_op.cc:312] APPLY: finished
0709 13:03:30.684309 (+  2715us) log.cc:844] Serialized 196 byte log entry
0709 13:03:30.790472 (+106163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:30.808109 (+ 17637us) write_op.cc:454] Released schema lock
0709 13:03:30.857578 (+ 49469us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:30.906491 (+ 48913us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:30.906528 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4083030,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":262059,"apply.run_cpu_time_us":52594,"apply.run_wall_time_us":1132420,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95999,"num_ops":22,"prepare.queue_time_us":117163,"prepare.run_cpu_time_us":13332,"prepare.run_wall_time_us":511255,"raft.queue_time_us":108596,"raft.run_cpu_time_us":46346,"raft.run_wall_time_us":154225,"replication_time_us":360893,"spinlock_wait_cycles":4864,"thread_start_us":353844,"threads_started":5,"wal-append.queue_time_us":202465,"wal-append.run_cpu_time_us":14136,"wal-append.run_wall_time_us":2282468}]]}
I20260709 13:03:38.014318  8579 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:38.014679 14980 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:38.015977  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:38.017098 14980 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:38.017612 14980 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:37.967612  8432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.012s	sys 0.015s
W20260709 13:03:38.018347  8432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.012s	sys 0.015s
I20260709 13:03:37.965914 15106 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:38.019654 15324 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:37.994836 15042 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:38.019641  9102 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:37.993027  9100 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:03:37.973937  9097 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:38.017850  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:38.009660 15412 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:03:38.020224 15106 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:38.028137  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:38.018610  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:38.031384  8508 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:38.034314  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:38.034873  8502 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 24.
I20260709 13:03:38.014348 15292 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:38.009660 15161 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.040349 14980 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.038148  8328 catalog_manager.cc:5697] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 12 to 15, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 15 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:38.048630  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53246.4us
I20260709 13:03:38.049531  8507 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 22: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:38.036868 15106 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:38.052807 15324 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:38.055032 15185 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:03:38.058152  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 76661.5us
I20260709 13:03:38.043023 15292 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:38.064553 14980 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.067783  8504 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:38.070204  8583 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:38.070824 15161 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:38.054159 15019 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:38.072203 15292 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:38.086808  8580 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:03:38.084383  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 71106.7us
I20260709 13:03:38.089668  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:38.090694  8503 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:38.092144  8503 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:38.092666  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:38.084622 15393 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:38.085143 15271 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:38.080008  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2842) took 1137 ms. Trace:
I20260709 13:03:38.096606 15227 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:38.093852 15393 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:38.103292 15393 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:38.101948  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:38.101917 15289 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:38.106892  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:38.094507  8432 rpcz_store.cc:276] 0709 13:03:36.942734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.391239 (+448505us) service_pool.cc:224] Handling call
0709 13:03:37.400844 (+  9605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.401050 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:37.403511 (+  2461us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.035688 (+632177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.049894 (+ 14206us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:38.053846 (+  3952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.059088 (+  5242us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.079952 (+ 20864us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2855,"prepare.queue_time_us":8826,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":312,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":8353,"thread_start_us":614953,"threads_started":1,"wal-append.queue_time_us":568834}
I20260709 13:03:38.100373 15154 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:38.126840  9101 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:38.125166  8501 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:38.099011  8328 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 10 to 18, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 18 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:38.146116  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:38.146675  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:38.144721  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 233465us
I20260709 13:03:38.148610  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:38.150383  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:38.151074  8575 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.151811  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:38.152815 15042 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:38.153390 15042 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:38.154467  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:38.154677  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:38.154672 15042 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.155629  8578 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:38.145625  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:38.157420  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:38.158185 15271 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:38.158735 15271 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.159943  8582 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:38.161322  8502 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 22. Current term is 23. Ops: []
W20260709 13:03:38.162214  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69701.8us
I20260709 13:03:38.162842  8502 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:38.163283  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:38.165385  8507 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:38.166508  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:38.171133  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:38.172437 15258 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.175348  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:38.176064  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:38.178265 15287 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:38.153332  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:38.180102 15227 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:38.181461 15154 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:38.188676 15227 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:38.189229 15154 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:38.189321 15227 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:38.189685 15154 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:38.190871 15258 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:38.190819 15154 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:38.191764  8584 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:03:38.192162 15154 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.197937  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:38.199548  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:38.200851  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:38.201674  8505 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:38.202409  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:38.186429  8582 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:03:38.211098  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:38.158780  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:38.187590  8578 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:38.212888  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:38.213863  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 55325.2us
W20260709 13:03:38.214200  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 196445us
I20260709 13:03:38.202313  8580 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:38.188057  8576 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:38.216774  8507 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:38.217610 14980 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:38.214334  8502 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.203382 15289 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:03:38.204171 15153 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
W20260709 13:03:38.218616  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 172725us
I20260709 13:03:38.210862  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:38.169636 15106 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.244679  8575 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:38.179292  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:38.225466  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 72232.8us
I20260709 13:03:38.201788  8501 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:38.217830  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:38.204532  8400 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:38.276398  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:38.237119 15179 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:38.279191  8504 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:03:38.281090  8434 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:38.289330  8501 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:03:38.292361  9096 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:03:38.296751  8549 leader_election.cc:400] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 23. Current term is 24.
I20260709 13:03:38.297173  8549 leader_election.cc:403] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:38.300031  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:38.302925  9068 leader_election.cc:336] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 2.708s (SENT)
I20260709 13:03:38.303561  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:38.306167 15392 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:38.306703 15392 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:38.307132 15392 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:38.308264 15399 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.309374  8579 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:38.292886  9096 pending_rounds.cc:85] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 14
I20260709 13:03:38.312582  8547 leader_election.cc:400] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22.
I20260709 13:03:38.313019  8547 leader_election.cc:403] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:38.286412 15289 consensus_queue.cc:1243] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:03:38.286147 15258 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:38.310878  9096 pending_rounds.cc:107] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:03:38.317131  9096 raft_consensus.cc:2889] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.321151  8506 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:38.322821  8505 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:38.327584 15321 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:03:38.331831 14980 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:38.332324 14980 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:38.334870 14511 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:38.335554  8328 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 8 to 19, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 19 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:38.337270 15106 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:38.338974 15288 consensus_meta.cc:287] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.009s
I20260709 13:03:38.339525 15288 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.341056  8510 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:38.337569  8328 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 19 to 22, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 22 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:38.314391 15276 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:03:38.345271  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.316684 15258 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:38.351670  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:38.354702  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 136905us
I20260709 13:03:38.350133  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:38.333458 14980 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:38.342015 15288 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:38.359592  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 180416us
I20260709 13:03:38.363310  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:38.366833  8328 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 14 to 17, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 17 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:38.367909  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.369866  8582 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:03:38.368824 15271 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.346782 15276 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:38.374202  8429 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:38.374007  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 158515us
W20260709 13:03:38.383606 15415 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:38.394814  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:38.384620 15369 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:38.386435  8328 catalog_manager.cc:5697] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 10 to 14, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 14 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:38.356334 15258 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.388571 15225 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:38.388801 15232 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22.
I20260709 13:03:38.343802 15399 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:38.388279  8576 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:38.389549 15276 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:38.427703  8398 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:38.440160  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 124420us
I20260709 13:03:38.445320  8475 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:38.453233  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:38.455542  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 135025us
I20260709 13:03:38.455153  8328 catalog_manager.cc:5697] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 8 to 16, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 16 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:38.437644 15106 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:38.466413  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:38.442472 15179 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:38.452176 14980 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:38.468036  8328 catalog_manager.cc:5697] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 13 to 17, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 17 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:38.461740 15369 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:38.491812  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:38.456228 15292 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:38.501317  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 93562.2us
I20260709 13:03:38.483415 15399 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:38.504962  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 68624us
I20260709 13:03:38.490943 15321 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 23. Current term is 24.
I20260709 13:03:38.507656  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:38.508293 15417 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:03:38.507160  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 204290us
W20260709 13:03:38.512429  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 46119.8us
I20260709 13:03:38.509153  8432 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:38.511104  8328 catalog_manager.cc:5697] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 6 to 14, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 14 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:38.481516 15227 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.515949 15401 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 13:03:38.536314 15416 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:38.537514 15426 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:38.538311 15425 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:03:38.541131 15165 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:38.541589 15165 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:38.541728  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:38.542515 15165 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.543208  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:38.543943 15165 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:38.546125 15153 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:38.517246  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 312777us
I20260709 13:03:38.555601  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:38.546550 15288 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:38.545881  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:38.560454 15425 consensus_queue.cc:1243] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 18.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:03:38.563726 15232 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:38.564284 15232 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:38.565152 15232 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:38.586615  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 134738us
W20260709 13:03:38.589270  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 43480.2us
I20260709 13:03:38.590689  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:38.559226 15393 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:38.547767 15399 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:03:38.601605  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46128.2us
W20260709 13:03:38.602013  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 46638.4us
I20260709 13:03:38.587380 15271 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:38.658366  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 152094us
I20260709 13:03:38.741472  8550 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:38.742837  8550 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:38.743721 15397 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:03:38.686496 15421 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:03:38.744529 15397 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:38.745133 15397 raft_consensus.cc:697] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:38.511210 15324 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.075s
I20260709 13:03:38.604944 15288 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:38.753657  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 180212us
W20260709 13:03:38.739439  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.756364  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:38.658165 15394 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:38.667840 15427 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:38.609125 15161 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:38.566181 15179 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:38.603780  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 96193.7us
W20260709 13:03:38.741485  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 137850us
W20260709 13:03:38.759550  8502 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.005s
W20260709 13:03:38.782347  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.764809  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.782099  8502 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:38.785351 15435 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:38.785845 15435 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:38.759078 15288 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:38.752911 14990 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:38.759734 15154 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.567s	user 0.003s	sys 0.015s
I20260709 13:03:38.758315 15394 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:38.834825 15394 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.836688 15394 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:38.793944  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 203320us
I20260709 13:03:38.839511  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:38.841012  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:38.842291 15165 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:38.843073 15165 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:38.843398 15165 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.843727 15165 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:38.757716 15153 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.746268 15397 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.847841 15436 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.848373 15436 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.846444 15153 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:38.810748  9068 leader_election.cc:336] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.591s (SENT)
I20260709 13:03:38.851197 15287 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:38.787179 15393 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.807540  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:38.661981 15422 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.303s
I20260709 13:03:38.816926 14350 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:38.821548 15435 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:38.822521 15428 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.156s	user 0.003s	sys 0.003s
W20260709 13:03:38.827437 15392 consensus_meta.cc:287] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.520s	user 0.016s	sys 0.000s
I20260709 13:03:38.828047 15438 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:03:38.829012 15227 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:38.829599 15420 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.335s	user 0.005s	sys 0.000s
I20260709 13:03:38.831444 15427 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:38.808439 15288 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:38.866508 15287 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:38.881716 15287 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:38.882750  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:38.883561  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 83380.7us
I20260709 13:03:38.889418  8429 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
W20260709 13:03:38.891309  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 98247.4us
W20260709 13:03:38.894168  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 114828us
I20260709 13:03:38.882210 15153 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:38.898177 15418 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.297s	user 0.000s	sys 0.013s
W20260709 13:03:38.899674 15417 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:03:38.901328 15321 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:38.901074 15288 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.901732 15321 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:38.902196 15424 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:38.902660 15321 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:38.904074 15321 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:38.904181 15161 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:38.904865 15161 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:38.904985  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1453) took 1331 ms. Trace:
I20260709 13:03:38.904253 15288 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:38.906142 15276 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:38.907210  8434 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:38.908252 15276 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:38.876176 15271 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:38.920894 15271 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:38.922214 15258 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:38.923507 15271 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:38.924558 15153 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:38.890977 15289 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:38.930263 15287 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.932032 15287 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:38.933305  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.934176 15422 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:38.905416  8509 rpcz_store.cc:276] 0709 13:03:37.573121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.574740 (+  1619us) service_pool.cc:224] Handling call
0709 13:03:37.583474 (+  8734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:37.599323 (+ 15849us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:37.682584 (+ 83261us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b180045ef20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a1d21358f 00007f1a16252571 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd
0709 13:03:38.025269 (+342685us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.493593 (+468324us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.496806 (+  3213us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:38.549061 (+ 52255us) log.cc:844] Serialized 26 byte log entry
0709 13:03:38.549277 (+   216us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:38.549328 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.549428 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.899440 (+350012us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b24003fdb68. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a160d89c4 00007f1a160d6acb 00007f1a16291dc9 00007f1a16291a55 00007f1a1629109d 00007f1a18ec310e 00007f1a18eda88c 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221
0709 13:03:38.904658 (+  5218us) raft_consensus.cc:1685] finished
0709 13:03:38.904679 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.904810 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76112,"prepare.queue_time_us":105662,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":32007,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":15238,"spinlock_wait_cycles":48442880,"thread_start_us":661516,"threads_started":3,"wal-append.queue_time_us":234953}
I20260709 13:03:38.935688 15042 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:38.870232 15392 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.935514 15422 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:38.936846 15042 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.937502 15431 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:38.937397 15042 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.953920 15042 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:38.937727 15422 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:38.937952 15431 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:38.954556 15289 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:38.955260 15289 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.955384 15431 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.956707 15431 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:38.935499 15185 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:03:38.954557 15422 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:38.958714 15185 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:38.959069 15185 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:38.959045 15422 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.960421 15422 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:38.960136 15185 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:38.961357 15185 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:38.962212  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.962637  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.938439 15392 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:38.939155 15432 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:03:38.964339 15432 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:38.964717 15432 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:38.876633 15292 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:38.942333 15161 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.943720  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:38.947381  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:38.974238 15292 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:38.974915 14980 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:38.872444 15393 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.976202 15292 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:38.976599 15292 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:38.977471 15292 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.978952 15292 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:38.978744 15227 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:38.980002 15227 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:03:38.980440 15227 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:38.982735 14990 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:38.983176 15289 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:38.983387  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:38.983898 15154 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:38.984304 15154 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:38.985165 15154 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:38.986469 15154 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:38.986826 15432 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:38.986495 15161 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:38.977800 15393 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:38.994249  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 116284us
I20260709 13:03:38.995185 15435 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.019343  8476 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:39.034308  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 293906us
I20260709 13:03:38.981529 15227 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.047648  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.047545  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:39.049683  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:39.048673  8434 raft_consensus.cc:2410] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:03:39.054853 14511 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:39.051996 15185 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:39.025177 15165 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.078605  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:39.084239  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:39.085242  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:39.089634  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.090442 14511 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:39.097869  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 357628us
I20260709 13:03:39.068404 15154 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:03:39.083290 15436 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:39.072512 15271 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:39.084575 15185 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:39.080147 14990 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:03:39.104375  8576 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:39.091642 15289 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:39.108752  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.099479 15227 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:39.099740 15393 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:39.113987  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:39.115137  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.115804 15258 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:39.116017  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.116792  8429 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:39.118098  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:39.112924  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:39.123430  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:39.124866  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:39.130257  8434 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:39.131063 15165 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:39.131258  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:39.131842  8504 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:39.133020  8504 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:03:39.139889 15432 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:39.142463  8506 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:39.150503 15185 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.152302 15179 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.152992 15179 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.158396  8505 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
W20260709 13:03:39.158742  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 47708.9us
I20260709 13:03:39.125921  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:39.162804  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.165880 14511 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:39.167596  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.168694  8428 raft_consensus.cc:2410] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:03:39.170656  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:39.171924 15393 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.172607 15393 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.174988 15393 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:39.175839  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 117463us
I20260709 13:03:39.176870  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:39.179194  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.180135  8429 raft_consensus.cc:2368] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22.
I20260709 13:03:39.181414  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.184691  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.182243  8432 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
W20260709 13:03:39.206121  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.206188  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.187424 15393 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:39.211459  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 97542.6us
I20260709 13:03:39.212394  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:39.210709  8428 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
W20260709 13:03:39.215813  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.221626  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:39.224792  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 116435us
I20260709 13:03:39.225768  8434 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:39.216392  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:39.229871  8503 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:39.229573  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:39.235100  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.241454  8428 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:39.242143  8507 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:39.249082  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:39.249706  8502 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:39.234625 15185 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:39.252902  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.253705  9067 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:39.245205 15161 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:39.255141 15161 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.255508 15161 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.260149 15435 consensus_queue.cc:1059] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:39.261060 14511 raft_consensus.cc:3055] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:39.261409 14511 raft_consensus.cc:740] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:39.262383 14511 consensus_queue.cc:260] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.254667  8434 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:03:39.272884  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:39.242085 15179 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:39.245683 15394 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:39.233255 15258 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:03:39.278128  8434 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:39.253343 15397 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:03:39.253929 15185 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:39.291632  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 77763.8us
I20260709 13:03:39.284775  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:39.286839  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:39.292781  9096 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:39.289465 15430 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:39.293375 14511 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:39.291249 15422 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:39.297376 15422 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.297747 15422 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.298226  8502 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:39.298377  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:39.299821 15442 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:39.298348  8429 raft_consensus.cc:1275] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:03:39.303246  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:39.250267 15447 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:03:39.301642  8429 pending_rounds.cc:85] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 10
I20260709 13:03:39.305691  8429 pending_rounds.cc:107] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 17.11
W20260709 13:03:39.305651  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 59037.1us
I20260709 13:03:39.284233 15435 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:39.306273  8429 raft_consensus.cc:2889] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:39.307740  8475 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.309173  9067 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:39.310640  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:39.311264  8582 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:39.293274 15185 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.313383  8434 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:39.295471 15430 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:39.317685  8507 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:03:39.318710 15425 raft_consensus.cc:2804] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:39.319370  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:39.326694  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:39.307826 15179 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:39.323624  8398 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:39.331347  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.332697  8550 leader_election.cc:400] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22.
I20260709 13:03:39.334300 15444 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:39.333662  8550 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:39.319881 15430 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:39.344784  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.325721 15393 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:39.348527  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:39.350821 15161 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.352026 15287 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.352582 15287 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.354818 15287 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:39.355528  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:39.356144  8582 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:39.356240  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.356796  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.357407  8426 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:39.358174  9095 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:39.347281  8398 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:39.353652  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.361281  9096 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:39.361325  8550 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.327796 15425 raft_consensus.cc:697] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:39.326193 15042 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:39.358707  8476 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:39.329488 15179 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.360064  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:39.359150  8398 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:39.334492 15454 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:39.370244 14980 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:39.371501 14990 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:39.372159 15288 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:39.373374 15369 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:39.374529 15433 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:39.367168 15444 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:39.416237 15442 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:39.421975  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 60714us
I20260709 13:03:39.392252 14980 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:39.380925 15425 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.381888 14350 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:39.378590 15042 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.440227 15042 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:39.383291 15426 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:39.440448  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:39.440838 15426 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.441260 15426 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.442335 14350 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:39.427544  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:39.443003 14350 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:39.443846  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:39.400053 15401 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:03:39.343911 15431 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:03:39.386404  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:39.457297  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 70963.3us
I20260709 13:03:39.365120 15276 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:39.384438 15454 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:39.467762  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.468575  8575 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:39.471813  8426 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 12. (term mismatch)
I20260709 13:03:39.472210  8426 pending_rounds.cc:85] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 11
I20260709 13:03:39.472519  8426 pending_rounds.cc:107] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 23.12
I20260709 13:03:39.472755  8426 raft_consensus.cc:2889] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:39.473843  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:39.379647 15179 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.398237 15393 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.398459 15288 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:39.426929  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 66910.6us
I20260709 13:03:39.482836  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:39.468514 15154 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:03:39.432353 15461 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:39.416878 15422 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.417784 15444 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.416711 15433 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.423806 15369 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:39.438097  8579 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:39.448483  8550 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.379956  8428 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:39.416857 14990 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:39.417493 15394 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.475545 15276 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:39.520602  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.474648  8582 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:39.521273  8428 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:39.480453  8432 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:39.396833  8434 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:39.482363  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:39.522665  8583 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 22: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:39.486196  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 111152us
W20260709 13:03:39.431572 15463 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:03:39.469858 15454 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:39.524932  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 102015us
I20260709 13:03:39.493141 15399 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:39.498278  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:39.488564 15288 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:39.488675 15401 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:03:39.503572  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.504421  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:39.510362  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.532876  8575 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
W20260709 13:03:39.533354  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.514014  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:39.517088  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:39.533981  8580 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.518616  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:39.496182  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:39.510932 15444 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.524987 14990 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.542979  9093 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:39.524156  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:39.473968  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:39.543731  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.525839  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.514341 15433 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.517823  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:39.553177  9097 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.535032  9094 raft_consensus.cc:2410] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:03:39.534890  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.555593  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:39.519436 15154 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:39.488381 15393 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.475244 14980 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.558887  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:39.560508  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:39.561522  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.564996  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:39.565522  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:39.566187  9100 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:39.568835  9098 raft_consensus.cc:2410] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:03:39.569072  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:39.571148  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 67656.5us
I20260709 13:03:39.571007  8577 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:39.557955 15436 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:39.578297  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:39.525427 15287 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:03:39.530459 15394 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.577219  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:39.575928  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:39.582361  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 56635.1us
I20260709 13:03:39.542677 15399 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.588120  9094 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:39.568517 15401 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:39.589901  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 96115.3us
I20260709 13:03:39.590186  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:39.591132  9098 raft_consensus.cc:2410] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:03:39.591306  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:39.593433  8509 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:39.593581  9095 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:03:39.595132  8507 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:39.597981 15393 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:39.598539  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:39.567147 15430 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.600912 15430 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:39.602305  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:39.602960  8434 raft_consensus.cc:3060] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:39.605365  9097 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:39.605535  8432 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:39.609601  9100 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:39.611506  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:39.614711  9098 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:39.615127  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 59809.4us
I20260709 13:03:39.570567 15425 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
W20260709 13:03:39.635905  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 126716us
I20260709 13:03:39.639038  8431 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:03:39.641948  9100 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:39.644807  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:39.672904  8434 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:39.673835  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.682833  8430 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:03:39.682751  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.638729 15401 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:03:39.610741 15392 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:03:39.635138 15165 consensus_queue.cc:1059] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:03:39.570557 15369 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.692162  9093 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:39.643795 15474 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:39.671259 15464 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:39.670454 15446 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:39.698050  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:39.700143  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.700423  8430 raft_consensus.cc:1240] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:03:39.641022 15154 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.702662  8431 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:03:39.687367 15472 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:39.609275 15276 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.704617  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:39.714229  8579 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:39.688777 15442 consensus_queue.cc:1048] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:03:39.681838 15185 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.699378 15436 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:39.703683 15422 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:39.730840  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:39.733517  9094 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:39.735098  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.741565  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:39.758497  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.781533  8431 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:39.730458 15393 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.782491  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.741827 15476 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:39.799062  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:39.799714  8582 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:39.800961 15185 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:39.801514 15393 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.735419 15472 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:03:39.803587 15393 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:39.809432  8579 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:39.747346 15394 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:39.715986 15474 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.829391  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.832012 15442 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:39.832477 15442 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:39.833437 15165 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.834088 15165 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.836330 15165 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:39.836784 15426 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:39.828476  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 152780us
I20260709 13:03:39.840344  8579 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:39.735312 15444 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:39.843760  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:39.844944  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 162271us
I20260709 13:03:39.845808  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:39.841586  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 159313us
I20260709 13:03:39.743463 15288 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.847122  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:39.853276  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 171852us
I20260709 13:03:39.858839  8430 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:39.864665  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:39.865458  9101 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:39.868185  8431 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:39.875928  9096 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:39.880359  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:39.880740  8431 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:39.881878  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:39.882742  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:39.883891  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:39.885219  8584 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:03:39.885926  8576 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:39.888226  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:39.893519  8430 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:39.893996  8434 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:39.874400 15487 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:39.900233  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:39.902417  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:39.892097 15468 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:03:39.918751  9101 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:03:39.919169  9101 pending_rounds.cc:85] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 11
I20260709 13:03:39.919418  9101 pending_rounds.cc:107] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:03:39.894301 15394 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.919755  9101 raft_consensus.cc:2889] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:39.913659  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.911370  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.894430 15393 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:39.897837 15476 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:39.891916 15483 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.922281  8431 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:39.951985  8580 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:39.954384  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:39.928586 15469 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 13:03:39.924566 15471 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:03:39.909082 15477 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:39.959281  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.875138 15436 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.911234 15369 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:03:39.965394  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.965057  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:39.969576  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.969911  8435 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.970157  8432 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:39.967088  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:39.950532 15393 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:39.971870  8430 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
I20260709 13:03:39.959671 15477 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.978091  8426 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:39.981148  8434 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:39.964016 15321 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:39.982882  8434 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:39.952764 15483 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:39.969157 15179 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.004871  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:40.010279  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 135590us
I20260709 13:03:39.961355 15498 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:03:39.971544 15433 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:39.983789 15477 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:39.985298 15487 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:39.993203 15321 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:40.018342  8502 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:03:40.019119  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:40.020642  9095 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:03:40.022418 15481 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:40.023065 15481 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:40.023731 15452 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.676s	user 0.016s	sys 0.027s
I20260709 13:03:40.025290 15481 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:40.026424 15495 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:03:40.028092 15490 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:40.028290 15397 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:40.028717 15397 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:40.029590 15397 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.030988 15397 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.031137 15288 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.035912 15501 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:03:40.042950 15460 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.694s	user 0.000s	sys 0.010s
I20260709 13:03:40.046625  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:40.048695  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:40.049602  8434 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:40.062654  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:40.063469  8426 raft_consensus.cc:2376] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19. Re-sending same reply.
I20260709 13:03:40.064483  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:40.016945 15426 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.082742  8432 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:40.070705  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:40.084022  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:40.085204  8434 raft_consensus.cc:2376] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18. Re-sending same reply.
W20260709 13:03:40.072125  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 112096us
I20260709 13:03:40.086227  9102 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:40.086936  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:40.069590  8435 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:40.087944  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:40.089810  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:40.091169  9099 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:40.091464  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:40.093207  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:40.093732  8426 raft_consensus.cc:2376] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20. Re-sending same reply.
I20260709 13:03:40.097715  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:40.099741  9100 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:03:40.101076  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:40.102139  9097 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:03:40.106195  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:40.106496 15487 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.068080 15446 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:40.116400  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:40.117322  8577 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
W20260709 13:03:40.117448  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.118275  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.125190  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:40.131774 15497 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:03:40.135232  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:40.136127  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:40.137111  9094 raft_consensus.cc:2368] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21.
I20260709 13:03:40.067227 15321 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.120033 15276 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:40.133546 15476 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.133836 15446 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.066249 15393 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.152155  9102 raft_consensus.cc:1240] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:40.154522  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:40.145778 15444 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:40.158380 15491 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:40.158808 15491 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.159163 15491 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:40.159451 15161 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.147081 15276 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:40.162388 15165 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:40.162982  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:40.164533  9096 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: [16.14-17.15]
I20260709 13:03:40.157460  9102 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:40.154587 15446 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:40.151978  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:40.166700  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:40.169023 15500 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.100s
I20260709 13:03:40.173940  8580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:03:40.175594  8580 raft_consensus.cc:606] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:40.145153 15154 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:03:40.184726 15501 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.185199 15483 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.191963  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:40.180895 15481 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:40.154386 15476 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:40.207588  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50148.1us
W20260709 13:03:40.207059 15454 consensus_meta.cc:287] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.664s	user 0.004s	sys 0.008s
W20260709 13:03:40.210585 15509 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:03:40.215766 15470 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.213210 15433 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.219730 15489 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:40.224295  8505 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:40.232887  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:40.210212 15481 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.208774 14990 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:40.240830  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48966.9us
I20260709 13:03:40.241801  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:40.242698 15154 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:40.244884  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:40.245559 15501 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:40.245743 15154 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:40.246810  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:40.248404  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:40.249531  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:40.250609  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:40.235023 15394 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:40.238571 15481 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.213390 15454 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.269419  8428 raft_consensus.cc:2368] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19.
I20260709 13:03:40.269783 15476 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.270671 15454 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:40.258970 14990 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 13:03:40.272367 14990 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:40.272838 14990 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:40.241540 15433 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:03:40.253152 15321 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:40.283788  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.285753  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:40.252552 15397 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 13:03:40.229991 15470 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.262217 15496 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:40.265875 15436 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:40.268311 15154 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:40.254566  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:40.289619  8549 leader_election.cc:400] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21.
W20260709 13:03:40.300163  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45642.9us
I20260709 13:03:40.284835 15487 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.295967 15476 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.296216 15321 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:40.299703 15424 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:40.301515 15454 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:40.303128 15154 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:40.310195 15496 consensus_queue.cc:1059] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:03:40.315021 15501 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:03:40.315220 15476 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:40.273980 14990 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.329360 15476 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.319967 15516 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:03:40.334215 15454 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:40.334653 15454 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:40.324007 15496 raft_consensus.cc:3055] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:40.312819 15446 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:40.336053 15496 raft_consensus.cc:740] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:40.312309 15424 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:40.337111 15496 consensus_queue.cc:260] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.338855 15496 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:40.324594 15501 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:40.341419 15501 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:40.328456 14990 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:40.318557 15436 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.329209 15154 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.323431 15470 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.330811 15491 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:40.343120  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.344923  8503 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:40.347708 15501 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.348874  9094 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:40.350649 15491 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:40.353191 15459 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 1.022s	user 0.005s	sys 0.003s
W20260709 13:03:40.354712 15485 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.341s	user 0.003s	sys 0.000s
I20260709 13:03:40.355862  9100 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:40.356617 15292 raft_consensus.cc:3055] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:40.359819 15399 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:40.337056 15424 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:40.370179 15501 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.374078 15436 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:40.375552 14980 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:40.369094 15292 raft_consensus.cc:740] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:40.377357  8578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
W20260709 13:03:40.384090  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 80480.1us
I20260709 13:03:40.384282  8578 raft_consensus.cc:606] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:40.384303  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:40.385792  9102 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:40.378860  9094 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:03:40.383014  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47920us
I20260709 13:03:40.342880 15454 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.399801  8578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:03:40.387259 15494 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:03:40.415834  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:40.427510  9102 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:40.428531  9102 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.415970  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:40.432071  9096 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:03:40.416554  9068 leader_election.cc:336] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.947s (SENT)
I20260709 13:03:40.432906  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:40.416508  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:40.433501  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.417306 15397 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:40.390256 15424 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.418985 15454 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.397944 15477 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.422096 15472 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:40.446759  8509 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:40.417310  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:40.422071 15481 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.444381  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:40.450858  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:40.451579  8508 raft_consensus.cc:2393] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 23: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:40.450871  9095 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:40.447949  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:40.453172  8510 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:40.445464  8504 raft_consensus.cc:1240] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
W20260709 13:03:40.454644  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.455945  8430 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 21: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:40.456344  9102 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:40.402212 15227 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:03:40.463204 15227 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:40.463587 15227 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:40.463773  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 57961.1us
W20260709 13:03:40.464466  9068 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.949s (SENT)
I20260709 13:03:40.396353 15491 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:03:40.465900 15491 consensus_queue.cc:1243] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:03:40.466464 15491 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:40.466780  9096 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:40.471339  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:40.466799 15491 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:40.477948  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.478534  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.478838  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.481383  8426 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:03:40.476446 15491 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.487761  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:40.488617  8426 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:40.491554 15491 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.496171 15487 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:40.497493  8501 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:40.498595  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:40.500994 15481 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:40.501046 15276 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.502166 15476 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:40.502470 15474 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:40.513077  8578 raft_consensus.cc:606] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:40.513552  8578 raft_consensus.cc:614] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:40.503525  8431 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:40.470947 15470 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:40.402190 15292 consensus_queue.cc:260] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.521530 15292 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:40.502879 15477 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:40.506353  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:40.506825 15476 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.527443  8578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:03:40.536491  8578 raft_consensus.cc:606] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Received request to transfer leadership to TS 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:40.537050  8578 raft_consensus.cc:614] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:40.549132  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.555658  8510 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:40.576287 15179 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.578613  8429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f"
dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:57422
I20260709 13:03:40.579300  8429 raft_consensus.cc:606] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:40.579885 15476 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:40.579787 15442 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.541857 15522 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:40.558996 15528 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.602363  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.602499  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.603461  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:40.603602  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.605708  8583 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:40.601995  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.606544  8576 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:40.611583  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.612483  8582 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:40.613997  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:40.614842  8579 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:40.617779  8504 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:40.618367  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:40.593062 15482 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.010s	sys 0.022s
I20260709 13:03:40.624413  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.592335 15232 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.592372 15487 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.621870  8582 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:40.630218  8578 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:03:40.632710  8576 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:40.633893  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:40.644853  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:40.646770  8579 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:40.658911  9099 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:40.619573 15442 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:40.661718  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:40.663928  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.623740 15476 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:40.665690  8576 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 20: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:03:40.638346 15482 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.011s	sys 0.023s
I20260709 13:03:40.610644 15528 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.666240 15477 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:40.642395 15436 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:40.725189 15488 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.936s	user 0.006s	sys 0.000s
I20260709 13:03:40.730357 14511 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.662046 14990 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:40.658310 15154 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:03:40.618748 15522 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.642354 15481 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:03:40.668515  9099 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 13:03:40.735731  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.737241  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:40.738610  8510 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:40.729272 15476 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.643775 15487 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:40.738652  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.739271  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:40.805027  8429 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 19. Current term is 20. Ops: []
W20260709 13:03:40.805125  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 65923.4us
W20260709 13:03:40.739888  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.805568  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.642555 15232 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.809067 15232 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:40.669219 15474 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:40.809746 15474 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.728935 15276 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.811528 15276 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:40.812057 15474 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:40.744200  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.738860 15165 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:03:40.814215 15369 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:40.814402  8580 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:40.814755 15369 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.815182 15369 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:40.815647  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:40.816303  8580 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:40.744236  8576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
W20260709 13:03:40.796200  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.818127 15481 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:40.818321  8576 raft_consensus.cc:606] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:40.818583 15481 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:40.818825  8576 raft_consensus.cc:614] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:40.819744 15487 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:40.819545 15481 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.820132  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:40.820632 15525 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:03:40.820809 15481 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:40.821355 15165 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:40.822006 15292 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:40.822443 15292 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:40.822561 14990 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:40.823549 14990 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.797144  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.826192 15425 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.826587  8581 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:03:40.826819 15526 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:03:40.827442  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 1369) took 1293 ms. Trace:
I20260709 13:03:40.827589  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:40.827890  8428 rpcz_store.cc:276] 0709 13:03:39.534490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.534638 (+   148us) service_pool.cc:224] Handling call
0709 13:03:40.827208 (+1292570us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54003a1e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:40.827355 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644090240}
I20260709 13:03:40.828701  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:40.829216 15179 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.829712 15179 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.796316  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:40.831590  8578 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:03:40.831741 15179 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.832957  8578 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:03:40.736586 15470 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.834662 15528 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:40.800105  8502 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:40.806617  8501 raft_consensus.cc:2393] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:40.823426 15292 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.834355 15470 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.799621 15431 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.836403 15431 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.837061  8430 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:40.837633  8581 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:03:40.838131 15292 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:40.838363 15431 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.742131 15393 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:03:40.801277  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:40.841751  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.821810  9067 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:40.842980  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:40.819770  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.798399 14511 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:40.845878  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 44382.1us
I20260709 13:03:40.855013  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:40.862769  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:40.855870 15179 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 13:03:40.862828  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1208) took 1372 ms. Trace:
I20260709 13:03:40.863874  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:40.865830  9095 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:40.868167  8576 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:40.869227  8580 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:40.870158  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2892) took 1302 ms. Trace:
I20260709 13:03:40.862928  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.865725  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:40.880040  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.882527  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.883128  8576 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
W20260709 13:03:40.885740  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.867116  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:40.873571  8581 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:40.865902  8584 rpcz_store.cc:276] 0709 13:03:39.490256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.490366 (+   110us) service_pool.cc:224] Handling call
0709 13:03:39.490654 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.885747 (+395093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.862559 (+976812us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54001a4854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:40.862742 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898354432}
I20260709 13:03:40.870533  8575 rpcz_store.cc:276] 0709 13:03:39.552548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.554545 (+  1997us) service_pool.cc:224] Handling call
0709 13:03:39.563002 (+  8457us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:39.569863 (+  6861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.569894 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:39.574887 (+  4993us) log.cc:844] Serialized 52 byte log entry
0709 13:03:39.788150 (+213263us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:39.788217 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.788320 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:40.724600 (+936280us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:40.843551 (+118951us) raft_consensus.cc:1685] finished
0709 13:03:40.843573 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.854616 (+ 11043us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5028,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":9961,"spinlock_wait_cycles":14329216,"thread_start_us":174088,"threads_started":1,"wal-append.queue_time_us":197392}
I20260709 13:03:40.872360  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:40.900511  8578 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:40.901180  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:40.895705 14350 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:03:40.900626  9099 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:40.821784 15165 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:40.837666 15470 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.900281  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:40.844906 15397 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.845568 15473 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:40.905143  8577 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2895) took 1258 ms. Trace:
I20260709 13:03:40.899694  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:40.908776  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:40.921818  8580 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:40.919739  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:40.801167 15436 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:40.923274  8502 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:40.855432 15433 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:40.848675 15276 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:40.921052  8577 rpcz_store.cc:276] 0709 13:03:39.638954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.644569 (+  5615us) service_pool.cc:224] Handling call
0709 13:03:40.897248 (+1252679us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54000654d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:40.897379 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1069613440}
I20260709 13:03:40.803267 15477 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.941612  8501 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:40.941843  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.927652  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:40.826815 15425 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.895432 15537 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:40.920606 15165 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:40.960554  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:40.963522  8502 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:40.942619 15470 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:40.905154 15447 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:03:40.965577  8509 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:40.945917 15399 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:40.920987 15473 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:40.973845  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:40.907402 15535 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:03:40.922827 15397 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:40.950095 15433 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:40.985157  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:40.972774 15179 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:41.007308  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.976500 15399 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:41.049247  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.977901 15470 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:41.055439  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.999316 15042 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:41.056977 15399 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:41.065184  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:41.012893 15179 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.087386  8580 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:41.087867  8580 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:41.093338 15426 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:41.068122 15042 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.113986  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:41.112291  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:41.091051 15527 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.349s	user 0.000s	sys 0.002s
I20260709 13:03:41.077358 15431 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.088690  8580 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.084854 15179 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:41.126883  8580 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:41.122550  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53812.8us
I20260709 13:03:41.128489  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:41.130189  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:41.128289 14350 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:41.103124 15276 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:41.117923 15042 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:41.133220  8319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 177699us
W20260709 13:03:41.132067  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 158333us
I20260709 13:03:41.099030 15447 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.044s
I20260709 13:03:41.124881 15535 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:41.153671  8580 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:41.126647 14990 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:03:41.135281 15487 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:03:41.136380 15446 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:03:41.154510 15501 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
I20260709 13:03:41.130983 15547 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:41.140038 15540 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.123700 15537 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:03:41.133373 15476 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:41.130409 15431 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.175807  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:41.183944  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:41.186172  8430 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:41.139593 15161 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:03:41.158630 15534 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:41.216933  8430 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:41.162918 15522 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:41.202610  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.177248 15528 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.131403 15473 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.146456 15276 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.168586 15477 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:41.196199  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69104.2us
I20260709 13:03:41.118381 15433 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.156239 15470 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.191701  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:41.218152  9099 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
W20260709 13:03:41.204201 15541 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:03:41.179883 15436 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:41.179780 15487 consensus_queue.cc:1243] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:03:41.247725  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 113149us
I20260709 13:03:41.247529 15227 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.193061 15425 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:41.255162 15431 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:41.256482 15179 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.273993  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.267583  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:41.274720  8434 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:41.221779 15397 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:41.270702  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 403610us
W20260709 13:03:41.272018  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 465808us
W20260709 13:03:41.263209  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 71609.3us
I20260709 13:03:41.264058 15477 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.278622  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:41.222461 15502 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:41.185210 15540 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.277087  9065 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:41.288162  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:41.273285 15473 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:41.290917  8428 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:41.240821 15476 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:03:41.272598 15436 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:41.291934  8429 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:41.279449 15431 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:41.228300 15534 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.278328 15227 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:41.243903 15528 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.275327 15165 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.265772 15369 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.286902 15502 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:41.315281  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.325484  8429 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
W20260709 13:03:41.325906  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.322078  9068 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:41.287544 15472 consensus_queue.cc:1059] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:03:41.288556 15477 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.328907  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:41.331455  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.330654  8578 raft_consensus.cc:2376] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17. Re-sending same reply.
I20260709 13:03:41.334843  8429 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:03:41.282727 15553 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:41.328771 15502 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:41.323886 15447 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:41.329591 15555 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:41.318965 15560 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:41.346733 15546 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:03:41.349258  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:41.349670 15481 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.001s
I20260709 13:03:41.350276 15481 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.350525 15549 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:41.350847  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.351874  8434 raft_consensus.cc:2393] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 20: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:41.351269  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:41.352905  8432 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:41.354633  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.356544 15399 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.352931 15481 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.358220  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.358729 15399 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:41.359529  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:41.360074  8434 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:41.361554  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:41.362282  8578 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:41.363829  8432 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:03:41.365406  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:41.340016 15543 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:03:41.313829 15436 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.366559  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:41.339871 15431 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:41.372396  8434 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:41.373924 15431 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:41.374958 15431 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.342679 15553 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:41.379287 15553 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.382124 15447 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:41.382220  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.386632  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:41.388201  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.389021  8427 raft_consensus.cc:2410] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:03:41.390072  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:41.391350  8434 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:03:41.367610 15425 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:41.402426  8506 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:41.384021 15542 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 13:03:41.396425  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:41.406821  8434 raft_consensus.cc:2376] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20. Re-sending same reply.
I20260709 13:03:41.370354 15555 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:41.406184  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1482) took 1184 ms. Trace:
I20260709 13:03:41.408579  8426 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:41.397497  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.407796  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.408707  8503 rpcz_store.cc:276] 0709 13:03:40.214721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.214898 (+   177us) service_pool.cc:224] Handling call
0709 13:03:41.398798 (+1183900us) spinlock_profiling.cc:243] Waited 64 ms on lock 0x7b54001fcf54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:41.398933 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147096832}
I20260709 13:03:41.400926 15553 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:41.390475 15561 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.409804  8427 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:03:41.407126 15481 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:41.425509  8426 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:41.429991  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.430856  8432 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 13: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:41.429801  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:41.435228 15292 consensus_meta.cc:287] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.000s
I20260709 13:03:41.422250 15179 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:41.443303  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.445791  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.442648  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 165642us
I20260709 13:03:41.448736  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:41.455307  9065 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:41.455442  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:41.456324  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 177767us
I20260709 13:03:41.457358  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:41.459415  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:41.459656  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:41.460633  9102 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:41.445267 15551 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:03:41.443923 15561 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:41.476712 15554 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:03:41.476835 15561 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.462603 15477 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:41.466954 15559 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:03:41.460029 15165 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:41.467974 15436 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:41.510551 15447 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:41.479656  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:41.447705 15558 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:03:41.461629  8475 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:03:41.522943  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.478963 15369 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:41.488114 14511 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:41.489524 15547 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.477315 15503 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:41.510824  9068 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:41.513933  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 159623us
W20260709 13:03:41.522773  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 61198us
I20260709 13:03:41.533646  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:41.483451 15477 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:41.523891  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:41.493726  8319 catalog_manager.cc:4755] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): ChangeConfig:REMOVE_PEER RPC failed for tablet 09de6eee9632412ebe0a904f65cd2a3c: Remote error: Service unavailable: leader transfer in progress
I20260709 13:03:41.532615  8476 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:41.539908  8319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47884.3us
I20260709 13:03:41.514147 15165 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.544093  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:41.514933 15447 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.524897 15535 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.546561  8400 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:41.512516 15567 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:41.531919 15569 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:41.540853 15477 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:41.546319  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 91083us
I20260709 13:03:41.532012 15503 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:41.550803  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:41.548924 15522 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:41.549326 15447 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:41.549578 15369 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:41.555696 15569 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.550415 15516 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:41.577085 15565 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:03:41.580286 15503 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.582177 15503 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:41.588220 15566 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:41.590632 15561 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:41.561120 15535 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:41.591572 15535 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.591948 15535 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:41.557251 15477 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:41.600351  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:41.543192 15042 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.604228  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:41.608832  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:41.560357 15572 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:03:41.617048  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 70565us
I20260709 13:03:41.617244 15572 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.617830 15572 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:41.618628 15579 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:41.620728  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:41.621685 15579 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:41.622555 15579 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:41.623628 15579 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.626461  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:41.629293  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:41.630730  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.549994 15165 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.632802  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.632936  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:41.633881  8435 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:41.635999  8476 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:41.593856 15569 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:41.613487 15292 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:41.613245 15369 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:41.632110 15426 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.654615 15572 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.678146  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:41.703415  8433 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:41.681771  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.682173 15577 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:41.685631  9100 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:41.704535  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:41.630411 15479 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:41.707716 15574 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:41.708407  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:41.640420 15566 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:41.709651  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:41.722829  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:41.704670 15577 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:41.775583  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:41.690061 15292 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.720968 15566 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.739825 15399 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:41.706058 15426 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.742347 15479 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:41.789391 14350 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:41.824016  9096 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:41.860128 15292 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:41.862685 15165 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:41.874161  8433 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:03:41.783512 15566 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:41.875439  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:41.784282 15397 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.102s
W20260709 13:03:41.887593 15576 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:41.887892 15570 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:41.741391 15502 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.783397 15561 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.902642  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:41.917305  8433 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:41.935946  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.872501 15433 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.899422 15474 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:41.912606 15397 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:03:41.913406 15584 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:03:41.908591  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:41.890451 15526 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:03:41.954092  8433 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:41.838568 15399 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.977564 15399 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:41.977960 15580 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.243s	user 0.001s	sys 0.001s
I20260709 13:03:41.945581 15426 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:41.951414 15561 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.982079 15474 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:41.982969 15572 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:41.983156 15474 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.959616 15397 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:41.983031 15561 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:41.986956 15397 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:41.988401 15397 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:41.977605 15569 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:41.993045 15569 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:41.863968 15568 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.402s
I20260709 13:03:41.999789 15516 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:42.000579 15516 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.003407 15516 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.005364  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:42.006119 15502 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.006354 15426 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.006589  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.007257  8435 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:41.959897 15433 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.007047 15426 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.008138  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:42.008641  8435 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.009078 15433 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.010304 15426 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.012373 15479 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.015885 15042 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.016177  8435 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
W20260709 13:03:42.020723  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.942605 15582 log.cc:927] Time spent T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:42.026862  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:42.025637  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:42.032651  8476 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:42.039188  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.041512  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.042692  8435 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:42.044037  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.044979  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.045625  8578 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:42.039880  8431 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:42.048161  8576 raft_consensus.cc:2410] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:03:42.051779  8434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.006s	sys 0.008s
W20260709 13:03:42.052176  8434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.008s
I20260709 13:03:42.054093  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.054847  8580 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:42.056771  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.057974  8504 raft_consensus.cc:2410] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:03:42.040373 15568 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:41.898218 15369 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:42.054388 15473 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.757s	user 0.009s	sys 0.002s
I20260709 13:03:42.082842  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:42.048015 15569 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:42.089208 15594 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.090700 15516 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:42.091296 15572 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:42.091830 15179 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.098757 15397 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.101150 15503 consensus_meta.cc:287] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.004s
I20260709 13:03:42.107371 15534 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.112192  9099 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:41.962502 15570 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.001904 15535 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.082263  8502 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:42.070478 15579 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.085152 15399 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.075215 15537 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:42.080317 15568 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.131311 15179 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.134593 15397 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.051779 15447 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.147946 15535 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.149230  8433 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:03:42.117944 15569 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:42.116165 15321 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:41.964869 15577 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.188280  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.189414  8504 raft_consensus.cc:2410] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:03:42.155452 15568 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:42.214934  8502 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:42.216135  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.199616  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.200673  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:42.217873  8503 raft_consensus.cc:2368] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 23. Current term is 24.
I20260709 13:03:42.201540  8398 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:42.220180 15179 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:42.223477  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.227689 15397 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.199343 15321 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:42.227732 15556 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.854s	user 0.008s	sys 0.001s
I20260709 13:03:42.233606 15569 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.235872  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2681) took 1383 ms. Trace:
I20260709 13:03:42.236680  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.236310  8505 rpcz_store.cc:276] 0709 13:03:40.852960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.864096 (+ 11136us) service_pool.cc:224] Handling call
0709 13:03:40.864406 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.864740 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.864765 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:40.865225 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.184183 (+318958us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:41.184225 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.184293 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.115106 (+930813us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:42.235539 (+120433us) raft_consensus.cc:1685] finished
0709 13:03:42.235578 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.235810 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":228781,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":87,"spinlock_wait_cycles":26384768,"thread_start_us":318571,"threads_started":1,"wal-append.queue_time_us":474252}
I20260709 13:03:42.241645 15540 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.245497 15549 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:42.246498  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3112) took 1810 ms. Trace:
I20260709 13:03:42.246889  8506 rpcz_store.cc:276] 0709 13:03:40.435961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.436676 (+   715us) service_pool.cc:224] Handling call
0709 13:03:41.402186 (+965510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.402951 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.246321 (+843370us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54001fcf50. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:42.246445 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219494656}
I20260709 13:03:42.247334  8505 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:42.148581 15579 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.246109 15549 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.251559 15579 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.252532 15549 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.256693 15601 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:42.257651 15601 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.258276 15601 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.260741 15601 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:42.264055  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 62630.7us
I20260709 13:03:42.120436 15516 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.122452 15572 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.213129  9093 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:42.280921  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.281626  8584 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:42.283918  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.284624  8576 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:42.286098  8398 leader_election.cc:400] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 23. Current term is 24.
I20260709 13:03:42.286656  8398 leader_election.cc:403] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:03:42.270257  8578 raft_consensus.cc:2468] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:42.271169  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.261612 15570 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.276726  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.293383  8428 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:42.277725  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.295121  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2739) took 1061 ms. Trace:
I20260709 13:03:42.149394 15399 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.290450  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.121635 15594 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.182741 15534 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.107s
I20260709 13:03:42.200934 15481 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.281292 15537 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:42.290100  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.335078  8426 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:42.300467  8578 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:42.297641  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.278662 15540 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.299793  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:42.295547  8430 rpcz_store.cc:276] 0709 13:03:41.227310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.227736 (+   426us) service_pool.cc:224] Handling call
0709 13:03:41.228040 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.329603 (+101563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.329643 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:41.329684 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:41.329715 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.288158 (+958443us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54003a3754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:42.288205 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.288324 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233122048}
I20260709 13:03:42.278445 15397 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:03:42.344875 15397 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:42.345259 15397 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:42.293809  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.346158  8576 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:42.299916 15547 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:42.298637  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:42.323449 15447 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.323838 15399 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.325639 15594 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.326102 15481 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.331701  8584 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:42.331890 15516 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.291296  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.295725 15590 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:42.301306 15570 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:42.377051 15570 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.355620 15547 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.380317 15570 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:42.350090  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 51567.2us
I20260709 13:03:42.358577 15179 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:42.340857 15535 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:03:42.382639 15179 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.384742 15179 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.351102  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.385448  9098 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:42.388029 15566 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.303375 15601 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:42.359956  8501 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:42.356546  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.351287  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.391223  9100 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:42.368927  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:42.361186  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.369767  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.352475 15540 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.382058 15547 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.348294 15397 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.394068  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.357286 15427 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.400974 15477 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.764s	user 0.006s	sys 0.004s
I20260709 13:03:42.402282  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.406422  8430 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:42.403929 15540 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.356276 15474 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:42.398602 15447 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:42.415854  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:42.407447 15528 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.430111  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:42.433094  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.437050  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2633) took 1845 ms. Trace:
I20260709 13:03:42.433944  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:42.420764  8576 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:42.398092 15601 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.420465 15397 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:42.396203 15560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.002s	sys 0.013s
I20260709 13:03:42.398654 15549 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:03:42.416980 15566 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.441684  9067 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:42.413916 15474 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:42.437440  8583 rpcz_store.cc:276] 0709 13:03:40.591339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.616866 (+ 25527us) service_pool.cc:224] Handling call
0709 13:03:40.631458 (+ 14592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.849729 (+218271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.849772 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.259000 (+409228us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b2c0003d068. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:03:41.259431 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.345062 (+ 85631us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:41.345118 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.436734 (+1091616us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540028d054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:42.436787 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.436835 (+    48us) raft_consensus.cc:1685] finished
0709 13:03:42.436848 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.436995 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62830,"raft.queue_time_us":27767,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":41047,"spinlock_wait_cycles":447370368,"thread_start_us":80474,"threads_started":1,"wal-append.queue_time_us":166550}
I20260709 13:03:42.435285 15489 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:42.458598  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:42.444375 15560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.003s	sys 0.013s
I20260709 13:03:42.413071 15477 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.412099 15427 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.437274 15600 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:42.444921 15161 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:42.459596 15474 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.432245 15447 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.472962  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:42.459224 15479 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:42.462687 15555 raft_consensus.cc:2804] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:42.460194 15476 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:42.482100  9097 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:42.482574  8508 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:42.482928 15555 raft_consensus.cc:697] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:42.484794 15442 raft_consensus.cc:3055] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:42.488004 15321 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:42.491408 15604 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:42.525496 15276 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.526628 15427 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.527971 15481 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.530320 15477 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.531342  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.532002  9094 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:42.532097  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.532675 15447 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:42.520151 15442 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:03:42.494477 15618 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:03:42.495589  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:42.545610  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50119.7us
I20260709 13:03:42.546326  8426 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:42.496112 15516 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.498571  8504 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:03:42.499184  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.500030  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.550364  9101 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:42.470674 15577 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:42.473982 15161 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.473450 15600 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.515069  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:42.465494 15560 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:42.480130 15479 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:42.524008  8427 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:42.554494 15481 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:42.534653  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.535043  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.535532  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:42.532948  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.578217  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.578894  9100 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:42.580077  9100 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:42.538403  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.581241  8578 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:42.539214  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.540894  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.582038  8577 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:42.543866  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.553256  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.553542  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.522871 15594 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:42.564074  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.583504  9101 raft_consensus.cc:2410] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:03:42.533747 15555 consensus_queue.cc:237] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.520937 15476 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:42.571007  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 56027.3us
I20260709 13:03:42.571594  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.493582 15537 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.576630  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.562392 15161 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:42.565308 15600 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.575841 15321 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:42.570289 15577 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:42.625661 15232 raft_consensus.cc:993] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:03:42.625048 15577 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.626230 15232 raft_consensus.cc:1081] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Signalling peer 6930e07cbba2484ca2bf800a58acdbb0 to start an election
I20260709 13:03:42.634910 15321 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.577059 15481 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.590543  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.639426  8580 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:42.591675  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 2744) took 1261 ms. Trace:
I20260709 13:03:42.640187  8429 rpcz_store.cc:276] 0709 13:03:41.330587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.331216 (+   629us) service_pool.cc:224] Handling call
0709 13:03:42.591513 (+1260297us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b54001d42d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:42.591620 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6124416}
I20260709 13:03:42.635696 15321 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.599990  8577 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:42.590776 15426 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.562686 15276 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:03:42.617893  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.618505  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.653460  8581 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:42.587993 15594 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:42.622452  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.08718e+06us
I20260709 13:03:42.641671 15481 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:42.589879  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 54426.3us
I20260709 13:03:42.559445 15516 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.637578  8583 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:42.643600 15479 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.644986 15601 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.644604 15560 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.645210 15593 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:42.608088 15537 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.606012 15442 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.652261  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:42.653817  8578 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:03:42.587008  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:42.655287  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:42.622608  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.668713  8576 raft_consensus.cc:2393] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:42.665910  9068 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:42.674642  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 87725.1us
I20260709 13:03:42.666736 15427 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:03:42.664515 15549 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:03:42.664783 15593 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:42.642940 15474 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.682332 15477 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:42.682189 15161 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.683353  9095 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:42.683399 15537 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.686429  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.687073  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.687813  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.688508  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.685045 15394 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:42.691622  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.692409  8583 raft_consensus.cc:2368] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16.
I20260709 13:03:42.682235 15593 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.693570 15593 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:42.691757 15394 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:42.694619 15394 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.695554 15394 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.698535  8580 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:42.692534 15161 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.656375 15594 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:42.704823  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54853.5us
I20260709 13:03:42.707168  8581 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:42.707628  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.707757 15601 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.708827 15601 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.709372 15516 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.708325 15547 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:42.710976 15601 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.712569 15568 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.718497  8429 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:42.719130 15476 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.718554  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.720441  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.721238  8431 raft_consensus.cc:2410] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:03:42.722785  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.723050 15442 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:42.723642  8430 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:42.719774  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.726301 15496 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:42.726876 15496 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.727181  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:42.727823  8508 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:42.729130 15496 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:42.729712 15479 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:42.730693  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.731297  8431 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
W20260709 13:03:42.733755  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.734393 15593 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.734535 15621 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.176s	user 0.002s	sys 0.000s
I20260709 13:03:42.734946 15593 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.734678 15397 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.735879  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.735762 15397 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.683404 15474 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.736696  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:42.718472  8583 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.738413 15547 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:42.737874 15397 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.739612  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:42.740130 15593 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:42.740352 15397 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:42.740851 15397 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:42.654525 15426 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.742774 15397 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:42.743944 15161 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:42.744158  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 78328.4us
I20260709 13:03:42.704159 14990 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:42.736999  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.748799 15477 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:42.752020 15161 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:42.754341 15610 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.754914 15610 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:42.752229  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.756880 15610 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.760123 15474 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:42.760815 15474 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.761487  9093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:03:42.762159  9093 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:42.762461  9093 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:42.763242 15321 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.763863 15474 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.764343  8578 raft_consensus.cc:2368] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18.
I20260709 13:03:42.765267  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:42.766103 15476 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:42.766238  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:42.766438  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:42.766824  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.772259 15165 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:42.759877 15594 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.774420  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.775146  8580 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:42.773623  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 98041.2us
I20260709 13:03:42.765836  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:42.743319 15426 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:03:42.778498 15161 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:42.779059  9068 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:42.779249 15161 consensus_queue.cc:1243] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer dacb523538a14c7cb335ab9c18f4111b log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:03:42.779405  8550 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:42.780228 15547 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:42.780946 15547 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:42.777750  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:42.774528  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.782171 15594 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.768657  8398 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:42.770725  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:42.782811  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.782912 15165 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:42.782614  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.792622  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.789568  8581 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 23 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 10.
I20260709 13:03:42.803525  8576 raft_consensus.cc:2368] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15.
I20260709 13:03:42.795616  8583 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:42.798054  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:42.800302  8580 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:03:42.788542  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:42.806056  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:42.810801  8584 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 25.
I20260709 13:03:42.812304  9096 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:03:42.823288  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:42.826763  8475 leader_election.cc:400] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16.
I20260709 13:03:42.827133  8475 leader_election.cc:403] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:42.858492  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.858994  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.793602  9093 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:42.860256  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 71822.4us
I20260709 13:03:42.864118 15547 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:42.864686 15547 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:42.865007  8475 leader_election.cc:400] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15.
I20260709 13:03:42.865231 15547 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.865489  8475 leader_election.cc:403] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:42.867872  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.868374 14350 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:03:42.868566  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 63661.1us
I20260709 13:03:42.859226  9096 raft_consensus.cc:2368] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20.
W20260709 13:03:42.871400  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 65475.4us
I20260709 13:03:42.872843  8400 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:42.873270  8475 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:42.868417  8576 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:42.869114 14350 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.876573  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.878170  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.881655  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:42.784893 15321 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.883045  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.887677  8580 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:42.883378  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.890264  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.883517  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.891858  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1420) took 1260 ms. Trace:
I20260709 13:03:42.892555  9094 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:03:42.786396 15522 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:42.883045  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.885195  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:42.880288  9068 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:42.810956 15165 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.899634  8581 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:42.892223  8432 rpcz_store.cc:276] 0709 13:03:41.631087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.750645 (+119558us) service_pool.cc:224] Handling call
0709 13:03:41.778679 (+ 28034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.785182 (+  6503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.785215 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.864299 (+ 79084us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.273125 (+408826us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:03:42.292078 (+ 18953us) log.cc:844] Serialized 14 byte log entry
0709 13:03:42.492811 (+200733us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b18003db8e0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:03:42.879352 (+386541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.879432 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.879481 (+    49us) raft_consensus.cc:1685] finished
0709 13:03:42.891630 (+ 12149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.891794 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3751,"prepare.queue_time_us":22516,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":237349,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":27650,"spinlock_wait_cycles":16309504,"thread_start_us":714344,"threads_started":2,"wal-append.queue_time_us":475716}
I20260709 13:03:42.904716  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:42.876263 15535 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:42.810853 15394 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:42.883879 15537 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:42.858340 15276 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:42.916908 14990 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:42.893949  8427 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:42.891026  9096 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:42.923297  8576 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
I20260709 13:03:42.867277 15426 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:42.922490  8580 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:42.867331 15610 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:42.887835 15570 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:42.939517  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.925168  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.927711  9093 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:42.872143 15447 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:42.876528 15540 raft_consensus.cc:3060] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:42.886127 15476 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:42.883076 15516 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:42.781647 15600 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:42.946377  9096 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:42.925140 15165 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:42.994570  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48299.4us
I20260709 13:03:42.884517 15561 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:03:42.918478 15522 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.000734  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:43.002444  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:43.003357  8433 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:43.005422  8428 pending_rounds.cc:85] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 12
I20260709 13:03:43.006124  8428 pending_rounds.cc:107] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:03:43.006466  8428 raft_consensus.cc:2889] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:42.965065  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.922801 15179 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:42.965911 14350 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:42.949683  8434 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:42.975666  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:43.007747  9094 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:43.008736  8580 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:42.987910  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.992758  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:42.932147 15593 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.013564  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.939229 15537 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:42.940390 15426 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.936790 15394 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:43.032140  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.032409  8509 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:43.032847  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:43.034212  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:43.071456  8505 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:43.071506  8433 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:42.991259 15570 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:43.010601 15522 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:43.041313 15590 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
W20260709 13:03:43.053838  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.055537  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:42.925762 15535 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:43.071753  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:42.956070 15431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.577s	user 0.021s	sys 0.010s
I20260709 13:03:43.061067  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:43.089800  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.086454  9098 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:43.078284  8581 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:03:43.090576  8501 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:43.010308 15179 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:43.018697 15568 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.084348  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.055387 15426 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:42.972365 15161 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 13:03:43.135084  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:42.948107 15470 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.138s
I20260709 13:03:43.146054  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:43.095024 15431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.716s	user 0.023s	sys 0.011s
I20260709 13:03:43.150858  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.092222 15590 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 23. Current term is 24.
I20260709 13:03:43.136927  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.153191  8509 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:43.147514  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:43.130518 15560 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:43.155174  8580 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:03:43.156035 15631 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:03:43.026523 15593 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:43.156121 15427 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.150210 15502 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:43.060540 15516 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.062062  9095 raft_consensus.cc:2368] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18.
I20260709 13:03:43.095419 15179 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:43.167150 15568 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:43.181190  8505 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:43.142926 15474 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:43.184307  8580 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:43.157747 15626 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:43.189421  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:43.236121  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47149.8us
I20260709 13:03:43.164952  9094 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:43.242556  8581 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:43.243063  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:43.245986  8580 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:43.188330 15431 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:03:43.235034 15608 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.770s	user 0.003s	sys 0.000s
I20260709 13:03:43.189081 15610 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:43.245236 15577 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:43.189435 15560 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.252115 15446 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:43.179656 15537 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:43.244488 15626 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.282832  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:43.311239  8579 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:43.283171 15600 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:43.276543 15610 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.283927  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.284132 15535 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:43.251763 15470 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:03:43.285547  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.328042  9102 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:43.329299  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:43.287002  9093 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:43.331099  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.329945  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:43.288690  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.332489  8579 raft_consensus.cc:3055] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:43.332860  8579 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:43.292357  9065 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:43.294803  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1225) took 1254 ms. Trace:
I20260709 13:03:43.334354  9102 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:43.301935  8509 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:43.155244 15570 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:43.230952 15502 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.240171 15516 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:43.241521 15568 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.326804  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:43.248972 15474 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.236814 15394 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.309266 15577 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:43.195709 15427 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.345969  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:43.377802  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.391358  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49572.2us
I20260709 13:03:43.392410 14350 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:43.392673  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 66000.1us
I20260709 13:03:43.319181 15477 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:43.300165 15446 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.304008 15590 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:43.324743 15534 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:43.405264  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:43.387859 15535 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:43.333499  8582 rpcz_store.cc:276] 0709 13:03:42.040767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.040902 (+   135us) service_pool.cc:224] Handling call
0709 13:03:42.041232 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.041564 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.041592 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.042076 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.337975 (+295899us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:42.338579 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.338658 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.093915 (+755257us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:43.294571 (+200656us) raft_consensus.cc:1685] finished
0709 13:03:43.294591 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.294758 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1698,"raft.queue_time_us":840,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5523,"spinlock_wait_cycles":7536512,"thread_start_us":256140,"threads_started":1,"wal-append.queue_time_us":386925}
I20260709 13:03:43.404479  9065 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:43.384104 15552 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:43.413544 14350 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.396835  8579 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.399044 15600 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:03:43.475522  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:43.482915  8428 raft_consensus.cc:2410] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:03:43.483793  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:43.480703  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:43.486864 14350 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.419296  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:43.407948  9102 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
W20260709 13:03:43.493788  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 89390.2us
I20260709 13:03:43.416031 14990 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:43.413699 15481 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.750s	user 0.005s	sys 0.005s
I20260709 13:03:43.418167 15446 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:43.436910 15629 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:03:43.450721 15622 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.815s	user 0.004s	sys 0.002s
W20260709 13:03:43.442495 15625 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 13:03:43.436340 15641 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:03:43.522972  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:43.441090 15502 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.539599  8582 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:43.511580 15276 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:43.532524  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 47580.7us
W20260709 13:03:43.456359 15442 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.000s
I20260709 13:03:43.431650 15487 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:43.451385 15560 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.479861 15474 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.537803  8578 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:03:43.436029 15610 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.481153 15568 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.468876 15427 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:43.454042 15593 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:43.434774 15640 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:03:43.541260  8582 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:43.510931 15648 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:43.453511 15626 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.512248 15232 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:43.572126 15540 consensus_meta.cc:287] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
I20260709 13:03:43.542289 14350 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:43.553349  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.582414  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.547369 15577 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.554817 15645 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:43.525501 15481 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.555048 15276 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:43.493553 15590 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.457116 15534 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.526360 14990 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:43.536924 15479 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.807s	user 0.004s	sys 0.008s
I20260709 13:03:43.568898  8575 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
W20260709 13:03:43.574640  8547 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.194:38749 timed out after 1.520s (SENT) [suppressed 48 similar messages]
W20260709 13:03:43.574930  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 154763us
I20260709 13:03:43.439592 15426 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.447803 15516 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:43.585244 15540 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 15. Current term is 16.
I20260709 13:03:43.598364  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:43.586966 15655 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.580093  8475 leader_election.cc:400] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20.
I20260709 13:03:43.608529  8475 leader_election.cc:403] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:43.577299  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 88942.7us
I20260709 13:03:43.511427 15535 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.568584 15487 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.571533 15572 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:43.585062 15476 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
W20260709 13:03:43.486534 15496 consensus_queue.cc:1175] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6930e07cbba2484ca2bf800a58acdbb0" responder_term: 17 status { last_received { term: 16 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:43.614012 15476 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 14. Current term is 15.
W20260709 13:03:43.602156 15547 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.736s	user 0.012s	sys 0.001s
I20260709 13:03:43.614832 15547 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.617030 15547 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:43.595795 15614 log.cc:927] Time spent T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.987s	user 0.000s	sys 0.004s
I20260709 13:03:43.581853 15232 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.609688  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:43.611941  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:43.582712 15610 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.018s
W20260709 13:03:43.618310  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 43708.3us
I20260709 13:03:43.620545  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:43.623984  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:43.617023 14990 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.619247 15487 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:43.641698  9102 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:43.644632  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:43.587255 15645 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.644663  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.653977  9097 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:43.658576 15534 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.648188  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:43.626394 15232 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:43.653071 14350 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:43.619421 15570 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20.
I20260709 13:03:43.660140  8475 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:43.659855  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:43.627345 15516 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:43.674754 15516 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.675271 15516 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:43.676522 15442 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:43.676918 15442 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.677260 15442 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:43.677327 15516 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:43.619578 15655 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.665395 14350 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.679762  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:43.679956 15655 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.680370  8581 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:43.680702 14350 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.681559  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:43.682351  8578 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:43.682498 15660 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:43.683205  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:43.683058 15660 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:43.683804  8583 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:43.685278 15660 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:43.672690 15179 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.685688  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:43.686892  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.688282  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.688941  9097 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:43.689186  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.690291  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.690886  9101 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
W20260709 13:03:43.690984 15632 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.775s	user 0.003s	sys 0.004s
I20260709 13:03:43.691157 15179 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:43.691535  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.692715  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:43.693054  8475 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:43.693586 15610 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:43.693789 15660 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:43.694053 15610 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.694450 15610 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:43.694555 15660 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:43.695529 15660 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:43.697503  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.678144 15570 raft_consensus.cc:2804] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:43.664276 15661 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.698562 15661 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:43.700012 15635 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:03:43.700969 15661 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.703336  9098 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:43.643540 15547 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:43.671505 15446 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.648629 15540 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:42.914919  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:43.711886  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:43.712448  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:43.700976  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:43.653434 15572 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:43.727072  8434 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:43.640607 15626 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:03:43.729676  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:43.730293 14350 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:43.724458 15547 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:43.751284 14350 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.751684 14350 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:43.752195 15547 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.750873  8434 raft_consensus.cc:2368] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23.
W20260709 13:03:43.754420 15522 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.000s
I20260709 13:03:43.723744 15568 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:43.755388 15535 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.755627 15568 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.756248  8579 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:43.757652 15568 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.730698  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:43.723585 15570 raft_consensus.cc:697] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:43.758971 15570 consensus_queue.cc:237] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.760334 14350 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:43.739718 15637 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.308s	user 0.000s	sys 0.002s
I20260709 13:03:43.761273 15481 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.754940  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:43.762518 14350 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:43.762765  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:43.763825  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:43.764431  8426 raft_consensus.cc:3060] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:43.741503 15638 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.664s	user 0.001s	sys 0.001s
I20260709 13:03:43.766199 15552 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:43.767580  8510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3134) took 1065 ms. Trace:
I20260709 13:03:43.732514 15474 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:43.759415 15426 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:43.764156  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:43.769119  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:43.754930 15626 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:03:43.744194 15649 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:03:43.743507 15645 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:43.770653  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:43.762861  8434 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:43.772053  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.773499  8509 raft_consensus.cc:1275] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:43.767942  8510 rpcz_store.cc:276] 0709 13:03:42.702657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.703789 (+  1132us) service_pool.cc:224] Handling call
0709 13:03:42.704134 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:42.704514 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.704545 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:42.729838 (+ 25293us) log.cc:844] Serialized 52 byte log entry
0709 13:03:43.011731 (+281893us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:43.060288 (+ 48557us) log.cc:844] Serialized 14 byte log entry
0709 13:03:43.079048 (+ 18760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.079139 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.735119 (+655980us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b1800398a40. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:03:43.740665 (+  5546us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:43.767379 (+ 26714us) raft_consensus.cc:1685] finished
0709 13:03:43.767401 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.767526 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18486,"prepare.queue_time_us":48548,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":33394,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":41883,"spinlock_wait_cycles":17427584,"thread_start_us":281413,"threads_started":1,"wal-append.queue_time_us":347477}
I20260709 13:03:43.654331 15476 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 13:03:43.825591  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:43.830617 15651 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.379s	user 0.000s	sys 0.002s
I20260709 13:03:43.785334 15626 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:43.832086 15626 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.833197  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:43.822412  8508 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:43.833849  8430 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:43.834800  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:43.833369 15626 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:43.835837  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:43.794219  8506 raft_consensus.cc:1240] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:03:43.838912  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:43.839121  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:43.784299 15661 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:43.840643  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.842175  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.841197  8434 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 20: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:43.841634  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.843372  8504 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:43.845813  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.846901  8426 raft_consensus.cc:2468] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
W20260709 13:03:43.792881  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 91966.9us
I20260709 13:03:43.848527  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.848714  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.958279  8503 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:43.958945  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:43.959631  8509 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:03:43.953063  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.849363  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:43.960487  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:43.850245  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:43.852267  8579 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:43.853170  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.853950  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:43.961987  8434 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
W20260709 13:03:43.898900  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 274077us
I20260709 13:03:43.844828 15661 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.770380 15522 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:43.840951 15568 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:03:43.953018  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:43.953591  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.956138  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.963965  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:43.972721  8475 leader_election.cc:400] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18.
I20260709 13:03:43.993238  8475 leader_election.cc:403] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:43.992789  8507 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:43.978951  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:44.003157  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:44.005893  8509 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
W20260709 13:03:43.972289 15165 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.947s	user 0.012s	sys 0.000s
I20260709 13:03:44.007669  8431 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:43.968698 15661 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:44.006618  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:44.013267  8508 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:44.014195 15165 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.000587 15276 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:44.017009  8504 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:44.019104 15431 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.020541 15446 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:43.999747 15516 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:44.006150 15643 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.727s	user 0.003s	sys 0.000s
I20260709 13:03:43.992730 15474 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:03:44.022807  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:44.025444  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:44.025635  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.049782  8579 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
W20260709 13:03:44.026451  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 47626.9us
I20260709 13:03:44.035018  8475 leader_election.cc:400] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18.
I20260709 13:03:43.971194 15426 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:44.048053  8505 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
W20260709 13:03:44.054855 15642 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.776s	user 0.003s	sys 0.006s
W20260709 13:03:44.054988  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 324335us
I20260709 13:03:44.002998 15528 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:43.964118 15660 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.074s
I20260709 13:03:44.091297  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.023648 15647 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:44.000066 15477 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:03:43.999905 15561 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:03:44.093137  8428 raft_consensus.cc:2368] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19.
I20260709 13:03:44.093297  8503 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:44.094784  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:44.066882  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:44.054889  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:44.118100  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 63327.2us
I20260709 13:03:44.008935 15655 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.119235  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:44.127187  8427 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:44.027261 15476 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18.
I20260709 13:03:44.036515 15568 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:44.049014 15179 consensus_queue.cc:1059] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 13:03:44.094337 15528 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.098845 15647 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:44.098604 15603 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:44.048938 15431 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.056754 15656 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:44.040128 15590 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.056839 15447 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:44.096470 15516 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:44.131807 15655 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:44.125876  8434 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 14.
I20260709 13:03:44.213446  8434 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:44.213119  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:44.214658  8426 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:44.141726 15568 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:44.038424 15276 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:44.099560  8550 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:44.120626 15540 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:44.269029  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 171860us
I20260709 13:03:44.183426  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1242) took 1477 ms. Trace:
W20260709 13:03:44.181931 15633 log.cc:927] Time spent T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.883s	user 0.012s	sys 0.006s
I20260709 13:03:44.185088 15522 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.185691 15535 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:44.183475 15431 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:44.193236  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2921) took 1653 ms. Trace:
I20260709 13:03:44.178787 15647 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.194773  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:44.280954  8504 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:44.195461  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:44.195840 15165 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.196703  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:44.097266 15426 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.183300 15603 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.197531  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:44.199631 15473 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:44.199965  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:44.201421 15042 raft_consensus.cc:3055] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:44.184897 15528 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.209463  8427 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:44.304018  8427 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:03:44.304128  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 253148us
I20260709 13:03:44.304574  8433 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:44.051440 15645 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:03:44.139941  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:44.222074  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 67148.9us
I20260709 13:03:44.269855  8584 rpcz_store.cc:276] 0709 13:03:42.706112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.867740 (+161628us) service_pool.cc:224] Handling call
0709 13:03:42.868034 (+   294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:42.868461 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.868489 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:42.876958 (+  8469us) log.cc:844] Serialized 52 byte log entry
0709 13:03:43.138003 (+261045us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:43.138076 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.138146 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.765948 (+627802us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:44.183098 (+417150us) raft_consensus.cc:1685] finished
0709 13:03:44.183122 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.183363 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3549,"raft.queue_time_us":7877,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":31834,"spinlock_wait_cycles":431562624,"thread_start_us":194677,"threads_started":1,"wal-append.queue_time_us":303424}
I20260709 13:03:44.204885 15663 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.276473 15601 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:44.278838  8575 rpcz_store.cc:276] 0709 13:03:42.539567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.539670 (+   103us) service_pool.cc:224] Handling call
0709 13:03:44.193056 (+1653386us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54000aa0d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:44.193173 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267034880}
I20260709 13:03:44.281562  8508 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.201472 15232 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.287212  8434 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:03:44.221324 15666 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
W20260709 13:03:44.293850  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 97207.9us
I20260709 13:03:44.323262  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:44.275885 15442 consensus_meta.cc:287] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.001s
I20260709 13:03:44.228389 15568 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:44.219777 15447 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.299712 15473 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:44.311506  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:44.268836 15572 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:03:44.314141  8429 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:44.297336 15397 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:44.329885  8508 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:44.302587 15042 raft_consensus.cc:740] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:44.333233  8433 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:03:44.298650 15610 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.600s	user 0.005s	sys 0.007s
I20260709 13:03:44.336673  8577 raft_consensus.cc:2368] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15.
I20260709 13:03:44.336493  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:44.318909 15601 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.347591  8434 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.347467  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.349414  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.350967  9100 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:44.347419  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.352197  9099 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
W20260709 13:03:44.336630 15549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.170s	user 0.008s	sys 0.012s
I20260709 13:03:44.355010  9093 raft_consensus.cc:2393] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:44.341416 15165 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.346160 15600 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:03:44.354660 15537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.025s	sys 0.042s
W20260709 13:03:44.389474 15537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.025s	sys 0.042s
I20260709 13:03:44.384377 15657 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:44.390321 15657 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.390923 15426 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:44.392202 15603 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.392361 15657 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.393275 15516 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:44.381856  8434 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:44.384171 15042 consensus_queue.cc:260] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.385329 15655 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:44.334270 15442 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.353538 15601 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:44.387060 15661 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:44.388379 15626 consensus_meta.cc:287] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.001s
W20260709 13:03:44.402601  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 79433us
I20260709 13:03:44.403898  8476 leader_election.cc:400] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23.
I20260709 13:03:44.400538  9068 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:44.405383  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 69837.9us
I20260709 13:03:44.406816  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:44.412743  8433 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
W20260709 13:03:44.363668 15549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.205s	user 0.008s	sys 0.013s
I20260709 13:03:44.408845  8434 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:44.356124 15496 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:44.411682  8476 leader_election.cc:403] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:44.333765 15663 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:44.401636 15487 consensus_meta.cc:287] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.738s	user 0.008s	sys 0.004s
I20260709 13:03:44.417253  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:44.421682  8433 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:44.420099  8476 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:44.421739  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:44.423491  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:44.425487 15276 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:44.425580 15447 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:44.420977 15042 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:44.434476 15487 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.435129  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:44.436609 15487 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.437796  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:44.441278 15567 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:44.441913 15567 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:44.442538  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1922) took 1154 ms. Trace:
I20260709 13:03:44.350060 15610 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.444947  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:44.427431 15442 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.445592  8508 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:44.449457  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:44.442945  9098 rpcz_store.cc:276] 0709 13:03:43.288301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.288424 (+   123us) service_pool.cc:224] Handling call
0709 13:03:44.442335 (+1153911us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400209c54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:44.442443 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851934464}
I20260709 13:03:44.452452  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:44.453922  8434 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:44.460641  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:44.464010  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.464622  8508 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:44.465165  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.466249 15657 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:44.466662  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.467022 15657 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.470492  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.471637  8584 raft_consensus.cc:2410] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:03:44.472738  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.473745  8583 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:44.474960  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.475646  8580 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:44.394498 15165 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:44.481328  8582 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:44.480646  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:44.487280  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 65649us
I20260709 13:03:44.489907  8581 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
W20260709 13:03:44.489532  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 66096.6us
I20260709 13:03:44.441944 15663 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:44.479851  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 59886.5us
I20260709 13:03:44.487293  8510 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:44.495389  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:44.496532  8476 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:44.483408  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:44.497443  8578 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:44.492900  8547 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:44.402266 15473 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:44.486253  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.486774  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:44.505213  8575 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 25: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:44.492889  8398 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:44.481947  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:44.481616  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46559.9us
I20260709 13:03:44.505502  8476 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:44.421149 15572 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23.
I20260709 13:03:44.506137  9065 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:44.481370  8505 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:44.478989 15537 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:44.491467  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:44.506633  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:44.503822  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:44.486419 15549 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:44.513542  8476 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:44.517197  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:44.483706 15680 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:44.490960 15593 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:44.498659 15425 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:44.499224 15673 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.442833 15567 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:44.493855 15394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.016s	sys 0.024s
I20260709 13:03:44.528846  8578 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
W20260709 13:03:44.545374 15394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.016s	sys 0.024s
I20260709 13:03:44.530979  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:44.532956  8581 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:44.515926 15561 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:44.509387 15540 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:44.508370 15663 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:44.503427 15477 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:44.516036 15528 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:44.521943 15537 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 23 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:44.521374 15680 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:44.486171 15601 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.550107  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:44.516134 15516 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:44.515954 15232 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.518965 15560 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:44.498924 15547 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:03:44.522698 15570 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:44.561075  8581 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:03:44.579957  8583 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:03:44.523182 15425 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:44.568348  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1434) took 1569 ms. Trace:
I20260709 13:03:44.574261  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.581766  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 2932) took 1171 ms. Trace:
I20260709 13:03:44.575316  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:44.545842 15572 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:44.540040 15682 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:44.631608  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.632411  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:44.579313 15555 raft_consensus.cc:2804] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:44.582561  8435 rpcz_store.cc:276] 0709 13:03:43.410540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.410692 (+   152us) service_pool.cc:224] Handling call
0709 13:03:43.410963 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.602605 (+191642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.602636 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:43.602672 (+    36us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:43.602702 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.581496 (+978794us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002dffd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:44.581542 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.581696 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440323840}
I20260709 13:03:44.561928 15528 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.636691 15528 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:44.618956 15431 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:44.637190 15431 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.637115  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.637718 15431 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:44.581598  8431 rpcz_store.cc:276] 0709 13:03:42.999100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.001573 (+  2473us) service_pool.cc:224] Handling call
0709 13:03:43.019261 (+ 17688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.027965 (+1008704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.568043 (+540078us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54003f0f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:44.568273 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2265463680}
I20260709 13:03:44.562608 15394 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:44.566370 15680 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:44.608861  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 57687.4us
W20260709 13:03:44.629472  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 138065us
I20260709 13:03:44.602507 15425 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:44.602867 15540 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:03:44.613256 15626 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:44.633584  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.551964 15647 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:44.634091  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 58876.3us
I20260709 13:03:44.603842 15657 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.554402 15673 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.642248  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.750862  9096 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:44.648578  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:44.751348  9093 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:44.649231 15679 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:03:44.654874 15431 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.618731 15560 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:03:44.641950  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:44.774693  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 132860us
I20260709 13:03:44.609495 15477 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:03:44.551183 15473 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:44.609405 15593 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:03:44.667587  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:03:44.781225  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 113730us
I20260709 13:03:44.750581  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.782214  8507 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:44.638687 15674 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:44.654008 15601 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.756487  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:44.786682  9097 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:44.662531 15684 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:44.638844 15572 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.775415  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:44.664620 15610 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.779932 15657 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:44.644233 15682 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:44.664371 15555 raft_consensus.cc:697] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:44.772410  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.784484  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:44.758574 15535 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:44.752800 15661 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:44.791965  9098 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:44.645102 15179 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.135s
I20260709 13:03:44.794279  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:44.797293  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:44.797823  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:44.808632  9093 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:44.812408  8431 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:44.800182  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:44.805567  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:44.629585 15516 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:44.790587 15560 consensus_queue.cc:1243] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:03:44.811790  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.812456  8429 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:44.783846 15276 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:44.804208  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:44.644059 15696 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.153s
I20260709 13:03:44.820843  9097 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:44.824899  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:44.757578 15626 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.661855 15537 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.804651 15601 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:44.809298 15476 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:03:44.850456 15681 log.cc:927] Time spent T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:03:44.883064  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:44.917449  8578 raft_consensus.cc:3060] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:44.806216 15549 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:44.884445  8581 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:44.961383  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:44.885592  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:44.886817  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 62032.8us
I20260709 13:03:44.806367 15600 raft_consensus.cc:697] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:44.890379  8429 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:44.815732 15663 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.803074 15657 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:44.972414 15657 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:44.830737 15276 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:44.881807 15686 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:03:44.891924 15476 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:44.956116  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.906656 15555 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.894762 15690 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:03:44.903028 15636 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.491s	user 0.002s	sys 0.003s
I20260709 13:03:44.894867 15179 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:44.942250  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:44.989573  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:45.014487  8583 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 22: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:44.951013  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:45.015169  9096 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:44.907774 15431 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:44.814352 15674 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:44.931902 15685 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
I20260709 13:03:44.816582 15535 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:44.963047  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:44.963709  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:44.965246  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 383837us
I20260709 13:03:44.971669 15683 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.971282 15663 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:44.895387 15695 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:03:44.975814  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 191401us
I20260709 13:03:44.892985 15601 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.884241  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:45.035462 15683 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.040336 15601 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:45.040764 15474 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:45.042177 15692 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:45.043005 15692 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:44.988878  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:45.045361  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 56603.7us
I20260709 13:03:44.915652  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:44.982582  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 419777us
I20260709 13:03:45.021941  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:45.046922  9100 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:45.022217  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1630) took 1326 ms. Trace:
I20260709 13:03:44.983853 15276 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:44.988121 15568 consensus_meta.cc:287] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.005s
I20260709 13:03:44.985958 15487 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:45.033563  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:45.042284 15683 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.018868  9102 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:45.050213  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:45.049113  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:45.036474 15442 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:45.032931 15477 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:03:45.029611 15610 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:03:45.052934  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1450) took 1074 ms. Trace:
I20260709 13:03:45.048243  9095 rpcz_store.cc:276] 0709 13:03:43.688246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.688565 (+   319us) service_pool.cc:224] Handling call
0709 13:03:43.688890 (+   325us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:43.706059 (+ 17169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.706091 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:43.711588 (+  5497us) log.cc:844] Serialized 78 byte log entry
0709 13:03:44.003060 (+291472us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:44.945186 (+942126us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b1800376f60. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a18ee74bc 00007f1a1623548b 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf
0709 13:03:44.966184 (+ 20998us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.981463 (+ 15279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.981558 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.981602 (+    44us) raft_consensus.cc:1685] finished
0709 13:03:45.014206 (+ 32604us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.014398 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38483,"prepare.queue_time_us":155065,"prepare.run_cpu_time_us":2252,"prepare.run_wall_time_us":32865,"raft.queue_time_us":36393,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":34421,"spinlock_wait_cycles":11678976,"thread_start_us":354677,"threads_started":2,"wal-append.queue_time_us":410303}
I20260709 13:03:45.058883 15673 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.059104  8426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2767) took 1327 ms. Trace:
I20260709 13:03:44.985826 15690 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:45.060451  9100 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:45.021086 15397 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:45.064478  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 148922us
I20260709 13:03:45.066628  9096 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:45.074069  8578 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:45.079511  8583 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:03:45.080260  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46782.4us
I20260709 13:03:44.850713 15689 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.031293 15702 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.983143 15552 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:45.088304  8427 rpcz_store.cc:276] 0709 13:03:43.978582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.310514 (+331932us) service_pool.cc:224] Handling call
0709 13:03:44.310793 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.317872 (+  7079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.317915 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.330374 (+ 12459us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.502664 (+172290us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:44.502703 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.502765 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.931156 (+428391us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:45.052637 (+121481us) raft_consensus.cc:1685] finished
0709 13:03:45.052660 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.052874 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6670,"raft.queue_time_us":8030,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":8372,"spinlock_wait_cycles":7532800,"thread_start_us":147600,"threads_started":1,"wal-append.queue_time_us":212819}
I20260709 13:03:45.042212 15663 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.094373  8426 rpcz_store.cc:276] 0709 13:03:43.731815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.223174 (+491359us) service_pool.cc:224] Handling call
0709 13:03:44.223708 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.273701 (+ 49993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.273746 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.273807 (+    61us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:44.273860 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.058803 (+784943us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b5400021054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:45.058860 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.059027 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113894144}
I20260709 13:03:45.069386 15426 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:45.061161 15709 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.087510 15522 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:45.086113 15686 log.cc:927] Time spent T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:44.986555 15516 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.084455 15707 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:45.093159 15610 consensus_queue.cc:1243] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:45.097069 15647 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:45.136894 15042 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.000s
I20260709 13:03:45.079869 15568 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.133986 15680 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.096380 15442 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.142412 15431 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:45.142930 15179 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.109642 15397 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:45.116977 15572 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.087081 15487 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:45.148526  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:44.964815 15682 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:45.151234  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 62846.9us
W20260709 13:03:45.133486  9127 heartbeater.cc:646] Failed to heartbeat to 127.7.41.254:45431 (4 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.41.254:45431 timed out after 15.000s (SENT)
I20260709 13:03:45.061934 15476 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.114166 15426 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:45.149878 15447 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.020s	sys 0.047s
I20260709 13:03:45.060855 15549 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.131232 15522 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:45.181098 15528 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 13:03:45.100795 15600 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.109910 15689 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:45.177789  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 82861.9us
I20260709 13:03:45.179155  8501 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21. Ops: []
W20260709 13:03:45.179376  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 83497.7us
I20260709 13:03:45.167683 15626 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.177093 15688 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:45.188235 15474 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:45.188148 15601 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:45.189031 15535 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:45.190881 15425 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.176414 15477 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:03:45.193171 15697 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:45.195734 15397 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:45.196856 15687 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.588s	user 0.001s	sys 0.000s
W20260709 13:03:45.199517  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 97126.7us
I20260709 13:03:45.109647 15702 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:45.177320  8509 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:45.147509 15711 consensus_queue.cc:1048] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:03:45.228947  8578 raft_consensus.cc:1217] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Deduplicated request from leader. Original: 18.14->[19.15-21.16]   Dedup: 19.15->[21.16-21.16]
I20260709 13:03:45.275810  8578 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [19.15-21.16]
I20260709 13:03:45.177889  8431 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 15.
W20260709 13:03:45.198452 15447 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.021s	sys 0.047s
I20260709 13:03:45.251341  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.255836 15474 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:45.196521 15657 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:45.254189  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 170329us
I20260709 13:03:45.289260 15660 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:45.199728 15426 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:45.290715 15692 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:45.293704 15713 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:03:45.248334 15528 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.228185  8550 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:45.258097  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:45.302799  8429 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:03:45.303900  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:45.120440 15709 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:45.308535 15709 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:45.178810 15179 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.252740 15476 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:45.268141  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:45.311077 15179 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:45.311357 15555 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:45.228061 15663 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.313205 15042 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:45.313547 15663 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.274645  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:45.315914  8434 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
W20260709 13:03:45.317111  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 89028.9us
I20260709 13:03:45.312980  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:45.251294  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.284641  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:45.176659 15473 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:03:45.166987 15690 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.296962  8431 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:45.329738  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:45.331233  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.331629  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:45.332525  8429 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:45.318946  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:45.334296  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:45.285975 15474 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:45.272284 15697 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.325228 15426 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.343370  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:45.417733  8580 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 13.
I20260709 13:03:45.342811  8579 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:03:45.448803  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 129900us
I20260709 13:03:45.450047  8431 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:45.293766 15601 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:45.336632 15683 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:45.257490 15688 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.469530  9101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1632) took 1112 ms. Trace:
I20260709 13:03:45.470233  9101 rpcz_store.cc:276] 0709 13:03:44.357220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.357379 (+   159us) service_pool.cc:224] Handling call
0709 13:03:44.383738 (+ 26359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.412723 (+ 28985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.412755 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.413213 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.500184 (+ 86971us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:44.500223 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.500282 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:45.196093 (+695811us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:45.459186 (+263093us) raft_consensus.cc:1685] finished
0709 13:03:45.459223 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.469435 (+ 10212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82850,"raft.queue_time_us":31681,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":7504,"spinlock_wait_cycles":5769600,"thread_start_us":68846,"threads_started":1,"wal-append.queue_time_us":124925}
W20260709 13:03:45.486209  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 368518us
I20260709 13:03:45.336344 15712 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:45.488399  8434 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:03:45.480348  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:45.455350 15442 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.458389 15663 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.505460  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.457482 15709 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:45.287807 15522 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.479132 15661 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:45.531893  8429 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:45.488195 15690 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:45.535132  8504 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:45.541379  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:45.541656  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:45.562436  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 3150) took 1125 ms. Trace:
I20260709 13:03:45.492285 15568 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.533514 15442 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:45.519603 15570 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:45.532832 15699 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.561059  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:45.563869  8504 rpcz_store.cc:276] 0709 13:03:44.437138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.438201 (+  1063us) service_pool.cc:224] Handling call
0709 13:03:45.505261 (+1067060us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b5800004298. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e3050a0 00007f1a1e304984 00007f1a1787f6d4 00007f1a1787f662
0709 13:03:45.562372 (+ 57111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8591104}
I20260709 13:03:45.543841 15487 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:45.578338  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:45.545588 15680 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.580973  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.582417  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.550945 15661 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:45.592270  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.571971 15442 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.578835 15472 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:45.596352  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.539860 15709 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.622754  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:45.614952 15516 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:45.620014 15657 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:45.630805 15727 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:45.630574 15661 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.636739  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:45.624071  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 369978us
I20260709 13:03:45.556564 15715 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:03:45.615361 15442 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:45.647927  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:45.595592 15425 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:45.588698 15570 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.638479 15472 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:45.652952 15165 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:45.653209 15724 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:03:45.660136  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:45.662305  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:45.588233 15699 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:45.673625  8510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2705) took 1833 ms (client timeout 2058 ms). Trace:
W20260709 13:03:45.674293  8510 rpcz_store.cc:269] 0709 13:03:43.840303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.840414 (+   111us) service_pool.cc:224] Handling call
0709 13:03:45.673378 (+1832964us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b5400153e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:45.673552 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482929536}
I20260709 13:03:45.675714  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.676698  8510 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:45.677574  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:45.678930  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:45.670284  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:45.682058  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:45.689764  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.691911  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.642637 15689 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:45.679237 15683 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:45.711257  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:45.643728 15516 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:45.708328  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:45.727185 15732 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:03:45.727355 15570 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.691215 15165 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.692389 15528 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.734386  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:45.736513 15276 consensus_meta.cc:287] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.653s	user 0.003s	sys 0.006s
I20260709 13:03:45.738130  8504 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:45.730866 15697 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:45.740243  8577 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 1254) took 1972 ms (client timeout 1564 ms). Trace:
I20260709 13:03:45.742004 15699 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:45.721360 15472 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:45.748672  8577 rpcz_store.cc:269] 0709 13:03:43.767717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.768811 (+  1094us) service_pool.cc:224] Handling call
0709 13:03:45.739949 (+1971138us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54000672d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:45.740120 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1282730368}
I20260709 13:03:45.748030  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:45.752717  8502 raft_consensus.cc:2410] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:03:45.705269 15426 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:03:45.745517  8580 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:45.748168 15737 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:03:45.757542 15674 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
I20260709 13:03:45.744120  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:45.758080 15674 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:45.758518  8504 raft_consensus.cc:1240] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:45.759105  8426 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 25.
I20260709 13:03:45.759378  8501 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:45.744062 15709 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.760749 15702 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:45.762589  8501 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:03:45.721014  8434 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:45.768020  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:45.741999 15683 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.757587 15474 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:45.777153  8428 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 2934) took 2157 ms (client timeout 2094 ms). Trace:
W20260709 13:03:45.777617  8428 rpcz_store.cc:269] 0709 13:03:43.619995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.620232 (+   237us) service_pool.cc:224] Handling call
0709 13:03:45.776915 (+2156683us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54001d38d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:45.777055 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037063040}
I20260709 13:03:45.778928  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:45.775583 15740 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:45.779753 15474 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.780915  8550 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:45.780432  8507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1530) took 1332 ms. Trace:
I20260709 13:03:45.781704  8510 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:03:45.722213 15516 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:45.781754  8507 rpcz_store.cc:276] 0709 13:03:44.447992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.448225 (+   233us) service_pool.cc:224] Handling call
0709 13:03:44.479286 (+ 31061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.782635 (+303349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.780198 (+997563us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b540008e3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:45.780373 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695921920}
W20260709 13:03:45.778921 15700 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.813s	user 0.003s	sys 0.000s
I20260709 13:03:45.801789  8580 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:45.821363  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:45.822255  8434 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 24.
I20260709 13:03:45.754619 15276 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:45.780416 15740 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:45.819638 15709 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:45.839856  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:45.789479 15547 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:45.753618 15165 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.854300 15709 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.858072 15709 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.858170 15276 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:45.846567 15740 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.860141 15661 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:45.860466 15516 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:45.875877 15661 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:45.887555 15496 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:45.903172  8431 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:03:45.903894  8428 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:45.898942 15661 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:45.909792 15442 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.918716 15442 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.913280 15165 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:45.920215  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:45.921383  8429 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:45.923382  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:45.928460  8581 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:45.938723  8429 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:45.931433 15547 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:45.940330  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:45.976555  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:45.926859 15446 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:45.948107  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2676) took 1440 ms. Trace:
I20260709 13:03:45.952548 15516 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:45.964111 15688 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:45.964809 15661 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:45.978185  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:45.927924 15683 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:03:45.980293  8582 rpcz_store.cc:276] 0709 13:03:44.507854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.512404 (+  4550us) service_pool.cc:224] Handling call
0709 13:03:44.512802 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:44.513131 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.513159 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:44.523500 (+ 10341us) log.cc:844] Serialized 52 byte log entry
0709 13:03:45.755121 (+1231621us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b1800447460. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:03:45.887295 (+132174us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:45.887329 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.887592 (+   263us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:45.947808 (+ 60216us) raft_consensus.cc:1685] finished
0709 13:03:45.947830 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.948045 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11601,"raft.queue_time_us":8081,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":26753,"spinlock_wait_cycles":6854912,"thread_start_us":131969,"threads_started":1,"wal-append.queue_time_us":1356832}
I20260709 13:03:45.997166  8550 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:46.025800 15740 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:46.026245 15552 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:03:46.027194  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 49118.6us
I20260709 13:03:45.981204 15663 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:46.032119  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:46.034394 15702 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:46.034960 15702 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:46.035952 15702 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:45.983310 15446 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.029896 15552 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:45.984556 15593 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:46.039273  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:46.029681 15487 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:46.048022  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:46.048652  8434 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:46.049762 15552 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.050961 15552 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:46.050829 15593 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:46.051560 15661 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:46.053766  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2677) took 1532 ms. Trace:
I20260709 13:03:46.054167  8575 rpcz_store.cc:276] 0709 13:03:44.521304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.910655 (+1389351us) service_pool.cc:224] Handling call
0709 13:03:45.911052 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:45.911377 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.911405 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:45.911848 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:03:46.032507 (+120659us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:46.032556 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.032821 (+   265us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.053552 (+ 20731us) raft_consensus.cc:1685] finished
0709 13:03:46.053572 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.053712 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1291,"raft.queue_time_us":216,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":14766,"spinlock_wait_cycles":1578240,"thread_start_us":100340,"threads_started":1,"wal-append.queue_time_us":118669}
I20260709 13:03:46.058836 15446 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.060539  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.045436 15487 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:46.061199  8431 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:46.063107  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:46.056493 15683 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:46.092988  8434 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 25.
I20260709 13:03:46.071341 15657 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:46.094674 15487 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.094651  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:46.096009  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:46.096357  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.096578 15394 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:46.096884 15707 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:46.100296 14990 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:46.099071  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:46.108762  8400 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:46.109151 15707 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.110704 15516 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:46.111121 15516 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:46.111418 15707 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.111529 15516 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:46.112005 15707 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:46.113044 15661 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:46.113559 15661 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.115597 15661 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.116086  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1932) took 1485 ms. Trace:
I20260709 13:03:46.116501  9098 rpcz_store.cc:276] 0709 13:03:44.630587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.633310 (+  2723us) service_pool.cc:224] Handling call
0709 13:03:46.115884 (+1482574us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54005014d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:46.116015 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289622912}
I20260709 13:03:46.100718 15394 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:46.118475 15683 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:46.119004 15683 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 25 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:46.118809 15394 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.098479 15676 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:46.119831 15394 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:46.110399  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:46.090309 15446 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:46.245431  8432 raft_consensus.cc:1275] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 13:03:46.247324  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 136978us
I20260709 13:03:46.248351  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:46.098793 15664 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:46.052212 15593 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:46.267154  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 705994us
I20260709 13:03:46.270254  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:46.098631 15657 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:46.122808 15496 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:46.121860 14990 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:46.291038 15165 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:46.291706  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.292259 15496 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:46.273264 15664 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.178086 15707 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:46.294911  8426 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:03:46.246464 15663 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.251096 15522 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:46.251332 15717 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.266335 15682 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:46.304972  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.332686  8504 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:46.305361  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.309404  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:46.334831  8434 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:46.310791  8431 raft_consensus.cc:1240] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:03:46.120229 15676 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.266445 15161 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:46.319442  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:46.309091 14990 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:46.271200 15709 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:46.321599  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1537) took 1205 ms. Trace:
I20260709 13:03:46.119863 15683 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:46.345106  8506 rpcz_store.cc:276] 0709 13:03:45.116422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.116634 (+   212us) service_pool.cc:224] Handling call
0709 13:03:45.134920 (+ 18286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.135244 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:45.492120 (+356876us) log.cc:844] Serialized 14 byte log entry
0709 13:03:46.121097 (+628977us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800359020. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:03:46.121460 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:03:46.321254 (+199794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:46.321304 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:46.321371 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.321434 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.321545 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":203022,"prepare.queue_time_us":365560,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":101,"raft.queue_time_us":797262,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":21570,"spinlock_wait_cycles":3271424,"thread_start_us":382765,"threads_started":2,"wal-append.queue_time_us":133951}
I20260709 13:03:46.266742 15446 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:46.324954  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:46.277524 15657 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:46.298705 15179 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.309046 15702 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.302186 15547 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:46.341303  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:46.316345 15431 consensus_queue.cc:1059] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:03:46.344048  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.344802 15708 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:46.322145  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.360829  8434 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:46.339077 15561 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:46.323055 15479 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:03:46.342960  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.348606 15721 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.387526 15721 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.389705 15721 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.327700 15707 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.378163  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.396796  8507 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:46.400513  8510 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:46.337352 15663 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.349615 15161 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.340984 15682 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.394665 15561 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.438730 15561 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.440227 15496 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:46.340790 15717 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:46.445529  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 175349us
I20260709 13:03:46.378139 15547 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:46.375674 15702 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.370116 15179 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.395430 15708 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:46.456523 15664 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:46.459718 15723 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.923s	user 0.002s	sys 0.000s
I20260709 13:03:46.463004 15161 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:46.463231 15682 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.464234 15447 raft_consensus.cc:3055] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:46.464643 15447 raft_consensus.cc:740] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:46.470532  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.463018 15729 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.918s	user 0.002s	sys 0.000s
I20260709 13:03:46.474406  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:46.474630  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3152) took 1907 ms. Trace:
I20260709 13:03:46.475414  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:46.474975  8505 rpcz_store.cc:276] 0709 13:03:44.567626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.567807 (+   181us) service_pool.cc:224] Handling call
0709 13:03:44.609730 (+ 41923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.819035 (+209305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.819088 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.819143 (+    55us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:44.819195 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.474419 (+1655224us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54000d7fd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:46.474466 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.474581 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480766336}
I20260709 13:03:46.465412 15447 consensus_queue.cc:260] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.495680  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:46.496539 15761 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 13:03:46.497593  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.499339  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:46.471875 15692 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.546337  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:46.559000  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 81974us
W20260709 13:03:46.536211  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 60982.6us
I20260709 13:03:46.538830  8582 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:03:46.539624 15688 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:46.540614  8575 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:46.573232  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.536633 15535 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:46.536422 15522 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:46.573998  8505 raft_consensus.cc:2393] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 21: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:46.465950 14990 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.588701  8579 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:03:46.573702 15762 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.199s	user 0.001s	sys 0.001s
I20260709 13:03:46.628975  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:46.636969  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:46.637347  8575 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:46.553789 15674 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.083s
I20260709 13:03:46.586946 15676 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.650954  8430 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:46.658135  9099 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:46.659886  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:46.585968 15688 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.667810  9101 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:03:46.669160  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:46.555195 15692 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.645635 15446 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:46.674437  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.675557  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.676347  8505 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:03:46.679338  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:46.683648 15717 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.685020 15179 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:46.686280 15692 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:46.687093  9098 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:03:46.687350 15764 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:03:46.691220 15516 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.002s
I20260709 13:03:46.691692 15516 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.647079 15496 consensus_queue.cc:1059] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:03:46.694758 15496 raft_consensus.cc:3055] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:46.695101 15496 raft_consensus.cc:740] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:46.675704 15479 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.695947 15496 consensus_queue.cc:260] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:46.696780 15479 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.698961 15479 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:46.699044 15688 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:46.699990  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.700212 15708 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:46.700651  8435 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:46.701464 15702 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.701632  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.697142 15496 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:46.650830 15766 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:03:46.627226 15535 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.709232  8435 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:46.710101  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:46.710312 15535 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.710778  8435 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 22: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:46.711091 15707 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.693914 15516 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.714116  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.715499  8575 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:46.716399  8434 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: [14.12-16.13]
I20260709 13:03:46.717372 14990 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.652613 15431 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:46.721570  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:46.722371  9099 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:46.720153  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.729503  8435 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:46.731144  8435 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:46.731261  8505 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:46.707398 15663 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.737625  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:46.738196  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 84558.5us
I20260709 13:03:46.748117  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:46.748445  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 1260) took 1414 ms. Trace:
I20260709 13:03:46.750397  8505 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:46.738781  8434 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:46.754510  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2685) took 1563 ms. Trace:
I20260709 13:03:46.749040  8578 rpcz_store.cc:276] 0709 13:03:45.333869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.334054 (+   185us) service_pool.cc:224] Handling call
0709 13:03:46.748271 (+1414217us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400282154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:46.748390 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309473024}
I20260709 13:03:46.758381  8434 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:46.759722  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:46.727790 15431 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.762612  8503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3148) took 2312 ms. Trace:
I20260709 13:03:46.763154  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1535) took 2263 ms. Trace:
I20260709 13:03:46.767670  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:46.767987  8509 rpcz_store.cc:276] 0709 13:03:44.489197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.489922 (+   725us) service_pool.cc:224] Handling call
0709 13:03:44.490267 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.270098 (+779831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.752457 (+1482359us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54003c8054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:46.752683 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579605760}
I20260709 13:03:46.767421  8503 rpcz_store.cc:276] 0709 13:03:44.436607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.459015 (+ 22408us) service_pool.cc:224] Handling call
0709 13:03:44.459390 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.262420 (+803030us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:45.262461 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:45.262512 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:45.262568 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.748983 (+1486415us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b5400372dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:46.749046 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.749151 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1106,"raft.queue_time_us":18022,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5887,"spinlock_wait_cycles":1601905024,"thread_start_us":105830,"threads_started":1}
I20260709 13:03:46.755093  8583 rpcz_store.cc:276] 0709 13:03:45.191211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.192009 (+   798us) service_pool.cc:224] Handling call
0709 13:03:45.192335 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:45.196531 (+  4196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.196563 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:45.197133 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:03:45.374301 (+177168us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:45.374364 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.744772 (+1370408us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b54000659d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:46.744820 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.744859 (+    39us) raft_consensus.cc:1685] finished
0709 13:03:46.744872 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.754422 (+  9550us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1321,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":25948,"spinlock_wait_cycles":8615296,"thread_start_us":176737,"threads_started":1,"wal-append.queue_time_us":325287,"wal-append.run_cpu_time_us":2560,"wal-append.run_wall_time_us":1101723}
I20260709 13:03:46.764317  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:46.774701  9098 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:46.764577  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:46.736891 15179 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:46.782243  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:46.780611  8503 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:46.787961  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:46.789055  9098 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:46.763594 15552 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.712s	user 0.012s	sys 0.000s
I20260709 13:03:46.793447 15774 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.793507 15772 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:46.794548 15431 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:46.880581 15772 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.883737 15577 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:46.884342 15577 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:46.878147 15474 consensus_queue.cc:1059] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:03:46.891161 15474 raft_consensus.cc:3055] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:46.891640 15474 raft_consensus.cc:740] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:46.892720 15474 consensus_queue.cc:260] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:46.894842  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.896476 15774 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.778537 15767 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.794940 15179 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.899544 15767 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.802353  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:46.761147 15775 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:46.761740 15674 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:46.902505 15674 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.905076 15673 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.905489 15775 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.905795 15673 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.949020 15673 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:46.818994  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3157) took 1539 ms. Trace:
I20260709 13:03:46.952630  8508 rpcz_store.cc:276] 0709 13:03:45.279332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.281157 (+  1825us) service_pool.cc:224] Handling call
0709 13:03:45.281428 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.479981 (+198553us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:45.704057 (+224076us) log.cc:844] Serialized 14 byte log entry
0709 13:03:46.320741 (+616684us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:46.320809 (+    68us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:46.320878 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.818669 (+497791us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540008ded4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:46.818734 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.818918 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1028592,"prepare.queue_time_us":108224,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":462378,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4098,"spinlock_wait_cycles":456089344,"thread_start_us":318497,"threads_started":2,"wal-append.queue_time_us":180341,"wal-append.run_cpu_time_us":3820,"wal-append.run_wall_time_us":1057833}
I20260709 13:03:46.828665  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.956640  8435 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:46.957878  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.958705  8435 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:46.830324  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.834774 15535 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:46.839748  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:46.827288  8432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2782) took 1532 ms. Trace:
I20260709 13:03:46.842760  8427 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:46.843776  8581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2940) took 1184 ms. Trace:
I20260709 13:03:46.851673  8584 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 16. Current term is 17. Ops: [14.12-16.13]
I20260709 13:03:46.852415  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.852986 15476 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.855597 15540 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:46.856756  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.857487 15560 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.861382  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.862540  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:46.863302  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.858397  8476 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:46.871654  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:46.867479  8583 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:03:46.875512  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:46.901511  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:46.812712  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 3158) took 1497 ms. Trace:
W20260709 13:03:46.910280  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.731652 15657 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.933445  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:46.942574  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:46.948887  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:46.853500 15660 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:46.959774  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:46.963263 15535 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:46.885515 15577 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.672530  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.675413  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:47.677769  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.679716  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:47.680474  8506 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:46.955873  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:47.681566  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.682971  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.683928  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.060914  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:47.686967  9101 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:47.687889  8576 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:47.689071  8505 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:47.689509  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:47.124796  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:47.646123  8433 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.024s	sys 0.046s
I20260709 13:03:47.295936 15775 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:47.691886  8433 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.026s	sys 0.046s
I20260709 13:03:47.359458  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.692505 15560 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.693877  8581 rpcz_store.cc:276] 0709 13:03:45.659294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.659791 (+   497us) service_pool.cc:224] Handling call
0709 13:03:46.843582 (+1183791us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540012fcd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:46.843722 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497511168}
I20260709 13:03:47.482250  8333 catalog_manager.cc:5697] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:47.695117  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:47.695779  8581 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.690100  8577 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:47.696923  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:47.248282  9093 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:03:47.697605  8577 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:47.698153  8582 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:47.698531  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:47.698807 15772 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:47.699119  8577 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:47.699954  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:47.447093 15655 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:47.700785 15655 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:47.671247  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1456) took 1101 ms. Trace:
I20260709 13:03:47.702306  8577 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:47.114979  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:46.964764  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:47.702575  8428 rpcz_store.cc:276] 0709 13:03:46.570009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.575302 (+  5293us) service_pool.cc:224] Handling call
0709 13:03:46.575553 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:46.575753 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:03:46.739444 (+163691us) log.cc:844] Serialized 14 byte log entry
0709 13:03:47.670887 (+931443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:47.670948 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:47.671006 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.671075 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.671186 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76345,"prepare.queue_time_us":578670,"thread_start_us":368815,"threads_started":2}
W20260709 13:03:47.309127  8431 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.088s	sys 0.162s
W20260709 13:03:47.705892  8431 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.090s	sys 0.165s
I20260709 13:03:47.706503 15042 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.706646 15547 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:47.707049 15042 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.792227 15773 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:47.708364 15773 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.709225 15042 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:47.710785 15773 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:47.699923 15657 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:47.682690  8508 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:03:47.704238  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:47.682754 15476 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.442737 15487 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.412110  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:47.679880  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.728448  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:47.730768  8583 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:46.964285  8432 rpcz_store.cc:276] 0709 13:03:45.294670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.297930 (+  3260us) service_pool.cc:224] Handling call
0709 13:03:46.123453 (+825523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:46.246015 (+122562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.827093 (+581078us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540025a8d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:46.827230 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764194176}
W20260709 13:03:47.685102  8427 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.005s	sys 0.013s
W20260709 13:03:47.732681  8427 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.005s	sys 0.013s
I20260709 13:03:47.715044  9093 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:47.734241  9093 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:47.735085 15161 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:47.735743 15161 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:46.984858 15442 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:47.738466 15161 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:47.744009  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.743938 15442 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.680302  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:47.695971  8579 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:47.743083  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:47.696805  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.745777  8581 raft_consensus.cc:2410] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:03:47.712072  8502 rpcz_store.cc:276] 0709 13:03:45.315276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.330938 (+ 15662us) service_pool.cc:224] Handling call
0709 13:03:46.812430 (+1481492us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54003c5d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:46.812615 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966711168}
I20260709 13:03:47.718688  8426 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:03:47.717379  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 783990us
I20260709 13:03:47.722566  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1271) took 1139 ms. Trace:
I20260709 13:03:46.996930 15673 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:47.725495  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:47.746938  8582 rpcz_store.cc:276] 0709 13:03:46.583188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.583436 (+   248us) service_pool.cc:224] Handling call
0709 13:03:46.583787 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.698526 (+1114739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.722355 (+ 23829us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000cd5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:47.722503 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2562294656}
I20260709 13:03:47.729355  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:47.704217  9098 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:47.725409  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.085479  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:47.085170  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:47.748315  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.748512  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:47.447163 15721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.005s	sys 0.021s
I20260709 13:03:47.739251  8432 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:03:47.735101  9093 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.15, Last appended by leader: 15, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.745144  9065 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:47.711444 15773 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.730139 15657 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.474380 15777 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:47.749015  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:47.719414 15496 consensus_meta.cc:287] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.008s	user 0.013s	sys 0.000s
I20260709 13:03:47.749993  8582 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:47.751569  9093 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:47.745258  8507 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 24.
I20260709 13:03:47.695439 15560 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:47.721149 15775 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.714529 15447 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.611670 15682 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.750010 15161 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:47.780485  9098 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:47.685752 15774 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:47.670899 15474 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:47.741107 15577 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:47.758641  8426 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:03:47.806248  8576 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:47.805838 15179 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:47.765349  9097 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:47.808714  8580 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:47.818497  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:47.819583  8582 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 17: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:47.809209  9093 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 14 index: 15. Preceding OpId from leader: term: 15 index: 15. (term mismatch)
I20260709 13:03:47.821053  9093 pending_rounds.cc:85] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 14
I20260709 13:03:47.821441  9093 pending_rounds.cc:107] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 14.15
I20260709 13:03:47.821867  9093 raft_consensus.cc:2889] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:47.752985 15232 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:03:47.727232 15772 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:47.755316  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.790616  8578 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.006s	sys 0.010s
I20260709 13:03:47.814078 15674 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:47.810360 15773 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:47.829975  8578 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.008s	sys 0.010s
I20260709 13:03:47.818426 15560 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:47.753839  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:47.831151  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 77383.2us
I20260709 13:03:47.808895 15657 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.837458 15657 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:47.838064  9102 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:47.838392  8577 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:47.741871 15547 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:47.754215  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:47.750835 15740 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.016s	sys 0.031s
I20260709 13:03:47.808784 15777 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:47.797596 15660 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:47.785898  9094 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:03:47.753053 15042 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:47.816120  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:47.857398  9101 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 14.
I20260709 13:03:47.869992  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:47.782228 15673 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.829222  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.829429  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.749043 15487 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.811020 15775 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.881484  8575 raft_consensus.cc:2410] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:03:47.848340 15547 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:47.845930  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:47.854555 15560 raft_consensus.cc:697] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:47.862337 15042 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.814105 15682 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:47.847858  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 93859.2us
I20260709 13:03:47.872866 15161 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:47.871110  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:47.794555  9096 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:47.849318 15740 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.016s	sys 0.037s
I20260709 13:03:47.814924 15774 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:03:47.893898  8583 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:47.897090  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:47.767316  9099 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:47.828784 15772 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:47.758659 15721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.006s	sys 0.023s
I20260709 13:03:47.871847 15179 raft_consensus.cc:2764] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:47.840137 15657 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:47.885921 15547 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:47.887645  8429 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:47.926963  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1272) took 1341 ms. Trace:
I20260709 13:03:47.927506  8584 rpcz_store.cc:276] 0709 13:03:46.585694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.585892 (+   198us) service_pool.cc:224] Handling call
0709 13:03:46.851385 (+265493us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:47.683073 (+831688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.926742 (+243669us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b540012fcd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:47.926897 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609672576}
I20260709 13:03:47.898407  9099 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:47.898923  9094 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:47.900496  9093 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:47.908541 15775 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:47.880266 15664 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:47.886600 15476 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:47.912006 15767 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:47.873179 15660 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:47.916807 15657 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:47.881523  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:47.993325  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 111873us
I20260709 13:03:47.995117  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:47.920302  9096 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:47.987464 15772 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:47.988636 15780 log.cc:927] Time spent T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:03:47.888240 15042 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:48.004985  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:47.972663  9102 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:47.964349 15476 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.018292 15476 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.020628 15476 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.021600 15476 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:48.022594 15476 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.020629  8430 raft_consensus.cc:1240] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:48.023931  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1473) took 1176 ms. Trace:
I20260709 13:03:48.024318  8430 rpcz_store.cc:276] 0709 13:03:46.847472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.058286 (+210814us) service_pool.cc:224] Handling call
0709 13:03:48.020266 (+961980us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b5800060398. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aa22 00007f1a1f133c09 00007f1a1e28dee0 00007f1a1e3570ab 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:03:48.020452 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.023633 (+  3181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.023869 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14923136}
I20260709 13:03:48.017184  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:48.027661 15476 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:47.943167 15161 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:03:48.100111 15487 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:47.995484 15657 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:47.997090 15664 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:48.107499  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 1.2491e+06us
I20260709 13:03:47.997129 15442 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.088203 15772 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:03:48.015861 15560 consensus_queue.cc:237] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.159479 15773 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:48.175421  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2688) took 1336 ms. Trace:
W20260709 13:03:48.182726  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 482754us
I20260709 13:03:48.191327 15673 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:48.221688  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 389868us
I20260709 13:03:48.181348 15777 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:48.191754 15682 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:48.242178  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 487504us
W20260709 13:03:48.242914  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 355585us
I20260709 13:03:48.204098 15474 consensus_queue.cc:1048] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:03:48.248962  8504 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:48.249487  8504 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:48.249672  8475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.018s	sys 0.015s
W20260709 13:03:48.250151  8475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.019s	sys 0.015s
W20260709 13:03:48.250553  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.249393  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 392789us
I20260709 13:03:48.259007  8508 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:48.245357 15540 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.238896 15673 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:48.280108  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.250430  8504 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.286718  8504 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:48.314706  8508 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:03:48.315276  8508 pending_rounds.cc:85] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 15
I20260709 13:03:48.315021  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.315634  8508 pending_rounds.cc:107] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:03:48.315999  8508 raft_consensus.cc:2889] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:48.315963  8502 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:48.328606  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.333050  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.335871  8547 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:48.362290  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.333869  8510 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:48.238915 15442 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:03:48.368009  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:48.374742  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.240228 15693 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.088s
I20260709 13:03:48.377224  8508 raft_consensus.cc:2410] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 13:03:48.389145  8549 leader_election.cc:336] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.017s (SENT)
W20260709 13:03:48.391635 15786 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:03:48.392287 15496 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:48.392683 15800 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:48.392894 15496 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:48.393464 15800 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.329393 15540 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.328773 15660 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.392697  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3173) took 1650 ms. Trace:
I20260709 13:03:48.398533  8509 rpcz_store.cc:276] 0709 13:03:46.742269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.777026 (+ 34757us) service_pool.cc:224] Handling call
0709 13:03:46.777430 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:46.923351 (+145921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:46.923404 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.683767 (+760363us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.025881 (+342114us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:03:48.025939 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.026048 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.392470 (+366422us) raft_consensus.cc:1685] finished
0709 13:03:48.392494 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.392637 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143817,"raft.queue_time_us":173055,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"thread_start_us":341773,"threads_started":1,"wal-append.queue_time_us":545946}
W20260709 13:03:48.401827  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 138131us
I20260709 13:03:48.402745  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:48.401949  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:48.403589  8549 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061): Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.169s (SENT)
I20260709 13:03:48.255543 15161 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.121s
W20260709 13:03:48.404632  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 147518us
I20260709 13:03:48.328270 15792 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.368525 15777 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.368884 15673 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:48.374445 15694 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:48.376010 15790 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:48.419516  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 169489us
I20260709 13:03:48.405493 15496 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.406116 15766 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:48.409317 15593 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:48.415063 15673 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:48.410745 15773 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:03:48.436447 15795 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:48.428719 15813 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:48.467491 15813 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.469568 15813 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.451761 15673 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:48.470392 15447 consensus_meta.cc:287] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.004s
I20260709 13:03:48.465454 15657 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.473436 15657 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:48.428329 15790 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.463820 15655 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:48.464601 15547 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.000s
I20260709 13:03:48.449513 15496 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:48.476223 15805 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:48.417474 15792 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:48.478457 15788 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:03:48.466936 15535 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:48.419163 15777 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.482185 15777 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:48.483394 15792 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.484694 15814 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:48.459357 15795 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.486987 15795 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:48.494725 15810 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.495447 15810 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.503237 15808 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:48.504120 15808 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.506543 15809 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.507257 15809 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.510597 15809 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.512409 15808 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:48.493351 15547 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.515668 15547 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:48.516921 15577 consensus_meta.cc:287] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.001s
I20260709 13:03:48.498512 15810 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:47.853971  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:48.558470  8398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.005s	sys 0.011s
W20260709 13:03:48.559374  8398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.005s	sys 0.012s
I20260709 13:03:48.558532  8333 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.569975  8333 catalog_manager.cc:5697] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 7 to 12, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 12 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
W20260709 13:03:48.572476  8328 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32800 (request call id 248) took 19959 ms (client timeout 15000 ms). Trace:
W20260709 13:03:48.250676  8427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.015s	sys 0.018s
W20260709 13:03:48.578351  8400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.002s	sys 0.005s
W20260709 13:03:48.578965  8400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.002s	sys 0.006s
W20260709 13:03:48.579037  8427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.015s	sys 0.018s
I20260709 13:03:48.618963 15795 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.622951  8502 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:03:48.519305 15673 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.650663  9095 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:48.651270  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.652027  9100 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:48.652719  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:48.653517  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.654266  8507 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
W20260709 13:03:48.654807  8549 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.554s (SENT) [suppressed 13 similar messages]
I20260709 13:03:48.655916  8507 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:48.639806 15797 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:48.658051 15797 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:48.579798  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 562623us
W20260709 13:03:48.660137  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.642341 15794 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.641443 15811 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:48.661175  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.660452  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:48.630707  8431 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.006s
W20260709 13:03:48.634231  8433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.001s	sys 0.009s
I20260709 13:03:48.652762  8509 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:48.638120  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2944) took 1232 ms. Trace:
W20260709 13:03:48.675258  8431 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.002s	sys 0.006s
I20260709 13:03:48.661707 15811 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:48.690976  8433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.002s	sys 0.009s
W20260709 13:03:48.701395  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.625958  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:48.634481 15808 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:48.642530 15810 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:03:48.713430  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 53206.8us
I20260709 13:03:48.677682  8575 rpcz_store.cc:276] 0709 13:03:47.405635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.409115 (+  3480us) service_pool.cc:224] Handling call
0709 13:03:48.637589 (+1228474us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001171d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:48.637865 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355029888}
W20260709 13:03:48.695173  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 270095us
W20260709 13:03:48.721967  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.666679  8333 catalog_manager.cc:5697] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 12 to 13, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 13 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
W20260709 13:03:48.717648 15664 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.012s	sys 0.012s
I20260709 13:03:48.661180 15794 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.639451 15809 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.085s
W20260709 13:03:48.727865 15664 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.013s	sys 0.013s
I20260709 13:03:48.733862 15808 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.735231 15810 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.738392 15824 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:48.732601  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.739188 15673 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.739276 15547 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:03:48.578236  8328 rpcz_store.cc:269] 0709 13:03:28.613415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.614188 (+   773us) service_pool.cc:224] Handling call
0709 13:03:48.572186 (+19957998us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:39.234731 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:39.263035 (+ 28304us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:39.263093 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:03:39.263113 (+    20us) tablet.cc:662] Decoding operations
0709 13:03:39.285920 (+ 22807us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:39.286048 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:39.286072 (+    24us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:03:39.287532 (+  1460us) tablet.cc:701] Row locks acquired
0709 13:03:39.287588 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:03:39.287752 (+   164us) write_op.cc:270] Start()
0709 13:03:39.287895 (+   143us) write_op.cc:276] Timestamp: P: 1783602219287690 usec, L: 0
0709 13:03:39.287931 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:03:39.288647 (+   716us) log.cc:844] Serialized 7556 byte log entry
0709 13:03:39.791430 (+502783us) op_driver.cc:464] REPLICATION: finished
0709 13:03:40.494702 (+703272us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a162350ac 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a1cd75ef0
0709 13:03:40.802061 (+307359us) write_op.cc:301] APPLY: starting
0709 13:03:40.838055 (+ 35994us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:41.471545 (+633490us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:41.471600 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:42.102243 (+630643us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:42.102748 (+   505us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:03:42.102835 (+    87us) write_op.cc:312] APPLY: finished
0709 13:03:42.103446 (+   611us) log.cc:844] Serialized 172 byte log entry
0709 13:03:42.305033 (+201587us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:42.305248 (+   215us) write_op.cc:454] Released schema lock
0709 13:03:42.322475 (+ 17227us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:42.322963 (+   488us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:42.322996 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":436258,"reported_tablets":44,"spinlock_wait_cycles":85888,"child_traces":[["op",{"apply.queue_time_us":932574,"apply.run_cpu_time_us":72429,"apply.run_wall_time_us":1525524,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83471,"num_ops":19,"prepare.queue_time_us":255018,"prepare.run_cpu_time_us":11656,"prepare.run_wall_time_us":126941,"raft.queue_time_us":102651,"raft.run_cpu_time_us":42566,"raft.run_wall_time_us":952746,"replication_time_us":503295,"spinlock_wait_cycles":10646400,"thread_start_us":1339330,"threads_started":5,"wal-append.queue_time_us":350409,"wal-append.run_cpu_time_us":18760,"wal-append.run_wall_time_us":2430157}]]}
I20260709 13:03:48.740734 15799 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.740430 15801 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:48.742493 15795 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.183750  8578 rpcz_store.cc:276] 0709 13:03:46.838949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.839772 (+   823us) service_pool.cc:224] Handling call
0709 13:03:46.841581 (+  1809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:46.841920 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:47.830485 (+988565us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.174954 (+344469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.175025 (+    71us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:48.175101 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.175196 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.175346 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1060787,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":51,"raft.queue_time_us":152,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3346,"thread_start_us":1328720,"threads_started":2}
I20260709 13:03:48.744316 15792 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:48.745795  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2955) took 1003 ms. Trace:
I20260709 13:03:48.746402 15797 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.752044  8428 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:48.726518  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0056690389999403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 13:03:48.753964  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 1962) took 1639 ms. Trace:
W20260709 13:03:48.755694  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 309396us
I20260709 13:03:48.756471  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.754278  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:48.760356 15777 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:48.760876 15813 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:48.762954 15811 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.752094  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2750) took 1910 ms. Trace:
I20260709 13:03:48.786669  8501 rpcz_store.cc:276] 0709 13:03:46.841163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.691282 (+850119us) service_pool.cc:224] Handling call
0709 13:03:47.691636 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.239324 (+547688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.239354 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.239858 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.623602 (+383744us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:48.623706 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.751346 (+127640us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b540008d9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:48.751429 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.751502 (+    73us) raft_consensus.cc:1685] finished
0709 13:03:48.751521 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.751884 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67646,"raft.queue_time_us":305566,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":91,"spinlock_wait_cycles":69910400,"thread_start_us":831697,"threads_started":2,"wal-append.queue_time_us":263250}
I20260709 13:03:48.755724  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1455) took 2186 ms. Trace:
I20260709 13:03:48.773073 15664 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:48.776546  8509 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:03:48.777319 15824 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.778317 15799 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.779619  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1470) took 1933 ms. Trace:
I20260709 13:03:48.782107  9095 rpcz_store.cc:276] 0709 13:03:47.114519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.114681 (+   162us) service_pool.cc:224] Handling call
0709 13:03:48.753580 (+1638899us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400508cd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:48.753806 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071332224}
I20260709 13:03:48.793095  8505 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:48.804008  8505 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:48.804968 15664 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.796725  9100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1651) took 1072 ms. Trace:
I20260709 13:03:48.799839  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:48.807083  9100 rpcz_store.cc:276] 0709 13:03:47.724625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.725064 (+   439us) service_pool.cc:224] Handling call
0709 13:03:48.796498 (+1071434us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b540007b054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:48.796660 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980431744}
I20260709 13:03:48.808224 15797 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:48.808768 15161 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:48.789086 15800 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.805524  8505 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.787879  8333 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 12 to 14, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 14 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.796586  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2792) took 2527 ms. Trace:
W20260709 13:03:48.817293  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 191811us
I20260709 13:03:48.818354  8547 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:48.781654  8583 rpcz_store.cc:276] 0709 13:03:47.742693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.742850 (+   157us) service_pool.cc:224] Handling call
0709 13:03:48.745308 (+1002458us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400116cd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:48.745550 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340069632}
I20260709 13:03:48.835175  8505 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:48.847074  8434 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:48.802011  9099 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.850615  8428 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 13:03:48.798628 15540 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:48.796875 15673 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:48.853992  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 74725us
I20260709 13:03:48.824501 15161 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:03:48.859990  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.848618 15547 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:48.810271  8431 rpcz_store.cc:276] 0709 13:03:46.568925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.569064 (+   139us) service_pool.cc:224] Handling call
0709 13:03:46.569356 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:46.569554 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:47.706232 (+1136678us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.754066 (+1047834us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.754194 (+   128us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:48.754290 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.754390 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.755635 (+  1245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3904,"prepare.queue_time_us":584352,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":385679,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":8603,"thread_start_us":2069744,"threads_started":3,"wal-append.queue_time_us":545668}
I20260709 13:03:48.800370 15792 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.816013  8433 rpcz_store.cc:276] 0709 13:03:46.269035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.269149 (+   114us) service_pool.cc:224] Handling call
0709 13:03:46.269472 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:46.269811 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:46.269840 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:46.273518 (+  3678us) log.cc:844] Serialized 26 byte log entry
0709 13:03:46.471417 (+197899us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b18002e0d20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf0d1 00007f1a192faa0f
0709 13:03:46.572845 (+101428us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:47.692485 (+1119640us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.782405 (+1089920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.796065 (+ 13660us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.796152 (+    87us) raft_consensus.cc:1685] finished
0709 13:03:48.796315 (+   163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.796520 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101702,"prepare.queue_time_us":581353,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":52388,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":5211,"spinlock_wait_cycles":19645184,"thread_start_us":2102803,"threads_started":3,"wal-append.queue_time_us":352411,"wal-append.run_cpu_time_us":3444,"wal-append.run_wall_time_us":2069345}
I20260709 13:03:48.809756  8427 rpcz_store.cc:276] 0709 13:03:46.846223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.965582 (+119359us) service_pool.cc:224] Handling call
0709 13:03:46.965812 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:46.966035 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:47.733179 (+767144us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.778719 (+1045540us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.779004 (+   285us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.779082 (+    78us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:48.779164 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.779296 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.779517 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7538,"prepare.queue_time_us":912695,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":64315,"raft.run_cpu_time_us":552,"raft.run_wall_time_us":41765,"spinlock_wait_cycles":968064,"thread_start_us":1698882,"threads_started":3,"wal-append.queue_time_us":715923}
I20260709 13:03:48.854676  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:48.867986  8547 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:48.857839 15801 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:48.862389 15777 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:03:48.869634 15826 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.024s
W20260709 13:03:48.872509  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.894570 15664 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:48.894858 15775 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:48.895143 15664 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:48.895812  8333 catalog_manager.cc:5697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:48.896968  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.874431 15792 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:48.875527 15810 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:48.877235  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.900727  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 76078.3us
I20260709 13:03:48.879567  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:48.882504  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.878901  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.898463  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.903684  8501 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:48.868183 15673 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:48.904877  8507 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:48.885202  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:48.868034 15829 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.906869  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:48.884848  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.870594 15794 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.875562 15808 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.876091 15801 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.903245 15232 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:48.906880 15829 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.901558  8431 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:48.910375 15801 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:48.916349  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2739) took 2077 ms. Trace:
I20260709 13:03:48.917713 15829 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:48.918285  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:48.918877  8435 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:48.875810 15547 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.916919  8506 rpcz_store.cc:276] 0709 13:03:46.838616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.682049 (+843433us) service_pool.cc:224] Handling call
0709 13:03:47.682356 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.252865 (+570509us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:03:48.385453 (+132588us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.829498 (+444045us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.885516 (+ 56018us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.885708 (+   192us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:48.885744 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.885859 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.900582 (+ 14723us) raft_consensus.cc:1685] finished
0709 13:03:48.900609 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.916106 (+ 15497us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37881,"prepare.queue_time_us":159776,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":141942,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":2328,"spinlock_wait_cycles":1280,"thread_start_us":739132,"threads_started":4,"wal-append.queue_time_us":393542}
W20260709 13:03:48.927052  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.927088 15831 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:48.928308  9067 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:48.928109 15831 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.930181  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:48.897989  8333 catalog_manager.cc:5697] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 5 to 7, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 7 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:03:48.930894 15831 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.931411 15774 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:48.932243 15774 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:48.931718  8333 catalog_manager.cc:5697] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.934520  9099 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:48.934398 15775 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:48.939666  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:48.911126 15824 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:48.933782  8333 catalog_manager.cc:5697] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:03:48.899559  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:48.941568 15826 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:48.942059 15826 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:48.942504 15826 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:48.925570 15547 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.884279  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.960109  8435 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:48.883755  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.960542  8429 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:03:48.963632  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:48.942611  8333 catalog_manager.cc:5697] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 5 to 13, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 13 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.933818 15774 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:48.949867  8504 consensus_meta.cc:287] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.663s	user 0.013s	sys 0.001s
W20260709 13:03:48.950838  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.952382  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 45773.5us
W20260709 13:03:48.952777 15833 log.cc:927] Time spent T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:03:48.954489 15790 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:48.966616  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 112006us
I20260709 13:03:48.980691  8505 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:03:48.981735  8505 pending_rounds.cc:85] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 11
W20260709 13:03:48.965587 15822 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:03:48.995424  8333 catalog_manager.cc:5697] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:03:48.995798  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.960186  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:48.985347 15831 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:48.986274  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:48.987993  8504 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:03:48.988883  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.989162  8502 raft_consensus.cc:2410] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 23 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:03:48.887800 15799 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:48.989627  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:48.995754  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:49.013494 15790 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:49.013929 15790 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:49.015020 15790 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.016939 15790 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:48.961685 15794 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:49.019778  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.020365  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:49.020630 15232 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:49.021727 15161 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.022267 15232 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:49.022544 15161 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:48.975401 15775 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 13:03:48.997417  8505 pending_rounds.cc:107] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:03:49.021790  8426 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:49.014297  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:49.018486 15496 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:49.026193  8505 raft_consensus.cc:2889] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:49.024880  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:49.027864 15496 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:49.035929 15496 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:49.037348  8502 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:49.038506  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2742) took 2199 ms. Trace:
I20260709 13:03:49.038877 15775 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:49.039168 15547 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:49.039844 15547 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:49.040017 15721 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:03:49.040349 15547 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:49.042261 15826 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.042954  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.043988  8430 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:49.044327  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.044572 15826 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:49.038324  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:49.039320 15775 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:49.038918  8505 rpcz_store.cc:276] 0709 13:03:46.839304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.689736 (+850432us) service_pool.cc:224] Handling call
0709 13:03:47.690014 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.792807 (+1102793us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b540026df20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b6dc0 00007f1a193411c0 00007f1a19342231 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c
0709 13:03:49.038174 (+245367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.038446 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265122176}
I20260709 13:03:49.048736  9099 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
W20260709 13:03:49.050427  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50520.5us
I20260709 13:03:49.053802  8434 raft_consensus.cc:2410] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:03:49.049256  9099 pending_rounds.cc:85] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 11
I20260709 13:03:49.055069  9099 pending_rounds.cc:107] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:03:49.055399  9099 raft_consensus.cc:2889] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:49.057888  9099 pending_rounds.cc:107] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:03:49.058986  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.058204  9099 raft_consensus.cc:2889] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:49.038550 15673 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:49.062433  8333 catalog_manager.cc:5697] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.072012  8429 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:03:49.082397  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 54160.9us
I20260709 13:03:49.071498  8432 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
W20260709 13:03:49.090183  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 100052us
I20260709 13:03:49.097074 15161 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:49.096652 15664 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.098398 15664 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:49.108006 15496 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.110220 15777 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:49.110468 15496 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:49.110762 15777 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:49.111248 15777 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:49.118202  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:49.119078 15673 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:49.120038 15673 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:49.120260  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:49.121287 15664 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:49.121577  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:49.121722 15664 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:49.122246 15664 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:49.124831 15775 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.132758  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.138867 15796 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:49.139320 15796 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:49.140273 15796 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.141300 15796 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:49.141640  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:49.143653  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:49.144117 15664 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.146502 15476 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:49.147107 15476 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.147605 15476 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:49.145745 15800 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:49.150614 15800 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:49.151103 15800 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:49.157245 15664 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:49.158268  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.158931  8476 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:49.159045  8429 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:03:49.159915  8430 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:49.160367  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.161027  8429 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:49.161974  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:49.162565  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:49.171018  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.173789  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 84831.6us
I20260709 13:03:49.176391  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:49.135748 15826 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:49.184473  8434 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:49.189297 15540 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:49.195863  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74411.1us
I20260709 13:03:49.194815 15540 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:49.196826 15540 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:49.205523  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1968) took 1468 ms. Trace:
I20260709 13:03:49.206115  9099 rpcz_store.cc:276] 0709 13:03:47.720210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.720316 (+   106us) service_pool.cc:224] Handling call
0709 13:03:47.767158 (+ 46842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.801032 (+1033874us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54005891a0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192bd06f 00007f1a19335f60 00007f1a193377de 00007f1a19341b49 00007f1a19342416 00007f1a1933ed8f 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62
0709 13:03:49.075108 (+274076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.188277 (+113169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406585088}
I20260709 13:03:49.213434  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:49.219573  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:49.228447  8506 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:49.229993  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:49.246713  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:49.191509 15799 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:03:49.232875  8505 pending_rounds.cc:85] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 11
I20260709 13:03:49.211503 15792 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.250277  8505 pending_rounds.cc:107] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:03:49.253850  8505 raft_consensus.cc:2889] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:49.189918 15801 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.258374 15660 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:49.258463 15801 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:49.259054 15660 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:49.261617 15660 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:49.252951 15721 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:49.262212  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:49.232721 15797 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:49.327220  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 124453us
I20260709 13:03:49.329417 15831 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:49.331676  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:49.332314 15791 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:49.333341  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:49.335338  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:49.336585  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:49.337275  8505 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:49.333051 15791 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.340422 15791 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:49.337967  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:49.347216  8505 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:49.351635  8506 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:49.373783  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:49.371469 15042 consensus_meta.cc:287] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 1.088s	user 0.000s	sys 0.020s
I20260709 13:03:49.395097  8333 catalog_manager.cc:5697] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 5 to 10, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 10 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:49.399977  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.398430  8550 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:49.405139  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 87174.2us
I20260709 13:03:49.394815 15042 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.305442 15792 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.279337 15800 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.410290  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.297253 15797 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:49.411931  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 59762.1us
I20260709 13:03:49.418830  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.428645  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:49.435092 15799 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:49.435333  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.436484  8578 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:49.438717 15801 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:49.438831  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.440719 15801 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:49.441104 15801 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:49.441491 15801 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:49.443377 15844 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:49.433579 15540 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.444118 15844 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.450063 15540 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:49.454631  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.465095 15837 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.112s	user 0.000s	sys 0.005s
I20260709 13:03:49.477923 15844 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:49.480032 15792 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:49.484256 15850 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:49.485030  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.486359  8434 raft_consensus.cc:2410] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:03:49.488426 15777 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:49.491693  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.492328  8426 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:49.493090  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.494083  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.494374  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.495111  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.495457  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.496150  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.496448  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.496551 15721 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:49.497278 15721 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:49.504390 15232 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:49.506489 15547 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.506491 15232 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:49.508217 15232 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:49.508699 15547 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:49.510493  8583 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:49.512575  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:49.514451  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.515499 15797 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:49.496804  8426 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:49.510592 15800 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:49.517364  8435 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:49.501739  8427 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:49.517670  8431 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:49.518482 15042 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:49.513972  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:49.521253  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 99658.6us
I20260709 13:03:49.532675  8507 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:49.532051  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:49.533613  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 204848us
W20260709 13:03:49.544175  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.547731  8502 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:49.559262  8427 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:49.546676  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:03:49.567006  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.537364  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:49.587291  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53913.3us
I20260709 13:03:49.590104  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:49.591216  8502 raft_consensus.cc:2410] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:03:49.591775 15042 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:49.592243 15042 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:49.592635 15042 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:49.542064 15844 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:49.589275  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.596701  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:49.604279  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.605296  8435 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:49.606338 15829 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:49.606874 15829 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:49.607327 15829 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:49.610488  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:49.613051  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.614352  8580 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:49.615562  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.616900  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.617545  8580 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:49.618629  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.620302  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.621948  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.623773 15777 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:49.623870  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.625056  8581 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:49.629351  8430 raft_consensus.cc:2410] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
W20260709 13:03:49.588726 15790 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.005s
I20260709 13:03:49.630453  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:49.597256  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:49.632351  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 43937.5us
I20260709 13:03:49.633773 15673 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:49.598013  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.639672  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:49.644245 15792 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:49.644747 15792 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:49.645196 15792 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:49.646899 15800 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:49.650172  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:49.651197  8431 raft_consensus.cc:2393] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:49.651975  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.653524  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.655264  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.662559 15775 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:49.665189  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:49.668268 15476 consensus_meta.cc:287] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.000s
I20260709 13:03:49.669567  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:49.671381  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:49.598069 15794 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:49.599942  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.701499 15042 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.702903  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.703703  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.601507 15844 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.712545  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.713074  8584 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:49.714615  8579 raft_consensus.cc:1240] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:49.721834  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:49.715104 15042 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:49.715405  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.716439  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.717713 15826 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.719784  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.742053  8431 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:49.729852  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.724802 15799 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:49.765196  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:49.766471  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.695300 15794 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:49.769951  9095 raft_consensus.cc:1275] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:49.774648  9097 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:49.778630  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:49.771057  8581 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:49.783360  8582 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:49.783560  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.725798 15844 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:49.725545 15855 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:49.698825 15476 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:49.793246  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.802680  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.803714  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.832674  9100 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:49.780959 15794 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:49.792783  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.845160  8576 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 23: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:49.852907  9099 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:49.855974  8501 raft_consensus.cc:2368] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20.
I20260709 13:03:49.763496 15826 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:49.861722  9097 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:49.866362  8510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.041s
W20260709 13:03:49.866794  8510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.009s	sys 0.041s
I20260709 13:03:49.872563  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.881675  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.891713  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:49.893090  8400 connection.cc:256] RPC call timeout handler was delayed by -1.2242739260000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:03:49.893606  8400 connection.cc:256] RPC call timeout handler was delayed by -1.1549739260000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:03:49.893983  8400 connection.cc:256] RPC call timeout handler was delayed by -1.0604739260000997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:03:49.894383  8400 connection.cc:256] RPC call timeout handler was delayed by -1.0109739260000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 13:03:49.894778  8400 connection.cc:256] RPC call timeout handler was delayed by -1.0010739260000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:03:49.891114  9093 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
W20260709 13:03:49.902174  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 223733us
I20260709 13:03:49.828092 15855 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:49.925472  9100 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:03:49.923709  9101 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
W20260709 13:03:49.933616  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 252427us
I20260709 13:03:49.931953  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:49.934505  8475 connection.cc:256] RPC call timeout handler was delayed by -2.6540996250000717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:03:49.934952  8475 connection.cc:256] RPC call timeout handler was delayed by -2.580299625000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 13:03:49.855768 15721 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:49.947161  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 87633.3us
I20260709 13:03:49.946816  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.946934  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.933944  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:49.956151  8581 raft_consensus.cc:1240] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:49.962890  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:49.963060  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.955749  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.979712  9097 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:49.980720  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.981448 15870 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:49.982290  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:49.983173  8581 raft_consensus.cc:2410] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 20 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:03:49.984503  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.985184  9095 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:03:49.986052 15829 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.986922  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.987882  9096 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:49.988322 15829 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:49.988598  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:49.988801 15858 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.989569 15858 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:49.990626  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:49.993635  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.994546  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:49.978147  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:49.924645 15799 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:49.966768 15824 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:50.019866 15476 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:50.021279 15721 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:50.022634  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.023986  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.025406  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.026113 15826 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:50.026787  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 105801us
I20260709 13:03:50.027120  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.029376  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:50.029572  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:49.971082 15774 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.062s
I20260709 13:03:50.030791  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:50.013013  8431 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:50.015379  9101 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 19: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:50.018640 15855 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:50.030918 15866 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:49.975625  9098 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:50.026790  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:50.025421  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:50.035818  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.042333  9093 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
W20260709 13:03:50.054517  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.060755  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:50.063200  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 99199.2us
I20260709 13:03:50.045279  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:50.084766  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.084929  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:50.034492 15826 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:50.105621  9094 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:50.037732 15866 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.037213 15870 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:50.110507  9098 raft_consensus.cc:2393] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:50.086730  9096 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:50.108098  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:50.116119  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:50.118384  8504 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:50.118927  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.119603  9101 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:50.125284  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:50.130635  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:50.132860  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 107534us
I20260709 13:03:50.134815  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.132345  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.135022  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:50.129307 15801 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.687s	user 0.013s	sys 0.000s
I20260709 13:03:50.141897  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.143209  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.136755  9094 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:50.140591  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.141383  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.114773 15866 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:50.148876  9095 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:03:50.156929  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:50.159257 15863 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260709 13:03:50.165545  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.168911  9101 raft_consensus.cc:2393] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 14: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:50.169737  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:50.171715  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 142418us
I20260709 13:03:50.172609  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:50.174275  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44172.4us
I20260709 13:03:50.176685  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.177843  9097 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:50.175585  9095 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:50.132411 15860 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:03:50.186797  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 224040us
W20260709 13:03:50.190366  8475 connection.cc:256] RPC call timeout handler was delayed by -1.2558514160000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:03:50.193735  8475 connection.cc:256] RPC call timeout handler was delayed by -1.1442514160000883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 13:03:50.196460  8475 connection.cc:256] RPC call timeout handler was delayed by -1.1235514160000548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 13:03:50.198405  8475 connection.cc:256] RPC call timeout handler was delayed by -1.0587514160000637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:03:50.219697  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 44480.3us
I20260709 13:03:50.221077  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.248018  9096 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:50.248567  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:50.250422  9097 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:03:50.149595 15801 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:50.280581 15868 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:03:50.280692 15860 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:50.281499 15860 consensus_queue.cc:1243] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:50.282158  9093 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:03:50.283027 15860 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:50.283519 15860 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.185000 15870 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.175527 15878 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:50.220032 15867 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:50.284313  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.297636  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:50.308749  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:50.309674  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.306071  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.309062  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:50.290748 15792 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.007s
I20260709 13:03:50.287446 15801 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:50.321964  9094 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:50.320407  9097 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:50.321348  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:50.306761 15863 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:50.283908 15860 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:50.290252 15878 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:50.342306 15878 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:50.334604 15883 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.346391 15883 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.349222 15883 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:50.350474  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:50.355785  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.356840  9093 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
W20260709 13:03:50.358522  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 74396.4us
I20260709 13:03:50.358598 15887 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:50.359563  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:50.362703  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 56976.8us
I20260709 13:03:50.366952  9096 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
W20260709 13:03:50.369817  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 233840us
I20260709 13:03:50.324659 15832 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:50.373520  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:50.371573  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:50.290840 15881 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:03:50.298332 15664 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 13:03:50.373415  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:50.326117 15797 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.292654 15870 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.382515  8549 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:50.395215  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 146758us
I20260709 13:03:50.364315 15858 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:50.330507 15792 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:50.432705 15673 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.378928 15826 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:50.441143 15673 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:50.381448 15476 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:50.328737  8581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a"
dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:37100
I20260709 13:03:50.449110 15673 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:50.449337  8581 raft_consensus.cc:606] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:50.455875  8505 pending_rounds.cc:85] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 10
I20260709 13:03:50.456235  8505 pending_rounds.cc:107] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:03:50.456470  8505 raft_consensus.cc:2889] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:50.459157 15844 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.001s
I20260709 13:03:50.459619 15844 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:50.461431 15794 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.589s	user 0.002s	sys 0.006s
I20260709 13:03:50.462368  9102 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: []
W20260709 13:03:50.466068  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 94575.2us
I20260709 13:03:50.466086  8507 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:50.471015  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 88690.1us
I20260709 13:03:50.433538 15797 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.461623 15844 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:50.479120 15775 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.800s	user 0.012s	sys 0.002s
W20260709 13:03:50.500303  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.498678 15042 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.501518 15042 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.461858 15794 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:50.503873  9067 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:50.514504  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 134933us
I20260709 13:03:50.481949 15801 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:50.519199 15890 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:03:50.520793 15857 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.658s	user 0.003s	sys 0.006s
I20260709 13:03:50.521771 15042 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:50.522498  9100 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
W20260709 13:03:50.529305  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.505098 15893 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:50.482165 15866 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.561203  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:50.571110  8582 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:50.571951  8581 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:50.527539 15796 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.582180  8431 consensus_meta.cc:287] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
I20260709 13:03:50.582676  8431 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
W20260709 13:03:50.584436  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.564782 15844 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:50.599032  9101 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:03:50.609995  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 94686.3us
W20260709 13:03:50.611860  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 83765.1us
I20260709 13:03:50.603276 15844 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:50.620357  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.594846 15796 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.628065  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.631213  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:50.632949  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 273540us
I20260709 13:03:50.625152 15844 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:50.597839 15893 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:50.641595 15859 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:50.642258 15859 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.642637 15859 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:50.629624 15792 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:50.641611 15889 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:03:50.650493  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2767) took 1354 ms. Trace:
I20260709 13:03:50.636739 15664 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:03:50.651058 15775 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:50.687314  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 71425.4us
W20260709 13:03:50.689466 15895 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:03:50.655630 15794 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:50.692503  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 46610.4us
I20260709 13:03:50.636888 15867 consensus_queue.cc:1059] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:03:50.687273  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.695124  8549 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.704926 15893 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:50.705700 15870 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:50.710009 15799 raft_consensus.cc:993] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: : Instructing follower 0b9f7467deed4381835a85ffd0e88af6 to start an election
I20260709 13:03:50.710582 15799 raft_consensus.cc:1081] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Signalling peer 0b9f7467deed4381835a85ffd0e88af6 to start an election
W20260709 13:03:50.710642  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 64078.8us
I20260709 13:03:50.711887  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:50.696646 15899 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:50.664711  8508 rpcz_store.cc:276] 0709 13:03:49.296605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.341285 (+ 44680us) service_pool.cc:224] Handling call
0709 13:03:49.341587 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.341949 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.341975 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.342498 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.534494 (+191996us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:49.580196 (+ 45702us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.580441 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.580536 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.520096 (+939560us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:50.640947 (+120851us) raft_consensus.cc:1685] finished
0709 13:03:50.650251 (+  9304us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.650423 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43966,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2148,"raft.queue_time_us":10914,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":17118,"spinlock_wait_cycles":7749888,"thread_start_us":191613,"threads_started":1,"wal-append.queue_time_us":426313}
W20260709 13:03:50.713096  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 81979.7us
I20260709 13:03:50.688154 15860 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:50.716869 15878 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.719314  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.720116  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.720747  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:50.694402 15797 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:50.723846 15476 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:50.726363  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:50.727785 15910 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:50.728423 15910 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:50.728941 15910 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:50.731153 15898 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:50.733129  8503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a"
dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:59098
I20260709 13:03:50.734110  8503 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.734565  8503 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:50.740166 15796 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:50.742208 15476 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:50.722632 15870 raft_consensus.cc:3055] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:50.742655  8476 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:50.742784 15870 raft_consensus.cc:740] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:50.743301 15664 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.744151 15903 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:50.723548 15893 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:50.743996 15870 consensus_queue.cc:260] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.743860 15664 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.727862  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:50.755728 15878 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:50.756567 15774 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:50.757063 15774 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:50.757740  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:50.749635 15867 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:50.724870 15854 consensus_queue.cc:1048] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:03:50.756827  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:50.758224  9102 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:50.761559  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:50.764570  8435 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:50.767118  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55311us
I20260709 13:03:50.758414  8433 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 25.
I20260709 13:03:50.772739  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:50.773171  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:50.755646 15794 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.776930  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 56849.7us
I20260709 13:03:50.777951  8503 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.779671  8549 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.773413  8428 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:50.762712 15903 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.760367 15900 raft_consensus.cc:2804] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:50.782814  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 51442.4us
I20260709 13:03:50.783774  8575 raft_consensus.cc:1240] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 25. Current term is 26. Ops: []
I20260709 13:03:50.783800  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:50.783784  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:50.783926  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:50.783259  8476 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:50.791378  8584 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:03:50.780393  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:50.786188  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 58466.6us
I20260709 13:03:50.786254  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:50.794315  8576 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:50.763798 15893 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.795655  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:50.763545 15860 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:50.774776 15870 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:50.795595 15893 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:50.788532  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:50.796706  8503 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:50.797744  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:50.783267 15824 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:50.743342 15476 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.799930 15540 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:50.814224 15540 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:50.814738 15540 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:50.815536  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:50.817898 15908 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:50.818966  8501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59114 (request call id 3185) took 1592 ms (client timeout 1708 ms). Trace:
I20260709 13:03:50.818841 15908 consensus_queue.cc:1059] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:03:50.819301  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:50.819480  8501 rpcz_store.cc:269] 0709 13:03:49.226172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.226353 (+   181us) service_pool.cc:224] Handling call
0709 13:03:50.818737 (+1592384us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400154854. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:50.818882 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386117504}
W20260709 13:03:50.803762 15907 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:50.820216 15908 raft_consensus.cc:3055] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:03:50.820744 15908 raft_consensus.cc:740] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:50.821290  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:50.789635 15794 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.822198 15882 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:50.822319  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:50.822659 15882 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:50.822897  8507 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:50.823668 15794 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:50.804715  8435 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:50.757975 15774 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.825102 15774 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:50.827185  8550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.397s	user 0.039s	sys 0.067s
W20260709 13:03:50.827503  8550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.398s	user 0.039s	sys 0.067s
W20260709 13:03:50.827767  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 1.39917e+06us
I20260709 13:03:50.828409  8550 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.829519 15824 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:50.808629  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:50.830528  8575 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 20: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:50.830667 15824 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.832818  8575 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:50.809986  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:50.836350 15861 log.cc:927] Time spent T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.870s	user 0.009s	sys 0.014s
I20260709 13:03:50.824321  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:50.843456  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.820011  8580 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:50.847270  8578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1277) took 1397 ms. Trace:
I20260709 13:03:50.788074 15867 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:03:50.851003  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:50.848807  8581 raft_consensus.cc:2468] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:50.810005 15900 raft_consensus.cc:697] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:50.866335 15914 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:50.867362 15900 consensus_queue.cc:237] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:50.823777 15882 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.871672 15882 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:50.872089  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:50.792269 15903 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:50.874554  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:50.875999  8583 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 14.
I20260709 13:03:50.807191 15878 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:50.880936  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:50.882099  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:50.882627 15829 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:50.889660  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:50.890702  9068 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Timed out: RequestConsensusVote RPC to 127.7.41.193:41353 timed out after 1.549s (SENT)
I20260709 13:03:50.891070  8506 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:50.891216  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:50.892599  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.902081  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:50.847775  8578 rpcz_store.cc:276] 0709 13:03:49.440777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.441155 (+   378us) service_pool.cc:224] Handling call
0709 13:03:49.441727 (+   572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.442338 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.442381 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.443133 (+   752us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.790867 (+347734us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:49.845729 (+ 54862us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.846003 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.846130 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.460646 (+614516us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b1800277180. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:03:50.835569 (+374923us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:50.838236 (+  2667us) raft_consensus.cc:1685] finished
0709 13:03:50.838255 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.838388 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5604,"prepare.queue_time_us":55213,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":27118,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":13809280,"thread_start_us":347204,"threads_started":1,"wal-append.queue_time_us":448155}
I20260709 13:03:50.902797  8509 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:50.904882  8576 raft_consensus.cc:1240] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:50.904851  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:50.906420  8506 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:50.907163  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:50.906348  8507 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:50.908394  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:50.909049  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:50.909636  8507 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:50.914240  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:50.907900  8501 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:50.854853 15869 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:50.911062  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:50.821586 15908 consensus_queue.cc:260] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:50.922495  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:50.960752  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:50.926589  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 146986us
I20260709 13:03:50.924412  8584 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:50.973560  8506 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:03:50.924677  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:50.974294  8510 raft_consensus.cc:2410] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:03:50.975575  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:50.983321  8508 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:50.925096  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:50.985515  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 73570.3us
I20260709 13:03:50.847601 15887 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:03:50.986239  8501 raft_consensus.cc:1240] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:50.912262 15898 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:50.990648  8510 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:50.996213  8507 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
W20260709 13:03:50.997305  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 173092us
I20260709 13:03:50.911731 15801 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:50.999264  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 108590us
I20260709 13:03:50.997519  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:50.980461 15796 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:50.997912 15884 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.350s	user 0.001s	sys 0.002s
I20260709 13:03:51.007078  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:51.012620  9065 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:50.906188 15799 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.092s
W20260709 13:03:51.013456  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 167415us
I20260709 13:03:51.014899  8550 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:51.014920  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:50.998811 15898 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:51.018988  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:51.020546  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 167517us
W20260709 13:03:51.022696  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 55968.4us
I20260709 13:03:51.013110 15908 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:51.013686 15869 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:51.026999  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:51.032032  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:51.032776  8508 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 13.
I20260709 13:03:51.036055  8508 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:51.039965  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:51.021034 15898 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:51.044173 15042 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:51.044701 15042 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:51.044667  9065 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:51.023706 15888 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.052672 15775 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:51.052347 15042 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.055234 15910 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.056464  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:51.058058 15910 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.039922 15476 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:51.057709  8509 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:51.066007  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:51.079887  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1646) took 1244 ms. Trace:
I20260709 13:03:51.080274  9099 rpcz_store.cc:276] 0709 13:03:49.835715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.065682 (+1229967us) service_pool.cc:224] Handling call
0709 13:03:51.079829 (+ 14147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:51.080484  9093 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:51.065717 15540 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:51.074232  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 59428.3us
I20260709 13:03:51.082132  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:51.076082 15921 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:03:51.076506 15912 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:03:51.076875 15915 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:51.077766 15664 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:51.082414  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 71635.2us
I20260709 13:03:51.058698 15922 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.023s
W20260709 13:03:51.087522 15892 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.610s	user 0.002s	sys 0.000s
W20260709 13:03:51.095760  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 51155.9us
I20260709 13:03:51.103471  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:51.103717  8509 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:51.111598  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 77273.7us
I20260709 13:03:51.099156 15914 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:03:51.113629  9065 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:51.114418 15540 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:51.115603 15042 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:51.105897 15893 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:51.118629  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:51.111450 15476 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:51.120106 15924 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:51.120141 15476 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:51.128122 15924 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:51.128278 15775 consensus_queue.cc:1059] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:51.128166 15476 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:51.117898  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:51.132617 15540 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:51.133057 15540 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:51.133495 15540 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:51.120012  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 62064.1us
I20260709 13:03:51.137087 15869 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:51.128726 15924 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.138052 15869 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:51.137796 15476 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.138442 15869 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:51.139428 15869 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.129733 15775 raft_consensus.cc:3055] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:51.142841  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:51.122535  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:51.151026  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:51.152168  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:51.144035 15775 raft_consensus.cc:740] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:51.155022 15775 consensus_queue.cc:260] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.150374 15660 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:51.156359 15660 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:51.156749 15660 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:51.158218 15854 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:51.159929  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:51.161258  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:51.162493  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:51.166388  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 43933us
I20260709 13:03:51.142510 15888 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:51.141896 15844 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.168995  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:51.169201 15922 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:03:51.175325  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 154067us
I20260709 13:03:51.141894 15476 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.150853 15799 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:51.181243  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:51.182806  8549 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:51.196945  8398 leader_election.cc:400] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20.
I20260709 13:03:51.197361  8398 leader_election.cc:403] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:51.169821 15922 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:51.162859 15664 raft_consensus.cc:2764] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:03:51.227305  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 47572.9us
I20260709 13:03:51.171250 15914 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:03:51.231204  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.170228 15792 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:51.228458  9065 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:51.197122 15860 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:51.234560  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 51865.2us
I20260709 13:03:51.233043 15476 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:51.247563 15930 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:51.248070 15796 raft_consensus.cc:2804] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:51.249087 15931 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20.
I20260709 13:03:51.250269 15914 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:51.191784 15888 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:51.247218  8549 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:51.243943  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:51.229564 15922 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.201196 15797 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:51.274495  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 77094.2us
I20260709 13:03:51.275206  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:51.276540  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 100450us
I20260709 13:03:51.170814 15915 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.076s
W20260709 13:03:51.290436 15933 log.cc:927] Time spent T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:03:51.292562 15927 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:03:51.292465 15540 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:51.274015 15918 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:03:51.258559 15796 raft_consensus.cc:697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:51.259491 15930 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:03:51.326407  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 211270us
W20260709 13:03:51.324674  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 56175.5us
W20260709 13:03:51.329697  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 47281.9us
W20260709 13:03:51.331184  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 149984us
I20260709 13:03:51.329941  9095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1676) took 1306 ms. Trace:
W20260709 13:03:51.333401  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 58253.8us
I20260709 13:03:51.370334  9095 rpcz_store.cc:276] 0709 13:03:50.023587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.151822 (+128235us) service_pool.cc:224] Handling call
0709 13:03:50.175163 (+ 23341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:50.179036 (+  3873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.327086 (+1148050us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b540035e150. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:51.329874 (+  2788us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52592896}
I20260709 13:03:51.371261  8475 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:51.371443  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:51.288430 15664 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:51.335639  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:51.356346 15888 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.358070 15540 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.362584 15796 consensus_queue.cc:237] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.320062 15931 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:51.332572 15932 log.cc:927] Time spent T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:51.452862 15936 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.453455 15936 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.456297 15936 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.353631 15924 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.459538 15924 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:51.442524  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 71327.7us
W20260709 13:03:51.443921  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 108357us
I20260709 13:03:51.444458 15854 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.444948 15935 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:51.445552 15923 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:51.373672  8550 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:51.374933 15664 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:51.490903  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 119517us
I20260709 13:03:51.497076  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:51.463393 15935 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:51.468686 15923 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:51.474128 15774 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.001s
I20260709 13:03:51.505995  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:51.513096  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:51.518383  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:51.519265  8584 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.521785  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:51.522456  9097 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:51.499332 15664 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:51.507648 15859 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.858s	user 0.012s	sys 0.001s
I20260709 13:03:51.533807  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:51.553606  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:51.554324  8506 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:51.511515 15935 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:51.516335 15923 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:51.557988  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50423.5us
I20260709 13:03:51.562806  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:51.513576 15844 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:51.567389  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:51.567790  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:51.472684 15941 consensus_queue.cc:1059] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.083s
I20260709 13:03:51.540349 15924 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:51.540094 15930 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:51.579464  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 205889us
I20260709 13:03:51.557410 15900 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.611151 15903 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:51.616400 15913 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:51.616914 15913 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:51.593737 15854 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:51.670552 15854 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.670979 15854 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:51.677335 15664 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.617748 15913 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.680045 15664 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.680984 15664 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:51.681402 15664 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:51.681859 15664 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:51.652462  8584 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:51.652333 15660 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:51.683642 15898 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.600s	user 0.001s	sys 0.008s
I20260709 13:03:51.684109 15898 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.684921 15660 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.601536 15924 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:03:51.658460 15908 consensus_meta.cc:287] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.620s	user 0.004s	sys 0.009s
I20260709 13:03:51.599233 15900 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.686188 15924 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:51.686647 15924 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:51.668695 15922 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.691005 15664 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.692773 15922 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.681770 15931 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.557226 15859 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.693912 15664 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.694814  8579 raft_consensus.cc:1240] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:03:51.694983 15924 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.696295 15859 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.696810 15924 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.699743  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:51.700435  8504 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 13.
I20260709 13:03:51.703997 15860 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:51.641350  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:51.705000  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:51.705693  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 64502.9us
I20260709 13:03:51.706539  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:51.706534 15476 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:51.707485 15540 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.708767  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:51.716367  8506 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:51.716584 15673 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:03:51.783288  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 215537us
W20260709 13:03:51.754407 15882 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.876s	user 0.012s	sys 0.008s
W20260709 13:03:51.793826  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 332677us
I20260709 13:03:51.794551  8502 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:51.793834  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:51.795907  8509 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:51.781376 15673 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:51.803977  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 222155us
I20260709 13:03:51.807308  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:51.808133  8502 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:51.798956 15898 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:51.808789  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 100092us
I20260709 13:03:51.811350  8506 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:51.813930  8509 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:51.808812  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:51.804800 15673 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:51.839164 15826 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:51.804639 15931 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:03:51.842901 15931 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:51.843377 15664 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.843495 15931 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:51.844099 15664 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:51.846915  8506 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 13:03:51.844169  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.819546 15952 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:03:51.855672 15952 consensus_queue.cc:1243] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:03:51.856141 15952 raft_consensus.cc:2764] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:03:51.840060 15826 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:51.859280 15826 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:51.859475 15858 consensus_queue.cc:1059] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:51.859814 15826 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:51.860145 15826 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:51.861012 15826 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.863495 15923 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:51.821333 15854 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:51.865209 15944 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.198s	user 0.000s	sys 0.003s
W20260709 13:03:51.867241 15939 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:03:51.867583 15664 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:51.867477 15854 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.868958 15854 raft_consensus.cc:3055] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:03:51.869344 15854 raft_consensus.cc:740] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:51.869791 15903 raft_consensus.cc:3055] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:51.870183 15903 raft_consensus.cc:740] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:51.871132 15903 consensus_queue.cc:260] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.865788 15923 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:51.870219 15854 consensus_queue.cc:260] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:51.873478 15896 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:51.872539 15903 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:51.851468 15935 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.919251  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 1998) took 1631 ms. Trace:
I20260709 13:03:51.920423 15935 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:51.919677  9098 rpcz_store.cc:276] 0709 13:03:50.287423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.380460 (+ 93037us) service_pool.cc:224] Handling call
0709 13:03:50.434406 (+ 53946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.530101 (+ 95695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.530137 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:50.575721 (+ 45584us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.626123 (+ 50402us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:50.626171 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.037993 (+411822us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b48000b0958. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:03:51.918932 (+880939us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b5400209c54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:51.918990 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.919034 (+    44us) raft_consensus.cc:1685] finished
0709 13:03:51.919048 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.919193 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2421,"raft.queue_time_us":12772,"raft.run_cpu_time_us":4041,"raft.run_wall_time_us":509673,"spinlock_wait_cycles":192813824,"thread_start_us":14775,"threads_started":1,"wal-append.queue_time_us":85018,"wal-append.run_cpu_time_us":1794,"wal-append.run_wall_time_us":1022797}
I20260709 13:03:51.841869 15898 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:51.898779  8547 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:51.928781  8547 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:51.929648 15914 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:51.930294 15914 raft_consensus.cc:697] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:51.931959 15801 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:51.931396 15914 consensus_queue.cc:237] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:51.932399 15801 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.932821 15801 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:51.933936  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:51.934446 15922 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:51.878196  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2710) took 1115 ms. Trace:
I20260709 13:03:51.935784  8583 rpcz_store.cc:276] 0709 13:03:50.762932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.782857 (+ 19925us) service_pool.cc:224] Handling call
0709 13:03:51.877951 (+1095094us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b5400115154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:51.878121 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196293888}
I20260709 13:03:51.848583 15931 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:51.874002 15896 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:51.938936 15896 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:51.940227 15896 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:51.914328 15826 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:51.944617 15790 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:51.945014 15790 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:51.914929 15476 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:51.915751  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:51.916132 15952 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:51.947083 15952 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:51.947103  8433 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:51.948385  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:51.945779 15790 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.948977  8427 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:51.948046 15952 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.946480  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:51.948069  8435 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:51.952420  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:51.953861  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:51.957065  8506 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 25. Current term is 26. Ops: []
I20260709 13:03:51.957938  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:51.958302  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:51.958611  8502 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:51.959474  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:51.959636  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:51.960161  8578 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:51.960477  8578 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:03:51.960728 15905 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.272s	user 0.010s	sys 0.019s
I20260709 13:03:51.960887  8576 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:51.961287  8578 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:51.963325  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:51.965368  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:51.966079  8577 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:51.965446  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2782) took 1511 ms. Trace:
I20260709 13:03:51.967269  8505 rpcz_store.cc:276] 0709 13:03:50.454449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.454744 (+   295us) service_pool.cc:224] Handling call
0709 13:03:50.455668 (+   924us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:50.457403 (+  1735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.457445 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:50.466957 (+  9512us) log.cc:844] Serialized 52 byte log entry
0709 13:03:50.603356 (+136399us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:50.603417 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.603510 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.960158 (+1356648us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:51.965162 (+  5004us) raft_consensus.cc:1685] finished
0709 13:03:51.965186 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.965392 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1356,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":10219264,"thread_start_us":89644,"threads_started":1,"wal-append.queue_time_us":162515}
I20260709 13:03:51.969522  8431 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:51.970239  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:51.971575  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:51.972152  9097 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:51.973217  8577 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:51.974992  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:51.979029  8578 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:51.979609 15866 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:51.980353  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:51.981287  9096 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:03:51.984454  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:51.985108  9095 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:03:51.994235  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.004457  9095 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
W20260709 13:03:52.003229  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 194505us
W20260709 13:03:51.999083  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.990924  9093 raft_consensus.cc:1275] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:52.001595  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:52.010874  8577 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:51.989923 15952 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:51.994326 15930 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:52.014175  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:52.023423  8579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2973) took 1219 ms. Trace:
I20260709 13:03:52.026374  9097 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:52.024786  8579 rpcz_store.cc:276] 0709 13:03:50.804119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.822386 (+ 18267us) service_pool.cc:224] Handling call
0709 13:03:50.822722 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:51.695210 (+872488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.015124 (+319914us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b5400066dd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:52.023334 (+  8210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2004971904}
I20260709 13:03:52.035761  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.038812  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:52.040148  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.040527  8578 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:52.049666  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:52.051834  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.052614  8579 raft_consensus.cc:2368] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19.
I20260709 13:03:52.053493  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.057081  8429 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:03:52.063917  8579 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:52.068504 15913 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:52.064563  8433 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 26.
I20260709 13:03:51.984488 15960 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:03:52.084244 15790 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:51.992755 15673 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.090370 15946 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:03:52.077683 15938 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.410s	user 0.003s	sys 0.000s
I20260709 13:03:52.106532  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:52.107558  8506 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:52.109756  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:52.118242  8504 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:52.121239  8575 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:52.122896  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:52.128731  8476 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:52.133913  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:52.133999  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.131455  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:52.134861  8510 raft_consensus.cc:2393] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 22: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:52.135594  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:52.136049  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.136832  8431 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:52.137176  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.138386  8426 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:52.138474  8435 raft_consensus.cc:1240] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:52.138474  8428 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:52.135371  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:52.139302  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 325298us
I20260709 13:03:52.143426  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:52.067411  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:52.119197 15775 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:52.149984  8431 raft_consensus.cc:1240] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:52.147055  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:52.149855  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.147416  8579 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:52.155876  8428 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:52.156239  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.156355  8506 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:52.157510  8434 raft_consensus.cc:1240] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:52.154825  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:52.158468  8430 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:03:52.157665  8400 connection.cc:256] RPC call timeout handler was delayed by -1.0184005079998997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 13:03:52.136818 15855 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:03:52.150059 15943 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.003s	sys 0.030s
I20260709 13:03:52.160861  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.161729  8435 raft_consensus.cc:1240] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:03:52.162727  8432 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 25. Current term is 26. Ops: [24.12-25.13]
I20260709 13:03:52.159614  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:52.173321  8434 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:52.163759  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.173938  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:52.141583 15831 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:52.145263 15673 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:52.166637  8476 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:52.164086  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:52.177057  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:52.159636 15826 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:52.159533 15540 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:52.205490  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:52.175216 15917 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.365s	user 0.008s	sys 0.004s
I20260709 13:03:52.181341  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:52.163110 15855 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.091054 15946 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.187042  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.172013 15898 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 13:03:52.190201  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.209534  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.180253 15936 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:52.234484  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:52.190868 15797 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:03:52.193770  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:52.236443  8434 raft_consensus.cc:2393] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 16: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:52.199424 15799 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:52.199884  8550 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:52.162990 15924 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.240734 15924 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.241348 15952 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:52.170231 15943 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.003s	sys 0.030s
W20260709 13:03:52.242316  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49188.1us
I20260709 13:03:52.242656 15969 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:52.243003 15924 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:52.242877 15791 consensus_queue.cc:1059] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:52.243671 15896 consensus_queue.cc:1059] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:52.244081 15791 raft_consensus.cc:3055] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:52.244529 15791 raft_consensus.cc:740] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:52.244853  8430 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:52.145957 15966 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 13:03:52.245976 15966 consensus_queue.cc:1059] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:52.246964 15966 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:03:52.247291 15966 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:52.247342 15673 raft_consensus.cc:3055] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:52.247929 15673 raft_consensus.cc:740] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:52.248225 15966 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.248875 15673 consensus_queue.cc:260] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:52.249642 15966 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:52.235205  8398 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:52.251483 15801 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:52.207952 15826 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.253717 15801 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:52.198215 15963 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:52.250620  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.250898 15797 raft_consensus.cc:697] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:52.251032  8550 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:52.208762  8435 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:52.243855  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:52.254696  8577 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 15: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:52.255493  8431 raft_consensus.cc:3060] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:03:52.256176 15969 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:52.281684  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:52.232740 15794 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
W20260709 13:03:52.261847  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.264369 15952 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:52.206128 15831 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
W20260709 13:03:52.264365  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.265151  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:52.234498 15855 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:52.206387 15540 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:52.274379  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.295217 15042 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.295706 15042 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:52.273052  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 93320.8us
I20260709 13:03:52.296844 15969 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.245424 15791 consensus_queue.cc:260] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:52.299002  8510 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:52.299320 15791 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:52.277047  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.244527 15896 raft_consensus.cc:3055] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:52.279475  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.303085 15960 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:52.258081 15859 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:52.290551  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46774.1us
W20260709 13:03:52.315793  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.291282  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:52.316721  8582 raft_consensus.cc:2393] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 26: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:52.292709  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.297626 15042 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:52.317314  8435 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:52.318277  8426 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:52.319340  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:52.319983  8426 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
W20260709 13:03:52.277158  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 263999us
I20260709 13:03:52.309705  8427 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 22: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
W20260709 13:03:52.310216  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 73234.8us
I20260709 13:03:52.303952  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.315609  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:52.290674  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:52.321976  8434 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:52.322512 15042 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.322611  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:52.321379  8426 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:52.326114  8508 raft_consensus.cc:2368] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21.
I20260709 13:03:52.323236 15042 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:52.326925  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.327517  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.284080 15829 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:52.331831  8431 raft_consensus.cc:2468] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:52.332334  8510 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:52.330983  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:52.289717 15924 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:52.334831  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:52.336122  8503 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 15: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:52.302413 15901 raft_consensus.cc:3055] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:03:52.292042 15673 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:52.342768  8398 leader_election.cc:400] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21.
I20260709 13:03:52.343144  8398 leader_election.cc:403] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:52.343274  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:52.345402 15970 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:03:52.345682 15951 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:52.312320 15896 raft_consensus.cc:740] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:52.347095 15896 consensus_queue.cc:260] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.348412 15896 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:52.304356 15801 consensus_queue.cc:1059] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:03:52.318574 15945 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260709 13:03:52.351018 15945 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:52.351372 15945 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:52.352224 15945 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.352783 15854 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:52.353430 15945 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:52.334452 15888 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:03:52.355224 15888 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:52.355624 15888 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:52.315182 15952 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:52.360978  8428 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:52.329198  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.309414 15540 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:52.338044  8426 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:52.326076 15878 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.344933  8508 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:52.359647  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:52.359861  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:52.367105  9095 raft_consensus.cc:2368] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19.
I20260709 13:03:52.363498  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:52.368028  9097 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:52.363296 15971 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21.
I20260709 13:03:52.335656  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:52.365146  8427 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:52.363690  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:52.367112  9093 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:52.340077 15941 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:03:52.372422  8435 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:52.374058  8428 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:52.364265  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:52.334743 15660 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.345345 15859 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:52.378728  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:52.379530  9098 raft_consensus.cc:2393] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:52.335901 15924 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:52.381870  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:52.339232 15794 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:52.340531 15901 raft_consensus.cc:740] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:52.373278 15878 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.355247 15826 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:52.383875  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 48651us
I20260709 13:03:52.384737  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:52.391091  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 46755.3us
W20260709 13:03:52.387061  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.383987 15978 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:52.416838 15978 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.387643  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:52.401924  8428 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:52.420598 15908 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:52.387199  8435 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:52.383239  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:52.422259  9099 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.373795 15888 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.423295 15888 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:52.395859  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:52.386564  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 50986.2us
I20260709 13:03:52.404102 15826 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:52.404913 15969 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:52.410279 15859 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:52.410658 15955 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:03:52.413549 15799 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:52.446798 15799 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:52.448019 15900 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:52.447824 15799 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.449074 15799 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:52.449785 15959 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:03:52.344925 15831 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:52.431147 15971 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.436523  9096 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:52.338603 15829 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.436484  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:52.441442  8434 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:52.441694  9097 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:52.390751 15790 raft_consensus.cc:2764] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:52.452792  9067 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:52.346180 15797 consensus_queue.cc:237] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:52.463375 15893 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:52.463804 15893 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:52.452292  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:52.433676  9099 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:52.442505 15794 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.458353 15935 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.465167  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 60750.4us
I20260709 13:03:52.450364 15792 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:03:52.389137 15924 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:52.467993  8576 raft_consensus.cc:3060] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:52.467914  8581 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2970) took 1704 ms (client timeout 1708 ms). Trace:
I20260709 13:03:52.466109  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:52.462390 15922 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:52.481113 15976 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:03:52.501408  8581 rpcz_store.cc:269] 0709 13:03:50.763769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.773107 (+  9338us) service_pool.cc:224] Handling call
0709 13:03:52.467750 (+1694643us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b54003df9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:52.467863 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109970304}
I20260709 13:03:52.465827 15540 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:52.503089  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:52.481922 15844 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:52.450949 15826 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.519133  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:52.500263 15794 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:52.524874  8506 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:52.509536 15791 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:52.515626 15476 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:52.526755 15791 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.527215 15791 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:52.527236 15476 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:52.528430 15476 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.524547 15898 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.505594 15922 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:52.489939 15935 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:52.541925  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.543424  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:52.540186  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.544611  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.546698  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:52.547664  8583 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:03:52.468700 15952 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:52.515924 15976 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:52.550626 15042 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:52.547701  8575 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:52.521350 15844 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:52.556869  8579 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:03:52.558091  8575 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:52.558641  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.549763 15853 raft_consensus.cc:3055] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:52.567126  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:52.565171  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 128741us
I20260709 13:03:52.572901  8400 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:52.572919 15794 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:52.574280  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:52.574815 15794 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:52.575242 15794 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:52.575613 15794 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:52.576325  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:52.576521  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:52.577037 15042 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:52.577170  8579 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:52.577425 15042 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.577817 15042 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:52.584689  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 68260.8us
I20260709 13:03:52.586449  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:52.566848 15951 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.669766  8581 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:52.624607  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:52.634156  8505 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 26.
I20260709 13:03:52.592151  9101 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:52.604106  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:52.588564  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:52.642514  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.633193  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:52.625525  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:52.699148  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 74616us
I20260709 13:03:52.668447  9097 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:52.690757  9094 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:03:52.603109 15540 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:52.566370 15948 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.700762 15948 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.703274 15948 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:52.693135 15983 consensus_queue.cc:1059] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:52.685642 15913 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.004s
I20260709 13:03:52.707050 15855 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.708757  8507 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:03:52.708884 15946 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:52.711153 15855 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:52.587738 15042 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.700160  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:52.567550 15853 raft_consensus.cc:740] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:52.729805 15853 consensus_queue.cc:260] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.731794 15853 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:52.697232  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 184182us
I20260709 13:03:52.623323 15881 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.625823 15826 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:52.624270 15976 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.618518 15844 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.724601 15971 raft_consensus.cc:3055] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:52.629407 15854 consensus_queue.cc:1048] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.093s
W20260709 13:03:52.735558  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 160080us
I20260709 13:03:52.695055 15935 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:52.685968 15673 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:52.669847 15882 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:52.779386 15882 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.761498  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:52.781473 15882 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:52.781847  9101 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:52.642149 15922 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:52.783113 15922 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:52.784580  9101 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:52.786919 15978 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:52.603394 15790 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:52.762686  8400 leader_election.cc:400] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19.
I20260709 13:03:52.695230 15951 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.745297 15881 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.766983  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:52.621917 15791 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.767834 15794 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:52.751443 15971 raft_consensus.cc:740] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:52.773061 15869 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:52.736995 15797 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:52.774840 15775 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:52.775240  9100 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:03:52.775743 15540 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:52.776286  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:52.777099  9098 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 20 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 13:03:52.802713 15476 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.787623  8400 leader_election.cc:403] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:03:52.815143  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 52663.2us
I20260709 13:03:52.815822  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:52.817101  8400 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:52.785817  9101 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:52.804414  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:52.818056  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.818356  9099 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:52.803673 15963 consensus_meta.cc:287] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.000s
I20260709 13:03:52.778081 15924 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:52.811576  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.812711  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:52.817880  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:52.818915  8580 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:52.821626  8575 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:52.827077  8575 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:52.833230  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:52.833351  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:52.836656  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.837836  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.810351 15775 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:52.839941  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:52.842768  8580 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
W20260709 13:03:52.843885  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.818977 15790 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:52.860813  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:52.819360 15673 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19.
I20260709 13:03:52.881485  9093 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:52.882715  9099 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:52.821301 15935 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.830721 15963 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:52.883338  8429 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 25. Current term is 26. Ops: [24.12-25.13]
I20260709 13:03:52.856986  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:52.831681 15797 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:52.840535 15952 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:52.838833 15991 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:52.818403 15540 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.855530 15826 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:52.877566 15790 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.900614  8504 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:52.821497 15476 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.901592  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:52.881587 15914 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:52.903818  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:52.893114 15976 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:03:52.902302 15966 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.001s
I20260709 13:03:52.895128 15799 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.892400 15960 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:52.897697 15673 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:52.904633 15790 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:52.922508  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.905239 15946 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:52.928817 15797 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.930696 15951 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:52.910188 15896 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:52.938772  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:52.903026 15941 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
W20260709 13:03:52.935418 15982 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:03:52.923545 15976 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:52.907717 15937 consensus_queue.cc:1059] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:03:52.946324 15791 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:52.946467 15476 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:52.977104  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:52.984943  8510 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 24.
I20260709 13:03:52.985947  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:52.986176  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:52.936187 15952 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:52.981818  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:52.982751  8429 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22. Ops: []
I20260709 13:03:52.925645 15799 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.903324 15971 consensus_queue.cc:260] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.934525 15960 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:52.975148 15896 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:53.001494  8510 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:52.925282 15914 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.022698  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:53.022969  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 183087us
I20260709 13:03:52.994517 15774 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:52.934259 15775 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.021284 15540 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:53.033677  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.038108  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:53.010603 15995 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:53.025862 15971 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.054870  8400 leader_election.cc:400] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19.
I20260709 13:03:53.026530 15799 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:53.032389 15774 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.062682 15774 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:53.026057 15896 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.066684  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.067414  8429 raft_consensus.cc:2393] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:53.029251 15960 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:53.068291 15826 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:03:53.027367 15924 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.002923 15794 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.027979  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:53.070571 15976 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.071455  9101 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 14.
I20260709 13:03:53.029225  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.023856 15796 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.030939 15959 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:53.032449  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:53.035285  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:53.050145  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.037199  8510 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:53.056455  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:53.058436 15859 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.058884 15937 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:53.002779 15881 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.060096  8507 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:53.060791 15952 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.092473  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.094094  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:53.094756  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:53.095448  8547 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.095470  8430 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:53.029968 15914 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:53.097774 15914 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:53.098831 15914 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:53.099308 15042 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.099591 15914 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:53.099982 15914 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:53.100782 15914 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.083238 15859 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:53.085640 15937 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.103395 15859 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:53.103875 15937 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:53.095654  8398 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.061805  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:53.117103  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.117756  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.118959  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:53.119065  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:53.117733  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.119879  8575 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.122494  8430 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:03:53.122745  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.123229 15914 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:53.123456  8434 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:53.123172  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:53.124818  8426 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:53.126906 15042 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.127390 15042 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.122740  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.073578 15869 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:53.138388 15997 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:03:53.137943  8575 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:53.129460 15941 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260709 13:03:53.222447  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:53.254606  8576 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 25.
I20260709 13:03:53.193078 15042 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:53.167766  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.238701  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:53.139747  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 83400.6us
W20260709 13:03:53.197279  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 71397.8us
W20260709 13:03:53.187472  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53176.7us
I20260709 13:03:53.259624  8506 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:53.259583  8549 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.260362  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:53.262979  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:53.266674  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.277741  8429 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:53.289152  8426 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:53.240603 15893 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.129328 15866 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.191963 15898 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.124063 15476 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:53.081883 15796 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.300051 15042 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.191785 15673 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:53.124291 15881 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:53.298576 15859 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:53.304593  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:53.152594 15987 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.153s
I20260709 13:03:53.191148 15959 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:53.265157 15794 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:53.274603 15924 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:53.310000 15042 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.290597 15860 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:53.140074 15951 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:53.291407 15955 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:53.335137 15955 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.335083 15951 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.335700 15955 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:53.337365 15951 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.293978 15829 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.339960  9102 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:53.126255 15963 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.341746 15963 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.262833 15869 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:53.326453  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.317899 15941 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.328353 15042 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.312690 15476 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.320624 15881 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.310972 15898 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.318994 15859 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:53.320186 15826 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:53.320691  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:03:53.370401  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 49904.7us
I20260709 13:03:53.298254 15900 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:03:53.326944  8504 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:53.226528 15901 consensus_queue.cc:260] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:53.305716 15866 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.316931 15896 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:03:53.366041  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.377699  8503 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 23: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:53.368449  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.378924  8506 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
W20260709 13:03:53.374248  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 98218.7us
I20260709 13:03:53.374047 15826 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:53.380831 15826 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.381274 15881 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.385582 15866 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:53.381167 15476 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:53.389886  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:53.370152 15893 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:53.325922 15959 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:53.391537  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:53.393177 15774 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.386454 15859 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.407168  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:53.394764  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:53.408007  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:53.408763 15774 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 26 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.396643 15898 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:53.381307 15869 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:53.399585 15476 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:03:53.399139  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.402721  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:53.403328  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:53.427737  8581 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:53.428246 15869 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:53.428917  9102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 1661) took 1923 ms (client timeout 2167 ms). Trace:
W20260709 13:03:53.429370  9102 rpcz_store.cc:269] 0709 13:03:51.505297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.505461 (+   164us) service_pool.cc:224] Handling call
0709 13:03:53.428762 (+1923301us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54005d2d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:53.428861 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4157915392}
I20260709 13:03:53.429845  8507 raft_consensus.cc:1275] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:03:53.404568  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:53.405488  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:53.405753  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:53.407066  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:53.409057  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.409307 16001 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:53.409585  8577 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:53.394179  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:53.432729  8505 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:53.374812 15673 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:03:53.438373  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.439224  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.439867 15959 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:53.440914 15969 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.441401 15969 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.443507 15969 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:53.440689 15976 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:53.444895  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.394857 15878 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:53.417534 16006 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:03:53.419166  8502 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:53.413487  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.415740  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.363632 15941 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:53.446693  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.466507  8433 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:53.408049 15859 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:53.451090  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 52006.4us
I20260709 13:03:53.453092  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:53.454454  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:53.461711  8426 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:53.470561  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:53.491881  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:53.493920  8581 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:53.494016  9068 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:53.494812  8431 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.495880  8435 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
W20260709 13:03:53.489164  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.497448  8583 raft_consensus.cc:2393] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 25: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:53.497530  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.472887  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.501318  8428 raft_consensus.cc:1275] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:53.491827  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.474560  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.488663  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:53.504055  8502 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:53.504879  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:53.508692  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.510782 15042 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:53.511189 15042 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.511492 15042 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.511791  9068 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:53.507612  8432 raft_consensus.cc:2376] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19. Re-sending same reply.
I20260709 13:03:53.513193  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:53.514151 15951 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:53.447990 15976 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 23 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:53.514817 15951 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.515462 15951 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:53.515918 15976 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:53.522855  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:53.523128  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50356.8us
I20260709 13:03:53.525234  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:53.525059  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:53.525908  8502 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:03:53.504582  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:53.533790  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 129303us
I20260709 13:03:53.461575 15866 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:53.539700  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.547533  8581 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:53.548337  8431 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:53.474659 15860 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:53.550146 15888 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:53.474082 15881 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
I20260709 13:03:53.550606 15888 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.550994 15888 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:53.549715 15860 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:53.554244 15860 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:53.554301 15971 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:53.554968 15881 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:53.554917 15971 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:53.557441 15971 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:53.605219  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 80267.8us
I20260709 13:03:53.563077  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.624300  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:53.625072  8581 raft_consensus.cc:2393] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 20: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:53.562753  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:53.626775  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 80882.4us
I20260709 13:03:53.492784 15952 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:53.660683  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.630716  8430 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:53.646003  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.632705  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:53.721303  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 75401.5us
I20260709 13:03:53.666821  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:53.670259  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.630508  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:53.647307  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.722180  8475 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.631004  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:53.730096  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 63285.2us
I20260709 13:03:53.736744  8502 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 26.
W20260709 13:03:53.561904 16005 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:03:53.738314  9065 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:53.738941  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 113422us
I20260709 13:03:53.740175  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:53.742581  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.604846 15476 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:03:53.729620 15959 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.673542 16001 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:03:53.746510 15983 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:53.721760 15790 consensus_meta.cc:287] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.782s	user 0.010s	sys 0.001s
I20260709 13:03:53.546162 15866 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.605655 15791 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:53.579125 16003 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.764690  8475 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 2.167s (SENT) [suppressed 25 similar messages]
I20260709 13:03:53.764669 16003 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:53.767324 16003 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.762661 15959 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:53.774439 15959 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.775238 15959 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:53.762562 15790 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.764194 16011 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.769254 15775 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.754096 15952 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.539343 15829 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:53.774657 15831 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:53.763142 15476 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.668380 15896 consensus_queue.cc:1048] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 13:03:53.774408 15866 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.630231 15971 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:03:53.793771  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 271022us
I20260709 13:03:53.665298 15796 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.727828 15854 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:53.789803  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.791297  8502 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:53.743273  8400 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:53.743538 15042 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.750881 15881 raft_consensus.cc:2804] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:03:53.751176 15898 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:53.791888  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 251756us
I20260709 13:03:53.655589 15797 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 13:03:53.789345 15831 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:53.786769 15829 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.825822  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.797729  8432 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:53.809463  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:53.826855  8508 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.827630  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:53.791410 15883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.000s	sys 0.014s
I20260709 13:03:53.811457 15987 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:03:53.815343  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 72192.3us
I20260709 13:03:53.834869  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:53.656174 15935 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.151s
I20260709 13:03:53.816529 15042 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:53.802183  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:53.824542  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:53.830494  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.844015  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:53.794775 15971 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:53.849224  8505 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:53.849525  8507 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
W20260709 13:03:53.851131  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 55124.3us
W20260709 13:03:53.831599 15883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.014s
I20260709 13:03:53.812914 15898 raft_consensus.cc:697] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:53.791219 16011 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.822419 16003 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:53.831693 15829 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:53.826409 15881 raft_consensus.cc:697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:53.795161 15476 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:53.864539 15955 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.000s
I20260709 13:03:53.887185  8431 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 23: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:53.849555 15971 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:03:53.883915  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.865587 15891 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:03:53.892915  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 128247us
I20260709 13:03:53.899021 15042 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:53.849218 15673 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:53.965360 15042 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:53.965920 15042 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:53.965783  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:53.966288  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 66066.9us
I20260709 13:03:53.966766  8504 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 26.
I20260709 13:03:53.968267  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.975700 15891 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:03:53.967582 16012 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:03:53.887867 15941 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:53.984988 15042 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.987823  9068 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:53.990370 15796 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:53.990911 15673 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:53.991631 15952 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:53.992347 15952 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:53.992735 15952 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.993062 15952 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:53.990378 15042 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.010017  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:54.025749  8508 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:53.891786 15955 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.059734 15042 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:53.986244 15774 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:03:54.072284  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 62344.7us
W20260709 13:03:54.072320  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 169798us
I20260709 13:03:53.965794 15947 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
W20260709 13:03:54.077646  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 224264us
W20260709 13:03:54.077895  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 243109us
I20260709 13:03:54.078413  8550 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:54.104372  8475 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:54.105329  9068 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:54.106295 15042 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:53.975020 15878 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 13:03:54.021984 15854 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.126196  8400 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:54.140302  8575 raft_consensus.cc:1240] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:03:54.128559 15791 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.145074 15791 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:54.073640 15859 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.148645 15960 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.988713 16016 consensus_queue.cc:1048] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.146s
I20260709 13:03:53.902906 15831 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:54.163117  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.126844 15796 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:54.154647 16013 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 13:03:54.151423 15791 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.200109  8427 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 23: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:54.140139 16017 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.149948 15859 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.201241 15790 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.168169 15960 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.206388 16014 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:54.216728 16014 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.217458 15960 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.195466 15794 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:54.218933 16014 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.201730 16008 raft_consensus.cc:3055] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:54.219460 16008 raft_consensus.cc:740] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:54.220090 15951 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.002s
I20260709 13:03:54.072592 15881 consensus_queue.cc:237] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.220281 16008 consensus_queue.cc:260] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.220525 15951 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:54.189484  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 85233.8us
I20260709 13:03:54.157922 15774 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:54.196501 15893 consensus_meta.cc:287] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.000s
I20260709 13:03:54.166742 16003 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:54.200085 16020 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 13:03:54.022677 15898 consensus_queue.cc:237] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.199137 16022 raft_consensus.cc:2804] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:54.202592 15955 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.212949 16033 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:54.153259 15854 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.200937 16011 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:54.241722 15914 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 1.118s	user 0.012s	sys 0.001s
W20260709 13:03:54.245242 16006 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:54.256443 15987 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.198124 15796 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:54.327757  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.335664  8576 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:54.336606  8584 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:54.305146 15960 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.337582 15987 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:54.344826 16026 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:03:54.345283 15987 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:54.311491 15897 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:54.323045 16022 raft_consensus.cc:697] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:54.262871 15774 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.302181 16003 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:54.251314 16017 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.338835 16035 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.340770 15914 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.364326  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:54.365891 15042 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:54.373180 15042 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.342338 16016 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:54.255455 15891 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.377643  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:54.354426 15476 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.389137  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:54.392366  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.394098  9102 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:03:54.394840  9094 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:54.399015  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:54.399919  8433 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:54.404791  9095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856"
dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
mode: GRACEFUL
new_leader_uuid: "0b9f7467deed4381835a85ffd0e88af6"
 from {username='slave'} at 127.0.0.1:45968
I20260709 13:03:54.376459 16032 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.376718 15951 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.415795  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:54.376281 16030 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:54.348302 15960 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.378674 15941 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:54.409685 16014 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.420536 16042 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:54.447527 16042 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.450326  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:54.451007  8428 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:54.451977  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:54.452361 15854 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.453063  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:54.362216 15897 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.454308 16022 consensus_queue.cc:237] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.459347 16003 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.461480 16017 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.463349 15897 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.390264 16016 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.466391 15960 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.467974 16016 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.468621 16030 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.449752 16042 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.397326 15878 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.386740 15914 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.421983  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.476074  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:54.481685  8577 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:54.482465  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:54.436425 15941 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:54.486093 15941 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:54.487180  8434 raft_consensus.cc:1240] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:54.446040 16014 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.489531 16014 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.446858 15859 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.490510 15955 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:54.491439 16033 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.491935 16033 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.492089 15878 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.441164 15774 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:54.432202 15888 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.881s	user 0.010s	sys 0.000s
I20260709 13:03:54.495301 15888 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.497421 15888 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:54.423134 15673 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.497859 15901 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:03:54.498147 15673 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.500735 15673 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.501380  9098 raft_consensus.cc:2368] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21.
I20260709 13:03:54.502372  9095 raft_consensus.cc:606] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Received request to transfer leadership to TS 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:54.502723  9095 raft_consensus.cc:614] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:54.417927 16032 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.505420 16030 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.476423  9094 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:54.508862  8434 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:54.508965 15960 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:54.516340  8579 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:54.519208  8579 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:54.519806  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.521700  8578 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:03:54.523888  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.509171  8428 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:54.524533  8580 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:03:54.528012  8580 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:54.533018  8428 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
W20260709 13:03:54.445083 15959 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.001s
I20260709 13:03:54.435510 15796 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.386463 16035 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.636348 16035 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.564266  8400 leader_election.cc:400] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21.
W20260709 13:03:54.557364  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.636874  8400 leader_election.cc:403] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:54.533903 15826 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:54.546682 15976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.007s	sys 0.029s
W20260709 13:03:54.637341  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 73251.1us
W20260709 13:03:54.637703 15976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.015s	sys 0.042s
W20260709 13:03:54.599715 15952 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.000s
I20260709 13:03:54.638443 15952 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:54.639307 16030 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:03:54.640583 15952 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.642647  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.643038  8430 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:54.625736 15987 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.644146 15959 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:54.644891 15987 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:54.645481  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:54.615093  8547 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:54.646195 15959 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:54.646756 15959 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:03:54.647099 15959 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.647425 15959 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:54.647629 15987 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:54.648320 15987 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.648903 15987 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.650732  9095 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:03:54.651221 15914 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.652056  9098 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 13:03:54.653012  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.653590  9100 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:54.654417  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.656126  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:54.656463 15829 consensus_meta.cc:287] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.757s	user 0.009s	sys 0.001s
I20260709 13:03:54.657246  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:54.657060 15829 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:54.658404 15775 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.000s
I20260709 13:03:54.658568  8576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 2991) took 1269 ms. Trace:
I20260709 13:03:54.659022  8576 rpcz_store.cc:276] 0709 13:03:53.389109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.389561 (+   452us) service_pool.cc:224] Handling call
0709 13:03:54.658427 (+1268866us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54001a2f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:54.658517 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1977484160}
I20260709 13:03:54.660148  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.660266 16003 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.661417  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.661022 16003 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.662253 15947 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.662910 15947 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.666199  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:54.666350  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:54.667050  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.667205  8431 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:03:54.667795  8580 raft_consensus.cc:2393] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:54.668582  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:54.669065  8580 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:54.670413  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.671104  8431 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:54.671564  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:54.672152  8579 raft_consensus.cc:3060] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:03:54.673635 16004 log.cc:927] Time spent T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.587s	user 0.013s	sys 0.009s
I20260709 13:03:54.674227 15960 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:54.674506  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.674923  8583 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:54.675096  8582 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 23.
I20260709 13:03:54.675571  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1678) took 1820 ms. Trace:
I20260709 13:03:54.675923  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:54.676502  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.677281  8583 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:54.676000  9096 rpcz_store.cc:276] 0709 13:03:52.854717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.880990 (+ 26273us) service_pool.cc:224] Handling call
0709 13:03:52.886522 (+  5532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.886837 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.886863 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:52.892417 (+  5554us) log.cc:844] Serialized 26 byte log entry
0709 13:03:53.003572 (+111155us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:03:53.054316 (+ 50744us) log.cc:844] Serialized 14 byte log entry
0709 13:03:53.054603 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.054711 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.343975 (+1289264us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b180036baa0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:03:54.415238 (+ 71263us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:54.675358 (+260120us) raft_consensus.cc:1685] finished
0709 13:03:54.675379 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.675513 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14715,"prepare.queue_time_us":51640,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":3233,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":20963,"spinlock_wait_cycles":108078848,"thread_start_us":106865,"threads_started":1,"wal-append.queue_time_us":191090}
I20260709 13:03:54.678651  8583 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:54.678658  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:54.679736 15829 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:54.680105 15796 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:54.680362 15930 raft_consensus.cc:3055] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:54.680703 15796 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:54.681617 15796 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.684791  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:54.687017  9099 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:54.693917  8430 raft_consensus.cc:2393] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 23: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:54.696314  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:54.697089  8502 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:54.698765  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:54.699759  8508 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 20: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:54.702301  8576 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 23.
I20260709 13:03:54.700734  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:54.677192  8582 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:54.511899  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1518) took 1063 ms. Trace:
I20260709 13:03:54.534394 15859 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:54.508754 15866 consensus_meta.cc:287] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.708s	user 0.005s	sys 0.005s
I20260709 13:03:54.507076 16032 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.537540 16033 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.512286 15878 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:54.624894 15971 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.000s
I20260709 13:03:54.690454  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:54.709654  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.712457  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:54.726907  8505 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:54.726998  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.712972  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:54.707409  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:54.729168  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:54.729728  9095 raft_consensus.cc:3060] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:54.731386  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.732743  8580 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:54.732909  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.734330  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.734438  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.734709  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.735621  8582 raft_consensus.cc:2393] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 20: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:54.735771  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.735855  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.736105  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.736457  8583 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:54.704538  8429 rpcz_store.cc:276] 0709 13:03:53.448164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.448280 (+   116us) service_pool.cc:224] Handling call
0709 13:03:53.498504 (+ 50224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.498700 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:03:53.498948 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:03:54.340374 (+841426us) spinlock_profiling.cc:243] Waited 8.97 ms on lock 0x7b18001141c0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16234e07 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a18ed920b 00007f1a18eded23 00007f1a18edf23a 00007f1a19349a2a
0709 13:03:54.511322 (+170948us) log.cc:844] Serialized 14 byte log entry
0709 13:03:54.511558 (+   236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.511622 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:54.511677 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.511743 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.511846 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":373,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":28668,"spinlock_wait_cycles":481034624,"thread_start_us":170171,"threads_started":1,"wal-append.queue_time_us":1014872}
I20260709 13:03:54.736688  8576 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:54.737293  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.738394  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:54.739084  8580 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:54.739404  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:54.740284  8580 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 13:03:54.740414  8504 raft_consensus.cc:2393] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:54.721556  8579 raft_consensus.cc:2468] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 26.
I20260709 13:03:54.740875  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:54.741127  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:54.742065  8506 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:54.743278  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.758328  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.759063  8583 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:54.745797  9097 raft_consensus.cc:2393] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:54.747434  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.762372  8579 raft_consensus.cc:2393] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 22: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:54.748359  8550 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:54.736609  9098 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:54.764967  9068 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:54.766592  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.680723 15930 raft_consensus.cc:740] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:54.563315 15860 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.176s
W20260709 13:03:54.768455  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 78096.6us
I20260709 13:03:54.769696  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.778605  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:54.724728 16017 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.770691  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:54.770861  8508 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:03:54.766861  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:54.791783  8503 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 24: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:54.775591  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:54.779551  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 200303us
I20260709 13:03:54.793970  8506 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:54.725996 15976 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:54.769863  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:54.795130  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:54.796252  8580 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:54.796463  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.796751  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:54.797140  8579 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:54.798722  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.797331  9093 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:54.780692  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:54.781039  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.801014  8576 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:54.777681  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:54.801753  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 53645us
I20260709 13:03:54.801862  8582 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:03:54.787653  8502 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:03:54.803532  8505 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:54.804869  9097 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:03:54.811080  9097 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:54.812454  9095 raft_consensus.cc:2410] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:03:54.814797  9096 raft_consensus.cc:2393] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:54.802956  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:54.815004  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.759343 16033 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.746938 16014 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.818243  9065 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:54.821893  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:54.816073  8583 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:54.747798 16035 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:54.833370  9097 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:54.823254  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:54.834805  9095 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 17. (term mismatch)
I20260709 13:03:54.835201  9095 pending_rounds.cc:85] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 16
I20260709 13:03:54.835420  9095 pending_rounds.cc:107] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 19.17
I20260709 13:03:54.835654  9095 raft_consensus.cc:2889] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:54.837080  9095 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:54.767642 16032 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:54.767876 15878 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:54.838217 15878 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.838866  8580 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:54.840579 15878 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:54.841311 15878 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:54.775884 15952 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:54.775795 15881 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:54.712854 15866 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.843374  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:54.827405 15935 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.022s	sys 0.011s
I20260709 13:03:54.813663 16022 raft_consensus.cc:2764] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:03:54.746706 15971 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:54.848106  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 69087.5us
I20260709 13:03:54.818071 15903 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:54.866190  8506 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:54.775662 16019 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.074s
I20260709 13:03:54.848963  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:54.870429  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 106518us
I20260709 13:03:54.841763 15878 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.797293 16051 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:54.860651  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.813856 15947 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.798013 15976 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:54.847131 15941 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.813346 15790 consensus_queue.cc:1059] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
W20260709 13:03:54.868201 15935 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.022s	sys 0.011s
I20260709 13:03:54.887301  9102 raft_consensus.cc:2368] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20.
I20260709 13:03:54.823205 16052 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:54.843518 15955 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:54.890460  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.890612  9093 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
W20260709 13:03:54.886134  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 85529.5us
I20260709 13:03:54.885419  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:54.894115  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.891470  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:54.882586  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 104056us
I20260709 13:03:54.867561 15881 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.895684  8435 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 26.
I20260709 13:03:54.814781 16017 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.876801 15952 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.833963 16011 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:03:54.831964 16033 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:54.898240  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 128440us
I20260709 13:03:54.824532 15898 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:03:54.921607  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.947289  9101 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:03:54.888433 15878 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:54.934384  9097 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:54.949604  9097 raft_consensus.cc:1240] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:03:54.867707 16035 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.936718  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.879238 16055 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:54.959460  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:54.960145  9101 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:54.962070  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.962771  8579 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
W20260709 13:03:54.941216  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 55882.1us
W20260709 13:03:54.941527  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53452us
I20260709 13:03:54.963886  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:54.889539 15976 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:54.893801 15869 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:54.844182 16014 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.935233  9095 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:54.954468  9093 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:54.865890 16032 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:54.941126 15881 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:54.966591 15969 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.967165 15969 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:54.969481 15969 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.946637 15959 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:54.970923  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:54.971836  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:54.972309 15959 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:54.972611 15963 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:54.973696 16057 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:54.975278 16035 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:54.975623 16062 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:03:54.981470  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 3043) took 1155 ms. Trace:
W20260709 13:03:54.981812 16061 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:03:54.981876  8435 rpcz_store.cc:276] 0709 13:03:53.826533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.827353 (+   820us) service_pool.cc:224] Handling call
0709 13:03:54.981231 (+1153878us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540025a8d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:54.981373 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454488320}
I20260709 13:03:54.984265  8581 raft_consensus.cc:1275] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:03:54.875350 16047 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:03:54.985906 15971 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:54.985948 15893 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.931818 15955 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.987257 15955 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:54.987202 15893 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:54.894447 16051 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:54.993032  8584 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46464 (request call id 1320) took 1874 ms (client timeout 1729 ms). Trace:
I20260709 13:03:54.993290  8578 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:03:54.993481  8584 rpcz_store.cc:269] 0709 13:03:53.118597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.118728 (+   131us) service_pool.cc:224] Handling call
0709 13:03:54.992833 (+1874105us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400283f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:54.992935 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2798556032}
I20260709 13:03:54.961685  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:54.997032 16003 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:54.997155 15960 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:54.997684 15960 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.998068 15960 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:54.999500 15866 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:54.897416 15941 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.001597  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:55.002650  8582 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:54.934403 15952 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:55.019577 15790 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:55.020370  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:55.034924  8502 raft_consensus.cc:2393] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 24: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:54.951078 15774 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:54.949370 15829 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:55.034942  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:55.045159  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 81362.6us
I20260709 13:03:55.048381  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.049281  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:55.049877  8504 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:55.064927  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 131092us
W20260709 13:03:55.067531  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 66026.7us
I20260709 13:03:55.082984  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:54.963968 15983 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:03:55.050776 15987 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:55.084669  8427 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 1529) took 1521 ms (client timeout 1736 ms). Trace:
W20260709 13:03:55.087868  8427 rpcz_store.cc:269] 0709 13:03:53.563045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.633221 (+ 70176us) service_pool.cc:224] Handling call
0709 13:03:55.084455 (+1451234us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b540025a3d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:55.084609 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102630272}
I20260709 13:03:55.048337 15775 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:55.053313 15959 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:55.083774  8506 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:03:55.052049 16017 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.052167 16001 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:55.052314 15891 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:03:55.092478  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:55.083401 16069 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:55.102909  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:55.104588  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 58568.9us
W20260709 13:03:55.106035 16063 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:55.097579  8504 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:55.052551 15790 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.044739 15869 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:55.068042 15893 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:55.055824 15971 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.094641 15959 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.104172  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.116912  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:55.093298 16066 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:55.126142  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.114816  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.098982 16001 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:55.104070 16069 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:55.121238  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.112124  9065 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:55.128649  8433 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:55.120076  8506 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:03:55.131475  8576 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:55.126006  8549 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:55.125178 15959 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:55.139145  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:55.106295 16003 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:55.098747 16068 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:03:55.142710  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.143118  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.145856  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 2993) took 1744 ms. Trace:
I20260709 13:03:55.147821  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:55.148058  8575 rpcz_store.cc:276] 0709 13:03:53.401699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.401816 (+   117us) service_pool.cc:224] Handling call
0709 13:03:53.402195 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:54.140734 (+738539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.145616 (+1004882us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54000aa0d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:55.145799 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696924032}
W20260709 13:03:55.148706  8432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 1531) took 1585 ms (client timeout 1848 ms). Trace:
I20260709 13:03:55.104635 15829 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:03:55.133487 16001 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:55.134119 15893 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:55.110536 15966 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:03:55.161818  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.135753 16069 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:55.149120  8432 rpcz_store.cc:269] 0709 13:03:53.563748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.631409 (+ 67661us) service_pool.cc:224] Handling call
0709 13:03:55.148554 (+1517145us) spinlock_profiling.cc:243] Waited 69.6 ms on lock 0x7b54003f1e54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:55.148654 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160134528}
I20260709 13:03:55.145856 15987 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:55.126991 15971 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.166904  8502 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 26.
I20260709 13:03:55.145581 15935 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.186470  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.161948 15901 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:55.161203 15860 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:55.221400  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.222453  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:55.163319 15826 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:55.212710  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.162189 16033 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.159248 15774 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:55.227701 15774 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.228657 15960 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.232064 16017 raft_consensus.cc:2764] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:03:55.232285 15960 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.232036  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:55.145762 16035 consensus_queue.cc:1059] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:03:55.149642 16066 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:55.211489  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.148777 16070 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:55.165390 15893 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.220310  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:55.173902 15987 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.226548  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.215294 15901 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.170167 15888 raft_consensus.cc:2804] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:55.238752  8575 raft_consensus.cc:2368] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 26. Current term is 27.
I20260709 13:03:55.220840 15860 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.241034  8432 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 24.
I20260709 13:03:55.213739 16078 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.219884 16014 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.224412 16003 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.245968 16067 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:03:55.220667 15947 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.043s
I20260709 13:03:55.236761  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.225059 15826 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.267441  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.279022  8431 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
W20260709 13:03:55.270072  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 92866.1us
W20260709 13:03:55.246785 16075 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:55.242730 15987 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:55.239305 16070 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.237535 16017 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:55.239244 15893 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:55.222577 16030 consensus_meta.cc:287] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
I20260709 13:03:55.264389  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.223740 15935 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.221051 15869 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.251735 15901 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:55.280997  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.266405 15860 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:55.276746 16003 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.331138  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.300916 15878 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.370769  8427 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:55.376717  9100 raft_consensus.cc:1240] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:03:55.281558 16014 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:55.377648 16014 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.305743 15971 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.377942 15878 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.380329 15952 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.298552 16055 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.381886 16055 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.384476 16055 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.386775 16030 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21.
I20260709 13:03:55.343334 15854 raft_consensus.cc:3055] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:55.335244 15930 consensus_queue.cc:260] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.341930  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.286701  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.341884  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.272148 16078 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.370759  8426 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:55.286864  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.281822 15888 raft_consensus.cc:697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:55.281642 15826 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:55.373356  9095 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:55.374094 15935 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.295470 16066 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.323973 15673 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:55.325139 16027 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:55.288297  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.287724 15790 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.287874 16070 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:55.399336  9094 raft_consensus.cc:1240] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
W20260709 13:03:55.400439  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.417106  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.417737  8583 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:55.419466  8582 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:55.389048  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.394517  9093 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
W20260709 13:03:55.399500  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 165781us
I20260709 13:03:55.387548 15854 raft_consensus.cc:740] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:55.377982 16014 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:55.404894  8550 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.264478 16068 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:03:55.389703  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.445475  8426 raft_consensus.cc:3060] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:03:55.316797 16074 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.003s
I20260709 13:03:55.425452  8400 leader_election.cc:400] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20.
I20260709 13:03:55.308044 16051 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.303755 15831 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:55.304131 16015 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:55.388015 15930 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:55.390112 16078 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:55.456254  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:55.457835  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:55.459964  8426 raft_consensus.cc:2468] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:03:55.469169  8508 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:03:55.469926  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.470321  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:55.464680  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:55.471104  8508 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:03:55.449661  8400 leader_election.cc:403] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:55.466651  8503 raft_consensus.cc:1240] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 25. Current term is 26. Ops: []
I20260709 13:03:55.394241 15952 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:55.455763  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 334159us
W20260709 13:03:55.476329  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 51015.9us
I20260709 13:03:55.478189  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:55.477736  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.470582  8426 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:55.371860 16003 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.415445 15790 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:55.479861 16019 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20.
I20260709 13:03:55.468214 16015 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:55.480080 15790 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.480935 16015 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.482126 16015 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:55.482271 15790 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.447484 15887 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:55.486229 15887 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:55.486626 15887 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:55.487313  8577 raft_consensus.cc:1275] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:03:55.490703  8577 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:55.491897  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:55.495527  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.412926 15476 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.496553 15476 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:55.493772 16052 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.004s
I20260709 13:03:55.499104 16052 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:55.500291 15901 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.415876 15935 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.400803 15903 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.369449 15976 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.386847 15955 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.509047  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:55.515358  8510 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:55.513954  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:55.515766  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:55.333252 15959 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.397269 15673 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.507679  8426 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 27.
W20260709 13:03:55.511878  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.467744 15937 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.522229  8550 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.522675  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.397503 16027 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.520396  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:55.523353  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.524403  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:55.524428  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:55.439908 15881 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.528494  9095 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:55.395310 15888 consensus_queue.cc:237] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.446162 15893 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.445961 15860 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.527175  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.510254 16068 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:55.539933  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:55.540026  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:55.540999  8503 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:55.528645  8506 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:55.532996  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.541663  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:55.542248  8576 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:55.533095  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.533211  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.534194  8505 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:55.534451  8584 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 24: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:55.536110  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.538697  8575 raft_consensus.cc:1240] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: [16.16-16.16]
I20260709 13:03:55.525134  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:55.543754  8579 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:55.551957  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:55.553421  9096 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:03:55.527880 15796 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:55.530635 15774 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:55.513662 15935 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.568849 15935 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.569542  8578 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 24: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:55.529145 15952 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.570295 15952 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.572096  8431 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:55.573223  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:55.573912  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.574751  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:55.575019  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.575723 15878 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:55.576088 15878 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:55.576447 15878 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:55.560644 15774 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:55.577098 15774 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:55.578405 15947 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:55.578616 16083 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:55.579173 16083 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.579491 16083 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:55.580232 15969 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:55.580413  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.580668 15969 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:55.581035 15881 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.581233  8430 raft_consensus.cc:2393] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 22: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:55.582093  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.582656  8430 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:55.514907 15903 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.583753  8577 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:55.535024 16052 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:03:55.585269 16052 raft_consensus.cc:697] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 27 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:55.586138 16052 consensus_queue.cc:237] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.561522  8580 raft_consensus.cc:2393] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 24: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:55.547308 16055 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:55.589059 16055 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:55.589463 16055 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:55.591089 15952 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.537355 16078 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:55.591660 16078 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:55.592022 16078 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:55.535723 15854 consensus_queue.cc:260] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.594090 15878 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.595141 15854 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:55.596176 15878 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.581549 15969 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.597676 15969 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:55.603740 16027 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.540480 16068 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.605141 16068 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:55.562531 15987 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.605695  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 2876) took 1201 ms. Trace:
I20260709 13:03:55.606112  8428 rpcz_store.cc:276] 0709 13:03:54.404331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.452818 (+ 48487us) service_pool.cc:224] Handling call
0709 13:03:55.605539 (+1152721us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b54003f0f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:55.605638 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127671168}
I20260709 13:03:55.607370  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.609476  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.613328  8550 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.614085 15853 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:55.582716 16032 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.555979 16081 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:55.554987  8426 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:55.623471  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.624732  8426 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:55.548452 15869 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:03:55.530692 15937 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.616361  9067 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:55.576107  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.617643  8510 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:55.619050  8430 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:03:55.553670 16019 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:55.650663  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:55.619022  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 56679us
I20260709 13:03:55.653614  8428 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:03:55.620741 15853 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.659898  8507 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:03:55.662011  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 45756.5us
I20260709 13:03:55.625407 16081 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.664574  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:55.666479  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:55.668093  8400 leader_election.cc:400] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 26. Current term is 27.
I20260709 13:03:55.668488  8400 leader_election.cc:403] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 13:03:55.558364 15775 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:03:55.669173  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.670879  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:55.671346  8400 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.672446 15796 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:55.663905 15878 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:55.674584 15983 consensus_queue.cc:1059] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:55.675297 16030 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:55.675625 15983 raft_consensus.cc:3055] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:55.675731 16030 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.676105 15983 raft_consensus.cc:740] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:55.676218 16030 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:55.677088 15983 consensus_queue.cc:260] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.16, Last appended by leader: 16, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.667809 15853 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:55.672204 16014 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.670197 16085 consensus_queue.cc:1059] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:03:55.683550 16085 raft_consensus.cc:3055] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:55.683678 15976 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.683760 16014 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:55.684517 16069 consensus_meta.cc:287] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.001s
I20260709 13:03:55.684916 16069 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.685665 16003 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:55.686149 16003 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.686491 16003 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:55.687068 16070 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.688293  8432 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 21: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:55.651401 15901 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.654016 16082 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:55.665112 15476 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.694379  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.695959  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.716857  8580 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
W20260709 13:03:55.697371  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.698891  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 292579us
I20260709 13:03:55.700727  8426 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:03:55.720883  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.721889  8426 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 23: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:55.700191  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:55.722360  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:55.724098  8550 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.624219 15935 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:03:55.628086 15887 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.727771  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:55.730628  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:55.719362  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:55.735462  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.684545 15878 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:55.669258 16081 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:55.670969 16019 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:55.790992 15959 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.731791 16055 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.795989 16055 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.797008 16019 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.798521  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:55.799297  8502 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:55.800422 16069 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.802866  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:55.814230  8582 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:55.819321  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:55.753623  8507 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 27.
I20260709 13:03:55.739318  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:55.672547 16032 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 26. Current term is 27.
I20260709 13:03:55.700795 15881 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:55.752393  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.743436  8400 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.700224 16085 raft_consensus.cc:740] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:55.632947 15826 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.589803 16083 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.741541 15866 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:55.742122 16035 raft_consensus.cc:2804] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:55.743935 15983 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:55.829418  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:55.829723  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 86358.4us
I20260709 13:03:55.827018 16069 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.757639 15971 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:55.731434 16082 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:55.837481  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 98211.8us
I20260709 13:03:55.741704 15947 consensus_queue.cc:1048] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.093s
I20260709 13:03:55.866712  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:55.867329  9098 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:55.828939 15881 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:55.801659 16027 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:03:55.728451 15796 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.095s
I20260709 13:03:55.827319 15476 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:03:55.829460 15898 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:55.861768  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:55.872474  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:55.841822 16040 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.469s	user 0.006s	sys 0.000s
I20260709 13:03:55.872839  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.882404  8580 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:55.803936 16077 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:03:55.835635 16014 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:55.841626 15878 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:55.857261  8502 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 24.
I20260709 13:03:55.876295  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.853613 15866 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.918886 15866 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:55.919333  9098 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:55.920768  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.892673  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.921810  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.922006  9100 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:03:55.922829  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:55.825764 16022 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.043s
W20260709 13:03:55.900861  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 71534.5us
I20260709 13:03:55.838670 15797 consensus_queue.cc:1048] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:03:55.867081 15971 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.924763 16076 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.924945 15971 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:55.925314 16076 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.926563 16083 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.871392 15955 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:55.927726 16076 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.908281  9093 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:03:55.910315  9096 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 19: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:55.910846  8580 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:55.912250 16032 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:55.931447 16032 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.933384 16032 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.913038  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.873582 15881 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:55.935102  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.898149 15898 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:55.936760 15898 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:55.942348 16071 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.943001 16071 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:55.946722 16022 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:55.894249 15893 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.903599 16085 consensus_queue.cc:260] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:55.913290 16082 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:55.955034 15887 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.957887 15937 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.960990  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.962172  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:55.962989  8434 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 24: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:55.963778  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:55.966235 15941 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:55.967883 15826 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:55.903462 15673 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:55.902503 16014 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.977980 16014 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:55.982501  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.987910  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:55.988696  9095 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:55.914186 16086 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
W20260709 13:03:55.992241  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.829237 16073 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 13:03:56.007004  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.008091  8476 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:55.908998 16091 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:55.990733 15878 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.028054  9095 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:56.020212  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.034150  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:55.997023 15476 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.044790  8503 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:55.875829 16069 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.057881  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.064512  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.065208  8503 raft_consensus.cc:2368] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 23. Current term is 24.
I20260709 13:03:56.054016  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:56.011336 15969 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:56.010581 15831 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:03:56.039623 15878 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:56.069581  8503 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:03:55.901364 15774 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.002646 15673 consensus_queue.cc:1059] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:03:56.028584 16030 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:56.080132  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:03:56.108683 16097 log.cc:927] Time spent T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:03:56.079627 15969 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.086372  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.093153  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:56.134325  9095 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:56.135885  8506 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:56.094864  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:56.138384  9102 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:56.112533  8426 raft_consensus.cc:2410] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 17 because replica has last-logged OpId of term: 16 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 15.
I20260709 13:03:56.008706 15853 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:56.061663 15476 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.114921 15860 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.078467 16070 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.095136  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:56.095793  8505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 1631) took 1076 ms. Trace:
I20260709 13:03:56.150117  8505 rpcz_store.cc:276] 0709 13:03:55.019043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.020904 (+  1861us) service_pool.cc:224] Handling call
0709 13:03:55.021175 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.543228 (+522053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.095521 (+552293us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54003e58d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:56.095726 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179349760}
I20260709 13:03:56.119571 16085 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:56.102519  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:56.070153 16001 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.899s	user 0.011s	sys 0.000s
I20260709 13:03:56.120517 15881 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.125188  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:56.090982  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:56.160389  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.161507  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.132347  8432 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:03:56.165684  8432 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:56.166369  9099 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:56.145460  9095 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 24.
I20260709 13:03:56.127978 16022 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:03:56.127905  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 198553us
I20260709 13:03:56.163546  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:56.180152  9096 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:56.076386 16047 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:56.179139  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:56.183287  8501 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:03:56.171898  9102 raft_consensus.cc:2468] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:03:56.172174  8428 raft_consensus.cc:2368] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22.
I20260709 13:03:56.173465  8432 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:03:56.187276  9099 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 25.
I20260709 13:03:56.185259  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:56.190973  8505 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:56.192016  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.152208 15673 consensus_queue.cc:1243] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:03:56.193367  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.190155  8549 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:56.208950  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:56.212699  9097 raft_consensus.cc:2468] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:56.213177  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.214366  8549 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:56.215700  8549 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:56.191179 15930 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.000s
I20260709 13:03:56.221371  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.083616 16081 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:56.205356 16068 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.004s
I20260709 13:03:56.224408  8506 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
W20260709 13:03:56.219270 16003 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.532s	user 0.001s	sys 0.009s
I20260709 13:03:56.229797  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1537) took 1077 ms. Trace:
I20260709 13:03:56.204942 16022 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:56.189338 15826 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:56.239531  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.205189 15869 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:56.229306 15831 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:56.243935  8506 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:56.253790  8427 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1535) took 1102 ms. Trace:
I20260709 13:03:56.182144 16001 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:56.220638 15937 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:56.205792 16091 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
W20260709 13:03:56.251926  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 424329us
I20260709 13:03:56.252027  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.273723  8510 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:56.274741  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.181628 15941 consensus_queue.cc:1059] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:03:56.233034  8431 rpcz_store.cc:276] 0709 13:03:55.152314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.661021 (+508707us) service_pool.cc:224] Handling call
0709 13:03:55.661421 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:55.661744 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.661770 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:55.669708 (+  7938us) log.cc:844] Serialized 26 byte log entry
0709 13:03:55.729044 (+ 59336us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:56.051917 (+322873us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.060895 (+  8978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.060971 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:56.108111 (+ 47140us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:56.223186 (+115075us) raft_consensus.cc:1685] finished
0709 13:03:56.229608 (+  6422us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.229741 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8177,"prepare.queue_time_us":150758,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":17542,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":59701,"spinlock_wait_cycles":141142272,"thread_start_us":283117,"threads_started":2,"wal-append.queue_time_us":150639}
I20260709 13:03:56.221467 15903 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.237994  9096 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 24.
I20260709 13:03:56.277767  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:56.256372  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.276175  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.278721  8508 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:56.279101  8510 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:56.280059  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.223285 15887 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:56.257792  9094 raft_consensus.cc:2368] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22.
I20260709 13:03:56.190908 16047 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.225864 15893 raft_consensus.cc:2804] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:56.184684  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:56.267995  8433 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:03:56.254179  8427 rpcz_store.cc:276] 0709 13:03:55.151840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.610454 (+458614us) service_pool.cc:224] Handling call
0709 13:03:55.610747 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:55.656522 (+ 45775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.656555 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:55.661577 (+  5022us) log.cc:844] Serialized 26 byte log entry
0709 13:03:55.741222 (+ 79645us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:03:56.253221 (+511999us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.253485 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.253562 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:56.253600 (+    38us) raft_consensus.cc:1685] finished
0709 13:03:56.253610 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.253736 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119349,"prepare.queue_time_us":174043,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":38765,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8013,"thread_start_us":415813,"threads_started":2,"wal-append.queue_time_us":185181}
I20260709 13:03:56.268648  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.285084  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:56.288882  8506 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:03:56.274233  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:56.281939  8549 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:56.298516  9065 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:56.298964  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:56.311578  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.307256  8508 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 25.
I20260709 13:03:56.309746  8435 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:56.317317  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.317483  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:56.317903  8504 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:03:56.318051  8426 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:56.319590  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:56.322847 16015 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:56.293515 15930 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.323625 15937 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:56.323917 15930 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.324564 15937 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.325991 15930 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.326195 15887 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:56.306406 15901 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:56.327064 15901 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.327031 15887 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.329190 15901 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.259296 16071 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:56.335248  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 61094.6us
W20260709 13:03:56.336191  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.337841  8398 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:56.339176  8504 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:56.340790  8435 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:03:56.364604  9065 leader_election.cc:400] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 23. Current term is 24.
I20260709 13:03:56.365054  9065 leader_election.cc:403] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:03:56.360127  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:56.307011 15860 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:56.250959 16003 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:56.378316  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 172189us
I20260709 13:03:56.380065  8475 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.376214  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:56.385123  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.387012  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.335146 15952 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:56.244763 16068 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.273438 15826 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.259848 15869 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.366588 15941 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:56.362399 15983 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:56.418236  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.383109 16066 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:03:56.397396  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 115538us
I20260709 13:03:56.401458 15042 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:03:56.420324  8434 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:56.415913 16071 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:56.376690 16030 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:56.374950 16083 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:56.386771 16019 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:03:56.408084  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 96661.5us
I20260709 13:03:56.446378  8547 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:56.392288 16076 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:56.430696  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:56.392354 15947 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:03:56.385816 15971 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.428956 15941 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.439193  8550 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.395816 15893 raft_consensus.cc:697] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:56.384472 16077 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 23. Current term is 24.
I20260709 13:03:56.543833 16003 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.532140 16108 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:03:56.547482  8431 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 24: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:56.416477 15901 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:56.548723 16014 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.002s
I20260709 13:03:56.549275 16014 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:56.417407 15878 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.419418 15959 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:03:56.552796 16078 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.960s	user 0.007s	sys 0.001s
I20260709 13:03:56.552909 15959 raft_consensus.cc:697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:56.444069  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:56.553994  9093 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:56.416669 15854 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:56.447849  8547 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:03:56.561043  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 113263us
I20260709 13:03:56.561870  8547 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.453403  9094 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:03:56.392582 16073 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:56.414070 15888 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
W20260709 13:03:56.535041  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 80933.5us
I20260709 13:03:56.453231 15922 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:56.453290 15930 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.536099 16071 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:03:56.537222 16106 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:03:56.537941 15971 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:56.458459 15866 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.005s
I20260709 13:03:56.542969 15893 consensus_queue.cc:237] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:56.556137  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 117028us
I20260709 13:03:56.441107 15969 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.445473 16019 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.558336  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.594967 16019 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:56.595281  8504 raft_consensus.cc:2368] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21.
I20260709 13:03:56.442695 16066 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 25 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:56.560093  9097 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:56.564126 16107 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:56.441138 15887 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:56.455366 15853 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:56.396248 16022 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:56.567504  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 172992us
W20260709 13:03:56.612125 16099 log.cc:927] Time spent T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.553s	user 0.000s	sys 0.003s
I20260709 13:03:56.567857  8432 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 24: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:56.615077  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.600816 16001 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:56.617165 15947 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:56.570106  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.625449 15959 consensus_queue.cc:237] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.626431 16014 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:56.626592  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 56650.1us
I20260709 13:03:56.627379  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.628547  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:56.571447 16108 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:56.631481  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.632630  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.629887  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:56.633672  8505 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:56.636024  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.636849  8504 raft_consensus.cc:2368] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 24. Current term is 25.
I20260709 13:03:56.636333  8475 leader_election.cc:400] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22.
I20260709 13:03:56.643043  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:56.643950  8575 raft_consensus.cc:2368] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22.
I20260709 13:03:56.645737  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:56.634727 16027 raft_consensus.cc:2764] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:03:56.630441 16108 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:56.622303 16120 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:56.459753 15774 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:56.531836 15941 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:56.553669 15476 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.568578 15881 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:56.568691 16103 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.602556  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:56.570881 15797 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.011s
W20260709 13:03:56.603406 16109 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:03:56.605695 16068 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.456571 16114 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.145s
I20260709 13:03:56.606925 15937 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:56.608793 15898 consensus_meta.cc:287] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.001s
I20260709 13:03:56.619529 15947 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:56.557827 16078 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.582211 15922 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:56.620711 16095 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.544s	user 0.004s	sys 0.000s
I20260709 13:03:56.621340 15826 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.621523  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 3063) took 1217 ms. Trace:
I20260709 13:03:56.622283 16047 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.591948 15866 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.587378 15896 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:56.625051  8507 raft_consensus.cc:1275] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:03:56.587906 15930 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.649638  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:56.650899  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:56.712219  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 117323us
I20260709 13:03:56.652906  8505 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:03:56.653306  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:56.716665  9096 raft_consensus.cc:2368] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21.
I20260709 13:03:56.534246 16076 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:56.655419  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:56.721103  9097 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:56.662885  8504 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
W20260709 13:03:56.695037 16035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.013s	sys 0.006s
W20260709 13:03:56.665354  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.667763  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:56.634313  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 72521.7us
I20260709 13:03:56.724677  9099 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:56.641041 15790 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:56.673594  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:56.674073  9100 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
W20260709 13:03:56.678926  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.596562 16066 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.687928  8581 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:03:56.745546  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:56.745669  9099 raft_consensus.cc:1240] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 13:03:56.746151  8581 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:03:56.747107  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:56.747684  8581 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:56.748039  9099 raft_consensus.cc:1275] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
W20260709 13:03:56.691606  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.639597 16110 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:03:56.693565  8476 leader_election.cc:400] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22.
I20260709 13:03:56.756299  8476 leader_election.cc:403] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:56.704059  8430 rpcz_store.cc:276] 0709 13:03:55.404475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.116974 (+712499us) service_pool.cc:224] Handling call
0709 13:03:56.117238 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.369157 (+251919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:56.369190 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:56.369246 (+    56us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:03:56.369281 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.621318 (+252037us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400290ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:56.621362 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.621472 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578837888}
I20260709 13:03:56.757710  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:56.760529  8475 leader_election.cc:400] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22.
I20260709 13:03:56.639969 16071 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:56.721993  8504 pending_rounds.cc:85] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 12
I20260709 13:03:56.767514  8504 pending_rounds.cc:107] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:03:56.767864  8504 raft_consensus.cc:2889] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.687740 15947 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:56.681813 16103 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.703876 15987 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.742890 15896 raft_consensus.cc:697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:56.734658 15901 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:56.736649 15866 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:56.690959 15898 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:56.739676  9098 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:56.740183 16078 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:56.687886 15937 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.755026 15826 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:56.743646  9101 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:03:56.751689  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:56.764804  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 77662.1us
I20260709 13:03:56.769922  9097 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:03:56.773485  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 80132.3us
W20260709 13:03:56.724344 16035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.013s	sys 0.006s
I20260709 13:03:56.725379 16125 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:56.780972 16081 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:56.812788  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.813596  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.814890  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.815922  8506 raft_consensus.cc:2393] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 24: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:56.788648  8435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60094 (request call id 3053) took 1638 ms. Trace:
I20260709 13:03:56.816608  8435 rpcz_store.cc:276] 0709 13:03:55.150451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.150697 (+   246us) service_pool.cc:224] Handling call
0709 13:03:56.788474 (+1637777us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400021054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:56.788589 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2634237696}
I20260709 13:03:56.789851 15869 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:56.791285  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:56.792287  8398 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:56.793879 16122 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:03:56.794852 16116 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.258s	user 0.002s	sys 0.000s
I20260709 13:03:56.748411  9099 pending_rounds.cc:85] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 10
I20260709 13:03:56.833155  8398 leader_election.cc:400] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21.
I20260709 13:03:56.833223  9099 pending_rounds.cc:107] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:03:56.833652  8398 leader_election.cc:403] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:03:56.833873  9099 raft_consensus.cc:2889] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.764518 15476 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.820644  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.742654 16076 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:56.764788 15881 consensus_queue.cc:1059] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:03:56.776769 16114 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22.
I20260709 13:03:56.835134  8507 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:56.821918  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:56.836580  9065 leader_election.cc:400] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 24. Current term is 25.
I20260709 13:03:56.841192  9065 leader_election.cc:403] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:03:56.767380 16071 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:56.836860  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:56.844139  8510 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:56.821405 16125 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.855242  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:56.859642  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:56.861052  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:56.861377  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:56.862087  8581 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:03:56.820464 16035 raft_consensus.cc:697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:56.777787 16019 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:56.836360 16078 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:56.869664  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:56.875506  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:56.878238  8581 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:56.880780  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:56.839962 15969 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:56.840354 16014 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21.
I20260709 13:03:56.841023 16047 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:56.881379  8577 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:56.850256 16030 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:56.829959 15826 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.870935 15888 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:56.847208 15476 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.901418  8581 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:56.866055 16127 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 24. Current term is 25.
I20260709 13:03:56.864995 16125 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:56.877249 16078 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:56.919472 15930 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.901769 16047 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:56.921082  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:56.987730  9099 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:56.924585 16035 consensus_queue.cc:237] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.929325 15937 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:56.929401  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:56.990322  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.991047  8581 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 22: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:56.931245  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:56.992087  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:56.835757 15947 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.883526 16082 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:03:56.939636  8577 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
W20260709 13:03:56.940580  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.940281 15941 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:56.941803 15903 raft_consensus.cc:3055] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:56.999786  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:56.943414 15901 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.934508 16030 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:56.868141 16001 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:03:56.989843  8504 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:03:57.015601  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:57.016970  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:56.992514  9097 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:56.997287  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.019104  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:56.879724 16121 consensus_queue.cc:1048] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.113s
I20260709 13:03:56.884145 15866 consensus_queue.cc:1059] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:03:57.002506  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:56.992087  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:03:56.993043 16052 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.004s	sys 0.007s
I20260709 13:03:56.993162 16078 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:57.019285  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:57.031733  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:57.000321 16127 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:03:57.030256 16134 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:57.035900  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:57.030563 15866 raft_consensus.cc:3055] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:57.027691  8582 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:57.015939 15930 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.052495 16069 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.052699 15930 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:57.018887 15901 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.055104 15930 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:57.055203  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:57.024248 15937 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:57.056104 15901 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.056371  8433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2883) took 1834 ms. Trace:
I20260709 13:03:57.056768  8433 rpcz_store.cc:276] 0709 13:03:55.221907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.983563 (+761656us) service_pool.cc:224] Handling call
0709 13:03:55.983894 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:56.311108 (+327214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.056151 (+745043us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54003f2d54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:57.056320 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652817664}
I20260709 13:03:57.057711 15826 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.057837  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:57.058163 15869 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:57.058629  8433 raft_consensus.cc:2368] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 22. Current term is 23.
I20260709 13:03:57.059093 16019 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:57.058776 15869 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:56.898550 15896 consensus_queue.cc:237] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:57.059617  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:57.061082 15869 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:57.061410  8433 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:03:57.061704 16103 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.062181 16047 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:57.063444  8432 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:57.003271 15903 raft_consensus.cc:740] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:57.011901 15971 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:57.080296  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:57.081104  8510 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:57.075453  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:57.085835  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:57.027205 16085 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:57.033252  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:57.090790  8430 raft_consensus.cc:2368] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21.
W20260709 13:03:57.031383 16052 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.005s	sys 0.008s
I20260709 13:03:57.024394 15987 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:57.031637 16139 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:57.041755  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:57.111950  8581 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:57.113101  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:57.040936  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 159750us
I20260709 13:03:57.044677 16048 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:57.045590  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.026715 15947 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:56.899569 16071 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.046406 16030 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:57.048653 15898 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:57.049685 15941 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:57.050338 15866 raft_consensus.cc:740] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:57.128459 15866 consensus_queue.cc:260] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.051478  8434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52386 (request call id 1546) took 1834 ms. Trace:
I20260709 13:03:57.130185  8434 rpcz_store.cc:276] 0709 13:03:55.217090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.964593 (+747503us) service_pool.cc:224] Handling call
0709 13:03:55.964878 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.429423 (+464545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.051267 (+621844us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54003f0a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:57.051427 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1047018880}
I20260709 13:03:57.055989 15937 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:57.133572 15937 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:57.055994  8431 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 21: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:57.025974  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:57.068889  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:57.159531  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 133635us
W20260709 13:03:57.031091 16131 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:03:57.030262 16083 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:57.023569  8435 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:57.120222 16128 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:57.015632 16068 consensus_queue.cc:1059] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:03:57.091989  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:57.092252  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.177491  8433 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:03:57.178650  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.180190  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.092758  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.182891 15869 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.183596 15869 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.100467  8510 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:03:57.103096 16141 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:03:57.103066  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:57.066867 16127 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.103820 16055 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:57.107580  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:57.108026  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:57.123297 16139 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.123864  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.028156  8577 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
W20260709 13:03:57.199174  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 91676.4us
I20260709 13:03:57.136407 15866 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:57.149421 16019 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:57.152716 16069 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.153352 16071 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:57.087987 15476 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.208084  9094 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:03:57.134133 16136 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.139s	user 0.004s	sys 0.000s
I20260709 13:03:57.088624 15971 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:57.155795 15987 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.196022 16145 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:57.173398  9068 leader_election.cc:400] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 22. Current term is 23.
I20260709 13:03:57.173267  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:57.215127  9068 leader_election.cc:403] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:03:57.175506 16128 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.205471  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.223659  8577 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:57.112458 15903 consensus_queue.cc:260] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.169792  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:57.226199  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 53062.8us
I20260709 13:03:57.191942 16003 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:57.089481  8507 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 20: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:57.191565  9097 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:03:57.230379  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:57.215448  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.217758 16121 raft_consensus.cc:3060] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:57.218791  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.236402  8576 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:57.221958 16139 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.208438 16019 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.222554 15869 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:57.223203  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:57.240198  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.227438  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:57.234531  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:57.235481  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 63496.8us
I20260709 13:03:57.209136 15941 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:57.175005 16083 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.245254  8576 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:03:57.248885  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:57.249007  9068 leader_election.cc:400] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21.
I20260709 13:03:57.249476  9068 leader_election.cc:403] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:03:57.228442 16128 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:57.203215 16055 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.229681 16068 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:57.253345  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:57.208315 16069 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.240161 16003 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 21 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:57.247501 16066 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:57.267493  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:57.267484  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.250710 16139 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:57.269766  9101 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:57.255620 15888 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.016s
I20260709 13:03:57.274343 16083 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:57.271322  8577 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:57.230168 16145 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.293520  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.270659 16139 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:57.268754 15790 consensus_meta.cc:287] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.514s	user 0.013s	sys 0.001s
I20260709 13:03:57.295288 15878 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:57.295652 15987 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.298107 15971 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:57.298727  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 218986us
I20260709 13:03:57.299523  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 2053) took 1208 ms. Trace:
I20260709 13:03:57.299837  9095 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:03:57.269567 16066 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:57.291941 16068 raft_consensus.cc:2764] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:03:57.329941  8547 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:57.251982 16125 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.302438  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.340304  8583 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:57.302556 15898 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.302919  8578 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 3018) took 1610 ms (client timeout 1627 ms). Trace:
I20260709 13:03:57.305891  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:57.342455  9101 raft_consensus.cc:2393] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 24: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:57.306941  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:03:57.342144  8578 rpcz_store.cc:269] 0709 13:03:55.692126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.692275 (+   149us) service_pool.cc:224] Handling call
0709 13:03:57.302740 (+1610465us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400283a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:57.302864 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3403308288}
I20260709 13:03:57.307667 16047 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.308844  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:57.240832 15896 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:03:57.313179  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:57.312026  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 564453us
I20260709 13:03:57.349334  9100 raft_consensus.cc:2393] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:57.316322  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.352010  8577 raft_consensus.cc:1240] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: [16.11-18.12]
I20260709 13:03:57.251657 15869 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:03:57.314805  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:57.317320  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.326124  9093 rpcz_store.cc:276] 0709 13:03:56.091491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.094869 (+  3378us) service_pool.cc:224] Handling call
0709 13:03:57.299321 (+1204452us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54002b8c54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:57.299467 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929094400}
I20260709 13:03:57.354516  8579 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:57.343653 16100 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 1.248s	user 0.000s	sys 0.004s
I20260709 13:03:57.302166  9099 raft_consensus.cc:2410] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:03:57.334096 16081 raft_consensus.cc:3055] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:57.295326 16055 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:57.350481 16143 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:03:57.343806  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:57.366955  9096 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:57.368134  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:57.368871  9096 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:57.319101 16139 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:57.339705  8547 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:57.342630  8581 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: []
I20260709 13:03:57.312012 16159 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:57.371774  8581 raft_consensus.cc:1240] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:03:57.322460 15790 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:57.330782 16066 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:57.350682  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:57.373945  9096 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:03:57.375140  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:57.300943  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.346642 16008 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:57.360560  8578 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:03:57.341001  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 92166.1us
I20260709 13:03:57.383852  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:57.385380  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:57.385852  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:57.386313 16052 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:03:57.388281  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:57.388878  8579 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:57.389312  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:57.389488  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:57.389823  8577 raft_consensus.cc:1240] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20. Ops: [17.12-19.13]
I20260709 13:03:57.390772 16127 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:57.361457 15969 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:57.358412 16081 raft_consensus.cc:740] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:57.347206 15898 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:57.395934  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:57.358126 15476 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:03:57.382447 16035 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:57.394335 16019 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.533717  8583 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:03:57.418602  8501 raft_consensus.cc:2393] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 16: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:03:57.413434 16154 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:03:57.414315 16156 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:03:57.412540 16151 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:03:57.351037 16047 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.374607 15955 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:57.426452 16145 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:57.429303  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.640203  8579 raft_consensus.cc:1240] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:57.430217 16076 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.431080 16152 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:03:57.431311  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:57.433394  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 82781.9us
I20260709 13:03:57.647608  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:57.437826  8547 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:57.438277 15476 consensus_queue.cc:1243] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:03:57.395025 15969 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.362042 16003 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.392488 15790 raft_consensus.cc:2764] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:03:57.396719 16121 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 22. Current term is 23.
I20260709 13:03:57.490298  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.656665  8582 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 21: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:57.449621  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.659972  8576 raft_consensus.cc:2368] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21.
I20260709 13:03:57.460801  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.491755  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:57.467332  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.468753  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:57.473922  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 2048) took 1593 ms. Trace:
I20260709 13:03:57.662348  9098 rpcz_store.cc:276] 0709 13:03:55.880591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.922638 (+ 42047us) service_pool.cc:224] Handling call
0709 13:03:57.473716 (+1551078us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54006130d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:57.473858 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876714880}
I20260709 13:03:57.475574  8507 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:57.478826  8434 raft_consensus.cc:1275] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:57.446250  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2820) took 1991 ms. Trace:
W20260709 13:03:57.460646 16133 log.cc:927] Time spent T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.465s	user 0.001s	sys 0.002s
I20260709 13:03:57.445279 16069 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.513742  8508 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 22: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:57.482882  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:03:57.665496  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 182686us
I20260709 13:03:57.666203  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:57.667359  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:57.514256  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:57.670773 15878 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:57.671162 15878 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:57.671520 15878 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:57.484272  9099 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:03:57.453720  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:57.518476  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.403025  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:03:57.676280  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 273340us
I20260709 13:03:57.461261 16081 consensus_queue.cc:260] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.680593 16081 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:57.456921 15983 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:57.681713 15983 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:57.682514 15983 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:57.683506 16127 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:57.684181 16127 consensus_queue.cc:1059] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:57.684926 15775 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:57.685182 16127 raft_consensus.cc:3055] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:57.685288 15775 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:57.685608 16127 raft_consensus.cc:740] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:57.685808 15775 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:57.687022  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 195342us
I20260709 13:03:57.687347 15896 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:57.689392 15922 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:57.549194  8426 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:03:57.513550 16078 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.691828  9094 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
W20260709 13:03:57.550180  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 296837us
I20260709 13:03:57.692891 16078 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:57.467113 16125 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:57.467278 16143 log.cc:927] Time spent T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:57.533352 15941 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:57.446106 16163 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.138s
I20260709 13:03:57.710896  8578 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:03:57.649449 16051 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:57.444609 16128 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.663997 15969 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:57.459827 15898 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:57.696851  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:57.653254 16076 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.699029  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:57.738482  8576 raft_consensus.cc:2393] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 19: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:57.642316 15955 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.708930 16047 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.663482  8509 rpcz_store.cc:276] 0709 13:03:55.455032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.455809 (+   777us) service_pool.cc:224] Handling call
0709 13:03:55.479859 (+ 24050us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:55.665687 (+185828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.665715 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:55.668480 (+  2765us) log.cc:844] Serialized 26 byte log entry
0709 13:03:55.900120 (+231640us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:55.900154 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.900222 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:57.255349 (+1355127us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:03:57.419187 (+163838us) raft_consensus.cc:1685] finished
0709 13:03:57.419208 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:57.446186 (+ 26978us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7013,"raft.queue_time_us":8071,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":66652416,"thread_start_us":326569,"threads_started":2,"wal-append.queue_time_us":320721}
W20260709 13:03:57.706360  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.707453  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:57.712111  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 64582.8us
W20260709 13:03:57.651850  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 214120us
I20260709 13:03:57.712587  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:57.723498  9093 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:03:57.714006  8398 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:57.734247  8582 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 15.
I20260709 13:03:57.669986  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:57.735167  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:57.697295 15893 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:57.701921  8577 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:57.707221 16078 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:57.748606 16078 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.746955  8547 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:57.730949 15790 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:57.757798  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 43898.9us
I20260709 13:03:57.759059  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:57.761844  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 91914.9us
W20260709 13:03:57.761891  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 49383.2us
I20260709 13:03:57.765977 16047 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:57.768649 16047 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:57.769606 16047 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:57.772637 15775 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.736967 16071 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:03:57.787122  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 92220.6us
I20260709 13:03:57.790951 15042 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:57.795612  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.796466  8426 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 25 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:03:57.798384  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.798480  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.801331  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:57.802331  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.802439  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:57.803118  8400 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:57.803485  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:57.805749  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:57.757586 15790 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.806547  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:57.815853  9098 raft_consensus.cc:1275] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:03:57.816339  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 52957us
I20260709 13:03:57.766207 15941 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:57.774313 16055 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:57.774158 15860 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:57.834969  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:57.829545 16103 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:57.830073 15893 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:57.832677  8400 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:57.802892 15896 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:57.827912 15790 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:57.855870  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 105173us
I20260709 13:03:57.839856 16019 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:57.817945 16163 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:03:57.843271 15853 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:03:57.819859 16071 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.860759 16069 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:57.840158 15826 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:03:57.905546  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:57.906334  8581 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:57.906684  8507 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:03:57.848649 16110 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:57.868908 15866 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:57.876734 16019 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 21 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:03:57.932294  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 99684.7us
I20260709 13:03:57.937409  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:57.916455  8509 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:03:57.913932  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:57.900393 16051 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:57.925110 16171 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:03:57.961936  8577 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
W20260709 13:03:57.925930 16177 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:57.977483  8577 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:57.907401 16069 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:57.980247  8581 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:03:57.831938 15774 consensus_queue.cc:1059] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:03:57.896457 16066 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:57.964141 15826 consensus_queue.cc:1243] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:03:57.983227 16159 consensus_meta.cc:287] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.004s
I20260709 13:03:57.981482 16128 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.984843 15869 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:57.997534 16139 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.000s
I20260709 13:03:57.915828 16110 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.014688  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46442 (request call id 2758) took 1338 ms. Trace:
I20260709 13:03:58.019832  8584 rpcz_store.cc:276] 0709 13:03:56.676587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.676705 (+   118us) service_pool.cc:224] Handling call
0709 13:03:56.676998 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:56.848213 (+171215us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:03:56.848244 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:57.427317 (+579073us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b2c0003d068. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:03:57.427743 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:03:57.638441 (+210698us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:03:57.638476 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.818265 (+179789us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540028c8d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:57.818319 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:58.014449 (+196130us) raft_consensus.cc:1685] finished
0709 13:03:58.014471 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:58.014625 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6317,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":7577,"spinlock_wait_cycles":408895232,"thread_start_us":209370,"threads_started":1,"wal-append.queue_time_us":374467}
W20260709 13:03:58.021149  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 83819.9us
W20260709 13:03:58.018342  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.007185 16078 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.010593 16076 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:57.994951 16181 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:03:58.030054  9095 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:03:58.032719 15969 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.012013 15826 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:03:58.011838 16159 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353) with higher term. Message: Invalid argument: T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21.
W20260709 13:03:58.035223 16178 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:03:58.023061 16008 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.631s	user 0.003s	sys 0.007s
I20260709 13:03:58.019166 16048 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:58.019524 15775 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.058641  8429 raft_consensus.cc:1275] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:03:58.061622  8429 pending_rounds.cc:85] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 15
I20260709 13:03:58.061899  8429 pending_rounds.cc:107] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 13:03:58.062377  8429 raft_consensus.cc:2889] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:58.060173  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:58.070739  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:03:58.075387  9102 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:58.022439 16139 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:58.087137  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 285090us
I20260709 13:03:58.057386 16048 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.094729  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:58.063066 16070 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.092947  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:58.036329 16069 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.076380 15955 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.105917  9067 leader_election.cc:400] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21.
I20260709 13:03:58.101006  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:58.027112 16019 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.057106 16076 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 13:03:58.103632  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 202661us
I20260709 13:03:58.098601 16048 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:58.107021  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:58.100827 16201 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:03:58.103686 16082 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:58.088851 16197 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:03:58.118050 15775 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:03:58.121510 16183 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:03:58.118657 16199 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:58.122721 16199 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.101239 16070 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.134958 16127 consensus_queue.cc:260] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.136425 16127 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:58.120074 15826 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:58.139396 16077 raft_consensus.cc:3055] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:58.139837 16077 raft_consensus.cc:740] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:58.139901 15878 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.140692 16077 consensus_queue.cc:260] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:58.145368  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50754.2us
I20260709 13:03:58.146245  8475 leader_election.cc:400] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 20. Current term is 21.
I20260709 13:03:58.147096  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:03:58.150372 16066 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.120566 16206 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:58.156203 16110 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.145437 16077 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:58.149741 15826 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:03:58.157670 16139 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:58.151757 16186 log.cc:927] Time spent T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:58.172786 15903 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:58.149046 16197 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:03:58.163637 16083 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.174583 16083 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.177089 16083 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.144784 15878 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.178822 15969 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.151757 16202 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:03:58.172515 15930 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:03:58.171581 16110 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:58.183563  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:58.195348  9099 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:03:58.199151  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:58.200773  9101 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:58.201161  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:58.201705  9093 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:58.201761  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:58.183096 15790 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.199108 15878 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.205416 15878 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.202608  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:58.206399  9101 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:58.206550 15790 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.192442 16110 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:58.208873 16110 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:58.165256 16206 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:58.214080 16206 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:58.217514  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 46029.3us
I20260709 13:03:58.222750  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:58.192050 16199 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.232600  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:58.246450  8509 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:03:58.221550 16008 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:58.223977 16205 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:58.261026  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2752) took 1611 ms. Trace:
I20260709 13:03:58.266924  8575 rpcz_store.cc:276] 0709 13:03:56.649200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.649428 (+   228us) service_pool.cc:224] Handling call
0709 13:03:58.259194 (+1609766us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540009a454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:58.260964 (+  1770us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150921088}
I20260709 13:03:58.304603  9093 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:03:58.234598 15969 consensus_queue.cc:1059] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:03:58.267340 15826 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 13:03:58.310377  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:58.345213  8510 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:58.310582 16204 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:58.259446 16205 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:58.311426 16182 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:03:58.312520  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:58.374320  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 113673us
I20260709 13:03:58.313257  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:58.316804 16206 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.308365  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:58.380929  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:58.381105  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 72830.4us
I20260709 13:03:58.253183 16070 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.252211 16197 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:58.323071  8503 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:03:58.243149 16114 consensus_queue.cc:1048] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:03:58.259835 16008 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:58.347747  9065 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:03:58.397994  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50341us
I20260709 13:03:58.257599 16128 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:58.371848  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:58.243575 16202 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 13:03:58.379626  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:58.380117  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:58.428467  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:58.429226  9097 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 20: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:58.386400  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:58.386924  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:58.390813  8475 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:58.353950  9101 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
W20260709 13:03:58.393673  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 293814us
I20260709 13:03:58.397322  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:58.431555  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:58.378381  8584 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:03:58.435288  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:58.373844 16205 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:58.435746  8549 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:58.437597  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:03:58.427112  8510 raft_consensus.cc:2368] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:03:58.447894  9065 leader_election.cc:400] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:03:58.448372  9065 leader_election.cc:403] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:03:58.396092 16139 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:58.393246 16199 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.463832  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:58.463883  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:58.460748  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:58.468801  8584 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:03:58.471484  8575 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:03:58.475188  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:58.445281 16182 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:58.449977 16181 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:58.474006 16068 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:03:58.464756 16200 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:58.466531 16103 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:03:58.439255 15881 consensus_queue.cc:1059] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:03:58.396950 16197 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.374722 16204 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.393486 16210 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.091s
I20260709 13:03:58.455274 15969 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:03:58.477661 16139 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:58.481990 15878 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.483108 16182 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:58.512317  8576 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:58.484270 16192 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:58.477449 16199 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.521356  8577 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:03:58.529479 16206 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.494679 16181 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:58.532392 16085 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:58.532780 16214 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:58.538810 16008 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.499562 16103 raft_consensus.cc:697] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:58.539161  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:58.541137  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:58.541558 16208 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:03:58.611135  8579 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:58.541150  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:58.611966  8430 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:03:58.542263  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:58.543689  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:58.499203 16210 consensus_queue.cc:1243] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:03:58.546530  8577 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:03:58.568898  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:58.596066  8576 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:58.524840 16182 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:58.494483 16198 consensus_queue.cc:1059] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.159s
I20260709 13:03:58.519547 16202 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:58.525393 16192 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:58.604961  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:03:58.621203  8504 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 20: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:58.626991  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:58.495914 16200 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:58.446075 16128 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:58.627875 16211 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
W20260709 13:03:58.644462  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 190055us
I20260709 13:03:58.662758  8475 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:58.670902  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:58.671577  8576 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:03:58.599980 16085 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:58.657557 15826 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:58.651278 16192 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:58.685818  8475 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:58.677802 16048 consensus_meta.cc:287] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.561s	user 0.001s	sys 0.009s
I20260709 13:03:58.667389 16213 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:58.649748 16110 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.698868  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:58.681227 15826 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.664175 16066 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:03:58.696185 16204 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.670388 16070 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:03:58.671551 16206 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:03:58.654177 16202 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:58.685465 16198 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:58.630949 16139 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.704713 15826 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:58.677946 16180 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 14, Time since last communication: 0.030s
W20260709 13:03:58.736634 16220 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:03:58.696745 16008 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:58.700104 16048 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.680433 16181 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:58.689590 16103 consensus_queue.cc:237] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.724066 16174 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:58.796334  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.723582 16204 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:03:58.751921  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 92745.3us
W20260709 13:03:58.829095  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.805047  8432 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:58.830205  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:58.830484  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:58.833016  8426 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:58.782316 16217 log.cc:927] Time spent T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:03:58.758173 16180 consensus_queue.cc:1243] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:03:58.847493 16218 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:03:58.792075 16110 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.768278 16197 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.827366 16199 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.855594  8426 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:03:58.858346 15930 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.858932 15854 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:58.859364 15854 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:58.858965 15930 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.860168 15854 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.861589 15854 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:58.758361 16008 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:58.749800 16198 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.861974 15930 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.866930 16128 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:58.864392 16008 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.866317 16198 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:58.870292 16223 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:58.888504  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:03:58.863267 16200 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.889829 16210 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:58.890519 16085 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.842226 16204 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:03:58.891944 16077 consensus_meta.cc:287] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.006s
I20260709 13:03:58.875833 16197 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:58.897243  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:58.880250 16127 consensus_meta.cc:287] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.743s	user 0.007s	sys 0.007s
I20260709 13:03:58.896051  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:58.901227  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:58.904457  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 61340.1us
I20260709 13:03:58.908037 16191 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:03:58.907110  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:58.909842 16164 log.cc:927] Time spent T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 1.263s	user 0.000s	sys 0.002s
I20260709 13:03:58.910297 16191 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:58.907804  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:58.915921  8584 raft_consensus.cc:1240] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:03:58.917168  8581 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:58.917886  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:58.918231  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:58.901139 15893 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.898177 16048 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.887881 16202 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.914160 16198 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:03:58.920787 16145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.008s	sys 0.009s
I20260709 13:03:58.938933 16128 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:58.939877 16192 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.905918 15826 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.906105 16197 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:58.900787 16210 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:58.934234 16239 consensus_queue.cc:1059] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 13:03:58.937363 16145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.008s	sys 0.009s
I20260709 13:03:58.951426 16030 raft_consensus.cc:3055] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:58.951908 16030 raft_consensus.cc:740] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:03:58.952198 15826 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:58.952340 16232 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:03:58.948082 16236 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:58.952090 16239 consensus_queue.cc:1243] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:03:58.958757 16204 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.959542 16182 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:58.960572 16197 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.960343 16236 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:58.970425 16192 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:03:58.974335 16205 consensus_meta.cc:287] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.011s
I20260709 13:03:58.974844 16205 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:58.977351 16210 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:58.972812 16236 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:59.022151  8400 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.41.196:40061 timed out after 1.818s (SENT) [suppressed 4 similar messages]
I20260709 13:03:59.029726  8506 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 17: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:03:58.929399 15893 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.035166  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:59.040716  8581 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:58.972790 16182 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:59.049268 16232 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:59.056236 16205 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.060842  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.063033 16242 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.063941 16242 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:59.050597 16232 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:59.069948 16197 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.070820 16197 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:59.073740 16197 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:59.066838 16181 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.083498 15893 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.084043 16232 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:59.067920  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45233.8us
I20260709 13:03:59.080857 16181 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.095602 16085 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:59.096390 16085 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.077450 16052 consensus_queue.cc:1048] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:03:59.094724 16197 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:59.087280 16242 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:59.099241 16181 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.100636 16197 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:59.101864 16085 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.102110  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3251) took 1368 ms. Trace:
I20260709 13:03:59.103580 16197 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:59.102566  8501 rpcz_store.cc:276] 0709 13:03:57.733259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.733417 (+   158us) service_pool.cc:224] Handling call
0709 13:03:57.789198 (+ 55781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:57.789518 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:57.789546 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:57.790007 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:03:57.865795 (+ 75788us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:03:57.865848 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.865939 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:58.036070 (+170131us) raft_consensus.cc:1685] finished
0709 13:03:58.036092 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.101563 (+1065471us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b54003732d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:59.101876 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19406,"raft.queue_time_us":116129,"raft.run_cpu_time_us":883,"raft.run_wall_time_us":28945,"spinlock_wait_cycles":104938752,"thread_start_us":75501,"threads_started":1,"wal-append.queue_time_us":204603,"wal-append.run_cpu_time_us":2054,"wal-append.run_wall_time_us":1073192}
I20260709 13:03:59.118202  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:59.120296  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:03:59.122735  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 674866us
W20260709 13:03:59.127401  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 94232.6us
I20260709 13:03:59.129518  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.131156 15866 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:03:59.141309  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:03:59.131282  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.131811 16085 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:03:59.133169 16128 consensus_queue.cc:1048] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:59.137351  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.140749 15774 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.139597  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.144179 15775 raft_consensus.cc:3055] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:59.146068 15869 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:59.146708 16103 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:59.147537  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 686673us
I20260709 13:03:59.151893 16085 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.161319 15774 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.159101 15775 raft_consensus.cc:740] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:03:59.164074 16197 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:03:59.228500  9068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.236536  8577 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 24: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:03:59.238969 15774 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:03:59.245174  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:59.244874 16239 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:59.242941  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.247468  8581 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:59.249038 16103 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.250736 16085 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.250900 16163 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.251708 16163 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.252521 16103 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.256860 15775 consensus_queue.cc:260] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.258776 15775 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:59.253368 15869 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.260897  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.263370  9098 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
I20260709 13:03:59.263929 15869 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.266178 15969 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:59.267009  8429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52372 (request call id 2881) took 4328 ms. Trace:
I20260709 13:03:59.267092 15969 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.267584  8429 rpcz_store.cc:276] 0709 13:03:54.938152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.938347 (+   195us) service_pool.cc:224] Handling call
0709 13:03:54.961678 (+ 23331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:58.062870 (+3101192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.266425 (+1203555us) spinlock_profiling.cc:243] Waited 3.1 s on lock 0x7b5400126454. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:59.266768 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7121229056}
I20260709 13:03:59.261215  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.271440  9101 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:59.279829 15476 consensus_queue.cc:1059] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:59.283690  8577 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:57.192688  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:59.286060 15888 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:59.288154  9095 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1736) took 1594 ms (client timeout 1763 ms). Trace:
W20260709 13:03:59.288713  9095 rpcz_store.cc:269] 0709 13:03:57.693887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.708495 (+ 14608us) service_pool.cc:224] Handling call
0709 13:03:59.287755 (+1579260us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400551754. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:59.287965 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649067904}
I20260709 13:03:59.289536 16163 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:59.288403 15888 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.293061 15888 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:59.302242  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.303251  8581 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:59.303383  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.304270  9095 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:03:59.304522  9097 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:03:59.269851 15969 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.305352  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:59.306375  9101 raft_consensus.cc:2368] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23.
I20260709 13:03:59.306200 16239 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:59.309492 16160 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:59.310433 16160 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.315244  9094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1722) took 2073 ms. Trace:
I20260709 13:03:59.315439 16160 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.315723  9094 rpcz_store.cc:276] 0709 13:03:57.241213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.241360 (+   147us) service_pool.cc:224] Handling call
0709 13:03:57.241650 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:57.692191 (+450541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.314718 (+1622527us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b5400560ed4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:59.315058 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034833792}
I20260709 13:03:59.317415 16239 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.325380  9097 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:03:59.325795  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.326655  9098 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:59.326725 16035 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.327498 16035 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.332814  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.338723  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.332455 16035 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.343652 16071 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.344539  9094 raft_consensus.cc:1240] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
I20260709 13:03:59.344565  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:59.347069  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.323472 15888 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:59.354877  9068 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:59.355618  8583 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1368) took 1923 ms. Trace:
I20260709 13:03:59.356045  8583 rpcz_store.cc:276] 0709 13:03:57.431762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.535065 (+103303us) service_pool.cc:224] Handling call
0709 13:03:57.535443 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:57.765501 (+230058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:57.765546 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:57.765605 (+    59us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:03:57.765660 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.355106 (+1589446us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400116cd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:03:59.355198 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.355446 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528441728}
I20260709 13:03:59.341325 16239 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.347498 16194 raft_consensus.cc:3055] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:03:59.372255 16163 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:59.378291  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.384240  9101 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:03:59.387122  9098 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:59.388816  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:59.379406 16194 raft_consensus.cc:740] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:59.392305  9096 pending_rounds.cc:85] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 14
I20260709 13:03:59.393905  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:03:59.372925 16191 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:59.375334 15869 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:03:59.395757 16231 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.591s	user 0.000s	sys 0.003s
I20260709 13:03:59.396873  9096 pending_rounds.cc:107] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:03:59.401350  9096 raft_consensus.cc:2889] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:59.402819  9098 raft_consensus.cc:1240] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:03:59.401199  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.408610  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:59.409198  9098 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:03:59.412434  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:03:59.413457 16251 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:03:59.422302  8577 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:59.407490  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:59.382854 15888 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.430995  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.432407  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.433576  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.435045  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.436311  9101 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:59.436990  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:59.417464 16191 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.450809 16003 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:59.451419 16003 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:59.451894 16003 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:59.454285  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:03:59.455703  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 65021.6us
I20260709 13:03:59.457105  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:59.458359 15866 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:59.458706 16239 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.459416 16239 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.459962  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:59.461313  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.461781 16239 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.470831  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.478329  9094 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:03:59.481081  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.488952  9098 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:03:59.461915  9101 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 25.
I20260709 13:03:59.467373 15888 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:59.479847  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.492188  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.492786  8576 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:03:59.493150  8577 raft_consensus.cc:2410] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:03:59.492957  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:59.494093  9099 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 17: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:03:59.495003  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:59.472414  9102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33884 (request call id 1730) took 2163 ms (client timeout 1818 ms). Trace:
I20260709 13:03:59.502187 15898 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:59.515105 16239 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:59.516286 16239 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.515949 15898 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.516783 16239 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:59.518419  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 61515.4us
W20260709 13:03:59.496294  9102 rpcz_store.cc:269] 0709 13:03:57.308517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.308633 (+   116us) service_pool.cc:224] Handling call
0709 13:03:59.472024 (+2163391us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b5400508054. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:59.472190 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635141376}
I20260709 13:03:59.472714  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:59.519419  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:59.550671  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.495842 16191 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.557041  9095 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
W20260709 13:03:59.560285  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 87920.7us
I20260709 13:03:59.462714 16194 consensus_queue.cc:260] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:59.561174  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:03:59.567883  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 48636.6us
I20260709 13:03:59.470505 16030 consensus_queue.cc:260] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:59.572827  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.569566  8579 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:03:59.571280  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.573601  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:03:59.573185  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:59.577733  9102 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:59.584124  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.584906  9102 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:03:59.587369  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:03:59.581338 15888 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:59.584683 16194 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:59.572330 16035 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:03:59.587845 16103 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:59.600026  8549 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:59.589072 15853 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:03:59.600697 16103 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:59.602469 15898 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:59.620138  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 45252.4us
I20260709 13:03:59.613273 16125 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:59.619859 16103 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:59.632596  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.640554  9101 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:59.643471 16114 raft_consensus.cc:3055] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:03:59.644024 16114 raft_consensus.cc:740] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:59.646206 15937 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:59.646690 15937 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.647028 15937 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:59.648387 16262 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:59.644057 16190 raft_consensus.cc:3055] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:59.629577 16125 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:59.657215  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 117327us
I20260709 13:03:59.666755  9095 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:03:59.689738  9094 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
W20260709 13:03:59.659628  8575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54346 (request call id 3048) took 1184 ms (client timeout 1511 ms). Trace:
I20260709 13:03:59.658871  8582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46442 (request call id 2773) took 1272 ms. Trace:
I20260709 13:03:59.694196  8582 rpcz_store.cc:276] 0709 13:03:58.385911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.386084 (+   173us) service_pool.cc:224] Handling call
0709 13:03:59.658505 (+1272421us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400283f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:59.658682 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1492408064}
I20260709 13:03:59.684796  9095 pending_rounds.cc:85] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting all ops after (but not including) 12
I20260709 13:03:59.728284  9095 pending_rounds.cc:107] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:03:59.728699  9095 raft_consensus.cc:2889] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:59.692880  8575 rpcz_store.cc:269] 0709 13:03:58.474857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.474979 (+   122us) service_pool.cc:224] Handling call
0709 13:03:59.659269 (+1184290us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54000cd5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:59.659412 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375008128}
I20260709 13:03:59.654668 16190 raft_consensus.cc:740] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:59.645395 16114 consensus_queue.cc:260] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:59.754175  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 300047us
I20260709 13:03:59.753796 16190 consensus_queue.cc:260] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.755110 16114 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:59.755991  8400 leader_election.cc:400] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23.
I20260709 13:03:59.756132 16190 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:59.756407  8400 leader_election.cc:403] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:03:59.762176  8507 raft_consensus.cc:1240] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:03:59.762828 15969 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.763666 15898 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:59.763487 15969 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.764299 15898 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:03:59.665141  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:59.804932  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 51921.2us
W20260709 13:03:59.786087  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.774727  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.788398  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:03:59.793457  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 94271.9us
I20260709 13:03:59.686484 16125 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:59.664683  8550 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:59.785480  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.823474  8508 raft_consensus.cc:2410] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
W20260709 13:03:59.824025  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 204857us
I20260709 13:03:59.774199  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.781085  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:59.783178 16255 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.380s	user 0.001s	sys 0.001s
W20260709 13:03:59.828734  9066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.796216  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:03:59.839826  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 175340us
I20260709 13:03:59.765947 15969 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:03:59.842617  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 179373us
I20260709 13:03:59.843523  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.790510 15860 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:59.845274  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:59.766422 15898 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:59.791505 16167 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:03:59.855183 16257 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.397s	user 0.004s	sys 0.000s
I20260709 13:03:59.769416 15987 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.169s
I20260709 13:03:59.783825 16068 consensus_queue.cc:1059] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:03:59.852260  8505 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:59.858407  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.859508  8510 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:03:59.865643  8509 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:03:59.857170 16003 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.779784 16069 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23.
I20260709 13:03:59.867628  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.796554 16085 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:03:59.851279 15860 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:03:59.878170  8429 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 19: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:03:59.873944  8503 raft_consensus.cc:2468] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:59.778294 16197 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 13:03:59.860152 16052 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:59.873533  8502 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:03:59.883924  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.881145  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.801220  8332 catalog_manager.cc:5697] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:03:59.885870  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.864259 16167 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:03:59.890878  9067 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:03:59.895414  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.896005  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:59.896832  8428 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:03:59.897426  8503 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:03:59.897841  8503 pending_rounds.cc:85] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 13
I20260709 13:03:59.892046 16035 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.902211 16252 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:03:59.908376  8333 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57088 (request call id 362) took 72702 ms (client timeout 15000 ms). Trace:
I20260709 13:03:59.908730 16085 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:59.908794 16003 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.910271  8503 pending_rounds.cc:107] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:03:59.920275  8503 raft_consensus.cc:2889] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:59.918237  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:59.927585  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 170407us
I20260709 13:03:59.928700  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:59.924172  8508 raft_consensus.cc:2468] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 27.
I20260709 13:03:59.930702  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.929994  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.933815  9068 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:03:59.937110  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.916600 15893 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.945145  8502 raft_consensus.cc:2468] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:03:59.948240 15893 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.958171  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:03:59.958860  8432 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:59.958957  8506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1673) took 1647 ms (client timeout 2139 ms). Trace:
I20260709 13:03:59.959160 16239 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:59.959385  8506 rpcz_store.cc:269] 0709 13:03:58.311360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.386649 (+ 75289us) service_pool.cc:224] Handling call
0709 13:03:59.958708 (+1572059us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54000d7fd4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:59.958887 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376596352}
I20260709 13:03:59.961098  8506 raft_consensus.cc:1275] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:03:59.961378 16239 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.963831 15888 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:03:59.970009 15888 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.970796 16198 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:03:59.971302 16198 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:59.972359 15888 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:03:59.972985 15888 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:59.965054 16103 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.966110  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:03:59.974443  8429 raft_consensus.cc:2410] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 28 because replica has last-logged OpId of term: 27 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 13.
I20260709 13:03:59.978190  8505 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:03:59.978435 16103 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:03:59.979678  8426 raft_consensus.cc:1240] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 24. Current term is 25. Ops: []
I20260709 13:03:59.940912 16035 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.948329 15947 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:59.987061 15947 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.968583  8504 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:59.987485 15947 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:59.988790  8504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3267) took 1325 ms. Trace:
I20260709 13:03:59.989179  8504 rpcz_store.cc:276] 0709 13:03:58.663671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.664398 (+   727us) service_pool.cc:224] Handling call
0709 13:03:59.968195 (+1303797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.987718 (+ 19523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.988585 (+   867us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000d7fd0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:03:59.988733 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2997548928}
I20260709 13:03:59.967159 16167 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.994735  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.995507  8581 raft_consensus.cc:2368] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16.
I20260709 13:03:59.996474  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.997112  8579 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:03:59.998039  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:03:59.998142 16103 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:03:59.999065 15983 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:59.998836 16103 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.000110  8576 raft_consensus.cc:1240] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:00.002411  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.002971 16103 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.003930  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.005072  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:03:59.914588  8333 rpcz_store.cc:269] 0709 13:02:47.205940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.414863 (+208923us) service_pool.cc:224] Handling call
0709 13:02:47.898517 (+483654us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a9090 00007f1a19347f3a 00007f1a1f0fe1cc 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc 00007f1a1d6bc392 00007f1a1767a48c 00007f1a176798c6
0709 13:03:59.908117 (+72009600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:50.436125 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:50.608196 (+172071us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:50.614639 (+  6443us) write_op.cc:435] Acquired schema lock
0709 13:03:50.622290 (+  7651us) tablet.cc:662] Decoding operations
0709 13:03:50.739655 (+117365us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:50.739755 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:50.739784 (+    29us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:03:50.740973 (+  1189us) tablet.cc:701] Row locks acquired
0709 13:03:50.741016 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:03:50.741201 (+   185us) write_op.cc:270] Start()
0709 13:03:50.741364 (+   163us) write_op.cc:276] Timestamp: P: 1783602230741129 usec, L: 0
0709 13:03:50.741400 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:03:50.766980 (+ 25580us) log.cc:844] Serialized 5149 byte log entry
0709 13:03:51.612247 (+845267us) op_driver.cc:464] REPLICATION: finished
0709 13:03:51.963949 (+351702us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a162350ac 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a1cd75ef0
0709 13:03:52.190011 (+226062us) write_op.cc:301] APPLY: starting
0709 13:03:52.190130 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:52.252904 (+ 62774us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:52.252948 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:52.773636 (+520688us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:52.774064 (+   428us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:03:52.774137 (+    73us) write_op.cc:312] APPLY: finished
0709 13:03:52.774512 (+   375us) log.cc:844] Serialized 121 byte log entry
0709 13:03:52.776089 (+  1577us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933c32a 00007f1a192c1f14 00007f1a192c1ec3 00007f1a192c1e38 00007f1a192c1df3 00007f1a192c10dc 00007f1a192eae16 00007f1a192d2cbb 00007f1a192bd39d 00007f1a192c0d75
0709 13:03:52.880984 (+104895us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:52.893502 (+ 12518us) write_op.cc:454] Released schema lock
0709 13:03:52.903457 (+  9955us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:52.939238 (+ 35781us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:52.940159 (+   921us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1496360,"reported_tablets":46,"spinlock_wait_cycles":349996800,"child_traces":[["op",{"apply.queue_time_us":577417,"apply.run_cpu_time_us":38187,"apply.run_wall_time_us":729811,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58415,"num_ops":13,"prepare.queue_time_us":339784,"prepare.run_cpu_time_us":33996,"prepare.run_wall_time_us":555891,"raft.queue_time_us":212301,"raft.run_cpu_time_us":36729,"raft.run_wall_time_us":1199641,"replication_time_us":849710,"spinlock_wait_cycles":20166144,"thread_start_us":1080997,"threads_started":5,"wal-append.queue_time_us":313710,"wal-append.run_cpu_time_us":89536,"wal-append.run_wall_time_us":2912061}]]}
I20260709 13:03:59.953624  8582 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:04:00.009272  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:00.009758  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.010504  8503 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:04:00.011559  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.012465  8503 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:00.013533 16167 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:00.006307  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:03:59.927968 16252 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:03:59.949406 15937 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:03:59.985714  8475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.010109  8583 raft_consensus.cc:2393] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 19: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:04:00.015501  8506 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:04:00.013295  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:00.019979  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.025589  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.026312  8509 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:03:59.987491 16035 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.029429  8503 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 22: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:04:00.034727  8504 raft_consensus.cc:2410] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:04:00.020028 15860 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.035468 15860 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:00.035792  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.035984 15937 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.036497  8426 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:04:00.036815  8504 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:00.038484 16252 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.038985 15971 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:00.039110  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:00.039489  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 105753us
I20260709 13:04:00.039916  8509 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:04:00.039750 15971 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.040335  9068 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.042627 15866 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:00.042829 15971 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.043344 16030 raft_consensus.cc:3060] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:00.041769  9068 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:00.044907 16216 consensus_queue.cc:1048] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 13:04:00.048584 16182 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:00.048926  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.049223 16182 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:00.049629  8429 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:04:00.050454  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.051661  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.028210  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:00.047132  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.067317  8430 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:00.058749  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.080651  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.072757  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.053823  8504 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:04:00.080886  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:04:00.102216  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.096067  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.110466  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.110682  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:04:00.111589  8434 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:00.111974  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.062753 16277 raft_consensus.cc:2764] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:04:00.113214  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.063632  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:00.115190  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 51655.9us
I20260709 13:04:00.117161  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.118119 15866 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:00.118986 15866 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:04:00.120911 15866 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.121182 15774 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.121464 15866 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.121735 15774 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.123673 15774 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.124245 15775 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.124881 15775 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.053753 16182 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.127863 15775 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.124385 15774 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.123713 15866 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.081665  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:00.069204  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:04:00.143472  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
W20260709 13:04:00.141597  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 60045.1us
I20260709 13:04:00.057147 15893 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.149652 16114 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:00.153141 16114 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.153515 16114 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:00.154090 16003 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:00.154609 16003 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:00.156445 16085 raft_consensus.cc:3055] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:00.156936 16085 raft_consensus.cc:740] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:00.146672 16182 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:00.164736  8434 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
W20260709 13:04:00.163787  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 375489us
I20260709 13:04:00.169756  8432 raft_consensus.cc:2410] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:04:00.171984  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:00.171571 16069 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.180351 16069 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.183558 16069 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.191144 15947 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:00.198827  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 102981us
W20260709 13:04:00.206789  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 275115us
I20260709 13:04:00.207698  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
W20260709 13:04:00.211030  8476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.158793 15774 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.269585  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.173213 15893 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:00.157992 16085 consensus_queue.cc:260] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:00.273757  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 55973.7us
W20260709 13:04:00.275245  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 81343.2us
I20260709 13:04:00.276047  8400 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:00.276327 15947 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.277226  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.280027  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.277360  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.285175  8398 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:04:00.286131  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.290199 15042 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.290400  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.290911 15042 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.291963 15774 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.292670  8476 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:00.293380 15042 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.294225 16194 consensus_queue.cc:1059] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:00.294589  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:00.295375 16194 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:00.295804  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:00.295868 16194 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:00.296643 16194 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:00.296803 16003 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.297343 16035 consensus_queue.cc:1048] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:00.299068 16232 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:00.299531 15969 raft_consensus.cc:3055] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:04:00.300097 15969 raft_consensus.cc:740] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:00.299815 15893 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.301111  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:00.302657  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:00.304365  8502 raft_consensus.cc:2410] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:04:00.304073  9065 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:00.299355 16076 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:00.272154 16182 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:04:00.316220 15969 consensus_queue.cc:260] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.316946 16198 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.322983 16272 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:00.323788 16272 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:00.325820  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:00.299817 16232 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:00.319280 15042 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.319218  9065 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:04:00.320201  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 156598us
W20260709 13:04:00.321887  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 45965us
I20260709 13:04:00.274060 16069 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:04:00.332492  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:00.330600 15042 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.339151  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:00.313190 16076 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:00.343003  8400 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:00.343915  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.341295  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:00.345320  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.328485 15774 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:00.335186 15893 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.334393 16232 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:00.320088 16035 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:04:00.338747 15947 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:00.358618  8426 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:00.359163  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:00.346561 16076 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:00.348721 16281 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:00.321424 16125 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.347703 16191 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:00.360474  8398 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:00.365764 16282 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:00.366117 15969 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:00.366631 16139 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:00.366995  9067 leader_election.cc:400] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16.
I20260709 13:04:00.412370  9067 leader_election.cc:403] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:00.367188 16272 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.368018 16278 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.361419  8501 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:04:00.370626 16114 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.371340 16001 raft_consensus.cc:2804] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:00.371716 16167 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:00.351970 16085 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:00.378474  8429 raft_consensus.cc:1275] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:04:00.438829  8429 pending_rounds.cc:85] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Aborting all ops after (but not including) 13
I20260709 13:04:00.439121  8429 pending_rounds.cc:107] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:04:00.439354  8429 raft_consensus.cc:2889] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:00.379115  8547 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:04:00.442323  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 63287.5us
I20260709 13:04:00.443919  8547 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:00.444875  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.383210 16215 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:00.383769 16279 raft_consensus.cc:2804] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:00.383857 16198 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.447459 15893 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:00.447918 15893 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.448287 15893 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:00.450060 16069 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:04:00.451056 16242 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:00.452152 16242 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:00.452245 16125 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.452544 16242 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.452852 16125 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.452877 15955 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:00.453401 16125 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:00.384487 16047 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.454277 15860 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:00.454763 15860 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:00.454407 16047 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:00.454483 16003 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:00.455674 15860 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.457018 15860 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:00.360175 15947 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:00.457814  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.457921 15947 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:00.359166 15898 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:00.385768  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:04:00.384083 16194 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:00.462599 15042 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:00.462813  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 104217us
I20260709 13:04:00.463620  8400 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:00.463871 16194 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.389153  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.465059  8505 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 22 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 13:04:00.356588 16232 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:00.365656 16014 raft_consensus.cc:2804] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:04:00.465873 16014 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:00.466318 16014 raft_consensus.cc:3060] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:04:00.416815  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49981.4us
I20260709 13:04:00.402496 16281 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:00.453712 15955 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:00.438215 16167 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.482972  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:00.483053 16191 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:00.496055 15955 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:00.429132 16001 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:00.497452 16001 raft_consensus.cc:3060] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:00.497562 16279 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:00.498138 16279 raft_consensus.cc:3060] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:00.498585 15955 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:00.486321 16167 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:00.501600 16125 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:00.501767 16114 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:00.485833  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.503943  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 201559us
I20260709 13:04:00.452922 16242 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:00.427083 16277 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 15. Current term is 16.
I20260709 13:04:00.506752  8476 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:00.508939  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 167555us
W20260709 13:04:00.511076  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 95024.7us
I20260709 13:04:00.482901 16281 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:00.519073 15042 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:00.514428  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.532398  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.505569 16197 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:00.536893  9102 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:04:00.538838  9099 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:04:00.539462  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.546347  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.546756  9095 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:04:00.542390  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.552683  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.518571 16047 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.502861 16069 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:04:00.558475  8400 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:00.558578  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:00.558944  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.545553 16114 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:00.535591 16281 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:00.574402  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 67781.1us
I20260709 13:04:00.584759  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.528168 16191 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:00.579744  9101 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:00.581607  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 136813us
I20260709 13:04:00.576252 15042 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.583717  9100 raft_consensus.cc:1275] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:00.586782  9094 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:04:00.595894  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.599325  8476 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.596827  9099 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
W20260709 13:04:00.603091  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.604363  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 62037.3us
I20260709 13:04:00.607365  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:00.610688 16284 log.cc:927] Time spent T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:04:00.542552 16076 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:00.586871 16125 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:00.589408 16191 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:00.621223 15042 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:00.620570  8547 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.601627 16114 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.631258 15881 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:04:00.631669  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.631913 16295 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:00.634162  9093 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:00.634335  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.666597  9095 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
I20260709 13:04:00.635998  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.629767 16293 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:00.629505 16191 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:00.641152 16281 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.618758 16035 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:00.652287 16167 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.602010 15947 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.658563  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.662569  9101 raft_consensus.cc:2468] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:04:00.672410  8503 raft_consensus.cc:1240] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: []
W20260709 13:04:00.686305  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 50407.3us
I20260709 13:04:00.688757  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.689465  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.703933  8476 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.706490  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:00.707773  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:00.716077  9093 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:00.717237  8505 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:00.720592  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.687836 16198 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:04:00.727712  9097 raft_consensus.cc:2368] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20.
I20260709 13:04:00.729669  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.673273 16114 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.684358 16103 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:00.756008  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 125862us
W20260709 13:04:00.759115  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.758400  8508 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
W20260709 13:04:00.763921  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 205583us
I20260709 13:04:00.770473  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.709271 16232 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:00.801086 16232 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.803254  8505 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 20. Current term is 21. Ops: []
W20260709 13:04:00.806738 16292 log.cc:927] Time spent T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:04:00.806943  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:00.807915  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:00.808673  8577 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:04:00.811062  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.811834  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.811951 16232 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:00.812695 16232 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.813482  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:00.814567  8583 raft_consensus.cc:2368] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20.
I20260709 13:04:00.821312 15860 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.821944 15860 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:00.826812  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.827759  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:00.817673  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:00.829996  9099 raft_consensus.cc:3060] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:00.772754  9095 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:00.775957 15893 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.776585 15947 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.777465  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:00.778656 16287 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.329s	user 0.001s	sys 0.003s
I20260709 13:04:00.780151 16035 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:00.780905 16125 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:00.783830 16003 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:00.785646  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 66207us
I20260709 13:04:00.786279 16160 consensus_queue.cc:1059] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:00.788123  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:00.788846 15971 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:00.687836 15881 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.773797 16216 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:04:00.881963  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:00.904534  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:00.795779 16076 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:00.794481  9093 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:04:00.908674  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.798638 16139 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:00.841043  8510 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:04:00.842399  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.845710  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:00.850303  8579 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 16.
W20260709 13:04:00.878764  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 254274us
I20260709 13:04:00.858839  8398 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:00.882774  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:00.861393  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:00.794440 16281 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.906061  8430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.737717 15983 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 13:04:00.907899  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:00.909518  9101 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:04:00.914585  9094 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:04:00.920452  8550 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:00.923696  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:04:00.924438  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 65659.7us
I20260709 13:04:00.916589  8426 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:04:00.879534 15969 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.839109 16114 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.929984  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:04:00.933885  8548 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.934430  8428 raft_consensus.cc:1240] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Rejecting Update request from peer 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:00.769135 16001 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:00.937801 15898 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:00.926198 16030 raft_consensus.cc:3055] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:00.937026 16160 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:00.961259  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.966584  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:00.940780  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:00.881395 16003 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:00.954419 16272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.023s	sys 0.023s
W20260709 13:04:00.983700 16272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.024s	sys 0.024s
W20260709 13:04:00.984530  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 364020us
I20260709 13:04:00.960196 15969 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:00.987327  8575 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:00.990159  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 284176us
I20260709 13:04:00.991343  8426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:00.975749 15860 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:00.976382 16103 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:00.979429 16232 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:00.974565 16030 raft_consensus.cc:740] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:00.977854 16160 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.957438 16139 consensus_queue.cc:1048] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:04:01.013170  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:04:00.989755 15898 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:00.954489 16242 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.023579  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:00.999328 16167 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.021986  8584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 3074) took 1085 ms. Trace:
I20260709 13:04:01.027690  8503 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:00.987321 15774 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 13:04:01.012558 16103 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.041010 16103 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:01.036088  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:01.042483  8510 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:01.043501  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:01.044739  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:01.028018  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:01.046676  8427 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:04:01.047691  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:01.019127 15860 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:01.049358 15860 raft_consensus.cc:697] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:01.050398 15860 consensus_queue.cc:237] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:01.035075 16279 consensus_meta.cc:287] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.006s
W20260709 13:04:01.053351 16014 consensus_meta.cc:287] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.000s
I20260709 13:04:01.053311 16279 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:01.054912 16001 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:01.055402 16279 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:01.057559 16035 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.060873  8505 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:01.064721 15969 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.023628 16160 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:01.068256 16242 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.069353  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:01.070505  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:04:01.071043  8435 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:01.071623  8428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:01.040433  8434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b"
I20260709 13:04:01.073928  8434 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:04:01.045843  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:01.099336 16003 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.102337  9099 raft_consensus.cc:2468] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:04:01.103466  8427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:01.107295  8510 raft_consensus.cc:2410] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 25 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:04:01.107246  8434 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:04:01.108898  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:01.113708  8503 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 20: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:04:01.119531  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 258092us
W20260709 13:04:01.074854 16298 log.cc:927] Time spent T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:04:01.125587  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 205197us
W20260709 13:04:01.129407  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 170624us
I20260709 13:04:01.121627  8549 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.029736  8584 rpcz_store.cc:276] 0709 13:03:59.914146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.996105 (+ 81959us) service_pool.cc:224] Handling call
0709 13:04:00.049584 (+ 53479us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b5800083498. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621aeee 0000000000375939 00007f1a1e28e1e0 00007f1a1e3570c4 00007f1a1e357131 00007f1a1e318fc0 00007f1a1e303929 00007f1a1e3033d2 00007f1a1787abd4
0709 13:04:00.049746 (+   162us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:00.050248 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:04:00.050273 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:00.050895 (+   622us) log.cc:844] Serialized 52 byte log entry
0709 13:04:00.336593 (+285698us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:00.336656 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.336735 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.715284 (+378549us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:04:00.999214 (+283930us) raft_consensus.cc:1685] finished
0709 13:04:00.999243 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.999413 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1273,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":128455808,"thread_start_us":285302,"threads_started":1,"wal-append.queue_time_us":398202}
I20260709 13:04:01.150034  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.033272 16308 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:04:01.121644 16299 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.342s	user 0.006s	sys 0.000s
I20260709 13:04:01.152275  8549 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.053828 16014 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:01.159718  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:01.159050  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:01.033497 16125 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.116s
I20260709 13:04:01.163935  8549 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:01.114218 16035 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.164188 15955 raft_consensus.cc:2804] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:01.225051  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:01.227005  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 166305us
I20260709 13:04:01.149205 16277 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:01.230445  8435 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
W20260709 13:04:01.234153  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 74008.1us
I20260709 13:04:01.162917 16139 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:01.177017 15775 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:01.173149 16252 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:01.174618 16163 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:04:01.246553  8474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.132799 16160 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.173355 16282 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:01.163350 15971 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:01.252139 16035 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.176503 15893 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.224526 15881 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:01.223861 16014 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:01.162354 16242 consensus_queue.cc:1048] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 13:04:01.267067  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:01.279119  8429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:01.279363  8433 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
W20260709 13:04:01.270268  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.275043  8435 raft_consensus.cc:1240] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 22. Current term is 23. Ops: []
I20260709 13:04:01.184506 16197 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:04:01.252969 16307 log.cc:927] Time spent T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:04:01.284688  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 120974us
W20260709 13:04:01.285035  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.285485  8475 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:01.173974 16308 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.218206 16030 consensus_queue.cc:260] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:01.293095  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.302034  8576 raft_consensus.cc:2410] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 22 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
W20260709 13:04:01.299731  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 46058.3us
I20260709 13:04:01.305816  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.273563 16114 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:01.317111  8504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.004s	sys 0.013s
I20260709 13:04:01.312958  8580 raft_consensus.cc:2410] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:04:01.269356 16163 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:04:01.246091 16277 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.325134 16277 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:01.314564  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.310593 16194 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:01.327559 16320 raft_consensus.cc:2804] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:01.327642  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.328190 16320 raft_consensus.cc:697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:01.314767  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.329449  8583 raft_consensus.cc:2393] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 23: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:01.284403 15881 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.330359 16252 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:01.330963 16252 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.332759 16308 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.333010  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:01.333173 16252 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.315199  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.334391  8400 leader_election.cc:400] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20.
I20260709 13:04:01.334687  8400 leader_election.cc:403] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:04:01.315567  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:01.262391 16311 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:01.335551  8577 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:01.335722 16318 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:01.322695 16197 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.336448 16318 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:01.317756 16303 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.338212 16272 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20.
I20260709 13:04:01.319416  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.338498 16303 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:01.340353  8504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.004s	sys 0.013s
I20260709 13:04:01.340967  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:04:01.263602 15775 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.329274 16320 consensus_queue.cc:237] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:01.360095  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 48537.8us
I20260709 13:04:01.361629  8577 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
W20260709 13:04:01.363883 16316 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:04:01.365833 16309 log.cc:927] Time spent T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:04:01.367671 16191 consensus_meta.cc:287] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.000s
I20260709 13:04:01.368209 15971 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.369259 16303 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:01.368278 16191 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:01.385442  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:01.388564  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.389647  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:01.392920  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:01.399832  8503 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:01.400977  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:01.403872 15042 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:01.427019  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:01.427757  8584 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:01.428779  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:01.429456  8505 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:01.429324  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:01.430609  9097 raft_consensus.cc:2368] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 21. Current term is 22.
I20260709 13:04:01.280928 16282 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.435257  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:01.453213  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 52313.5us
I20260709 13:04:01.456725 16069 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:01.457526  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:01.458912  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:01.387032 16076 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:01.330371 15881 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.478330  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.491706  8577 raft_consensus.cc:2368] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 21. Current term is 22.
I20260709 13:04:01.482012  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:01.482245 15898 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.483111  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:01.460040  8435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dacb523538a14c7cb335ab9c18f4111b" is_pre_election: true
I20260709 13:04:01.432464 16085 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:01.472494  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:01.487258  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:01.495330  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 63497.2us
I20260709 13:04:01.491243  9068 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:01.502871  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:01.505949  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:01.508318  8503 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:01.459048 16232 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:04:01.511531  8400 leader_election.cc:400] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 21. Current term is 22.
I20260709 13:04:01.493898 16076 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.515408 15042 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:01.520850  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:01.461539 16293 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:01.523514  8400 leader_election.cc:403] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:01.524502  8431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60094 (request call id 3097) took 1219 ms. Trace:
I20260709 13:04:01.529234  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:01.523280  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:01.496855 15955 raft_consensus.cc:697] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:01.527915 15042 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.509775 16030 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:01.454073 16303 consensus_queue.cc:1059] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.065s
I20260709 13:04:01.534374  8507 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 24.
I20260709 13:04:01.494661 16191 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:01.538090  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.521800 16276 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:01.529862 16076 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:01.564864  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:04:01.536468 16306 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
I20260709 13:04:01.505592 15898 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.570410  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.528684  8431 rpcz_store.cc:276] 0709 13:04:00.054385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.054505 (+   120us) service_pool.cc:224] Handling call
0709 13:04:00.054827 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.055399 (+   572us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:04:00.331372 (+275973us) log.cc:844] Serialized 14 byte log entry
0709 13:04:00.555192 (+223820us) log.cc:844] Serialized 14 byte log entry
0709 13:04:00.733482 (+178290us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b180030ad20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a19337060 00007f1a19349716 00007f1a1935a287 00007f1a1935a208
0709 13:04:00.791344 (+ 57862us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b180030ad20. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f
0709 13:04:00.793203 (+  1859us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b48002f0358. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1e268aa1 00007f1a1e25fb37 00007f1a1e25f9ca 00007f1a1e35726f 00007f1a1e356f37 00007f1a1e36b55c 00007f1a1e36b508 00007f1a1e36b488 00007f1a1e36b443 00007f1a1e36a6ec 00007f1a1d294a96
0709 13:04:00.998719 (+205516us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:01.017543 (+ 18824us) log.cc:844] Serialized 26 byte log entry
0709 13:04:01.017799 (+   256us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:04:01.018157 (+   358us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.226554 (+208397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.226655 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.273874 (+ 47219us) raft_consensus.cc:1685] finished
0709 13:04:01.273894 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.274036 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":221792,"prepare.queue_time_us":342790,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":135,"raft.queue_time_us":409099,"raft.run_cpu_time_us":5098,"raft.run_wall_time_us":254243,"spinlock_wait_cycles":140876672,"thread_start_us":727926,"threads_started":3,"wal-append.queue_time_us":344243}
I20260709 13:04:01.533782 16069 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 21. Current term is 22.
I20260709 13:04:01.573014  8475 leader_election.cc:400] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 19. Current term is 20.
I20260709 13:04:01.548491 16047 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:04:01.591934  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 62514.9us
I20260709 13:04:01.491952 16163 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.592734  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:01.601452  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.581669 15947 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:01.613570  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.587538 16114 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:01.617415 16323 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:01.617795  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:01.618635  9101 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:01.619004 16323 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:01.619649 16323 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:01.622115 16323 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:01.626309  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.628491  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.628787  8580 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:04:01.632089  8400 leader_election.cc:400] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for earlier term 21. Current term is 22.
I20260709 13:04:01.633759  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:04:01.635427  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 132638us
I20260709 13:04:01.636220  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.599287 16277 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:01.591423 16191 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:04:01.633795  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 469883us
I20260709 13:04:01.643860  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:04:01.616559 16313 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 13:04:01.611837 16242 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:01.656589  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:01.638715  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.638322 16198 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:04:01.648315  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.614107 16160 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.647251  9101 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:04:01.638065 16163 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:01.623044 15937 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:01.622783 16114 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:01.659675  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:01.654985  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:01.665117  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:01.665318  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:01.665964 16019 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:01.666682 16197 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:04:01.641211 16069 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:04:01.667936  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.663897 16114 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:01.679688  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:01.674949  9101 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:04:01.666719  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:01.639243 15955 consensus_queue.cc:237] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.683434  9067 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.684252  8578 raft_consensus.cc:2393] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:01.669248  8400 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:01.642889 16303 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:01.675220 16103 consensus_meta.cc:287] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.001s
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 3
I20260709 13:04:01.657891 16242 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:04:01.676556 16304 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.391s	user 0.001s	sys 0.000s
I20260709 13:04:01.658305 16272 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:01.660782 16281 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:01.720013  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:01.721385  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:04:01.722162 16314 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 13:04:01.723599  8506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3291) took 1052 ms. Trace:
W20260709 13:04:01.724231 16324 log.cc:927] Time spent T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:04:01.714567 16318 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:01.726101 16318 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:01.726965 16318 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.729187  8505 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:04:01.729913 15881 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:01.730561 15881 raft_consensus.cc:3060] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:01.713145 16103 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.739359  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.724005  8506 rpcz_store.cc:276] 0709 13:04:00.670729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.671158 (+   429us) service_pool.cc:224] Handling call
0709 13:04:00.689982 (+ 18824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.690250 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.690290 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:00.708539 (+ 18249us) log.cc:844] Serialized 26 byte log entry
0709 13:04:01.107977 (+399438us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:04:01.108015 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.108081 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.723353 (+615272us) raft_consensus.cc:1685] finished
0709 13:04:01.723376 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.723534 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":352362,"threads_started":1,"wal-append.queue_time_us":511265}
I20260709 13:04:01.741598  8582 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:01.706494  8400 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:01.711122 16334 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:01.674495 15775 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:01.668519 16277 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:01.715591  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.649914 16191 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:04:01.641242 16336 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:04:01.666728 16019 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:04:01.714357 16242 raft_consensus.cc:3060] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:01.750695  8581 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:04:01.751691  8584 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:04:01.711211 15866 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:01.771061  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:01.777477  8584 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 24: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:04:01.778110  8550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.011s	sys 0.048s
W20260709 13:04:01.778472  8550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.012s	sys 0.049s
I20260709 13:04:01.783464  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:01.701126 16303 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.746273 16216 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:01.766855 16281 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:04:01.820756  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 137392us
I20260709 13:04:01.771517 16282 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:01.883950  8581 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:01.754485 15947 raft_consensus.cc:697] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:04:01.880508  8510 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:04:01.773164 16351 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:01.889264  9098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 2100) took 1379 ms. Trace:
I20260709 13:04:01.889678  9098 rpcz_store.cc:276] 0709 13:04:00.515658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.529933 (+ 14275us) service_pool.cc:224] Handling call
0709 13:04:00.530362 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.530834 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.530874 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:00.554507 (+ 23633us) log.cc:844] Serialized 26 byte log entry
0709 13:04:00.828308 (+273801us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:04:00.828366 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.828454 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.889040 (+1060586us) raft_consensus.cc:1685] finished
0709 13:04:01.889069 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.889205 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1037,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":13017,"thread_start_us":269843,"threads_started":1,"wal-append.queue_time_us":438172}
W20260709 13:04:01.947642  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 61656.1us
I20260709 13:04:01.885545 15860 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.953001  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.779381 16277 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.958988  8550 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.962814  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:01.775898 16215 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.120s
I20260709 13:04:01.966840 16215 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.967499 16215 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:01.968022 16303 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:01.970258 16346 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:01.971469  8430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52386 (request call id 1588) took 1123 ms. Trace:
W20260709 13:04:01.971902 16339 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:04:01.962147 16069 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.971920  8430 rpcz_store.cc:276] 0709 13:04:00.847856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.848007 (+   151us) service_pool.cc:224] Handling call
0709 13:04:01.971204 (+1123197us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b5400238f54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:04:01.971380 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963931008}
W20260709 13:04:01.963104 16295 consensus_meta.cc:287] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 1.267s	user 0.004s	sys 0.010s
W20260709 13:04:01.974782 16337 log.cc:927] Time spent T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:04:01.976871  7335 tablet_server.cc:179] TabletServer@127.7.41.193:0 shutting down...
I20260709 13:04:01.892985 15937 consensus_queue.cc:1059] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 13:04:01.974288 16325 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 13:04:01.991954 16333 log.cc:927] Time spent T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.317s	user 0.003s	sys 0.001s
I20260709 13:04:01.978245 16277 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:01.964769 15860 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:01.973969 16353 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 13:04:02.017340  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 54598.1us
I20260709 13:04:01.982945 16125 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:01.977749 16330 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:01.982877 16103 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.988773 16019 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:01.982599 16336 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.985543 15898 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:01.985883 16160 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:01.990482 16295 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:01.990906 16272 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:02.018673 16346 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.102753 16272 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.102999 16346 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.105643 16346 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:02.110575 16076 consensus_meta.cc:287] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
I20260709 13:04:02.111114 16076 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:02.112686  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2885) took 1085 ms. Trace:
I20260709 13:04:02.113147  8508 raft_consensus.cc:3060] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:02.113116  8501 rpcz_store.cc:276] 0709 13:04:01.026813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.026917 (+   104us) service_pool.cc:224] Handling call
0709 13:04:01.073228 (+ 46311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:01.110958 (+ 37730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:01.110998 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:01.111494 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:04:01.705760 (+594266us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:04:01.744680 (+ 38920us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.745053 (+   373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.745156 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.975581 (+230425us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b18001f7f80. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:04:02.112321 (+136740us) raft_consensus.cc:1685] finished
0709 13:04:02.112454 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.112622 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4166,"prepare.queue_time_us":40167,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":32486,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":13462,"spinlock_wait_cycles":5149056,"thread_start_us":469367,"threads_started":1,"wal-append.queue_time_us":789067}
I20260709 13:04:01.979218 16069 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.118824 16163 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:02.119704 16069 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.119442 16163 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:02.070777 16332 log.cc:927] Time spent T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:04:02.042330 16334 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:02.039762 16215 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.066743 15947 consensus_queue.cc:237] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.075901  9067 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:02.089123 15881 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:02.094739 16160 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.096073 16114 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.081725 16336 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.098239  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 2882) took 1076 ms. Trace:
I20260709 13:04:02.130744  8508 raft_consensus.cc:2468] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:04:02.131934  8580 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: []
W20260709 13:04:02.089869 16030 consensus_meta.cc:287] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.538s	user 0.003s	sys 0.005s
I20260709 13:04:02.105703 16272 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:02.082687 16344 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
W20260709 13:04:02.143107  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 67265.8us
I20260709 13:04:02.150017 16330 raft_consensus.cc:2804] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:02.155035  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.155733  9098 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:04:02.155925  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.159227  9096 raft_consensus.cc:2468] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:04:02.162101  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:02.134112  8502 rpcz_store.cc:276] 0709 13:04:01.021716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.026085 (+  4369us) service_pool.cc:224] Handling call
0709 13:04:01.111883 (+ 85798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:01.134919 (+ 23036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:01.134960 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:01.185384 (+ 50424us) log.cc:844] Serialized 26 byte log entry
0709 13:04:01.525530 (+340146us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:04:01.525581 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.525670 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.097827 (+572157us) raft_consensus.cc:1685] finished
0709 13:04:02.097850 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.098175 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25122,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":22028,"thread_start_us":248920,"threads_started":1,"wal-append.queue_time_us":475745}
I20260709 13:04:02.165928  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:02.163209  8578 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
W20260709 13:04:02.168754  9067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.170341  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:02.171661  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.172305  9102 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:04:02.171005  8581 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 18.
I20260709 13:04:02.174356  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:02.157230 16334 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:02.185830 16014 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:02.123430 16019 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.171473 16347 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.170362 16330 raft_consensus.cc:697] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:04:02.184995  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:02.198324  8575 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:02.186628 16076 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.213649 16336 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.214057  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.193961 16014 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.215016 16114 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.160713 15881 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:02.206633 16302 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:02.215906 15881 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.212198 16163 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.212038  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:02.218741  8579 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:02.194387 16334 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.222085 16019 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.205201 16347 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.224215 16334 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.214931  9101 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:04:02.215337 16014 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:02.190218 16160 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.207578  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:02.206611 16215 raft_consensus.cc:2804] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:02.227440 16215 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:02.227939 16215 raft_consensus.cc:3060] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:02.228637 16371 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:02.229115 16371 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:02.229478 16371 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.215960 16302 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.231670  8508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55892 (request call id 1702) took 1375 ms. Trace:
I20260709 13:04:02.232060  8508 rpcz_store.cc:276] 0709 13:04:00.856693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.856835 (+   142us) service_pool.cc:224] Handling call
0709 13:04:02.231525 (+1374690us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540008f7d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:04:02.231619 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2743144320}
I20260709 13:04:02.240824  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:02.243285  9101 raft_consensus.cc:1240] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:04:02.244889  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.245687  9098 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:04:02.246928 16019 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:04:02.250228  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:02.256254 16302 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.256942  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.258596 16330 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.250634 16242 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.263348  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.264189  9101 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:02.266496  8579 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:04:02.268210  8400 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:02.270123 16369 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:02.270658 16369 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:02.270774 16242 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.271533 16369 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:02.225037 16347 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:02.284332  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.284921  8398 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:02.285218  9098 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:04:02.280287  8547 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:02.287777  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.291174  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.291765  8510 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:04:02.292944  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:02.303458  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:02.311064  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:02.311892  9099 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.312848  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:02.313438  9101 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.315464  8510 raft_consensus.cc:2468] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:02.316664  8549 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:02.294977  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:02.332520  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:02.333436  9098 raft_consensus.cc:2393] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 20: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:04:02.335605  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 50760.4us
I20260709 13:04:02.343508  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:02.343395  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:04:02.285609 16295 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:02.312975 15898 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.313175 16114 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:02.380910 16358 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:02.381084 16114 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:02.381585 16358 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.382830  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:02.333098 16325 raft_consensus.cc:2804] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:04:02.387037 16343 log.cc:927] Time spent T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.712s	user 0.001s	sys 0.001s
I20260709 13:04:02.382845 16368 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:02.340553 16347 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:02.391534  9100 raft_consensus.cc:2468] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
W20260709 13:04:02.375377  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 199744us
I20260709 13:04:02.378302  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:04:02.379669 16329 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.704s	user 0.003s	sys 0.000s
I20260709 13:04:02.366940 16103 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:02.402580  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.403751  9098 raft_consensus.cc:2410] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:04:02.374246  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:02.396198  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:02.407368  9101 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:04:02.404496  8575 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:04:02.388898 16311 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.373368 15860 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.390718 16368 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:04:02.439708  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 262139us
I20260709 13:04:02.435189  9099 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:04:02.394186 16347 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.434482  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:02.395490 15881 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:02.402701 16242 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:02.402804 16325 raft_consensus.cc:697] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:02.405049 16114 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.476869  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:02.480728  9101 raft_consensus.cc:2393] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:02.482214  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.483130  9099 raft_consensus.cc:2410] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 for term 17 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:04:02.391134 15898 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.488379  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.489140  9098 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:04:02.440078 16280 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:02.404786 16295 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.473587 16347 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:02.475668 16242 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:02.503700  8502 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:02.512725  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 169393us
I20260709 13:04:02.442759 16311 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:02.517084  9100 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:04:02.513777  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:02.509413 16242 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:02.514446 16160 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:02.531353 16160 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:02.533545 16160 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.541558 15042 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.499763 16280 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.552695  9099 raft_consensus.cc:1275] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:04:02.522956 16030 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:02.557709  8549 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:02.561666  8510 raft_consensus.cc:1240] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:02.574750  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:04:02.555903 16242 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.580627  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.584875  8503 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:04:02.586369  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.589861  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:02.584527  9068 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:02.590646  8501 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:04:02.591624  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:02.592176  8508 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:02.592979  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.597007  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:02.560357 16320 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:04:02.600157  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 279099us
W20260709 13:04:02.601344  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 259439us
I20260709 13:04:02.602936  9067 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:02.609460  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.589305 16348 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:02.583871 16340 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:04:02.614562  8550 leader_election.cc:336] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:02.627908  8550 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:02.584810 16030 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.603870 16320 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.551792 16325 consensus_queue.cc:237] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.553603 16368 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:02.690419  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.672138  8508 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:04:02.646762  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.701145  8506 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:04:02.699275  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 89702.7us
I20260709 13:04:02.677516  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.620702 15947 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:04:02.666970 16374 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:04:02.702495  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.717602  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:02.638656 16320 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:02.640225 16085 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:02.675474 16358 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.684811 16295 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.710749 16125 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:02.760497  9100 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
W20260709 13:04:02.769971  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.773900 16371 consensus_meta.cc:287] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.003s
I20260709 13:04:02.779314  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.712642 15947 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:02.796408 15937 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.797461 16191 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.798280 16198 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:04:02.798799 16383 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:04:02.715766 16242 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.724409 16311 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.770681 16280 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:02.802703 16389 log.cc:927] Time spent T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:04:02.804987 16331 raft_consensus.cc:3055] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:02.806376  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.716506 16348 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:02.807677 16030 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.807848  9097 raft_consensus.cc:1275] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:04:02.808250 16314 log.cc:927] Time spent T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:04:02.808758 16380 log.cc:927] Time spent T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:04:02.808693  8502 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:04:02.815761 15947 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:02.784581 16376 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:04:02.683844 16014 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.822069 16312 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:02.819197  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:02.819837  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.819720  9096 raft_consensus.cc:1275] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:04:02.866784  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 51134.3us
W20260709 13:04:02.867630  8550 leader_election.cc:336] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:02.868510  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.825402 16331 raft_consensus.cc:740] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:04:02.799046 16378 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:04:02.823556  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.816381 16369 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:02.826004  8503 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
W20260709 13:04:02.831992  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 223372us
W20260709 13:04:02.822386 16392 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:04:02.853474  9068 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:02.821902 16198 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:02.858047  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.874691  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:02.875867  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.862272  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:04:02.874390  9068 leader_election.cc:336] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:02.878451  9068 leader_election.cc:336] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:02.827827 16125 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:02.818123 15042 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.865077  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.882135  8501 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:02.819185  8428 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52372 (request call id 2937) took 1751 ms. Trace:
W20260709 13:04:02.869230  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.819294 16371 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.815127 16085 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.822110 15937 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:02.879279  9068 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:02.881036  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:02.878726  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:02.877132  8547 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:02.882236 15042 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.888865  8505 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:02.882395  9097 raft_consensus.cc:2468] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:04:02.882905  8428 rpcz_store.cc:276] 0709 13:04:01.068175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.071393 (+  3218us) service_pool.cc:224] Handling call
0709 13:04:02.815869 (+1744476us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b5400125a54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:04:02.819124 (+  3255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054468864}
W20260709 13:04:02.893025 16341 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.017s	sys 0.027s
W20260709 13:04:02.893497 16341 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.017s	sys 0.027s
W20260709 13:04:02.888154  9068 consensus_peers.cc:597] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.890142 16125 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.900914 16321 consensus_queue.cc:1059] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:02.901597 16371 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.902851 16125 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.905190  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.905781 16372 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:02.884084 16318 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:02.907317 16318 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.907701 16318 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:02.914532  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:02.917110 16276 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:02.917521 16276 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:02.917862 16276 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:02.918388 16335 raft_consensus.cc:3055] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:02.918846 16335 raft_consensus.cc:740] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:02.919694 16335 consensus_queue.cc:260] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:02.877081 16242 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:02.915539 16279 raft_consensus.cc:3055] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:02.920696  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.925976  8509 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:02.926010  9097 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
I20260709 13:04:02.926433  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:02.920138 16085 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.922369  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.930689  8505 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
W20260709 13:04:02.922964  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:02.923707  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.924902  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:02.932016  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.932184  8506 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:04:02.922266  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:02.895236 16030 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:02.928473 16335 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:02.928768 15042 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.932041  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:02.934058  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.936331  8508 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:02.935468  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.937554  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:02.890759 16340 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:02.930243 16279 raft_consensus.cc:740] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:02.939056  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.870661 16312 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.943212  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.896951 16325 raft_consensus.cc:2804] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:02.943473  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:02.939776  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:02.943997  8510 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 25.
I20260709 13:04:02.927177 16372 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.949847  9097 raft_consensus.cc:2393] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 20: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:02.950230 16325 raft_consensus.cc:697] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:02.953693 16325 consensus_queue.cc:237] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.933851 16030 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:02.956364 16030 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:02.958909 16312 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.882642 16369 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.961346 16369 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.954105 15937 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:02.938550 16311 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:02.969652 16030 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.934508 16293 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:04:02.973264  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:02.979744  8508 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:02.981534  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:04:02.983920  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 44190.6us
I20260709 13:04:02.944669 16167 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:02.988493 16167 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:02.990526 16167 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:02.990559 16030 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:02.987370 16295 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:02.992110 16242 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:02.992616 16242 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.993042 16242 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:02.994393 16347 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:02.995896  9099 raft_consensus.cc:2393] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 19: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:02.921031 16348 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:03.007624 16354 log.cc:927] Time spent T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 1.332s	user 0.003s	sys 0.001s
I20260709 13:04:03.008533 16167 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.010398 16076 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:03.010969 16076 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.011936 15947 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.013224 16076 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:02.945233 16331 consensus_queue.cc:260] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.013747 16069 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:03.020710  9093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33884 (request call id 1769) took 1596 ms. Trace:
W20260709 13:04:03.037794  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 51148.9us
I20260709 13:04:03.041958  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:03.037602  9096 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:03.017957  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:03.045991  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:02.986306 16215 consensus_meta.cc:287] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.006s
I20260709 13:04:03.049114  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.056012  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:03.055819  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 126051us
W20260709 13:04:03.062343  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.045614 15947 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.045083  9093 rpcz_store.cc:276] 0709 13:04:01.424636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.427361 (+  2725us) service_pool.cc:224] Handling call
0709 13:04:01.431665 (+  4304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.487502 (+ 55837us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:04:01.633956 (+146454us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.640719 (+  6763us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:01.640769 (+    50us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:04:01.640820 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.020451 (+1379631us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b5400526554. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:04:03.020502 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.020634 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188144,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":70147,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"spinlock_wait_cycles":127856896,"thread_start_us":134239,"threads_started":2,"wal-append.queue_time_us":49506}
I20260709 13:04:03.017874 15898 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.046665 16030 raft_consensus.cc:2804] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:02.979067 16372 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.019940 16014 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.089605 16167 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.087030  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.064333  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:03.094132  9100 raft_consensus.cc:2393] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 18: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:03.021113 16198 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.043957 16295 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:04:03.099400  9065 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.055472 16069 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.084950 16030 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:03.062969 16215 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.069794 16197 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:04:03.094708 16167 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:03.098453 16125 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:03.106818 16409 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:03.124511  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.113698 16030 raft_consensus.cc:3060] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:03.116463 16276 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.134088 16276 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.137930  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.138587  8578 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
I20260709 13:04:03.139961 16191 consensus_queue.cc:1059] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:03.140698 16191 consensus_queue.cc:1243] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 5ffc86752d264d0c81f68028e6413a91 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:04:03.141949 16348 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:03.142532 16348 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.142675 16242 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.145211 16387 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:03.145915 16387 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.141360 16320 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.162493 16308 raft_consensus.cc:3055] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:03.162341  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:03.162451 16387 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:03.167071 16372 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.167702  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.167950  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:03.168226 16280 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.169072  8579 raft_consensus.cc:1240] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:04:03.169907  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:03.171224 16069 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.095281 16340 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.174304 16323 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:03.174515  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.213955 16406 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:03.203622 16308 raft_consensus.cc:740] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:03.182730 16215 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.184160 16198 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.128475 16125 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.237551 16293 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:03.124750 16167 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.238204 16293 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.240020 16167 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.159525 16409 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:03.185828  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.215070 16295 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:03.240983  8576 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:04:03.241207 16295 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:03.241703 16295 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:03.243736  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:03.244073  8576 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:03.244310  9102 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:03.186501  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.187179  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:03.248466 16125 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.248715  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:03.249822  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.249929 16308 consensus_queue.cc:260] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.251003  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:03.251565  9100 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:03.252528 16295 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.253419 16347 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.254926  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.251004 16308 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:03.201212  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.256201  8580 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 22: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:03.219590 16406 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.212472  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:03.203334 16410 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:04:03.169486 16279 consensus_queue.cc:260] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.258548 16279 raft_consensus.cc:3060] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:03.260526  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.261725  8504 raft_consensus.cc:1240] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:03.263597  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.264631 16406 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:03.264953  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.265455  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.266613  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:03.267103  8506 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:04:03.267303  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.267884  8509 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:04:03.268631  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:03.268702 16409 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:03.271540  8501 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:04:03.272040 16331 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:03.272622  8501 raft_consensus.cc:3055] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:03.273216  8501 raft_consensus.cc:740] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:03.264665  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.274606  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.275260  8583 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 22: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:03.275565  9100 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 26.
I20260709 13:04:03.276690  9102 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:04:03.277503  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.180966 16318 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.211575  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:03.265695  8507 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 25: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:03.269731  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.280910  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.281245  9094 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:04:03.288736  8504 raft_consensus.cc:1240] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 24. Current term is 25. Ops: []
I20260709 13:04:03.232524  8584 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:04:03.278335  8400 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:03.281394  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.273916  8501 consensus_queue.cc:260] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.240327 16293 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.317545  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.318758  8501 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:03.322469  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 44257.6us
I20260709 13:04:03.213019 16280 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.224896 16323 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.294696 16197 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:03.337155 16197 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.337993  8398 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:03.341723 15971 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:03.342272 16295 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.344658 16280 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.344743  8506 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
W20260709 13:04:03.345311  9068 consensus_peers.cc:597] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:03.345754  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 413068us
I20260709 13:04:03.329466 16047 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:03.336390 16242 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:03.348855  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 224410us
W20260709 13:04:03.349246  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:03.352389  9068 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:03.352985  9068 leader_election.cc:336] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:03.353329  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:03.355625  9068 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:03.384357  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:03.385258  8503 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:03.354076 15881 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:03.338243 16014 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:03.390372  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.408627  9093 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 26 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:04:03.406689  9065 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.358093 16047 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 21 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:03.351063 16280 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:03.412142  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:03.413077  8506 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:03.414469  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 60059.7us
I20260709 13:04:03.415294  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:03.416535  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:03.346482 16232 consensus_queue.cc:1059] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:04:03.418388 16197 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.419423  9093 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:04:03.419664 15881 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:03.416987  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.428867 16047 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.431679  8501 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:04:03.409555 16295 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:03.446909  8501 pending_rounds.cc:85] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Aborting all ops after (but not including) 10
I20260709 13:04:03.447311  8501 pending_rounds.cc:107] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:04:03.447628  8501 raft_consensus.cc:2889] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:03.440809  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:03.424799 16278 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:03.458319  8506 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:04:03.466176  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.461671  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.467285  9065 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:03.463110  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.467996  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:03.454806  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:03.469202  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 585894us
I20260709 13:04:03.471256  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
W20260709 13:04:03.469815  8550 leader_election.cc:336] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:03.473986  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.474275  9065 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.413738 16014 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.446637 16085 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:03.449275 16418 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:03.482728  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:03.479816  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.481273  9065 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:03.481760 15042 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:03.480980  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:03.473249  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:03.485518  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:03.478682  8398 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:03.486263  8579 raft_consensus.cc:2368] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:04:03.486055  9065 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.486068  8576 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:03.481052  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:03.488427  8505 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:04:03.491145  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:03.469729 16320 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.477450 16167 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:03.424278 16191 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:04:03.496498  8549 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:03.474893 16125 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:03.494804  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:03.482719 16347 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:03.495268  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:03.506764  8506 raft_consensus.cc:2368] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:04:03.497001  8547 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
W20260709 13:04:03.486049  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:03.504509  8473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.483214 16198 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:03.504663  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:03.484952 16076 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:03.483724 16418 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.511910  8502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59098 (request call id 2899) took 1224 ms. Trace:
I20260709 13:04:03.519747  8502 rpcz_store.cc:276] 0709 13:04:02.287728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.313554 (+ 25826us) service_pool.cc:224] Handling call
0709 13:04:03.511760 (+1198206us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540008d9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:04:03.511858 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366862208}
I20260709 13:04:03.482931 16417 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:04:03.474808 16390 consensus_queue.cc:1048] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:04:03.497254 16276 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:03.480142 16355 consensus_queue.cc:1048] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:04:03.470137 16295 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:03.514185  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.534986 15971 raft_consensus.cc:3055] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:03.518169 16242 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 13:04:03.533456 16318 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.530961 16003 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:04:03.521981  8581 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:03.543704 16014 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.544420 16323 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.544821  8503 raft_consensus.cc:2468] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:04:03.545693 16030 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.503790 16167 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.494550 16422 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:03.509135 16215 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:03.509647 16103 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:03.553269  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:03.510572 16347 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:04:03.518857 16421 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:04:03.530833 16419 log.cc:927] Time spent T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:04:03.511508 16278 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:03.562101  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.515715 16085 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.501181 15937 consensus_queue.cc:1048] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:04:03.522768 16418 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:03.517786 16325 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:03.571004 16335 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:03.595188 16003 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:03.559006 16069 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.594918  8503 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 25. Current term is 26. Ops: []
I20260709 13:04:03.562618 15983 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:04:03.559894 16340 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:04:03.599604  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.587863 16167 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:03.562969 15971 raft_consensus.cc:740] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:03.609580  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.610438  8505 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:04:03.658484  8509 raft_consensus.cc:2468] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:04:03.611654  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:03.552634 16276 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:03.597640 16347 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:03.646412 16348 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.614742  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.673486  8510 raft_consensus.cc:2410] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 26 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:04:03.591284 16215 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:03.652549  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 144740us
I20260709 13:04:03.659391  8504 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:03.658028 16232 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.642067 16085 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:03.614766  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 121791us
I20260709 13:04:03.642781 15881 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:03.598744 16318 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:04:03.663511  9067 leader_election.cc:400] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:04:03.690836  9067 leader_election.cc:403] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:04:03.650838 16325 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:03.666617 16280 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:03.667393 16276 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:03.641523 16014 consensus_queue.cc:1059] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 13:04:03.649184 16335 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.691553  9065 leader_election.cc:400] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:04:03.693813  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:03.699854 15042 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:03.699394  8576 raft_consensus.cc:2468] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:04:03.675760 16331 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.679688 16215 raft_consensus.cc:3060] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:03.688777  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:03.664271 16281 consensus_queue.cc:1059] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.026s
I20260709 13:04:03.659358 16069 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.701998  8549 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:03.706627 16426 log.cc:927] Time spent T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:04:03.705528  8476 consensus_peers.cc:597] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:03.713217 16379 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.829s	user 0.012s	sys 0.001s
I20260709 13:04:03.720327 16215 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.724681 16215 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:03.727588 16424 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.310s	user 0.002s	sys 0.000s
I20260709 13:04:03.615947 16278 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:03.712203  8476 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:03.734404  8476 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:03.735025  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:03.737493  8476 leader_election.cc:336] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:03.738749  8476 leader_election.cc:336] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:03.739315  8476 leader_election.cc:336] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:03.699126 16430 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:03.690958 16232 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:03.740506  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:03.755654  8580 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:04:03.709663 16422 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:04:03.764674 16335 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:03.708866 15971 consensus_queue.cc:260] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.766808  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:03.767225 15971 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:03.744812 16295 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.707477 16331 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.774986  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.742940 16435 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:03.786454  8504 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:04:03.760426 16030 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.792604 16417 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:03.793174 16417 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.774196 16278 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.777676 16085 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.789655 16429 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.787678 16347 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.812282  8547 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:03.815760 16340 raft_consensus.cc:2804] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:03.816938 16232 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.817498 15983 raft_consensus.cc:3055] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:04:03.817891 15983 raft_consensus.cc:740] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:03.818097 16331 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
I20260709 13:04:03.751580 16325 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.818737 15983 consensus_queue.cc:260] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.819922 15983 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:03.821707 16417 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:03.824107 16279 consensus_meta.cc:287] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.004s
W20260709 13:04:03.825063  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 148605us
I20260709 13:04:03.826718 16191 raft_consensus.cc:3055] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:04:03.827122 16191 raft_consensus.cc:740] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:03.827885 16191 consensus_queue.cc:260] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.829255 16191 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:04:03.830717 16308 consensus_meta.cc:287] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.000s
I20260709 13:04:03.825893  9065 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:03.825238 16069 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:03.839831  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 358809us
I20260709 13:04:03.840634  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.842226 16293 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:04:03.842631 16293 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.842989 16293 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:03.846159 16198 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:03.847234 16198 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.849403 16167 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.851315 16216 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:03.851965 16167 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.831406 16276 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.853598 16069 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.854530 16276 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:03.856349 16347 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.856864 16069 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.861757 16340 raft_consensus.cc:697] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:03.862773 16340 consensus_queue.cc:237] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:03.864946 15881 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:03.865456 15881 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:03.865607 16311 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:03.866223 16311 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.871060 16069 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.874260  8509 raft_consensus.cc:1275] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:04:03.868214 16311 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:03.876151  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:03.876685  9100 raft_consensus.cc:1240] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 25. Current term is 26. Ops: []
I20260709 13:04:03.877409  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.877523  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:03.878010  9098 raft_consensus.cc:2468] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:04:03.878611  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.880631  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:03.882373  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.882949  8584 raft_consensus.cc:2468] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 26.
I20260709 13:04:03.886171  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.887549  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:03.811919 16429 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:03.888934  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.891265 16429 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:03.894168  8475 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:03.895102  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 53129.8us
I20260709 13:04:03.896045  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:03.897084  8475 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:04:03.897473  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:03.897761 16216 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:04:03.948845  8476 leader_election.cc:336] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:03.949460  8476 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.898847 15969 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:03.899338  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:03.900301  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 74494.3us
I20260709 13:04:03.907728 16430 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653) with higher term. Message: Invalid argument: T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 19. Current term is 20.
I20260709 13:04:03.901350 16420 raft_consensus.cc:2749] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:04:03.908715 16308 consensus_queue.cc:1048] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:04:03.913120  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:03.914213  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.917333  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.923305  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.935389  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:03.943809  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:03.946892  9067 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:03.957211  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:03.977936  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:03.994452  9101 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:04:03.995759  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:03.981384  8476 consensus_peers.cc:597] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:03.984508  9093 raft_consensus.cc:1275] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:04:03.989401  8475 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:03.990685  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:04.001065  8475 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:04.005021  9100 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 24. Current term is 25. Ops: []
I20260709 13:04:03.983767 16167 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:04:03.947778 16197 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:04.010066  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 63296.6us
I20260709 13:04:04.010106  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:03.979030 16311 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:04:03.997280  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:04.031015  8476 leader_election.cc:336] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.018194  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:04.016803  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 81503.7us
W20260709 13:04:04.032164  8476 leader_election.cc:336] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.035168  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:04.026830  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:03.975003 15971 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.811131 16418 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:04.026754  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.025476  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:03.978785 16385 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:04.040786  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:04.054041  8476 leader_election.cc:336] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.058034  8476 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:04.058764  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:04.009135 16216 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:04.019413 16432 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.020776 16069 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:04.022279 15969 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:04.025741 16430 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:04.071487  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:04.087020  9102 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 18: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:04:04.084563  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 59169.7us
W20260709 13:04:04.082408  8550 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 51 similar messages]
I20260709 13:04:04.092872  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:04.094873  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:04.017903 16293 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.062314 16278 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:04.072978 16311 raft_consensus.cc:697] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:04.053066 16232 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:04:04.073153 16167 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:04.134943 15969 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:04:04.038602 16197 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:04.086259 16216 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.045256 15860 consensus_queue.cc:1048] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:04:04.146703  8398 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:04.154708  8504 raft_consensus.cc:2368] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 25. Current term is 26.
I20260709 13:04:04.114773 16430 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:04:04.181782 16280 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:04.182590 16280 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:04.181823 16430 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.183499 16280 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.096086 16437 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:04.175750  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:04:04.136052 16281 raft_consensus.cc:2804] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:04.097193 16279 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:04.115227 16069 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:04:04.187947  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:04.160663 15881 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.140024 16215 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:04.238443  9101 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
W20260709 13:04:04.239277  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.146843 16372 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.073307 16385 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:04.256976  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:04.109799 15971 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:04.084270 16432 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.270176  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
W20260709 13:04:04.262904  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 392869us
I20260709 13:04:04.174904 16030 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:04:04.206230 16216 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.264055 16279 raft_consensus.cc:2804] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:04:04.295351  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 241339us
I20260709 13:04:04.250627 16215 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.254611 16372 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.320881  9098 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:04:04.294382 16279 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:04.308072 16387 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.307973 16295 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.314867 16422 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:04.339339 16418 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:04.340391 16387 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:04.344501  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 153957us
I20260709 13:04:04.344790  9098 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 22. Current term is 23. Ops: []
I20260709 13:04:04.347332  9097 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:04:04.335527 16279 raft_consensus.cc:3060] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:04.290721 16311 consensus_queue.cc:237] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.343227 16198 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.354588  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:04.343698 16295 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:04.358812 16030 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:04.358858 15971 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:04.362195 16293 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:04.362062  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:04.346576 16422 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:04.385681 15983 consensus_meta.cc:287] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.004s
I20260709 13:04:04.356485 16198 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:04.389173  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 242560us
W20260709 13:04:04.414507  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 52544.5us
I20260709 13:04:04.418946  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:04.421751  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 125559us
W20260709 13:04:04.423493  8550 leader_election.cc:336] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:04.424872  8550 leader_election.cc:336] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.417984 15983 raft_consensus.cc:2804] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:04.418009 16385 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:04.428823  8550 leader_election.cc:336] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.424305 16197 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:04.433658  8550 leader_election.cc:336] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.434265  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:04.436251  8550 leader_election.cc:336] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:04.437793  8550 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.438558  8550 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:04.427362 16454 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.428597 15983 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.456513  8504 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:04:04.436738 16215 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:04.464895 16372 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:04.462996 16340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.003s	sys 0.014s
I20260709 13:04:04.438652 16323 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:04.463070 16454 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:04.467767 16454 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:04.461146 16047 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:04.470914 16340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.003s	sys 0.015s
I20260709 13:04:04.459724 15983 raft_consensus.cc:3060] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:04.473196 16323 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:04.457847 16385 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:04.435467 16216 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:04.460178 16125 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:04.440384 16432 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:04.474529 16385 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.464139 16281 raft_consensus.cc:697] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:04:04.498803 16446 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:04:04.501494 16443 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:04:04.502804 16295 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:04.503935 16422 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:04.508132 16191 consensus_meta.cc:287] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.678s	user 0.015s	sys 0.000s
I20260709 13:04:04.509629 16198 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:04.491750  8476 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.520601 16281 consensus_queue.cc:237] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:04.532507  8476 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:04.533298  8476 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.544631 16279 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:04.549149 16422 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:04.549844 16422 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.552222 16422 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:04.552541 16457 log.cc:927] Time spent T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:04:04.541342  8476 leader_election.cc:336] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:04.577963  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:04.583192  9068 leader_election.cc:336] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.585212  9068 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:04.575955 16198 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:04.588587  8503 raft_consensus.cc:1275] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:04:04.587617  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:04.579798 16340 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.593784  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:04.582482 16325 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.604197  9095 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:04.607292  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:04.609272  9102 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:04:04.591847 16279 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:04.605077 16191 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:04.629459  9065 leader_election.cc:400] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 election: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 25. Current term is 26.
I20260709 13:04:04.651681  9065 leader_election.cc:403] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:04:04.652877 16429 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:04.629495  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:04.593636 16198 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:04.650339  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:04.656178 16198 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:04.616719 16323 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.645655 16197 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:04:04.657681 16323 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:04.663830  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:04.664927  8502 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate dacb523538a14c7cb335ab9c18f4111b in this term.
I20260709 13:04:04.667438  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:04.605497 15947 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:04.631579  9068 leader_election.cc:336] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:04.676226  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 44705us
I20260709 13:04:04.614382 16432 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.606415 16325 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.598953 16340 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:04.642575  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:04.644146 16453 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:04:04.645638 16387 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:04.648679  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:04.649813  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:04.650339  8476 leader_election.cc:336] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.612418 16455 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:04.673038  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:04.659318 16459 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:04:04.746250  8578 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
W20260709 13:04:04.756090  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 105793us
I20260709 13:04:04.768213  8507 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 18: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:04.742426  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:04.769487  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:04.769635  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:04.770490  8502 raft_consensus.cc:2393] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 22: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:04.749982  8510 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:04:04.770824  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:04.740940  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:04.772028  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:04.726614  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:04.740624  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:04.754671  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:04.773325  8583 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:04:04.659430 16167 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.775310 16167 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.775607 15860 consensus_queue.cc:1059] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:04:04.777072 16387 raft_consensus.cc:3055] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:04:04.777508 16387 raft_consensus.cc:740] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:04.777599 16167 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:04.786391  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:04.778843 16198 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:04.670981 16448 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:04.781879  8508 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 21: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:04.782727  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:04.804363  8579 raft_consensus.cc:2468] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:04:04.793931  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:04.796096  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:04:04.786427  8476 leader_election.cc:336] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.734959 16330 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.806341  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:04.746116 16340 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:04.740123 16323 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:04.837790  8476 leader_election.cc:336] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.765463 16455 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.777326 16429 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749) with higher term. Message: Invalid argument: T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 for earlier term 25. Current term is 26.
I20260709 13:04:04.785344 15969 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:04.854238  8507 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:04:04.854844 15969 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:04.855404 15969 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:04.855738  9100 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:04.851400 16455 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:04.735175 15983 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.875664  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:04.742955 16432 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.844928 16197 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.886132  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:04.845118 16047 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:04.847476 16216 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:04.890712  8502 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
W20260709 13:04:04.893225  8476 leader_election.cc:336] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:04.893779 15881 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:04.896077  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:04.837546 16417 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:04:04.896716  8502 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:04:04.899320  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:04.847479 16330 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.848950 16448 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:04.915645  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 140392us
I20260709 13:04:04.892412 16197 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.939997 15969 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:04.958122  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:04.958431  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:04.961825  8475 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:04.962141  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:04.963668  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:05.029724  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 67980.9us
I20260709 13:04:05.037540  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:05.039635  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:05.044096  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.045794  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:05.047765  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:05.080193  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 160586us
I20260709 13:04:05.118626  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.119426  8583 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:04:05.130888  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:05.131754  9093 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
W20260709 13:04:05.132607  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 211729us
I20260709 13:04:04.942595 16323 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.179s
I20260709 13:04:05.040911 16384 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:05.143970  9093 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:04:05.158557 16432 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:05.159761 16449 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.695s	user 0.007s	sys 0.003s
I20260709 13:04:05.162312 15983 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.162392  9099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 2145) took 1244 ms. Trace:
I20260709 13:04:05.162860  9099 rpcz_store.cc:276] 0709 13:04:03.917981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.918205 (+   224us) service_pool.cc:224] Handling call
0709 13:04:03.923385 (+  5180us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:03.986685 (+ 63300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.986736 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:04.017427 (+ 30691us) log.cc:844] Serialized 52 byte log entry
0709 13:04:04.388739 (+371312us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:04:04.388806 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.388904 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:05.159206 (+770302us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a18eda86e 00007f1a18ed9bb6 00007f1a18ed97d8 00007f1a18ee3221 00007f1a18ee31d9 00007f1a18ee3169
0709 13:04:05.162085 (+  2879us) raft_consensus.cc:1685] finished
0709 13:04:05.162106 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.162334 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5147,"raft.queue_time_us":24544,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":17070,"spinlock_wait_cycles":26467072,"thread_start_us":304703,"threads_started":1,"wal-append.queue_time_us":383703}
I20260709 13:04:05.166093 16448 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:05.152464 16384 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:05.174499 16455 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.175086 16454 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:05.175815 16454 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.176718 16455 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.179200 16197 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.137866 16453 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.212913  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 101584us
I20260709 13:04:05.189627  8333 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 16 to 17, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 17 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.143931 16325 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.228706  8333 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.230119  8333 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 15 to 16, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 16 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.231393  8333 catalog_manager.cc:5697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 11 to 14, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 14 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.144744 15969 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.226068  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:05.249550  8333 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.152269 15937 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.083s
I20260709 13:04:05.251724  8333 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 13 to 20, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 20 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.254401  9101 raft_consensus.cc:2468] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 26.
W20260709 13:04:05.257364  9097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33868 (request call id 2140) took 1344 ms (client timeout 1620 ms). Trace:
I20260709 13:04:05.257483  8333 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 11 to 17, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 17 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.260037  9101 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:05.263444  9095 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:05.263768  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:05.155606 16308 consensus_queue.cc:1059] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.097s
W20260709 13:04:05.248054 16468 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:04:05.263859  9099 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
W20260709 13:04:05.258816  9097 rpcz_store.cc:269] 0709 13:04:03.912758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.912883 (+   125us) service_pool.cc:224] Handling call
0709 13:04:05.257183 (+1344300us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b540049d9d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a193432fa 00007f1a1e304b17 00007f1a1787f6d4 00007f1a1787f662 00007f1a1787f591 00007f1a1787f50c 00007f1a1787e7c2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:04:05.257295 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4306816}
I20260709 13:04:05.271185 16486 consensus_queue.cc:1048] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:05.272641  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.274109  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.274549  8505 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:05.279682  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:05.252453 16197 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:04:05.287599  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 150313us
W20260709 13:04:05.290761  8332 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57104 (request call id 383) took 113325 ms (client timeout 15000 ms). Trace:
I20260709 13:04:05.291538  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:05.295646  9099 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:05.254144 16454 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.293390  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.213188 16453 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:05.302109  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.302744  8509 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:04:05.305064  8333 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 13 to 16, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 16 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.278126 16455 raft_consensus.cc:3055] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:05.326928  8333 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 12 to 18, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 18 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.328083  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.329710  8506 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:05.336082  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:05.339852  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:05.294302 16197 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.328992  8333 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 17 to 18, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 18 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.299940 16479 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.326413 16330 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:05.342622 16466 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:04:05.380349 16479 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.383055 16479 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.390522 16069 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.391188  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:05.391091 16069 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.391523 16453 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:05.392341  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:05.393096 16069 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.392823 16463 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:05.400697  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:05.347162  8333 catalog_manager.cc:5697] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 14 to 20, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 20 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.372960 16216 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:05.299072 16325 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:04:05.378508 16385 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.348330 16197 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:05.326876 16455 raft_consensus.cc:740] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:05.345502 16477 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:05.405045  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:05.348080 16384 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:05.422748  8333 catalog_manager.cc:5697] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.426007  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:04:05.294694  8332 rpcz_store.cc:269] 0709 13:02:11.965543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.970780 (+  5237us) service_pool.cc:224] Handling call
0709 13:02:12.367518 (+396738us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a9090 00007f1a19347f3a 00007f1a1f0fe1cc 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc 00007f1a1d6bc392 00007f1a1767a48c 00007f1a176798c6
0709 13:04:05.290660 (+112923142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:00.638507 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:00.639248 (+   741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:00.639301 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:04:00.639324 (+    23us) tablet.cc:662] Decoding operations
0709 13:04:00.639729 (+   405us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:00.639830 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:00.639861 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:00.640172 (+   311us) tablet.cc:701] Row locks acquired
0709 13:04:00.640214 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:04:00.640389 (+   175us) write_op.cc:270] Start()
0709 13:04:00.640536 (+   147us) write_op.cc:276] Timestamp: P: 1783602240640322 usec, L: 0
0709 13:04:00.640590 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 13:04:00.641318 (+   728us) log.cc:844] Serialized 533 byte log entry
0709 13:04:01.713823 (+1072505us) op_driver.cc:464] REPLICATION: finished
0709 13:04:02.796172 (+1082349us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b4400022b4c. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a16178c85 00007f1a161796a2 00007f1a18eeb1db 00007f1a18ee6aaf 00007f1a162350ac 00007f1a1f08fab9 00007f1a1625169b 00007f1a1624f93f 00007f1a16251c02 00007f1a1cd75ef0
0709 13:04:02.994056 (+197884us) write_op.cc:301] APPLY: starting
0709 13:04:02.994185 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:02.995886 (+  1701us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:02.995936 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:02.996945 (+  1009us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:02.997247 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:04:02.997322 (+    75us) write_op.cc:312] APPLY: finished
0709 13:04:02.997654 (+   332us) log.cc:844] Serialized 25 byte log entry
0709 13:04:03.118996 (+121342us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:03.121624 (+  2628us) write_op.cc:454] Released schema lock
0709 13:04:03.121673 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:03.121982 (+   309us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:03.122000 (+    18us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2741043,"reported_tablets":46,"spinlock_wait_cycles":81003904,"child_traces":[["op",{"apply.queue_time_us":1204213,"apply.run_cpu_time_us":19238,"apply.run_wall_time_us":139254,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8303,"num_ops":1,"prepare.queue_time_us":278151,"prepare.run_cpu_time_us":19183,"prepare.run_wall_time_us":267061,"raft.queue_time_us":281611,"raft.run_cpu_time_us":45679,"raft.run_wall_time_us":1235650,"replication_time_us":1042980,"spinlock_wait_cycles":132566528,"thread_start_us":1676173,"threads_started":5,"wal-append.queue_time_us":609447,"wal-append.run_cpu_time_us":13197,"wal-append.run_wall_time_us":2450413}]]}
I20260709 13:04:05.460403  8333 catalog_manager.cc:5697] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 9 to 18. New cstate: current_term: 18 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.465020  9099 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:04:05.424081 16069 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:05.467788  8333 catalog_manager.cc:5697] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.479585  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:05.423520 16473 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:05.449457 16485 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:05.490492  8580 raft_consensus.cc:1275] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:04:05.459834 16432 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:05.458091 16384 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.505676  8333 catalog_manager.cc:5697] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 8 to 16, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 16 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.510210  8333 catalog_manager.cc:5697] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 11 to 20. New cstate: current_term: 20 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.515033  8333 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 11 to 15, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 15 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.519785  8333 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 22 to 24, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 24 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.427531 16216 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.514046 16384 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:05.525385  8333 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 14 to 20, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 20 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.502146 16485 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.497767 16478 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:05.461043 16454 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:04:05.510332 16483 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:05.536989  8333 catalog_manager.cc:5697] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 8 to 15, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 15 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.546823  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:05.469467 16278 consensus_queue.cc:1059] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:04:05.458257 16477 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:05.500743 16069 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.558182  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:05.554863  8333 catalog_manager.cc:5697] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 9 to 21, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 21 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.540480 16485 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:05.535315 15969 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:05.545488 16281 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:04:05.560828  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 221047us
I20260709 13:04:05.559798  8333 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 17 to 18, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 18 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.582160  8333 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.586114  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.589612  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.593950  8333 catalog_manager.cc:5697] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:05.599402  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 206045us
I20260709 13:04:05.601488  8475 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:05.553313 16483 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.615828  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.615947  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.617087  8333 catalog_manager.cc:5697] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 16 to 19, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 19 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.618314  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.628131  8584 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:04:05.629855  8333 catalog_manager.cc:5697] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.643004  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.643675  8579 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 25.
I20260709 13:04:05.639767 16484 raft_consensus.cc:3055] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:05.651440 16503 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:05.651800 16484 raft_consensus.cc:740] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:05.563316 16477 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:05.652127 16503 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.653066 16477 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:05.655339 16477 raft_consensus.cc:2804] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:04:05.656013 16477 raft_consensus.cc:697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:05.657127 16477 consensus_queue.cc:237] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.563829 16454 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:05.663630  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.663556  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:05.667034  8333 catalog_manager.cc:5697] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 13 to 21, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 21 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:05.574662 16280 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.673225  8333 catalog_manager.cc:5697] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 14 to 16, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 16 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.613128 16308 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:05.625118 16232 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:05.685431  8333 catalog_manager.cc:5697] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 12 to 18, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 18 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.631026 15860 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:04:05.694932 16308 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.631839 16483 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:05.637822  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 179678us
I20260709 13:04:05.613215 15969 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.631289 16281 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.690662 16454 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.725795 16232 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:05.766505 16232 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.768841 16454 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.769042 16232 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.772003 16281 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.691382 16280 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.774463 16280 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:05.777133  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 280973us
I20260709 13:04:05.750155 16503 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.789733  8579 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:04:05.796497  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.796718  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:05.796828  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 250066us
W20260709 13:04:05.777474 16491 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:04:05.722395 16278 consensus_queue.cc:1243] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer 6930e07cbba2484ca2bf800a58acdbb0 log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:04:05.814559 16280 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.814743  8398 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:05.815186 16280 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.816038  8398 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:05.817256  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:05.817408 16280 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.818038 16454 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:05.817986 16280 consensus_queue.cc:1059] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:05.818398 16232 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:05.826357  8398 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:05.828962  8502 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:04:05.830331  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:05.831954  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:05.833146 16454 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:05.838773 16502 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:04:05.844127  8505 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: []
I20260709 13:04:05.865377  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.868762  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.869623  8508 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 25.
I20260709 13:04:05.871070  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.873943  8502 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:04:05.830557 16280 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:04:05.832404 16232 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:04:05.847271 16278 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:05.877977  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:05.880369  8505 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:05.844692 16485 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:05.882563 16308 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.882472 16483 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.899747 16485 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:05.876437 16069 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:05.900676 16278 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.909951  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.912170  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.912228  9098 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:04:05.904965 16512 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.913417 16278 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:05.932854  8505 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:04:05.927044 16387 consensus_queue.cc:260] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.938683 16197 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:05.939574  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:05.938810  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 208429us
I20260709 13:04:05.941243 16197 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:05.942059  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.943187  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:05.946787  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.949168  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:05.950836  8505 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:04:05.916822 16384 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:05.953269 16384 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:05.963057  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:05.964107  9094 raft_consensus.cc:2368] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23.
I20260709 13:04:05.968747  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:05.969878  9099 raft_consensus.cc:2393] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 23: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:05.988101  8582 raft_consensus.cc:1275] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:05.987996 16417 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:04:05.990491 16513 log.cc:927] Time spent T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:05.990803 16417 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.991442 16417 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:05.991930  8501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59114 (request call id 3339) took 1252 ms. Trace:
I20260709 13:04:05.994907  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:05.996254 16517 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:05.996927  9100 raft_consensus.cc:1275] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:04:05.996796 16517 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:05.998199 16387 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:05.926074 16512 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.001154 16512 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.001892 16507 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:06.002457 16507 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.004616 16507 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.005096 16507 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:06.009711 16417 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.016955  9101 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:04:05.992358  8501 rpcz_store.cc:276] 0709 13:04:04.739761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.972206 (+232445us) service_pool.cc:224] Handling call
0709 13:04:05.117083 (+144877us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:05.255274 (+138191us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:05.484082 (+228808us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.724356 (+240274us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:05.724870 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:04:05.725045 (+   175us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:05.725081 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.725211 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:05.991699 (+266488us) raft_consensus.cc:1685] finished
0709 13:04:05.991725 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.991870 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11970,"prepare.queue_time_us":469699,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":1996,"raft.queue_time_us":85056,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":22465408,"thread_start_us":517869,"threads_started":3,"wal-append.queue_time_us":395975}
W20260709 13:04:06.093644  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.130573 16417 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.133873 16517 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.005539 16507 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.140657 16507 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.144884 16278 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:06.199451 16198 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.216566  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.219515  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.222951  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.223778  9094 raft_consensus.cc:2468] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 26.
I20260709 13:04:06.232673  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.233402  9099 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 17.
I20260709 13:04:06.229640 16198 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.235975  8400 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:06.236519 16198 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.237226 16318 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:06.237808 16318 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:06.239464 16191 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:06.240399 16191 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 23 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:06.240605  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.240059 16318 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.241565 16191 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.233309  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.243772 16512 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:04:06.246410  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:06.247176  8507 raft_consensus.cc:2393] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 22: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:06.244776  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:06.251514  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:06.252485  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.258081  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:06.256515  8400 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:06.264108  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.265920  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.268312 16453 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:06.284446  8398 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.284520  8501 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:04:06.285738  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.289649  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.259116 16318 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:04:06.292526  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.296289  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:06.296864  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:06.262568 16509 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:06.300264  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:06.301251  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:06.285009 16506 raft_consensus.cc:2804] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:04:06.286854 16520 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:06.308817  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:06.258929 16512 consensus_queue.cc:1059] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:04:06.314217 16526 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:06.314807 16526 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.317039 16526 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.287578 16047 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:04:06.309512  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 45502.5us
I20260709 13:04:06.299700 16511 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.309320 16515 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:06.318974 16511 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.319440  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.321265 16511 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.303773  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:06.297873 16318 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.323204 16318 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:06.291731 15898 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:06.326364 15898 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.329092 15898 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.333498  8580 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46464 (request call id 1427) took 1062 ms. Trace:
I20260709 13:04:06.334065  8580 rpcz_store.cc:276] 0709 13:04:05.271317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.274054 (+  2737us) service_pool.cc:224] Handling call
0709 13:04:05.490052 (+215998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:05.501732 (+ 11680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.333231 (+831499us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54001162d0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933e8ad 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6 00007f1a1767926f
0709 13:04:06.333418 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496098560}
I20260709 13:04:06.337028 15983 raft_consensus.cc:3055] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:06.337424 15983 raft_consensus.cc:740] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:06.338255 15983 consensus_queue.cc:260] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.299285 16509 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.258523 16454 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:04:06.293437 16453 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:06.287500 16518 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:06.292114 16069 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:06.341374  8506 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 15.
I20260709 13:04:06.312325 16506 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.343797 16526 consensus_queue.cc:1048] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:06.345840  9065 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:06.352577  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.353282  9095 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:04:06.353518  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:06.354187  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.354799  9095 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 15.
I20260709 13:04:06.313939 16030 raft_consensus.cc:2804] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:06.359887  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.343426 16509 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:06.364722  8509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.021s	sys 0.030s
I20260709 13:04:06.355996 16520 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:04:06.367383  8509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.021s	sys 0.030s
I20260709 13:04:06.355182 16506 raft_consensus.cc:3060] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:06.368073 16278 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.362128 16030 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.355597 16417 consensus_queue.cc:1048] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:04:06.366060 16473 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:06.373145 16030 raft_consensus.cc:3060] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:06.391399 16384 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.394613 16384 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.396790 16384 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.401358 16318 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:06.404100 16318 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.377185  8475 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.407488  8475 leader_election.cc:400] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23.
I20260709 13:04:06.407855  8475 leader_election.cc:403] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:04:06.408696  8475 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:06.379325 16503 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:04:06.436040  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 1.65067e+06us
I20260709 13:04:06.413674 16384 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:06.413275 16311 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:06.413028 16477 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) with higher term. Message: Invalid argument: T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for earlier term 22. Current term is 23.
I20260709 13:04:06.390780 16473 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:06.451402  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 140046us
I20260709 13:04:06.416560 16167 consensus_queue.cc:1048] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.028s
W20260709 13:04:06.453507  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 94528.7us
I20260709 13:04:06.459362  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:04:06.460583  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 139867us
I20260709 13:04:06.438263 16503 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:06.460016  8507 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:04:06.494037  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.494321  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:06.505162  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:06.460156 16318 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:06.509972  8505 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:06.514297 16520 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:06.515357 16167 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:06.498369 16534 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:06.547739  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.515676  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:06.525772  9094 raft_consensus.cc:1240] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:06.513614 16503 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.506556 16030 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.491456 16517 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:06.548795  9100 raft_consensus.cc:2468] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:04:06.575742  8575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54346 (request call id 3139) took 1928 ms. Trace:
W20260709 13:04:06.578799  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 83694.7us
I20260709 13:04:06.497749 16311 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:06.576256  8575 rpcz_store.cc:276] 0709 13:04:04.647555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.656028 (+  8473us) service_pool.cc:224] Handling call
0709 13:04:04.656395 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:04.758916 (+102521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.758964 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:04.785372 (+ 26408us) log.cc:844] Serialized 52 byte log entry
0709 13:04:05.057745 (+272373us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:05.065898 (+  8153us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.071917 (+  6019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.575363 (+1503446us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000aa5d4. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:04:06.575412 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.575455 (+    43us) raft_consensus.cc:1685] finished
0709 13:04:06.575534 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.575686 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2257,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":179828,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":21485,"spinlock_wait_cycles":234546560,"thread_start_us":179976,"threads_started":1,"wal-append.queue_time_us":332875,"wal-append.run_cpu_time_us":1948,"wal-append.run_wall_time_us":1018248}
W20260709 13:04:06.582002  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 145130us
W20260709 13:04:06.587180  9068 leader_election.cc:336] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.587695  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:06.582260  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 66699.5us
W20260709 13:04:06.567417 16491 log.cc:927] Time spent T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:04:06.591627  9068 leader_election.cc:336] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.592108  9068 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:06.549827 16543 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:06.602980  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 68070.3us
I20260709 13:04:06.566653 16167 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.572127 16438 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.599843  8505 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 26.
I20260709 13:04:06.601835  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.607887  9101 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
W20260709 13:04:06.604070  8550 leader_election.cc:336] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:06.598874  8476 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.609434  8550 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:06.588757 16477 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:04:06.617267  8550 leader_election.cc:336] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.621628  8550 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:06.568385 16318 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:06.622804 15937 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:06.624367  8550 leader_election.cc:336] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.627592  8505 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:04:06.627980  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:06.629104  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:06.632634  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.627611  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:06.607527 16167 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:06.580435 16534 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.611186 16520 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:04:06.651175 16532 log.cc:927] Time spent T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:04:06.651087 16520 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.590327 16311 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.650002 16473 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.649760 16465 consensus_queue.cc:1059] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:06.618130 16477 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:06.621042 16546 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:06.647202 15937 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:06.609100 16543 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.702251 16544 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:06.704120 16544 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:06.705364  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 2164) took 1295 ms. Trace:
I20260709 13:04:06.611939 16438 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:06.706204  9097 rpcz_store.cc:276] 0709 13:04:05.409949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.459029 (+ 49080us) service_pool.cc:224] Handling call
0709 13:04:05.459299 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:05.459494 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:04:06.575526 (+1116032us) log.cc:844] Serialized 14 byte log entry
0709 13:04:06.692342 (+116816us) log.cc:844] Serialized 14 byte log entry
0709 13:04:06.704914 (+ 12572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.704980 (+    66us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:04:06.705044 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.705130 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.705292 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1029547,"prepare.queue_time_us":1151433,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":88687,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":162,"thread_start_us":205937,"threads_started":4}
I20260709 13:04:06.744848 16465 raft_consensus.cc:3055] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:06.745456 16465 raft_consensus.cc:740] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:06.689308 16477 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:06.754954  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 163326us
W20260709 13:04:06.756076  9068 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:06.757329  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:06.758533  9068 leader_election.cc:336] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.761540  9068 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:06.762749  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.763149  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:06.770758  9068 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.771196  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:06.774714  9068 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.775211  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:06.705698 16544 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.791647 16520 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.796289 16438 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.773874 16030 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.803053 16543 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.803399 16544 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:06.804292 16311 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.810986  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:06.825119 16465 consensus_queue.cc:260] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.813881 16534 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.814419 16318 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:06.808297 16515 raft_consensus.cc:3055] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:04:06.830011  8507 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:04:06.846660  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.823695 16308 raft_consensus.cc:493] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:04:06.864470  8550 leader_election.cc:336] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.868381  8550 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:06.872895  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.875715 16003 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.847898 16568 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:06.876291 16003 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.876413 16568 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.877228 16477 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.879772 16568 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.880349 16568 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:06.881111 16167 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.845536 16564 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:06.883507 16167 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.884266  8504 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:04:06.887440 16484 consensus_queue.cc:260] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.888540 16484 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:06.850386 16465 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:06.891161 16455 consensus_queue.cc:260] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.892175 16455 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:06.845005 16509 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.898200 16308 raft_consensus.cc:515] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.899688  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.900180  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:06.856195 16557 log.cc:927] Time spent T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:04:06.843688 16515 raft_consensus.cc:740] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:06.909790  9100 raft_consensus.cc:2393] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:06.904599  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:06.905544  8578 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 25.
I20260709 13:04:06.879451 16477 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.864720 16543 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:06.911262  8398 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:06.932741  8398 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:04:06.933025  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 67164.1us
I20260709 13:04:06.933274 16540 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:04:06.933897 16540 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 26 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:06.934753 16540 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:06.935300 16069 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:06.845832 16506 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:06.920117  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:06.908540  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 52372.7us
W20260709 13:04:06.942555  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:06.940157  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:06.921394 16311 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:06.959483  9095 raft_consensus.cc:1217] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Deduplicated request from leader. Original: 17.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:04:06.901921 16566 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:06.916239 16216 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:06.963027  9095 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:04:06.963974  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:06.916141 16562 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:06.964547  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:06.978420  9100 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:06.908113 16198 consensus_queue.cc:1059] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.045s
W20260709 13:04:06.988940  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 54561.7us
I20260709 13:04:06.949404 16387 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:06.991397  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:06.985463  8550 leader_election.cc:336] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:06.959311 16311 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:06.996316  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:06.961628 16546 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:07.005154  9100 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 16.
I20260709 13:04:07.006305  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:06.997685  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:07.006861  9100 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:06.998622  8549 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:06.976527 16003 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:07.014074  8550 leader_election.cc:336] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.014463  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.016223  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.016984  8582 raft_consensus.cc:3060] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:07.019207  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:07.019284  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.019858  9098 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:07.021214  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:07.022888  8550 leader_election.cc:336] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.023520  8550 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.025394  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:07.009459 16384 consensus_meta.cc:287] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
I20260709 13:04:07.031436  9065 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.003108 16311 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:07.032748  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.031603  8475 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:07.037288  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.032256 16538 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.039454  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.000393 16069 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:06.988806 16515 consensus_queue.cc:260] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.047190 16506 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.049207 16476 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:07.010421 16546 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.037793 16543 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:04:07.050824 16559 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:07.051319  9065 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.052418 16308 leader_election.cc:290] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.028059 16509 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:07.054991  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 56477us
I20260709 13:04:07.059387  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.098116  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.040343 16384 raft_consensus.cc:2749] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:07.035563 15860 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:07.065177 16577 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:07.058996 16538 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.067195 16571 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:07.070708  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.083844 16069 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.032773 16387 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:07.087764  9096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 2163) took 1678 ms. Trace:
I20260709 13:04:07.082998 16543 raft_consensus.cc:493] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.090510  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.091308 16507 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:07.091365 16534 raft_consensus.cc:2764] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:04:07.092456  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:07.093914  8547 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.094424  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
W20260709 13:04:07.098423  8550 leader_election.cc:336] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.119625  9100 raft_consensus.cc:2468] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:04:07.060372  9098 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
I20260709 13:04:07.124804  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.125200  8475 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:07.126338  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:07.126614  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.127094  9098 raft_consensus.cc:2376] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20. Re-sending same reply.
I20260709 13:04:07.127539  9100 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:04:07.101432  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.097301 16476 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:07.108796  9096 rpcz_store.cc:276] 0709 13:04:05.409730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.456863 (+ 47133us) service_pool.cc:224] Handling call
0709 13:04:05.502347 (+ 45484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:05.502610 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:04:06.593467 (+1090857us) log.cc:844] Serialized 14 byte log entry
0709 13:04:07.087354 (+493887us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:07.087411 (+    57us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:04:07.087462 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.087594 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:07.087704 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1069555,"prepare.queue_time_us":1144385,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":139739,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6243,"thread_start_us":552505,"threads_started":3,"wal-append.queue_time_us":224911}
W20260709 13:04:07.123548  8550 leader_election.cc:336] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.129510  8576 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 18.
I20260709 13:04:07.120479 16543 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:07.129820  8550 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.132450  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.133206  8579 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:07.109555  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.137627  8580 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 24: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:07.138186  8475 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:07.141381  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.142220  9098 raft_consensus.cc:1275] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:04:07.144297  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.145346  9096 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: [16.12-18.13]
I20260709 13:04:07.151639 16546 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:07.152210 16477 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:07.157003  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.159960 16477 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:07.161077 16477 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.139462 16125 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:07.162472 16125 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.163269 16538 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.120877 16384 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:07.164577 16384 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.166615 16384 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.172005  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:04:07.173328  8400 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.174196 16508 raft_consensus.cc:2804] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:07.174566 16293 consensus_queue.cc:1048] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:07.174886 16076 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:07.175380 16076 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:07.175745 16076 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:07.176117 16293 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:07.176641 16293 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.128371 16387 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:07.162983  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 388270us
W20260709 13:04:07.179018  9068 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.179445  9068 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.180264 16387 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.182628 16293 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.174795 16508 raft_consensus.cc:697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:07.186448  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.185722  8575 raft_consensus.cc:2468] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:04:07.191347  8579 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 26.
I20260709 13:04:07.188930  8577 raft_consensus.cc:1240] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:07.195719  8400 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.199636  8578 raft_consensus.cc:2410] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:04:07.187115  8475 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:07.204942 16566 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:07.205225 16198 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:07.205397 16197 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:07.189206 16538 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:07.207054 16125 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:07.209268 16559 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.210052 16586 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:07.209808 16559 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.201722 16534 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:07.214432 16476 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.218518 16585 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:07.219174 16585 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.221331 16585 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.223063  9102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 2158) took 2367 ms. Trace:
I20260709 13:04:07.225486  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.228914 16508 consensus_queue.cc:237] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.188369  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.234488  8582 raft_consensus.cc:2468] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:04:07.223577  9102 rpcz_store.cc:276] 0709 13:04:04.824592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.826127 (+  1535us) service_pool.cc:224] Handling call
0709 13:04:04.826636 (+   509us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:04.927444 (+100808us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:04:04.967349 (+ 39905us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.278901 (+311552us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.279105 (+   204us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:05.279773 (+   668us) log.cc:844] Serialized 52 byte log entry
0709 13:04:05.279940 (+   167us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:04:05.385513 (+105573us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b1800452440. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162523f3 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:04:06.459065 (+1073552us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b1800452440. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a161ccc0a 00007f1a1f90c219 00007f1a16254a40 00007f1a1624f4e4 00007f1a1624f455 00007f1a1cd373c7 00007f1a193499a7 00007f1a193590bf 00007f1a19359038
0709 13:04:06.459258 (+   193us) log.cc:844] Serialized 14 byte log entry
0709 13:04:06.459480 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.811076 (+351596us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b1800452440. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1
0709 13:04:07.095363 (+284287us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b1800452440. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:04:07.160389 (+ 65026us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b5400502154. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933fe01 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2 00007f1a1767a48c 00007f1a176798c6
0709 13:04:07.160434 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:07.191681 (+ 31247us) raft_consensus.cc:1685] finished
0709 13:04:07.191697 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:07.191870 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1172539,"prepare.queue_time_us":1245611,"prepare.run_cpu_time_us":843,"prepare.run_wall_time_us":76828,"raft.queue_time_us":33203,"raft.run_cpu_time_us":546,"raft.run_wall_time_us":17488,"spinlock_wait_cycles":275543808,"thread_start_us":160361,"threads_started":1,"wal-append.queue_time_us":307271}
I20260709 13:04:07.237095  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:07.186285 15937 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:04:07.222098 16432 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.240532 16432 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.213580 16534 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.243640  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.187907 16507 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:07.260277 16534 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.242825 16432 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.240936 16580 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:07.261925  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:07.243477  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.244434  9100 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:07.246954  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 44921.6us
I20260709 13:04:07.265998 16589 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:07.266625 16589 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.268772 16589 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.269191  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.238204  8475 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:07.221697 16543 raft_consensus.cc:515] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.244153 16281 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.247437  9102 raft_consensus.cc:2468] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:04:07.272763  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:07.273438  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.273908  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.276647  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.277125  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.277396 16581 log.cc:927] Time spent T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:04:07.277207 16589 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:07.270056 16512 raft_consensus.cc:2804] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:04:07.289717  9098 raft_consensus.cc:1240] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 24. Current term is 26. Ops: []
I20260709 13:04:07.292604  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:07.295091  9099 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:07.287235 16589 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.299916 16589 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.300522  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.301344  9097 raft_consensus.cc:2393] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 26: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:07.302136  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.304411  9097 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 22. Current term is 23. Ops: []
W20260709 13:04:07.290974  8550 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.284386 16512 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.313200 16512 raft_consensus.cc:3060] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:07.286644 16536 raft_consensus.cc:2804] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:04:07.317548  8550 leader_election.cc:336] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.270437 16580 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.288767 16490 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:04:07.317137  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.321802  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.322499  8582 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 23.
I20260709 13:04:07.326144  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.328222 16536 raft_consensus.cc:697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:07.329340 16536 consensus_queue.cc:237] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.331095 15969 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.332145 16483 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.332877  9099 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:04:07.336455 16076 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.337847  9099 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:04:07.307137 16477 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:07.340553 16477 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.280596 16281 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.349471 16281 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.350806  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:07.334532 16559 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.351465  8504 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:07.352639 16477 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.325155 16447 raft_consensus.cc:493] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:07.352836 16311 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.353415 16447 raft_consensus.cc:515] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.354492  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.354872  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:07.355161  8502 raft_consensus.cc:1240] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:07.357106  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.361403  8504 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:04:07.345093 16580 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.346671 16543 leader_election.cc:290] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 26 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.361997  9096 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:04:07.363055  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.364444  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.364876  9067 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:07.367532  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.375532  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.375677  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.374467  9094 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:04:07.370507  8507 raft_consensus.cc:1240] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 22. Current term is 23. Ops: []
I20260709 13:04:07.376623  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.376288  8580 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:07.382382  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:07.385011 16483 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:07.385411 16483 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:07.385768 16483 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:07.368976  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.380271 16543 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:04:07.392725  8401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.394014  8398 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.397303 16488 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:04:07.398232  8400 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.400897  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.388211 16030 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:07.406651  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42b1603f302f4b188a0a19190c49fed2" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.392045 16543 raft_consensus.cc:493] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.409432  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:07.398543 16447 leader_election.cc:290] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.408427 16197 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:07.400182 16076 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.414762 16197 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:04:07.397898 16488 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.417109 16197 consensus_queue.cc:1059] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:07.417995 16518 raft_consensus.cc:3055] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:07.418411 16518 raft_consensus.cc:740] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:07.419450 15983 raft_consensus.cc:3060] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:07.419370 16518 consensus_queue.cc:260] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.418442 16488 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.424368 16518 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:07.425581  8398 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:07.424463  8580 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 26.
I20260709 13:04:07.410234 16543 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:07.426394 16197 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:07.427925 16197 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:07.428750 16197 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.430457  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.426406  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b195ca1ba0c4d7e993f9dc2d1a12629" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.433789  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:07.434386  8550 leader_election.cc:336] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.434695 16484 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:07.435339  8550 leader_election.cc:336] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:07.438637 16574 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.391s	user 0.002s	sys 0.001s
I20260709 13:04:07.444986 16484 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:07.440999 16582 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260709 13:04:07.401585  8581 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:07.410362 16030 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.455432 16311 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.456873 16030 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.401901 16453 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.457803 16453 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.459839 16453 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:07.462105 16588 log.cc:927] Time spent T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.411s	user 0.001s	sys 0.003s
I20260709 13:04:07.462775 16580 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:07.463366 16580 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:07.463762 16575 log.cc:927] Time spent T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.415s	user 0.000s	sys 0.002s
I20260709 13:04:07.466295 16580 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:07.470096  8399 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.472074 16216 raft_consensus.cc:3055] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:07.472487 16216 raft_consensus.cc:740] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:07.476649  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.477363  9100 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:04:07.478973 16515 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:07.481101  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.481297  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.481741  8507 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 24.
I20260709 13:04:07.483065  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.485424  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:07.488438  8550 leader_election.cc:336] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.489853  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:07.490164  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 52839.2us
I20260709 13:04:07.492170  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.494894  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.495548  8507 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 23.
I20260709 13:04:07.498119 16488 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:04:07.498267  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 72982.6us
I20260709 13:04:07.498646 16488 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.500650 16488 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.473271 16216 consensus_queue.cc:260] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.504165 16216 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:07.506855  8400 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:07.508248  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.500576  8475 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:07.508890  8507 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:04:07.497700  8581 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:04:07.515039  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337d7e57df5f492daf49939f167561a0" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:07.515544  9097 raft_consensus.cc:1240] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:04:07.515663  8507 raft_consensus.cc:3060] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:04:07.521371  8577 raft_consensus.cc:1240] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Rejecting Update request from peer 0b9f7467deed4381835a85ffd0e88af6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:07.522015  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.527444  9067 leader_election.cc:304] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:07.528476  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.534659  9065 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.505225 16488 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:07.537943  9098 raft_consensus.cc:1240] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: [16.14-18.15]
I20260709 13:04:07.534168  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:07.542933  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.518687 16454 raft_consensus.cc:3060] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:04:07.539373  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.538775  8475 leader_election.cc:304] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:07.540407  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:07.516352 16030 raft_consensus.cc:2804] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:07.547976  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.537743 16191 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.549147 16191 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.549665  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.551462 16191 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.551939  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.552608  9098 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:07.526897 16484 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:07.554359 16484 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.537487 16593 consensus_queue.cc:1059] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:04:07.555855 16340 raft_consensus.cc:3055] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:07.556249 16340 raft_consensus.cc:740] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:07.556394 16564 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:07.556612 16484 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.557410 15969 raft_consensus.cc:2749] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:07.557075 16340 consensus_queue.cc:260] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.561081  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.563778  8400 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:07.562999 16455 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.567255 16455 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.568297 16340 raft_consensus.cc:3060] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:07.533870 16524 raft_consensus.cc:2804] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:04:07.569361 16455 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.572873  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.574699  8502 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 21.
I20260709 13:04:07.576524  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.577625  8502 raft_consensus.cc:2410] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:04:07.537721 16538 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.040s
I20260709 13:04:07.578177 16311 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.579761  8510 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:04:07.543292 16476 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:07.518851 16512 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.578715 16311 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.585229  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.584961  8398 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:07.588972  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.589635  8398 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:07.582988  8507 raft_consensus.cc:2468] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 26.
I20260709 13:04:07.561882 16030 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:07.572686 16191 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:07.537544 16103 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:04:07.572837 16524 raft_consensus.cc:697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:04:07.584345 16534 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:07.580586 16477 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:07.586591 16455 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.603328 16524 consensus_queue.cc:237] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.604236 16311 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.594359 16191 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.606390 16191 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:07.609954  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.593305 16030 raft_consensus.cc:3060] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:07.592411 16453 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:07.592161 16537 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:07.561265 16488 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.612769  9096 raft_consensus.cc:2410] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:04:07.601256 16455 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.575134  8549 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.583765 16543 raft_consensus.cc:515] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.585397 16483 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:07.625600  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 50565.3us
I20260709 13:04:07.601918 16534 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:07.601647 16477 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:07.629128  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:07.613888 16540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.000s	sys 0.017s
I20260709 13:04:07.629046  8400 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:04:07.637765  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 105997us
I20260709 13:04:07.640615  8506 raft_consensus.cc:2393] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 21: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:07.629873 16103 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:07.632189 16540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.001s	sys 0.017s
I20260709 13:04:07.631429 16534 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:07.637527 16372 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:07.618582 16520 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.020s
I20260709 13:04:07.630939 16477 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:07.658381  8476 leader_election.cc:336] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.665477  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:07.635106 16400 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:07.672676  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.666400 16512 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:07.727572  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 69165.3us
W20260709 13:04:07.728969  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 397627us
W20260709 13:04:07.728564  8550 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.737140  8476 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:07.737941  8476 leader_election.cc:336] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.738454  8476 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.674060 16400 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:07.740928 16400 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:07.743134 16488 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.745793  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.746776 16455 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.746990  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.703394 16384 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:07.748256 16483 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:07.748819 16384 consensus_queue.cc:1059] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:07.749950 16384 raft_consensus.cc:3055] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:07.750306 16384 raft_consensus.cc:740] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:07.750707 16543 leader_election.cc:290] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.752395  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:07.753386  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:07.753578  8578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.753968  8507 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:07.755255  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.755793  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.757769  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ee2138cf46471e96358439600aaa0c" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.765810  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:07.766999  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4548803154450a8b2b2d3ee14dd41a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:07.767575  8584 raft_consensus.cc:3060] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:07.769308  8507 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 24.
I20260709 13:04:07.770561  9065 leader_election.cc:304] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:07.778867  8575 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:04:07.751144 16384 consensus_queue.cc:260] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.782949  9065 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:04:07.784276  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 46341us
W20260709 13:04:07.772360 16601 log.cc:927] Time spent T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:04:07.783917  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:07.788121  8550 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.790235  8550 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.790616  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:07.792793  8476 leader_election.cc:336] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:07.793226  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.796219  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:07.801713  8476 leader_election.cc:336] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:07.803012  8476 leader_election.cc:336] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.794831 16484 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:07.808797  8507 raft_consensus.cc:1240] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:07.809242  8502 raft_consensus.cc:1240] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:04:07.781441 16432 raft_consensus.cc:2804] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:07.803823 16216 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:07.810708 16515 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:07.813482  8502 raft_consensus.cc:1240] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:07.815927  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.817538  8507 raft_consensus.cc:1240] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 22. Current term is 24. Ops: []
I20260709 13:04:07.818137  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44116e7a54d141108511e22185400ffe" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.818838  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.819515  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.820215  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.791776 15969 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:07.835479  8504 raft_consensus.cc:2393] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 23: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:07.826434  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:07.839195 16540 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:07.841966 16512 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.842504 16512 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:07.844595 16512 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:07.846179  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:07.850539  8509 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:04:07.850778  9068 leader_election.cc:336] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.851243  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.828872  8584 raft_consensus.cc:2468] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 24.
I20260709 13:04:07.787660 16372 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
W20260709 13:04:07.856556  9068 leader_election.cc:336] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.860976  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:07.864032  9068 leader_election.cc:336] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.864656  9068 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.866595 16505 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:07.867486 16432 raft_consensus.cc:697] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:04:07.864595 16103 consensus_queue.cc:1059] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:04:07.868211 16384 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:07.869515  8504 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:04:07.869815 16484 raft_consensus.cc:3055] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:07.870199 16484 raft_consensus.cc:740] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:07.870955 16484 consensus_queue.cc:260] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.871671  8547 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.872335 16484 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:07.873271  8547 leader_election.cc:304] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:07.874248 16543 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:07.875020 16583 consensus_queue.cc:1059] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:04:07.875476  9068 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.875850 16498 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:07.876075 16578 raft_consensus.cc:2749] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:07.869165 16432 consensus_queue.cc:237] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.878098 16455 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:07.881215  9101 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:04:07.875170  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.875949  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.875818 16583 consensus_queue.cc:1243] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer 0b9f7467deed4381835a85ffd0e88af6 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:04:07.856302 16512 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.859828 16531 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:07.892118  8476 leader_election.cc:336] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.892904  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:07.900174 16603 log.cc:927] Time spent T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:04:07.860545 16540 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:04:07.888173 16543 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:07.905627  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:07.913364  8476 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.889798 16537 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
W20260709 13:04:07.917106  8476 leader_election.cc:336] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.894518 16583 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:07.921516  8476 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:07.905495 16483 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:07.930317 16585 raft_consensus.cc:3055] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:07.930783 16585 raft_consensus.cc:740] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:07.931684 16585 consensus_queue.cc:260] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.933317 16585 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:07.934192 16536 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:07.934976  8508 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:04:07.895967 16191 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.895318 16512 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:07.905184 16477 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:07.937544  8476 leader_election.cc:336] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:07.982455  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:08.103689  8476 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:08.055226  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 157814us
W20260709 13:04:08.104789  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 167265us
W20260709 13:04:08.105461  8476 leader_election.cc:336] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:08.071380  8583 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:04:08.001283  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:07.993337  8580 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:04:08.029804  7335 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 8460)
I20260709 13:04:07.983964  8475 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:07.995316  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:07.981761  8575 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:04:08.106455  8583 pending_rounds.cc:85] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 14
I20260709 13:04:08.105997  8476 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:08.118265  8583 pending_rounds.cc:107] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 18.15
W20260709 13:04:08.111353  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 127483us
I20260709 13:04:08.118705  8583 raft_consensus.cc:2889] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:08.110761  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 115556us
W20260709 13:04:08.065172 16608 log.cc:927] Time spent T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 13:04:08.130417  8476 leader_election.cc:336] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:08.130764  8501 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:04:08.131110  8476 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:08.111367  8575 pending_rounds.cc:85] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Aborting all ops after (but not including) 12
I20260709 13:04:08.133546  8575 pending_rounds.cc:107] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:04:08.134140  8575 raft_consensus.cc:2889] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:07.936272 16454 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:08.138003  8509 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
W20260709 13:04:08.138180  8476 leader_election.cc:336] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:08.138715  8476 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:08.013890 16490 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.951321 16515 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.192s
I20260709 13:04:07.936571 16372 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:08.145291 16477 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:08.146644 16191 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:08.148257 16611 log.cc:927] Time spent T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:04:08.148465  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:08.140359 16311 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:08.149087  8505 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:08.150120 16606 log.cc:927] Time spent T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.308s	user 0.005s	sys 0.001s
I20260709 13:04:08.162966  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:08.163640  9093 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:08.165808 16076 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:08.166404 16076 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.137547 15969 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:08.167903  8549 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.169231 16076 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:08.175921 16604 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: Append to log took a long time: real 0.330s	user 0.002s	sys 0.000s
I20260709 13:04:08.177649  8505 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:04:08.180070  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:08.166865 16610 log.cc:927] Time spent T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:04:08.183934  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:08.111403 16488 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:08.185549  8580 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:04:08.129272 16483 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:08.186295  8398 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:08.187875  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:08.190450  9100 raft_consensus.cc:1275] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:04:08.194816  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:08.190912  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:08.191325  9096 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:04:08.129088 16538 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:04:08.196379  8400 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:08.198673  9093 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:04:08.005443 15983 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.177s
I20260709 13:04:08.053490 16534 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.115644 16400 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.208106  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:08.208828  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 70685.6us
I20260709 13:04:08.208058  9099 raft_consensus.cc:1275] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:04:08.217016  8476 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:08.217494  8476 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:08.221414  8475 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:08.222045  8476 leader_election.cc:336] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:08.208185 16030 consensus_meta.cc:287] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 13:04:08.222530  8476 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:08.230336  8476 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:08.230821  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:08.201812 16191 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:08.233140  9096 raft_consensus.cc:1240] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Rejecting Update request from peer 5ffc86752d264d0c81f68028e6413a91 for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:08.208755 16518 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:08.238348  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:08.214869 16520 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:08.211853 16537 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:08.240844  8582 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:08.185990 16490 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:08.215765 16476 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:08.240785 16483 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:08.231454 15969 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:08.235749 16508 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:08.212520 16541 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:04:08.225600 16540 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:08.218863 16216 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:04:08.222167 16488 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:04:08.267182 16477 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:08.248440 16281 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:08.231513 16562 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.043s
I20260709 13:04:08.270583 16583 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:08.237329 16030 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.326249 16030 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:08.295491 16512 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:08.296761 16400 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:08.282505 16520 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:08.328039 16520 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.300513 16534 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:08.301870  8584 raft_consensus.cc:1275] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:04:08.316087  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 427528us
W20260709 13:04:08.335482  9068 leader_election.cc:336] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:08.335997  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:08.337141  9068 leader_election.cc:336] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:08.337627  9068 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:08.338796  9068 leader_election.cc:336] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:08.322364  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:08.339227 16543 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:08.339982 16543 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:08.355126  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:08.356168  8504 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 21: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:08.358754  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:08.360536 16562 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:08.368742  9068 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:08.239490 16191 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:08.382577  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 43792.6us
W20260709 13:04:08.383924  9068 leader_election.cc:336] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:08.385689  9068 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:08.390568  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 152331us
I20260709 13:04:08.394613  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:08.399077  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:08.407094  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:08.409562  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:08.410231  8550 leader_election.cc:336] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:08.412468  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:08.385479 16562 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:08.287539 16540 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.396165 16534 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:08.422231  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:08.431545  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 211357us
I20260709 13:04:08.433333  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:08.440583  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:08.456322 16281 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:04:08.457046 16281 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:08.423774 16576 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:08.460711  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:08.478236  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 256869us
I20260709 13:04:08.494771  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:08.431699 16537 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:04:08.469056 16583 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:08.498791  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 268470us
I20260709 13:04:08.535557  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:08.497506 16488 consensus_queue.cc:1048] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:04:08.521873 15969 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:08.508644 16536 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:08.499825 16508 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:04:08.541831 16578 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 13:04:08.551384  8575 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:04:08.554111  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 91358.7us
I20260709 13:04:08.524822 16583 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.524049 16216 consensus_queue.cc:1048] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.025s
W20260709 13:04:08.556145  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 85485.9us
I20260709 13:04:08.542068 16465 raft_consensus.cc:2764] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:04:08.561702  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:08.549639 16536 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.565311  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:08.566854  8506 raft_consensus.cc:1275] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:04:08.578931  8400 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:08.580036  8580 raft_consensus.cc:1275] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:04:08.584757  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:08.585425  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:08.585825  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 112576us
I20260709 13:04:08.558496 16191 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:08.594542  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:08.577203 16617 raft_consensus.cc:3055] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:04:08.556243 16620 consensus_queue.cc:1048] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:04:08.567803 16543 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:04:08.630334 16518 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:08.631232 16518 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:08.631779 16518 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.598955 16540 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:08.636116  8333 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32800 (request call id 249) took 22142 ms (client timeout 15000 ms). Trace:
I20260709 13:04:08.637641 16583 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:08.641322  8505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:08.601169 16617 raft_consensus.cc:740] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:04:08.663318  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 176856us
I20260709 13:04:08.590204 16384 consensus_queue.cc:1048] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
W20260709 13:04:08.716032  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 45469.2us
W20260709 13:04:08.717757  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 52807.4us
I20260709 13:04:08.718973  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:08.719897  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 111241us
I20260709 13:04:08.723438  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:08.730432  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:08.680879 16372 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:08.645345  8333 rpcz_store.cc:269] 0709 13:03:46.493424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.127072 (+13633648us) service_pool.cc:224] Handling call
0709 13:04:00.379527 (+252455us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a9090 00007f1a19347f3a 00007f1a1f0fe1cc 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc 00007f1a1d6bc392 00007f1a1767a48c 00007f1a176798c6
0709 13:04:08.636001 (+8256474us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:06.128458 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:06.129083 (+   625us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:06.129123 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:04:06.129144 (+    21us) tablet.cc:662] Decoding operations
0709 13:04:06.131373 (+  2229us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:06.131466 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:06.131499 (+    33us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:04:06.134854 (+  3355us) tablet.cc:701] Row locks acquired
0709 13:04:06.134872 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:04:06.135037 (+   165us) write_op.cc:270] Start()
0709 13:04:06.135164 (+   127us) write_op.cc:276] Timestamp: P: 1783602246134984 usec, L: 0
0709 13:04:06.135187 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:06.361703 (+226516us) log.cc:844] Serialized 11360 byte log entry
0709 13:04:06.827666 (+465963us) op_driver.cc:464] REPLICATION: finished
0709 13:04:07.085313 (+257647us) write_op.cc:301] APPLY: starting
0709 13:04:07.085507 (+   194us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:07.148437 (+ 62930us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a1933ae28 00007f1a1cd75581 00007f1a1cd74d58 00007f1a1cd799f1 00007f1a1cd799a9 00007f1a1cd79939 00007f1a1cd79901 00007f1a1cd78b2d 000000000038f354 000000000038f199
0709 13:04:07.300488 (+152051us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:07.300527 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:07.568160 (+267633us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:07.568582 (+   422us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:04:07.568631 (+    49us) write_op.cc:312] APPLY: finished
0709 13:04:07.578460 (+  9829us) log.cc:844] Serialized 252 byte log entry
0709 13:04:07.588617 (+ 10157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.600759 (+ 12142us) write_op.cc:454] Released schema lock
0709 13:04:07.611284 (+ 10525us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:07.639631 (+ 28347us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.653860 (+ 14229us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":251,"mutex_wait_us":1166423,"reported_tablets":44,"spinlock_wait_cycles":3856256,"child_traces":[["op",{"apply.queue_time_us":257212,"apply.run_cpu_time_us":40950,"apply.run_wall_time_us":545146,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125231,"num_ops":29,"prepare.queue_time_us":284502,"prepare.run_cpu_time_us":73310,"prepare.run_wall_time_us":1020199,"raft.queue_time_us":123020,"raft.run_cpu_time_us":62409,"raft.run_wall_time_us":204474,"replication_time_us":692337,"spinlock_wait_cycles":155526912,"thread_start_us":552048,"threads_started":4,"wal-append.queue_time_us":255147,"wal-append.run_cpu_time_us":13076,"wal-append.run_wall_time_us":1952483}]]}
I20260709 13:04:08.718364 16340 consensus_queue.cc:1059] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 13:04:08.742470 16629 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:04:08.772958 16616 log.cc:927] Time spent T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:04:08.781428 16498 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:04:08.794710  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 71927.1us
I20260709 13:04:08.786173 16576 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:08.749135 16372 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.809335 16372 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:08.788976 16518 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:08.810580 16627 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:04:08.813105  9097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33868 (request call id 2179) took 1277 ms. Trace:
W20260709 13:04:08.816854  8476 consensus_peers.cc:597] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:08.813546  9097 rpcz_store.cc:276] 0709 13:04:07.535253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.536022 (+   769us) service_pool.cc:224] Handling call
0709 13:04:07.536390 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:07.536794 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:07.536832 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:07.982422 (+445590us) spinlock_profiling.cc:243] Waited 6.63 ms on lock 0x7b1800016720. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a162202a6 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a
0709 13:04:08.179231 (+196809us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b2c000913e8. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a17c38a11 00007f1a17c48372 00007f1a1937aa01 00007f1a1933f43a 00007f1a1933e83e 00007f1a1e303419 00007f1a1787abd4 00007f1a1787ab62 00007f1a1787aa91 00007f1a1787aa0c 00007f1a17879cc2
0709 13:04:08.179725 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:04:08.391686 (+211961us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:04:08.405905 (+ 14219us) log.cc:844] Serialized 14 byte log entry
0709 13:04:08.422370 (+ 16465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.422495 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:08.627573 (+205078us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b1800016720. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a1f11ade1 00007f1a1f1275b1 00007f1a16252522 00007f1a162547c1 00007f1a16254779 00007f1a16254709 00007f1a162546d1 00007f1a162539cd 000000000038f354 000000000038f199 00007f1a1623583a
0709 13:04:08.812833 (+185260us) raft_consensus.cc:1685] finished
0709 13:04:08.812863 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:08.813024 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11719,"prepare.queue_time_us":14065,"prepare.run_wall_time_us":33,"raft.queue_time_us":18056,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":8556,"spinlock_wait_cycles":90246528,"thread_start_us":211590,"threads_started":1,"wal-append.queue_time_us":330344}
W20260709 13:04:08.825332  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 57266.8us
I20260709 13:04:08.838094 16515 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.838668 16515 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:08.844777  8504 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:04:08.858835  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:08.859809  8510 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:04:08.867376  8510 raft_consensus.cc:1275] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:04:08.826658 16619 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:04:08.785880 16629 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.840942 16515 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:08.872663  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:08.823370 16536 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:08.879932  8501 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:04:08.817948 16632 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.892125  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:08.897104 16637 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:08.905486 16637 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.905900 16637 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:08.906600 16631 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:08.913748 16580 consensus_queue.cc:1048] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:04:08.915828 16635 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:04:08.917061 16432 consensus_queue.cc:1048] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:04:08.919739 16629 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:08.920248  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:08.924485 16615 log.cc:927] Time spent T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.495s	user 0.003s	sys 0.000s
I20260709 13:04:08.911512 16518 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:04:08.930352  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:08.937470 16543 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:08.938160 16543 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.940790 16543 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:08.954751  8400 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:08.890344 16632 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:08.955502 16518 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.958653 16518 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:08.955617 16621 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:08.959882 16632 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:08.960636 16518 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:08.965124 16490 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:08.970057  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:08.971762  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:08.972476  8575 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
W20260709 13:04:08.980468  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 70005.9us
I20260709 13:04:08.981124  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:08.987367  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 75820.4us
I20260709 13:04:08.987859  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:08.992977  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:08.995705  8504 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 19: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:09.000223 16632 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:09.000757 16632 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.001138 16632 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:04:09.009114  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 290244us
I20260709 13:04:09.015441  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1186d8dca7484f8fd5714b4489ce99" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.009130 16647 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:09.029280  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:09.031723  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.032863  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.033485  9097 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:04:09.034840  8578 raft_consensus.cc:1240] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Rejecting Update request from peer dacb523538a14c7cb335ab9c18f4111b for earlier term 21. Current term is 22. Ops: []
I20260709 13:04:09.035235  8580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:09.035274  8576 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:04:09.036863  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.038684  9100 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:04:09.052508  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:09.053308  8581 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 23.
I20260709 13:04:09.054214  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.052587  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:09.061671 15983 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.062434 15983 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.063012  8400 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:09.064030 16515 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:09.079677  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:09.090459  9068 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 152 similar messages]
W20260709 13:04:09.108385  7335 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 8460)
I20260709 13:04:09.128032  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:09.120658  8475 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:09.103487 16647 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:04:09.154220 16632 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.156325 16617 consensus_queue.cc:260] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.157127 16632 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:09.158776 16281 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:09.159878  8400 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:09.162101 16639 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:09.164796 16538 raft_consensus.cc:3055] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:04:09.165256 16538 raft_consensus.cc:740] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:09.136960 16512 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:04:09.157976 16617 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:09.132448 16520 consensus_queue.cc:1059] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
W20260709 13:04:09.135517 16644 log.cc:927] Time spent T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.236s	user 0.000s	sys 0.002s
I20260709 13:04:09.177100 16538 consensus_queue.cc:260] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.135280 16384 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:09.178604  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:09.179435  9068 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:09.130707 16637 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:09.180974 16543 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:09.181959 16637 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:09.178773 16538 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:09.201114 15983 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:09.203079 16543 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:09.209074  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:09.211105  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:09.211681  8507 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:04:09.215577  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:09.218475  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:09.232784  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:09.233385  8583 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:09.238802  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:09.246347  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:09.246982  8579 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:09.249603  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.252043 16541 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.251794 15983 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:09.252426 16647 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.255046 16637 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.259074  8579 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:04:09.243989  8507 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:04:09.284411  8400 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:09.298695  8398 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:04:09.330790  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:09.336370  9093 consensus_queue.cc:237] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.294384 16647 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.294842 16520 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:09.298220 16636 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:09.337127 16453 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:09.288131 16541 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:09.388993 16619 log.cc:927] Time spent T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:09.384120 16400 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.299381 16637 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.423432  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:09.424079  9097 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:09.427630  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.394939 16453 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:09.445533  9097 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:04:09.389053 16520 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:09.449326 16663 log.cc:927] Time spent T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:04:09.451423 16637 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:09.451455 16647 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:09.452998 16662 log.cc:927] Time spent T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:04:09.428807 16400 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.455727 16400 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:09.456735 16453 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:09.460309 16541 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:09.463558 16520 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:09.526180  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 136926us
W20260709 13:04:09.536906  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:09.538050  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 244938us
W20260709 13:04:09.540588  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:09.547399  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:09.549316  8507 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:09.554318  8547 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:09.555896  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:09.556946  8510 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:04:09.558410  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:09.560384  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:09.554338  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:09.568298  9065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.575002  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.576270  9099 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:09.600402  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.606786 16437 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:09.607486 16437 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.608034 16437 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:09.536693  8475 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:09.638214 16520 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.639246 16520 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:09.636526  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:09.652483  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 79858.6us
W20260709 13:04:09.659296  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 123041us
I20260709 13:04:09.663353  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.665181  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.683856 16476 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:09.702389 16476 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 23 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:09.706552  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:09.707986  9094 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 19.
I20260709 13:04:09.711148  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:09.714268 16498 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:09.706576  8584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:09.716411  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 68546.8us
I20260709 13:04:09.677414 16520 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:09.738507 16372 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.758191 16372 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:09.751936  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:09.760593 16490 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:09.761344 16372 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:09.747442 16632 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:09.763913 16632 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.770222 16632 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:09.780696  8398 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b; no voters: 
I20260709 13:04:09.787259 16453 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:09.787748 16453 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.794153  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:09.788084 16453 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:09.803615  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 75227.9us
I20260709 13:04:09.810527 16632 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
W20260709 13:04:09.810060  8476 consensus_peers.cc:597] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:09.830406  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:09.806424 16476 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.839213  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:09.852222 16437 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.812562  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:09.824682  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:09.873824  8476 leader_election.cc:336] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:09.882421 16661 log.cc:927] Time spent T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:04:09.882735  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 72682.7us
I20260709 13:04:09.888309  8398 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:09.882856  8583 consensus_meta.cc:287] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.015s
I20260709 13:04:09.894956 16197 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:09.883414 16490 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:09.883116 16632 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:09.908946 16632 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:09.911494  8504 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:09.919305 16432 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:09.897444  8583 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 24.
I20260709 13:04:09.952340  8475 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:09.953397 16620 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:09.956262  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:09.974520  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 86306.4us
I20260709 13:04:09.979341  8398 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:04:09.982822  8476 leader_election.cc:336] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:09.983356  8476 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:09.984364 16490 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:09.984797 16488 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:10.109127  7335 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 8460)
I20260709 13:04:10.119577 16520 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.120334 16520 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:10.121785  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:10.123060 16520 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:10.134975  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:10.154181  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 46296.1us
I20260709 13:04:10.177524  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:10.179602  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
W20260709 13:04:10.191367  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 340864us
I20260709 13:04:10.207669 16453 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:10.221236  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:10.245318  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 109654us
I20260709 13:04:10.222380 16432 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:10.262617  8581 raft_consensus.cc:1275] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:10.266347 16531 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.267024 16531 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:10.277621 16498 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.278553 16453 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:10.278294 16498 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:10.279785  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:10.280387  9099 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:10.293392  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:10.269522 16432 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:10.300279  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:10.315663 16498 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:10.323431  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:10.324150  9096 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:10.333650  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:10.330847  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:10.334998  9097 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:10.317929 16437 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:10.347453 16618 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.348031  8507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:10.352564  8507 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:10.337260  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e2febf027be449183830c318fbd6012" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:10.353545  8502 raft_consensus.cc:3060] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:10.355029 16030 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:10.361687  9099 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
I20260709 13:04:10.365116  8400 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 
W20260709 13:04:10.359822  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:10.366993  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:10.371590 16576 consensus_queue.cc:1048] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:10.375087  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:10.399077 16191 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:04:10.414407  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 54424.9us
I20260709 13:04:10.375663 16531 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:10.425096 16485 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.425712 16485 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:10.426185 16453 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.426777 16453 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:10.386752 16618 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:10.430332 16520 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.430612 16618 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:10.431488  8510 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:04:10.406847 16030 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:10.439855  9096 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:04:10.441296  8575 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:04:10.442138 16191 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Becoming Leader. State: Replica: dacb523538a14c7cb335ab9c18f4111b, State: Running, Role: LEADER
I20260709 13:04:10.443238 16191 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:10.448719  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 49961.3us
I20260709 13:04:10.451356  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:10.470145  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:10.470942  8509 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
W20260709 13:04:10.479805  8331 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57088 (request call id 361) took 103193 ms (client timeout 15000 ms). Trace:
W20260709 13:04:10.480383  8331 rpcz_store.cc:269] 0709 13:02:27.285932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.286096 (+   164us) service_pool.cc:224] Handling call
0709 13:02:27.477733 (+191637us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a9090 00007f1a19347f3a 00007f1a1f0fe1cc 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc 00007f1a1d6bc392 00007f1a1767a48c 00007f1a176798c6
0709 13:04:10.479496 (+103001763us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88848,"reported_tablets":46,"spinlock_wait_cycles":195679488}
I20260709 13:04:10.495278 16515 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:04:10.504958  8507 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 20.
W20260709 13:04:10.517244  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 156059us
I20260709 13:04:10.503862  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:10.431116 16520 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:10.521736  8549 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:10.458871 16432 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:10.527108  9065 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:10.533974  8510 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:04:10.541576  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:10.543570 16691 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:10.544101 16691 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.544451 16691 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:10.545696 16103 raft_consensus.cc:2804] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:10.546461 16103 raft_consensus.cc:697] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:10.547238  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:10.569768  8577 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:10.552886 16453 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:10.574756 16678 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:10.554046 16485 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:10.589951 16689 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:04:10.595548  8575 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:04:10.603868  9098 raft_consensus.cc:1275] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:10.605625 16678 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.612562  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:10.612921  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:10.613511  8577 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 22: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:10.615206 16520 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:10.554931 16103 consensus_queue.cc:237] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:10.619720  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:10.620571  9093 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:10.621639  8510 raft_consensus.cc:2955] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 4 to 13, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:04:10.625674  9068 leader_election.cc:336] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:10.636332  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:10.628710  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:10.638218  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:10.610376 16678 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:10.651258  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:10.652348 16690 raft_consensus.cc:2955] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 4 to 13, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:10.657171 16485 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:10.657666 16485 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.658039 16485 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:10.658146  8327 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 16 to 17, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 17 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:10.659915 16372 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:10.660529 16372 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:10.664865  8506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:10.667543 16660 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:10.670842 16515 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.671452 16515 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:10.673198 16520 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.673727 16520 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:10.675156  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:10.682348  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:10.665843  8327 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 14 to 17, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 17 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:10.627959 16689 consensus_queue.cc:1048] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.062s
I20260709 13:04:10.691665  8327 catalog_manager.cc:5697] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:10.719880  8327 catalog_manager.cc:5697] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.728098  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:10.729638 16076 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:04:10.719492  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:10.754925 16372 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:10.757253  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:10.757493  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:10.766001 16372 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:04:10.766341  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 115173us
W20260709 13:04:10.763810  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:10.760128  8502 raft_consensus.cc:2468] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
W20260709 13:04:10.785248  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53919.9us
I20260709 13:04:10.742717 16515 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:10.760465 16520 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:10.800135  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:10.816574 16520 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:10.823150  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652dfe8b7bb64be896563cb525d678d1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:10.825268  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:10.829619  8398 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:10.830595 16541 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:10.832269  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 68154.6us
I20260709 13:04:10.833281  8327 catalog_manager.cc:5697] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 7 to 10, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 10 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
W20260709 13:04:10.845775  9068 consensus_peers.cc:597] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:10.860616  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 92811.8us
W20260709 13:04:10.861285  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:10.871173  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 67855.8us
I20260709 13:04:10.843741 16692 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:10.914407 16372 raft_consensus.cc:493] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.915115 16372 raft_consensus.cc:515] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:10.884166 16692 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.982761  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:10.983745  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 150268us
I20260709 13:04:11.005483 15983 raft_consensus.cc:493] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:11.019781 15983 raft_consensus.cc:515] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:11.010936 16030 raft_consensus.cc:493] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.022992 16030 raft_consensus.cc:515] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:11.025539 16030 leader_election.cc:290] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:11.026705  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 45449.5us
I20260709 13:04:10.884846 16691 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:10.993943  8550 leader_election.cc:336] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:10.989066 16372 leader_election.cc:290] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:11.044497  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 50600.8us
I20260709 13:04:10.988574 16692 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:10.993680  8327 catalog_manager.cc:5697] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 12 to 15, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 15 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.063475  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:11.077654  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e03855c7c944d6a2bd32561a407196" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:11.069038  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:11.117962  7335 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 8460)
I20260709 13:04:11.124665  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1a6df183ea46c0b7b35ceaa22ed236" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:11.071760  9099 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
W20260709 13:04:11.133857  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 56121.2us
I20260709 13:04:11.151033 16541 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.151669 16541 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:11.152017  8400 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.051733 16515 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.159878  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:11.153749 16541 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:11.188490  8583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9390750b3d3442e888055fd39566ef1" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:11.230896 16515 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:11.237118 16515 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:11.243729  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057641ab553c4ec08538f2ed159ba000" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:11.251022  8510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:11.200022 16197 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:11.270768 16691 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:11.272941 16690 consensus_meta.cc:287] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.005s
W20260709 13:04:11.245424 16485 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.004s
W20260709 13:04:11.295858 16716 log.cc:927] Time spent T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:04:11.301467  8503 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:04:11.306123 16454 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.306717 16454 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:11.307109  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:11.309041 16454 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:11.286904 16660 consensus_meta.cc:287] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.005s
I20260709 13:04:11.348785  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:11.385046  8503 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:04:11.387046  8327 catalog_manager.cc:5697] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:11.392593  8579 raft_consensus.cc:2955] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 4 to 13, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:11.395049 15983 leader_election.cc:290] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:11.399221 16692 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:11.402334  8502 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 22: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:11.289535 16485 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:11.405265 16678 consensus_meta.cc:287] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: Time spent flushing consensus metadata: real 0.714s	user 0.004s	sys 0.008s
I20260709 13:04:11.405826 16485 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:11.405715 16678 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:11.406605  8577 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 23: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:04:11.381415 16698 log.cc:927] Time spent T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:04:11.409096 16678 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:11.356850 16660 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:11.410183  9098 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dacb523538a14c7cb335ab9c18f4111b in term 22.
I20260709 13:04:11.418057  9093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:11.418792  9093 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:11.426791  8575 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 22: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:11.401929 16692 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:11.446523  8476 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:11.446691  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 62635.7us
I20260709 13:04:11.450368 16727 raft_consensus.cc:493] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:11.452672 16727 raft_consensus.cc:515] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:11.455108 16727 leader_election.cc:290] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:11.459363 16725 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:11.459843 16690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56456 (request call id 0) took 2132 ms. Trace:
I20260709 13:04:11.460264 16690 rpcz_store.cc:276] 0709 13:04:09.331574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.333738 (+  2164us) service_pool.cc:224] Handling call
0709 13:04:09.442299 (+108561us) log.cc:844] Serialized 494 byte log entry
0709 13:04:09.903396 (+461097us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5400668da0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192b8142 00007f1a19298eaa 00007f1a1929fd53 00007f1a1929fcd9 00007f1a1929fc69 00007f1a1929fc31 00007f1a1929edfd 000000000038f354 000000000038f199 00007f1a16252475
0709 13:04:09.904500 (+  1104us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b5400668da0. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a8571 00007f1a192bfb26 00007f1a192b949a 00007f1a192b8714 00007f1a19298eaa 00007f1a1929fd53 00007f1a1929fcd9 00007f1a1929fc69 00007f1a1929fc31 00007f1a1929edfd 000000000038f354
0709 13:04:11.459755 (+1555255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7216,"raft.run_cpu_time_us":4006,"raft.run_wall_time_us":68781,"spinlock_wait_cycles":28482560,"thread_start_us":62594,"threads_started":1,"wal-append.queue_time_us":66201,"wal-append.run_cpu_time_us":3353,"wal-append.run_wall_time_us":1078257}
I20260709 13:04:11.462539  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet adc232408fec446f9379aa9fb2c04164 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:11.465425  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:11.475216  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:11.475939  8502 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 22: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:11.479071  8575 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 22: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:11.482257 16702 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.482918 16702 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:11.487362  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 259332us
I20260709 13:04:11.492401  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
W20260709 13:04:11.493752  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 243560us
I20260709 13:04:11.501369  9094 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Refusing update from remote peer dacb523538a14c7cb335ab9c18f4111b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:04:11.501583  8398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 116935us
I20260709 13:04:11.485224 16702 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:11.522459  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:11.525343  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:11.530508  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:11.534811  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:11.541970 16709 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:11.543289  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:11.544082  9095 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:11.552316  9100 raft_consensus.cc:1275] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:04:11.555850  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:11.557684  8475 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.559716 16692 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:04:11.562732  8476 consensus_peers.cc:597] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:11.565286  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:11.565382  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:11.566416  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adc232408fec446f9379aa9fb2c04164" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:11.568312  9094 raft_consensus.cc:2393] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 22: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:11.567580 16731 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:04:11.576104 16485 consensus_queue.cc:1048] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:11.581735  9095 raft_consensus.cc:2468] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:04:11.583947  8549 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.588222  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:11.593802 16725 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:04:11.593883  8549 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:11.595054  8400 leader_election.cc:304] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:11.595188 16725 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:11.595821 16725 raft_consensus.cc:697] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:11.596828 16725 consensus_queue.cc:237] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:11.605130  8400 leader_election.cc:304] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:11.615988  8400 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.618311  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:11.620818  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:11.626776 15983 raft_consensus.cc:2804] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:11.627172 15983 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.627491 15983 raft_consensus.cc:3060] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:11.627686 16191 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:11.630366 16372 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:11.619567 16515 raft_consensus.cc:2749] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:04:11.636343 15983 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:11.639739 15983 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Requested vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:11.641496  8400 leader_election.cc:304] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.642611 15983 raft_consensus.cc:2749] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:11.645561  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f518d1b1d4c2478b9d4fc2483806952e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:11.615448 16731 raft_consensus.cc:2749] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:11.655552  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:11.659845  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:11.661437  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.665813  9101 raft_consensus.cc:2393] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate dacb523538a14c7cb335ab9c18f4111b in current term 23: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
W20260709 13:04:11.657964  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:11.669139 16520 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:11.672290  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.681138  8398 leader_election.cc:304] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.684260 16490 raft_consensus.cc:2749] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:11.702376  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.691155 16197 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:11.716362 16515 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:11.738312  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.739102 16191 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:04:11.757012 16702 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:11.757640 16702 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:11.759652  8550 leader_election.cc:336] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:11.763768  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:11.759727 16702 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:11.771514  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:11.777133  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:11.778226 15983 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:11.950591  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:11.986801  8327 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57088 (request call id 363) took 58153 ms (client timeout 15000 ms). Trace:
I20260709 13:04:11.987566 15983 raft_consensus.cc:493] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.988281 15983 raft_consensus.cc:515] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:11.992498  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:11.987804  8327 rpcz_store.cc:269] 0709 13:03:13.833522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.834882 (+  1360us) service_pool.cc:224] Handling call
0709 13:03:14.741934 (+907052us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b5400020710. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621ab71 00007f1a1621b0b2 00007f1a1f194a89 00007f1a1f12cda6 00007f1a1f0fe088 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc
0709 13:04:11.986714 (+57244780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:11.508488 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:11.509233 (+   745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:11.509286 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:04:11.509323 (+    37us) tablet.cc:662] Decoding operations
0709 13:04:11.510346 (+  1023us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:11.510450 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:11.510489 (+    39us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:04:11.511262 (+   773us) tablet.cc:701] Row locks acquired
0709 13:04:11.511314 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:04:11.511493 (+   179us) write_op.cc:270] Start()
0709 13:04:11.511661 (+   168us) write_op.cc:276] Timestamp: P: 1783602251511432 usec, L: 0
0709 13:04:11.511702 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:04:11.648323 (+136621us) log.cc:844] Serialized 2844 byte log entry
0709 13:04:11.786405 (+138082us) op_driver.cc:464] REPLICATION: finished
0709 13:04:11.833407 (+ 47002us) write_op.cc:301] APPLY: starting
0709 13:04:11.834522 (+  1115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:11.848877 (+ 14355us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:11.861181 (+ 12304us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:11.907936 (+ 46755us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:11.908310 (+   374us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:04:11.908379 (+    69us) write_op.cc:312] APPLY: finished
0709 13:04:11.908734 (+   355us) log.cc:844] Serialized 73 byte log entry
0709 13:04:11.908924 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:11.909055 (+   131us) write_op.cc:454] Released schema lock
0709 13:04:11.909112 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:11.909562 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:11.909588 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":388279,"reported_tablets":46,"spinlock_wait_cycles":17072896,"child_traces":[["op",{"apply.queue_time_us":44285,"apply.run_cpu_time_us":12829,"apply.run_wall_time_us":76177,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33359,"num_ops":7,"prepare.queue_time_us":71502,"prepare.run_cpu_time_us":9348,"prepare.run_wall_time_us":153704,"raft.queue_time_us":97900,"raft.run_cpu_time_us":10806,"raft.run_wall_time_us":34199,"replication_time_us":257530,"spinlock_wait_cycles":122496,"thread_start_us":192409,"threads_started":4,"wal-append.queue_time_us":13643}]]}
I20260709 13:04:12.000710 15983 leader_election.cc:290] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:12.001333  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:12.003296  8400 leader_election.cc:304] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:12.003319  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e038af5e5154b3e8ae9503fdedbb44b" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:12.004341 15983 raft_consensus.cc:2749] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:12.016386  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:12.033262 16515 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.033924 16515 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:12.036204 16515 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:12.035478  8328 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 17 to 19, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 19 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:12.038009  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:12.044553  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7e6e656d324c0bad9eee744f6f1886" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:12.050264  8398 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:12.052776 15983 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:12.049947  8328 catalog_manager.cc:5697] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 10 to 16, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 16 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.075057 15983 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.075594 15983 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:12.080212  8328 catalog_manager.cc:5697] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 13 to 18, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 18 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.087728  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:12.091329 15983 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:12.092272  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8ec20c8aeb4915950772c6add9f352" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:12.097298  8328 catalog_manager.cc:5697] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 15 to 21, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 21 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:12.104143  8398 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:12.107312 15983 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:12.116048 16515 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:12.116925 16515 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:12.121887 16515 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:12.124264  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:12.123414  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:12.122287  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:12.127607  8400 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:12.128985 15983 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:12.126015  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:12.129563 15983 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:12.130693  7335 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 8460)
I20260709 13:04:12.133586 15983 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:12.134353  8320 catalog_manager.cc:4755] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): ChangeConfig:REMOVE_PEER RPC failed for tablet 1e038af5e5154b3e8ae9503fdedbb44b: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:12.150413  9095 raft_consensus.cc:1275] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:04:12.152153 16725 consensus_queue.cc:1048] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:12.136211  8328 catalog_manager.cc:5697] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 17 to 24. New cstate: current_term: 24 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.147552  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:12.148089 16702 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:12.168385  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a41ce5cf754ad58e31f5e764daa48f" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:12.176820  8328 catalog_manager.cc:5697] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 15 to 20, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 20 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.179129 16702 raft_consensus.cc:493] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:12.183363 16702 raft_consensus.cc:515] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } attrs { replace: true } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:12.192871  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:12.199461  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:12.205935  8328 catalog_manager.cc:5697] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 12 to 16, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 16 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:12.201952  8400 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:12.212939  8398 leader_election.cc:304] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:12.215732  8328 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 17 to 19, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 19 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.219898 15983 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:12.225762 16733 raft_consensus.cc:2749] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:12.228042  8328 catalog_manager.cc:5697] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 14 to 18, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 18 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.251801  9102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6230ca5c82634f7abb78b594dab8da24" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:12.259605  8550 consensus_peers.cc:597] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:12.251055 16702 leader_election.cc:290] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:12.263330  8328 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 12 to 13, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 13 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.317070  8328 catalog_manager.cc:5697] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.342113  8328 catalog_manager.cc:5697] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:12.339810  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 51469.6us
W20260709 13:04:12.455618  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:12.504477  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:12.601140  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:12.639525  8328 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57104 (request call id 387) took 32542 ms (client timeout 15000 ms). Trace:
W20260709 13:04:12.654914  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:12.671452  8328 rpcz_store.cc:269] 0709 13:03:40.096812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.775535 (+8678723us) service_pool.cc:224] Handling call
0709 13:04:12.639434 (+23863899us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:12.446476 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:12.447218 (+   742us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:12.447251 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:04:12.447269 (+    18us) tablet.cc:662] Decoding operations
0709 13:04:12.457172 (+  9903us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:12.457259 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:12.457290 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:04:12.458315 (+  1025us) tablet.cc:701] Row locks acquired
0709 13:04:12.458334 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:04:12.458466 (+   132us) write_op.cc:270] Start()
0709 13:04:12.458579 (+   113us) write_op.cc:276] Timestamp: P: 1783602252458423 usec, L: 0
0709 13:04:12.458603 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:04:12.459256 (+   653us) log.cc:844] Serialized 4750 byte log entry
0709 13:04:12.481882 (+ 22626us) op_driver.cc:464] REPLICATION: finished
0709 13:04:12.499673 (+ 17791us) write_op.cc:301] APPLY: starting
0709 13:04:12.499763 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:12.534857 (+ 35094us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:12.534957 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:12.581562 (+ 46605us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:12.581824 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:04:12.581869 (+    45us) write_op.cc:312] APPLY: finished
0709 13:04:12.582210 (+   341us) log.cc:844] Serialized 113 byte log entry
0709 13:04:12.582369 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:12.582512 (+   143us) write_op.cc:454] Released schema lock
0709 13:04:12.582562 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:12.583024 (+   462us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:12.583057 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":17510,"apply.run_cpu_time_us":16026,"apply.run_wall_time_us":83310,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":9531,"prepare.run_cpu_time_us":4148,"prepare.run_wall_time_us":13882,"replication_time_us":23120,"thread_start_us":37168,"threads_started":2}]]}
I20260709 13:04:12.658496  8330 catalog_manager.cc:5697] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 13 to 14, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 14 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:12.681795  8330 catalog_manager.cc:5697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 9 to 12, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 12 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.694835 16731 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.695425 16731 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:12.687935  8330 catalog_manager.cc:5697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 6 to 16, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 16 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.697629 16731 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:12.699234  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:12.700811  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141901f3b86847429c9dead6a62a4b04" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:12.702375  8398 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:12.703787 16731 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:12.727735 16731 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.728374 16731 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:12.730769 16731 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:12.732254  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:12.738116  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c783a77969844f0b82c1b365e456c651" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:12.739746  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:12.818778 16731 raft_consensus.cc:493] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6930e07cbba2484ca2bf800a58acdbb0)
I20260709 13:04:12.819371 16731 raft_consensus.cc:515] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:12.821514 16731 leader_election.cc:290] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:12.831879  8330 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57098 (request call id 372) took 77196 ms (client timeout 15000 ms). Trace:
I20260709 13:04:12.832608  8327 catalog_manager.cc:5697] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.836498  8327 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.891556  8327 catalog_manager.cc:5697] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 14 to 18, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 18 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.896072  8327 catalog_manager.cc:5697] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 20 to 26. New cstate: current_term: 26 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:04:12.834363  8330 rpcz_store.cc:269] 0709 13:02:55.635523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.638160 (+  2637us) service_pool.cc:224] Handling call
0709 13:02:57.394002 (+1755842us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b540038bb54. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a192a9090 00007f1a19347f3a 00007f1a1f0fe1cc 00007f1a1f1fc37e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc 00007f1a1d6bc392 00007f1a1767a48c 00007f1a176798c6
0709 13:04:12.831793 (+75437791us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:12.709332 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:12.710135 (+   803us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:12.710174 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:04:12.710191 (+    17us) tablet.cc:662] Decoding operations
0709 13:04:12.710911 (+   720us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:12.710988 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:12.711046 (+    58us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:04:12.711477 (+   431us) tablet.cc:701] Row locks acquired
0709 13:04:12.711495 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:04:12.716294 (+  4799us) write_op.cc:270] Start()
0709 13:04:12.716411 (+   117us) write_op.cc:276] Timestamp: P: 1783602252711622 usec, L: 0
0709 13:04:12.716436 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:04:12.717010 (+   574us) log.cc:844] Serialized 1303 byte log entry
0709 13:04:12.718839 (+  1829us) op_driver.cc:464] REPLICATION: finished
0709 13:04:12.719240 (+   401us) write_op.cc:301] APPLY: starting
0709 13:04:12.719311 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:12.720933 (+  1622us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:12.721031 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:12.749830 (+ 28799us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:12.749988 (+   158us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:04:12.750987 (+   999us) write_op.cc:312] APPLY: finished
0709 13:04:12.751193 (+   206us) log.cc:844] Serialized 41 byte log entry
0709 13:04:12.751354 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:12.751457 (+   103us) write_op.cc:454] Released schema lock
0709 13:04:12.751500 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:12.785617 (+ 34117us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:12.786763 (+  1146us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":45,"spinlock_wait_cycles":38233472,"child_traces":[["op",{"apply.queue_time_us":201,"apply.run_cpu_time_us":4845,"apply.run_wall_time_us":54129,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"num_ops":3,"prepare.queue_time_us":4155,"prepare.run_cpu_time_us":3075,"prepare.run_wall_time_us":8038,"replication_time_us":2275}]]}
I20260709 13:04:12.936885  8327 catalog_manager.cc:5697] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 15 to 17, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 17 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.943931  8327 catalog_manager.cc:5697] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 20 to 21, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 21 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.950734  8327 catalog_manager.cc:5697] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 20 to 23, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 23 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.953168  8327 catalog_manager.cc:5697] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 17 to 20, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 20 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.955227  8327 catalog_manager.cc:5697] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 19 to 24, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 24 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.969825  8327 catalog_manager.cc:5697] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.974066  8327 catalog_manager.cc:5697] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 17 to 20, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 20 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.975863  8327 catalog_manager.cc:5697] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.977495  8327 catalog_manager.cc:5697] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 18 to 21, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 21 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.979884  8327 catalog_manager.cc:5697] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 15 to 20, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 20 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:12.983036  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 187514us
I20260709 13:04:12.983502  8327 catalog_manager.cc:5697] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 18 to 21, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 21 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.984879  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:12.990693  8327 catalog_manager.cc:5697] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 17 to 20, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 20 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.995468  8327 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 10 to 21. New cstate: current_term: 21 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:12.997035  8327 catalog_manager.cc:5697] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.998812  8327 catalog_manager.cc:5697] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 16 to 20, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 20 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.010807  8327 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 19 to 24, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 24 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.012727  8327 catalog_manager.cc:5697] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.014777  8327 catalog_manager.cc:5697] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 20 to 23, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 23 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.029146  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2b7b0063404db89eb6c3acc48e3abf" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:13.028060  8327 catalog_manager.cc:5697] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 21 to 22, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 22 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.036583  8327 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.043586  8327 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 19 to 21, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 21 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.045285  8327 catalog_manager.cc:5697] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 17 to 19, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 19 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.051246 16765 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:13.052043 16765 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:13.072139 16765 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:13.047881  8327 catalog_manager.cc:5697] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.077363  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:13.081902  8327 catalog_manager.cc:5697] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 12 to 16, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 16 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.084583  8327 catalog_manager.cc:5697] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.118389 16764 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.119014 16764 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:13.123013  9095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:13.123279  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dfd08eb514418f81f0ba7777a079e8" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:13.121594 16764 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:13.126309  8400 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:13.127800 16731 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:13.129451 16767 raft_consensus.cc:493] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.129985 16767 raft_consensus.cc:515] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:13.131111  7335 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 8460)
I20260709 13:04:13.132659 16767 leader_election.cc:290] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:13.138042  8476 consensus_peers.cc:597] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:13.140981  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:13.143358  8398 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:13.145898 16764 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:13.159718  8398 leader_election.cc:304] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:13.160758 16764 raft_consensus.cc:2749] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:13.170352  8509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9ecda5b5b04bbebb108bfcee54439e" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:13.223330  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0254141f106e4023bb2d8ba99024140c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:13.248584  8398 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:13.252404  8550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 43839.3us
I20260709 13:04:13.267786 16767 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:13.289126  8398 leader_election.cc:304] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:13.292486 16764 raft_consensus.cc:2749] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:13.307333  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:13.313974  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:13.317591  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:13.318570  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:13.319205  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:13.322139  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:13.348505  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:13.372668  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:13.422578  9068 consensus_peers.cc:597] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:13.432301  9094 consensus_queue.cc:237] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:13.434461  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:13.436364  8324 catalog_manager.cc:5697] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.440696  8327 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32800 (request call id 250) took 5837 ms. Trace:
W20260709 13:04:13.441157  8319 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet adc232408fec446f9379aa9fb2c04164 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 13
I20260709 13:04:13.446067  8324 catalog_manager.cc:5697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.441082  8327 rpcz_store.cc:276] 0709 13:04:07.603232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.997090 (+4393858us) service_pool.cc:224] Handling call
0709 13:04:12.039501 (+ 42411us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b5400020710. stack: 00007f1a16220343 00007f1a16220240 00007f1a15baf1d4 00007f1a1f8ed304 00007f1a1f8ed299 00007f1a160dadb1 00007f1a1621b640 00007f1a1f0f2b76 00007f1a1f1fcc3e 00007f1a1d6bd2a4 00007f1a1d6bd232 00007f1a1d6bd161 00007f1a1d6bd0dc 00007f1a1d6bc392 00007f1a1767a48c 00007f1a176798c6
0709 13:04:13.440612 (+1401111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:13.115913 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:13.116504 (+   591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:13.116545 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:04:13.116565 (+    20us) tablet.cc:662] Decoding operations
0709 13:04:13.118756 (+  2191us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:13.118812 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:13.118841 (+    29us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:04:13.121344 (+  2503us) tablet.cc:701] Row locks acquired
0709 13:04:13.121365 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:04:13.121505 (+   140us) write_op.cc:270] Start()
0709 13:04:13.121630 (+   125us) write_op.cc:276] Timestamp: P: 1783602253121456 usec, L: 0
0709 13:04:13.121654 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:04:13.122440 (+   786us) log.cc:844] Serialized 11290 byte log entry
0709 13:04:13.159373 (+ 36933us) op_driver.cc:464] REPLICATION: finished
0709 13:04:13.162406 (+  3033us) write_op.cc:301] APPLY: starting
0709 13:04:13.162496 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:13.227803 (+ 65307us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:13.227903 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:13.331164 (+103261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:13.331637 (+   473us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:04:13.331707 (+    70us) write_op.cc:312] APPLY: finished
0709 13:04:13.332274 (+   567us) log.cc:844] Serialized 252 byte log entry
0709 13:04:13.333160 (+   886us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:13.333428 (+   268us) write_op.cc:454] Released schema lock
0709 13:04:13.344216 (+ 10788us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:13.376287 (+ 32071us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:13.376335 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7746,"reported_tablets":44,"spinlock_wait_cycles":19073280,"child_traces":[["op",{"apply.queue_time_us":2542,"apply.run_cpu_time_us":38569,"apply.run_wall_time_us":213835,"cfile_cache_hit":116,"cfile_cache_hit_bytes":121104,"num_ops":29,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":6880,"prepare.run_wall_time_us":39554,"replication_time_us":37554}]]}
I20260709 13:04:13.444410  9095 consensus_queue.cc:237] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:13.461032  8509 raft_consensus.cc:1275] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:04:13.462837 16709 consensus_queue.cc:1048] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:04:13.473584  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.484782 16704 raft_consensus.cc:2955] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 3 to 14, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.488111  8502 raft_consensus.cc:2955] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 3 to 14, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.472527  8324 catalog_manager.cc:5697] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 14 to 19, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 19 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.597582  8324 catalog_manager.cc:5697] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 10 to 14, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 14 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:13.599400  8324 catalog_manager.cc:5697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 16 to 19, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 19 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
W20260709 13:04:13.627166  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 107839us
I20260709 13:04:13.628101  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1e038af5e5154b3e8ae9503fdedbb44b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
W20260709 13:04:13.636061  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:13.646901  8576 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:04:13.683909  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 52372.2us
I20260709 13:04:13.687387 16704 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:13.695412  8502 raft_consensus.cc:1275] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:04:13.705506 16709 consensus_queue.cc:1048] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:13.742148  8328 catalog_manager.cc:5697] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 15 to 24. New cstate: current_term: 24 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:13.744443  8328 catalog_manager.cc:5697] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 13 to 19, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 19 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.746796  8328 catalog_manager.cc:5697] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.749634  8328 catalog_manager.cc:5697] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 24 to 27. New cstate: current_term: 27 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:13.753589  8328 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 16 to 19, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 19 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.756285  8328 catalog_manager.cc:5697] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 19 to 21, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 21 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
W20260709 13:04:13.759617  8324 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57098 (request call id 373) took 51680 ms (client timeout 15000 ms). Trace:
W20260709 13:04:13.760080  8324 rpcz_store.cc:269] 0709 13:03:22.079572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.079825 (+   253us) service_pool.cc:224] Handling call
0709 13:04:13.759532 (+51679707us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:13.621535 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:13.631407 (+  9872us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:13.631998 (+   591us) write_op.cc:435] Acquired schema lock
0709 13:04:13.632018 (+    20us) tablet.cc:662] Decoding operations
0709 13:04:13.637078 (+  5060us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:13.637141 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:13.637175 (+    34us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:04:13.637782 (+   607us) tablet.cc:701] Row locks acquired
0709 13:04:13.637800 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:04:13.637950 (+   150us) write_op.cc:270] Start()
0709 13:04:13.638084 (+   134us) write_op.cc:276] Timestamp: P: 1783602253637895 usec, L: 0
0709 13:04:13.638114 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:04:13.638757 (+   643us) log.cc:844] Serialized 2079 byte log entry
0709 13:04:13.641101 (+  2344us) op_driver.cc:464] REPLICATION: finished
0709 13:04:13.641649 (+   548us) write_op.cc:301] APPLY: starting
0709 13:04:13.641751 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:13.644641 (+  2890us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:13.644755 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:13.648980 (+  4225us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:13.649197 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:04:13.649238 (+    41us) write_op.cc:312] APPLY: finished
0709 13:04:13.649459 (+   221us) log.cc:844] Serialized 57 byte log entry
0709 13:04:13.650959 (+  1500us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:13.651064 (+   105us) write_op.cc:454] Released schema lock
0709 13:04:13.651102 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:13.651698 (+   596us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:13.651725 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":852412,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":285,"apply.run_cpu_time_us":7251,"apply.run_wall_time_us":10009,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20880,"num_ops":5,"prepare.queue_time_us":160,"prepare.run_cpu_time_us":3595,"prepare.run_wall_time_us":17532,"replication_time_us":2824}]]}
I20260709 13:04:13.766999  8328 catalog_manager.cc:5697] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 15 to 16, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 16 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.770931  8328 catalog_manager.cc:5697] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 18 to 20, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 20 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.773789  8328 catalog_manager.cc:5697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 21 to 24, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 24 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:13.779871 16778 raft_consensus.cc:2955] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 3 to 14, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.775460  8328 catalog_manager.cc:5697] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 19 to 26, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 26 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:13.782521  8328 catalog_manager.cc:5697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 20 to 24, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 24 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:13.792460  8328 catalog_manager.cc:5697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 13 to 17, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 17 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
W20260709 13:04:13.793354  8476 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:13.794435  8328 catalog_manager.cc:5697] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.796254 16776 raft_consensus.cc:493] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.796264  8328 catalog_manager.cc:5697] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 19 to 23, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 23 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.796878 16776 raft_consensus.cc:515] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:13.797523  8581 raft_consensus.cc:2955] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 3 to 14, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:13.799422 16776 leader_election.cc:290] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:13.799975  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:13.800709  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18349b8506fc4ede84bfb527fb6e8a68" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:13.802831  8400 leader_election.cc:304] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:13.803944 16776 raft_consensus.cc:2749] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:13.804979 16751 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.805540 16751 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:13.808445 16751 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:13.798235  8328 catalog_manager.cc:5697] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 15 to 19, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 19 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.811342  8328 catalog_manager.cc:5697] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 12 to 26, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 26 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.813814  8328 catalog_manager.cc:5697] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 13 to 26, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 26 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.815817  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:13.816584  8502 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:04:13.817997  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:13.818600  9094 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:04:13.819409  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:13.820212 16751 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:13.820554 16751 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.820895 16751 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:13.830140 16776 raft_consensus.cc:493] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.830722 16776 raft_consensus.cc:515] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:13.832978 16776 leader_election.cc:290] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:13.838155  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:13.842200  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:13.816839  8328 catalog_manager.cc:5697] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 14 to 22. New cstate: current_term: 22 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:13.848450  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435c81d2d1f346bea90c20030455900c" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:13.866775  8328 catalog_manager.cc:5697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 19 to 24. New cstate: current_term: 24 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:13.869525  8328 catalog_manager.cc:5697] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:13.907497  8400 leader_election.cc:304] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
W20260709 13:04:13.909932  8400 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 56635.6us
I20260709 13:04:13.910810 16733 raft_consensus.cc:2749] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:13.914135 16763 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.914635 16763 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:13.916755 16763 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:13.921592  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:13.922506  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f59320c7be4aea96b523f7f5083650" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:13.920858 16751 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:13.932344  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:13.937881  8319 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6230ca5c82634f7abb78b594dab8da24 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:13.939942  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:13.940552  8502 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:13.941134  8400 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:13.944972 16776 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:13.948386  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fa0c62ae854ede982769f8be4f5421" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:13.949087  9094 raft_consensus.cc:3060] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:04:13.953576  8476 consensus_peers.cc:597] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:13.961017  8502 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:04:13.962222  8547 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:13.962984 16762 raft_consensus.cc:2804] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:13.963464 16762 raft_consensus.cc:697] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:13.964351 16762 consensus_queue.cc:237] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:13.978333  9094 raft_consensus.cc:2468] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:04:13.970925 16751 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:14.011590  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 163917us
I20260709 13:04:14.025810 16776 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.059229 16765 raft_consensus.cc:493] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.059842 16765 raft_consensus.cc:515] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:14.060626 16776 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:14.044144  8503 raft_consensus.cc:2955] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 3 to 14, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:14.097491  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:14.100039  8504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:14.104223  8550 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 211 similar messages]
I20260709 13:04:14.110153 16765 leader_election.cc:290] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:14.122527 16776 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:14.131606  7335 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 8460)
I20260709 13:04:14.133677  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4156673eede4435930a1d9fd63f78a3" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:14.136346  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fff54c32b2248dca5e70dc82b71155d" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:14.141438  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 97623.4us
I20260709 13:04:14.168927 16776 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.169509 16776 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:14.172042 16776 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:14.182197  8400 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:14.195405 16765 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:14.197033  8400 leader_election.cc:304] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:14.197767 16765 raft_consensus.cc:2749] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:14.201350  8327 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:14.202770  8327 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:14.204912  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:14.205503  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2240cdfdfc6c47f49f2aaea6aa62b675" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:14.206254  8327 catalog_manager.cc:5697] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 4 to 13, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 20 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.208066  8327 catalog_manager.cc:5697] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 18 to 26. New cstate: current_term: 26 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.219053  8327 catalog_manager.cc:5697] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: config changed from index 3 to 14, VOTER 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) evicted. New cstate: current_term: 20 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.220925  8327 catalog_manager.cc:5697] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 20 to 24, leader changed from 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 24 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.224094  8327 catalog_manager.cc:5697] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 16 to 22, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 22 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:14.228122  8328 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57098 (request call id 375) took 5123 ms. Trace:
I20260709 13:04:14.228612  8328 rpcz_store.cc:276] 0709 13:04:09.104467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.683374 (+3578907us) service_pool.cc:224] Handling call
0709 13:04:14.228048 (+1544674us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:13.931233 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:13.931802 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:13.931841 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:04:13.931858 (+    17us) tablet.cc:662] Decoding operations
0709 13:04:13.935891 (+  4033us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:13.935962 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:13.935998 (+    36us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:04:13.937743 (+  1745us) tablet.cc:701] Row locks acquired
0709 13:04:13.937762 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:04:13.937922 (+   160us) write_op.cc:270] Start()
0709 13:04:13.971453 (+ 33531us) write_op.cc:276] Timestamp: P: 1783602253937870 usec, L: 0
0709 13:04:13.971489 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:04:13.988716 (+ 17227us) log.cc:844] Serialized 7819 byte log entry
0709 13:04:13.992173 (+  3457us) op_driver.cc:464] REPLICATION: finished
0709 13:04:13.992626 (+   453us) write_op.cc:301] APPLY: starting
0709 13:04:13.992701 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:14.034718 (+ 42017us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:14.034813 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:14.118069 (+ 83256us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:14.140040 (+ 21971us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:04:14.140110 (+    70us) write_op.cc:312] APPLY: finished
0709 13:04:14.140545 (+   435us) log.cc:844] Serialized 180 byte log entry
0709 13:04:14.140734 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:14.140925 (+   191us) write_op.cc:454] Released schema lock
0709 13:04:14.140989 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:14.142279 (+  1290us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:14.142311 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47,"reported_tablets":45,"spinlock_wait_cycles":145280,"child_traces":[["op",{"apply.queue_time_us":263,"apply.run_cpu_time_us":24813,"apply.run_wall_time_us":149588,"cfile_cache_hit":80,"cfile_cache_hit_bytes":83520,"num_ops":20,"prepare.queue_time_us":239,"prepare.run_cpu_time_us":6032,"prepare.run_wall_time_us":60359,"replication_time_us":12571}]]}
I20260709 13:04:14.225349  8327 catalog_manager.cc:5697] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 18 to 23, leader changed from 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 23 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:14.235354  8327 catalog_manager.cc:5697] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 21 to 23, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 23 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:14.294787  8400 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:14.298329 16765 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:14.328778  8328 catalog_manager.cc:5697] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 18 to 24, leader changed from 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194) to dacb523538a14c7cb335ab9c18f4111b (127.7.41.193). New cstate: current_term: 24 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:14.331352  8328 catalog_manager.cc:5697] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "dacb523538a14c7cb335ab9c18f4111b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } }
I20260709 13:04:14.333280  8328 catalog_manager.cc:5697] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: config changed from index 3 to 14, VOTER dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) evicted. New cstate: current_term: 21 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
I20260709 13:04:14.345652  8502 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:14.347604 16789 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:04:14.367328  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e038af5e5154b3e8ae9503fdedbb44b with delete_type TABLET_DATA_TOMBSTONED (TS 5ffc86752d264d0c81f68028e6413a91 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:50448
I20260709 13:04:14.381433 16795 tablet_replica.cc:333] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:14.382784 16795 raft_consensus.cc:2243] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:14.383996 16795 raft_consensus.cc:2272] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.392760 16795 ts_tablet_manager.cc:1916] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:14.406679  9094 raft_consensus.cc:1275] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:04:14.408516 16787 consensus_queue.cc:1048] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:04:14.415977  8320 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 76467.8us
W20260709 13:04:14.419634  8320 catalog_manager.cc:4755] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet adc232408fec446f9379aa9fb2c04164: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:04:14.470163 16795 ts_tablet_manager.cc:1929] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.13
I20260709 13:04:14.470836 16795 log.cc:1199] T 1e038af5e5154b3e8ae9503fdedbb44b P 5ffc86752d264d0c81f68028e6413a91: Deleting WAL directory at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/wals/1e038af5e5154b3e8ae9503fdedbb44b
I20260709 13:04:14.477281  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet 1e038af5e5154b3e8ae9503fdedbb44b (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:04:14.502545  8328 catalog_manager.cc:5697] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:04:14.599573  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:14.605197  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:14.660363  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:14.661512  8326 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 6230ca5c82634f7abb78b594dab8da24 with cas_config_opid_index 3: aborting the task: latest config opid_index 14; task opid_index 3
I20260709 13:04:14.677348  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e038af5e5154b3e8ae9503fdedbb44b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:50448
I20260709 13:04:14.678941  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet 1e038af5e5154b3e8ae9503fdedbb44b (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
W20260709 13:04:14.680886  8326 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57104 (request call id 385) took 74009 ms (client timeout 15000 ms). Trace:
W20260709 13:04:14.681406  8326 rpcz_store.cc:269] 0709 13:03:00.671702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.672003 (+   301us) service_pool.cc:224] Handling call
0709 13:04:14.680762 (+74008759us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13278,"reported_tablets":46}
I20260709 13:04:14.690505  8331 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57088 (request call id 365) took 10159 ms. Trace:
I20260709 13:04:14.692751  8331 rpcz_store.cc:276] 0709 13:04:04.530708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.492804 (+5962096us) service_pool.cc:224] Handling call
0709 13:04:14.690419 (+4197615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58546,"reported_tablets":46}
I20260709 13:04:14.707373  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:14.709991  7335 tablet_replica.cc:333] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:14.712038  7335 raft_consensus.cc:2243] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:14.713320  7335 raft_consensus.cc:2272] T f2a5011db54b4e9f85a54c19ade01aa8 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.716809  7335 tablet_replica.cc:333] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:14.718333  7335 raft_consensus.cc:2243] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:14.719640  7335 raft_consensus.cc:2272] T 6a195e69bd9b4a1a80805249b3c0c304 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.732988  7335 tablet_replica.cc:333] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:14.745805  7335 raft_consensus.cc:2243] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:14.747026  7335 raft_consensus.cc:2272] T 7c79fc54c7a44921afa731a1720c6b3b P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.758070  7335 tablet_replica.cc:333] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:14.759590  7335 raft_consensus.cc:2243] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:14.760681  7335 raft_consensus.cc:2272] T 094f99cd1bce4f88ab569c64b32b03b1 P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.763767  7335 tablet_replica.cc:333] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:14.777043  7335 raft_consensus.cc:2243] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:14.781590  7335 raft_consensus.cc:2272] T cbe0cd8e445e4958b026f85c697843e8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.786417  7335 tablet_replica.cc:333] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
W20260709 13:04:14.783241  8325 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57088 (request call id 364) took 35408 ms (client timeout 15000 ms). Trace:
W20260709 13:04:14.842288  8325 rpcz_store.cc:269] 0709 13:03:39.374396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.374978 (+   582us) service_pool.cc:224] Handling call
0709 13:04:14.783019 (+35408041us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28067,"reported_tablets":46}
I20260709 13:04:14.842888  7335 raft_consensus.cc:2243] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:14.844273  7335 raft_consensus.cc:2272] T d56fc8bb927a4cdd8b35293e875e2856 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.873157  7335 tablet_replica.cc:333] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:14.876626  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e038af5e5154b3e8ae9503fdedbb44b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:50448
I20260709 13:04:14.878312  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet 1e038af5e5154b3e8ae9503fdedbb44b (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:04:14.879141  7335 raft_consensus.cc:2243] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:14.880087  7335 raft_consensus.cc:2272] T 18349b8506fc4ede84bfb527fb6e8a68 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.883270  7335 tablet_replica.cc:333] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:14.884903  8329 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet adc232408fec446f9379aa9fb2c04164 with cas_config_opid_index 4: aborting the task: latest config opid_index 13; task opid_index 4
W20260709 13:04:14.888450  8329 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57104 (request call id 386) took 56573 ms (client timeout 15000 ms). Trace:
W20260709 13:04:14.898185  8329 rpcz_store.cc:269] 0709 13:03:18.315249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.315566 (+   317us) service_pool.cc:224] Handling call
0709 13:04:14.888340 (+56572774us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26679,"reported_tablets":46}
I20260709 13:04:14.906566  7335 raft_consensus.cc:2243] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:14.907408  7335 pending_rounds.cc:70] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Trying to abort 1 pending ops.
I20260709 13:04:14.907651  7335 pending_rounds.cc:77] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b: Aborting op as it isn't in flight: id { term: 23 index: 18 } timestamp: 7305634770744418304 op_type: NO_OP noop_request { }
I20260709 13:04:14.908085  7335 raft_consensus.cc:2889] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:14.908445  7335 raft_consensus.cc:2272] T d9390750b3d3442e888055fd39566ef1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:14.911213  8332 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57098 (request call id 374) took 23301 ms (client timeout 15000 ms). Trace:
W20260709 13:04:14.911964  8332 rpcz_store.cc:269] 0709 13:03:51.609921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.512342 (+13902421us) service_pool.cc:224] Handling call
0709 13:04:14.910939 (+9398597us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11648,"reported_tablets":45}
I20260709 13:04:14.921788  7335 tablet_replica.cc:333] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:14.922878  7335 raft_consensus.cc:2243] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:14.923527  7335 raft_consensus.cc:2272] T 8fff54c32b2248dca5e70dc82b71155d P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.926374 16515 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.926826 16515 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:14.928905 16515 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:14.931435  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:14.932248  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0318f5ccc3c5462784199f043fe82842" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:14.934779  8400 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:14.936579 16515 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:14.941342  7335 tablet_replica.cc:333] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:14.942437  7335 raft_consensus.cc:2243] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:14.943084  7335 raft_consensus.cc:2272] T 0a2b7b0063404db89eb6c3acc48e3abf P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.964241  7335 tablet_replica.cc:333] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:14.965267  7335 raft_consensus.cc:2243] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:14.966428  7335 raft_consensus.cc:2272] T 6230ca5c82634f7abb78b594dab8da24 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.969390  7335 tablet_replica.cc:333] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
W20260709 13:04:14.980794  8550 consensus_peers.cc:597] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:14.981545 16515 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:14.982189 16515 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:14.984354 16515 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:14.986547  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:14.986550  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1c8798b6794858b96202fe8f7264d6" candidate_uuid: "dacb523538a14c7cb335ab9c18f4111b" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:14.992782  8400 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dacb523538a14c7cb335ab9c18f4111b; no voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:14.998570  7335 raft_consensus.cc:2243] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:14.999363  7335 raft_consensus.cc:2272] T adc232408fec446f9379aa9fb2c04164 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:14.999507 16515 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:15.006990  7335 tablet_replica.cc:333] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.008016  7335 raft_consensus.cc:2243] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.016314  7335 raft_consensus.cc:2272] T bc7e6e656d324c0bad9eee744f6f1886 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.021066  7335 tablet_replica.cc:333] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.022719  8567 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e038af5e5154b3e8ae9503fdedbb44b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:50448
W20260709 13:04:15.024631  8333 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57104 (request call id 388) took 12405 ms (client timeout 15000 ms). Trace:
W20260709 13:04:15.025034  8333 rpcz_store.cc:269] 0709 13:04:02.619057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.784574 (+6165517us) service_pool.cc:224] Handling call
0709 13:04:15.024439 (+6239865us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":46}
I20260709 13:04:15.026933  8319 catalog_manager.cc:5028] TS 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): tablet 1e038af5e5154b3e8ae9503fdedbb44b (table test-workload [id=20aadca15e7e4aa88cb723030736de51]) successfully deleted
I20260709 13:04:15.029772  7335 raft_consensus.cc:2243] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.031257  7335 raft_consensus.cc:2272] T 18f59320c7be4aea96b523f7f5083650 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.038715  7335 tablet_replica.cc:333] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.039640  7335 raft_consensus.cc:2243] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.040282  7335 pending_rounds.cc:70] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Trying to abort 1 pending ops.
I20260709 13:04:15.040526  7335 pending_rounds.cc:77] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b: Aborting op as it isn't in flight: id { term: 21 index: 14 } timestamp: 7305634763003117568 op_type: NO_OP noop_request { }
I20260709 13:04:15.040850  7335 raft_consensus.cc:2889] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:15.081228  7335 raft_consensus.cc:2272] T ec1a6df183ea46c0b7b35ceaa22ed236 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.094859  7335 tablet_replica.cc:333] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
W20260709 13:04:15.113955  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:15.140120  7335 raft_consensus.cc:2243] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.142565  7335 raft_consensus.cc:2272] T a4e89695d22445b4b40c4e3c0d792325 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.145217  7335 tablet_replica.cc:333] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.150485  7335 raft_consensus.cc:2243] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.152652  7335 raft_consensus.cc:2272] T b9e03855c7c944d6a2bd32561a407196 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.155573  7335 tablet_replica.cc:333] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.156502  7335 raft_consensus.cc:2243] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.157023  7335 raft_consensus.cc:2272] T c783a77969844f0b82c1b365e456c651 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.177919  7335 tablet_replica.cc:333] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.178797  7335 raft_consensus.cc:2243] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.179936  7335 raft_consensus.cc:2272] T f25688d717bb4dae964fead4a15af269 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.182695  7335 tablet_replica.cc:333] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.210747  7335 raft_consensus.cc:2243] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.212090  7335 raft_consensus.cc:2272] T 4c7ceb457b3b46b096de1a7a57adccde P dacb523538a14c7cb335ab9c18f4111b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.215090  7335 tablet_replica.cc:333] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.216097  7335 raft_consensus.cc:2243] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.216706  7335 pending_rounds.cc:70] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Trying to abort 1 pending ops.
I20260709 13:04:15.216956  7335 pending_rounds.cc:77] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b: Aborting op as it isn't in flight: id { term: 18 index: 13 } timestamp: 7305634794016325632 op_type: NO_OP noop_request { }
I20260709 13:04:15.217320  7335 raft_consensus.cc:2889] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:15.217646  7335 raft_consensus.cc:2272] T 435c81d2d1f346bea90c20030455900c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.226356  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:15.236485  7335 tablet_replica.cc:333] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.246697  7335 raft_consensus.cc:2243] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.247346  7335 raft_consensus.cc:2272] T f518d1b1d4c2478b9d4fc2483806952e P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.262042  7335 tablet_replica.cc:333] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.263126  7335 raft_consensus.cc:2243] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.264333  7335 raft_consensus.cc:2272] T a12a506b127d40b1acc72c04ae2f5a40 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.266718  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:15.278687  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:15.279592  7335 tablet_replica.cc:333] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.280654  7335 raft_consensus.cc:2243] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.281785  7335 raft_consensus.cc:2272] T f86829baeb70423ab45311ca8cb560c8 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.300599  7335 tablet_replica.cc:333] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.306318  7335 raft_consensus.cc:2243] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.307431  7335 raft_consensus.cc:2272] T 45dd878477224acc8d0d4dca5d5d4f02 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.323424  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:15.326485  7335 tablet_replica.cc:333] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.327373  7335 raft_consensus.cc:2243] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.341977  7335 raft_consensus.cc:2272] T 9dd9d456ec5e4a83be19a678fcfc50f1 P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.356458  7335 tablet_replica.cc:333] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.357396  7335 raft_consensus.cc:2243] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.358596  7335 raft_consensus.cc:2272] T 7c808e5ae17447f4a32fc1b5624cc91a P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.362985  7335 tablet_replica.cc:333] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.363853  7335 raft_consensus.cc:2243] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.364441  7335 raft_consensus.cc:2272] T 1d9ecda5b5b04bbebb108bfcee54439e P dacb523538a14c7cb335ab9c18f4111b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.377794  7335 tablet_replica.cc:333] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.379072  7335 raft_consensus.cc:2243] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.379751  7335 raft_consensus.cc:2272] T 09de6eee9632412ebe0a904f65cd2a3c P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.382810  7335 tablet_replica.cc:333] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.385561  7335 raft_consensus.cc:2243] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.386669  7335 raft_consensus.cc:2272] T f6c83778726d49c5b8622ad284f71aa9 P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.393435  7335 tablet_replica.cc:333] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
W20260709 13:04:15.407125  8476 consensus_peers.cc:597] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:15.418007  7335 raft_consensus.cc:2243] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.418804  7335 raft_consensus.cc:2272] T 652dfe8b7bb64be896563cb525d678d1 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.421801  7335 tablet_replica.cc:333] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.422663  7335 raft_consensus.cc:2243] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.423421  7335 raft_consensus.cc:2272] T 9d8ec20c8aeb4915950772c6add9f352 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.433501  7335 tablet_replica.cc:333] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.434374  7335 raft_consensus.cc:2243] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.434919  7335 raft_consensus.cc:2272] T 1e038af5e5154b3e8ae9503fdedbb44b P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.444454  7335 tablet_replica.cc:333] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.445237  7335 raft_consensus.cc:2243] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.454066  7335 raft_consensus.cc:2272] T 0254141f106e4023bb2d8ba99024140c P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.456390  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:15.457226  7335 tablet_replica.cc:333] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.458335  7335 raft_consensus.cc:2243] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.459426  7335 raft_consensus.cc:2272] T b7dfd08eb514418f81f0ba7777a079e8 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.464452  7335 tablet_replica.cc:333] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.465274  7335 raft_consensus.cc:2243] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.480315  7335 raft_consensus.cc:2272] T df86b8c30ce74df593c44831a29d2f9f P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.484840  7335 tablet_replica.cc:333] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.490206  7335 raft_consensus.cc:2243] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.491366  7335 raft_consensus.cc:2272] T 141901f3b86847429c9dead6a62a4b04 P dacb523538a14c7cb335ab9c18f4111b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.511098  7335 tablet_replica.cc:333] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.512432  7335 raft_consensus.cc:2243] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.513118  7335 raft_consensus.cc:2272] T c4156673eede4435930a1d9fd63f78a3 P dacb523538a14c7cb335ab9c18f4111b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.516570  7335 tablet_replica.cc:333] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.517498  7335 raft_consensus.cc:2243] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.518173  7335 raft_consensus.cc:2272] T c0a41ce5cf754ad58e31f5e764daa48f P dacb523538a14c7cb335ab9c18f4111b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.533336  7335 tablet_replica.cc:333] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.534296  7335 raft_consensus.cc:2243] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.535141  7335 raft_consensus.cc:2272] T 057641ab553c4ec08538f2ed159ba000 P dacb523538a14c7cb335ab9c18f4111b [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.542335  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:15.544343  7335 tablet_replica.cc:333] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.545356  7335 raft_consensus.cc:2243] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.548539  7335 raft_consensus.cc:2272] T 0318f5ccc3c5462784199f043fe82842 P dacb523538a14c7cb335ab9c18f4111b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.555987  7335 tablet_replica.cc:333] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.556850  7335 raft_consensus.cc:2243] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.559285  7335 raft_consensus.cc:2272] T 37072d40853c44b1b312489112c9250e P dacb523538a14c7cb335ab9c18f4111b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.562183  7335 tablet_replica.cc:333] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.574462  7335 raft_consensus.cc:2243] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.576205  7335 raft_consensus.cc:2272] T 6d4b315396764044bd73a9cb7f985b2b P dacb523538a14c7cb335ab9c18f4111b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.579681  7335 tablet_replica.cc:333] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.580487  7335 raft_consensus.cc:2243] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.581302  7335 raft_consensus.cc:2272] T bd1c8798b6794858b96202fe8f7264d6 P dacb523538a14c7cb335ab9c18f4111b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.584293  7335 tablet_replica.cc:333] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.611353  7335 raft_consensus.cc:2243] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.612709  7335 raft_consensus.cc:2272] T 64f4890aeba446ef8cf170616e61d6ab P dacb523538a14c7cb335ab9c18f4111b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.615657  7335 tablet_replica.cc:333] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b: stopping tablet replica
I20260709 13:04:15.616313  7335 raft_consensus.cc:2243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.616930  7335 raft_consensus.cc:2272] T 2240cdfdfc6c47f49f2aaea6aa62b675 P dacb523538a14c7cb335ab9c18f4111b [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.642829  8320 catalog_manager.cc:4755] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6230ca5c82634f7abb78b594dab8da24: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:04:15.680847  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:15.757310  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:15.761107  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:15.773777 16782 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.774461 16782 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:15.777096 16782 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:15.781618  8550 leader_election.cc:336] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:15.793803  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:15.796165  8547 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:15.797304 16782 raft_consensus.cc:2749] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:15.798471  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:15.799757 16790 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.800360 16790 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:15.803449 16790 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:15.803689  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:15.813797  8476 leader_election.cc:336] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:15.814294  8476 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:15.815790 16790 raft_consensus.cc:2749] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:15.822985 16775 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.823613 16775 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:15.830960  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:15.831895  8502 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 24.
I20260709 13:04:15.833205  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:15.834158 16778 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:15.834604 16778 raft_consensus.cc:493] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.835031 16778 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:15.840070 16801 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.840690 16801 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:15.843770  9068 leader_election.cc:336] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:15.846398 16782 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.846989 16782 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:15.849979 16782 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:15.865285  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:15.866605 16801 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:15.825925 16775 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:15.873793  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:15.874552  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:15.892203  8550 leader_election.cc:336] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:15.894193  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:15.897858  8547 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:15.898988 16787 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:15.903599 16778 raft_consensus.cc:515] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:15.920035  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a5011db54b4e9f85a54c19ade01aa8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:15.920790  8503 raft_consensus.cc:3060] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:15.938710 16775 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.939314 16775 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:15.941291 16775 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:15.941803 16790 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.942377 16790 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:15.943035  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:15.943662  8502 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:04:15.944379 16790 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:15.944890  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:15.945814  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:15.945763 16804 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:15.946548 16804 raft_consensus.cc:493] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.946919 16804 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:15.948939  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:15.954363 16801 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.955238 16778 leader_election.cc:290] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:15.954939 16801 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:15.957116 16801 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:15.958069  8476 leader_election.cc:336] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:15.949585  8503 raft_consensus.cc:2468] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 25.
I20260709 13:04:15.958586  8476 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:15.959013  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:15.961620  8577 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
I20260709 13:04:15.963022  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:15.963757 16790 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:15.961032  9065 leader_election.cc:304] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:15.959467 16801 raft_consensus.cc:2749] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:15.964912 16790 raft_consensus.cc:493] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:15.965324 16790 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:04:15.967396  8476 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:15.967971 16778 raft_consensus.cc:2804] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:15.969327 16778 raft_consensus.cc:697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:04:15.970467 16778 consensus_queue.cc:237] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:15.970935 16804 raft_consensus.cc:515] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:15.972227  9094 raft_consensus.cc:2393] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:15.973371 16804 leader_election.cc:290] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:15.974385  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe0cd8e445e4958b026f85c697843e8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:15.974961  8503 raft_consensus.cc:3060] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:15.975045  8475 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:15.984798  8476 leader_election.cc:336] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:15.996791  8503 raft_consensus.cc:2468] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
I20260709 13:04:15.997501 16801 raft_consensus.cc:2749] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:15.998909 16790 raft_consensus.cc:515] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.001087  9065 leader_election.cc:304] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.004112 16803 raft_consensus.cc:2804] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:16.004638 16803 raft_consensus.cc:697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:04:16.005532 16803 consensus_queue.cc:237] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.027930  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a195e69bd9b4a1a80805249b3c0c304" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:16.028570  8577 raft_consensus.cc:3060] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:16.032665 16790 leader_election.cc:290] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.037931  8577 raft_consensus.cc:2468] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 25.
I20260709 13:04:16.037700  8333 catalog_manager.cc:5697] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 24 to 25, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 25 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:16.045128  8476 leader_election.cc:336] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.045800  8475 leader_election.cc:304] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.048584 16790 raft_consensus.cc:2804] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:16.049608 16790 raft_consensus.cc:697] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:16.050787 16790 consensus_queue.cc:237] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.094095  8332 catalog_manager.cc:5697] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 24 to 25, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 25 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.151674 16787 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.152223 16787 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.154345 16787 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.156692  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:16.157344  8503 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:04:16.161269  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:16.162225 16782 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:16.162585 16782 raft_consensus.cc:493] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.162927 16782 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:16.167605  8550 leader_election.cc:336] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.173424 16782 raft_consensus.cc:515] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.173204  8332 catalog_manager.cc:5697] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 20 to 21, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 21 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.176646 16782 leader_election.cc:290] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.179993  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c79fc54c7a44921afa731a1720c6b3b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:16.180590  8502 raft_consensus.cc:3060] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:16.180560  8550 leader_election.cc:336] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.189559  8502 raft_consensus.cc:2468] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:04:16.191673  8547 leader_election.cc:304] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.192528 16782 raft_consensus.cc:2804] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:16.193011 16782 raft_consensus.cc:697] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:16.193848 16782 consensus_queue.cc:237] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.222124 16778 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.222792 16778 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.226850  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:16.227389  8332 catalog_manager.cc:5697] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 19 to 20, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 20 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.228353 16778 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.261034 16801 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.261574 16801 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.263677 16801 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.267184  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.267833  8577 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 17.
I20260709 13:04:16.268767  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:16.270700 16801 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:16.271057 16801 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.271387 16801 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:16.274499  8476 leader_election.cc:336] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.274660 16778 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.275142 16778 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.276971 16778 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.278108  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.281894 16801 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:16.288818  8476 leader_election.cc:336] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.303004  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094f99cd1bce4f88ab569c64b32b03b1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:16.303604  8577 raft_consensus.cc:3060] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:16.309590  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:16.311648  8577 raft_consensus.cc:2468] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 18.
I20260709 13:04:16.312969  8475 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.313869 16790 raft_consensus.cc:2804] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:16.314407 16790 raft_consensus.cc:697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:16.315160 16801 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 18 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.322716 16791 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.323289 16791 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.325678 16791 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:16.328538  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:16.329324  9101 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:04:16.331059  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.315335 16790 consensus_queue.cc:237] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.340569 16787 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.341428 16791 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:16.341265 16787 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.341933 16791 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.343724 16787 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:16.343907 16791 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:16.348052  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:16.349915  8550 leader_election.cc:336] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.351372  8549 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.352092 16782 raft_consensus.cc:2749] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:16.387166  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 56189.8us
I20260709 13:04:16.400175  8332 catalog_manager.cc:5697] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 17 to 18, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 18 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:16.411569  8476 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.424621 16821 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.425499 16821 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.427819 16791 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.428666 16782 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.436200 16782 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.438479 16782 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.430675  8502 raft_consensus.cc:1275] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:04:16.440709 16803 consensus_queue.cc:1048] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:04:16.445255  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.447180  8503 raft_consensus.cc:1275] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:04:16.448822 16803 consensus_queue.cc:1048] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:04:16.460668  8550 leader_election.cc:336] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.477620  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56fc8bb927a4cdd8b35293e875e2856" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:16.478296  9101 raft_consensus.cc:3060] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:04:16.479559  8476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 51918.8us
I20260709 13:04:16.488409  9101 raft_consensus.cc:2468] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
I20260709 13:04:16.497481  8475 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.435534 16821 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.495537 16782 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.498540 16801 raft_consensus.cc:2804] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:16.501456 16801 raft_consensus.cc:697] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:16.502470 16801 consensus_queue.cc:237] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.500694  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:16.499275 16782 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.508544  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.510510 16790 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.510865 16789 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:16.511235 16790 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.514860 16782 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:16.515430  8550 leader_election.cc:336] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.516219 16790 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:16.516341  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:16.518388  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:16.498522 16791 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:16.523030  8549 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.537019 16789 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.537634 16789 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.539897 16789 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.542040  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:16.542779  8501 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 24.
I20260709 13:04:16.547070  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:16.548691 16787 raft_consensus.cc:2749] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:16.534412 16822 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.591464 16782 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.603197 16787 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.603798 16787 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.603974 16828 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:04:16.604864  8476 leader_election.cc:336] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.604791 16828 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.605381  8476 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.606182 16778 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.607000 16828 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.606765 16778 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.610841 16778 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.612012 16787 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:16.583335 16822 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.614059 16782 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.617764  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
W20260709 13:04:16.618129  8476 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.618604  8501 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 21.
W20260709 13:04:16.603250  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:16.622957  9065 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.628610 16778 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:16.629093 16820 raft_consensus.cc:2749] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:16.629665 16778 raft_consensus.cc:493] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.630168 16778 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:16.598539 16830 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:04:16.636329  8550 leader_election.cc:336] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.620960 16782 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:16.640010  8476 leader_election.cc:336] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.644549  8476 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:16.647650  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 100659us
I20260709 13:04:16.636600 16830 raft_consensus.cc:493] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.646347 16820 raft_consensus.cc:2749] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:16.657332  8502 raft_consensus.cc:1275] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:04:16.647619 16822 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.651314 16828 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.661590  8577 raft_consensus.cc:1275] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:04:16.652150 16803 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.665823 16778 raft_consensus.cc:515] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:16.675593  8550 leader_election.cc:336] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.653421 16830 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:16.667354  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.677551  8581 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
I20260709 13:04:16.668753  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:16.677948  8550 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.678330  9101 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:16.669658  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:16.673203  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.679167  9094 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:04:16.679215  8579 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 20.
I20260709 13:04:16.680665  9067 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.678514  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:16.680159  8332 catalog_manager.cc:5697] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 23 to 24, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 24 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.686841 16837 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.687407 16837 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.690119 16778 leader_election.cc:290] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.679984 16782 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.682466 16829 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.697685 16829 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.699926 16829 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.674938 16828 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.702126 16828 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.679939 16822 consensus_queue.cc:1048] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:04:16.679349 16803 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.683961 16801 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:04:16.704569 16801 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.705089 16801 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:16.705248 16782 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:16.710212  8476 consensus_peers.cc:597] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.705111  8550 consensus_peers.cc:597] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.710878  8476 leader_election.cc:336] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.707710 16782 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.714643 16835 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.715498 16835 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.680752 16832 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.728844 16832 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.734917 16835 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.737960  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c83778726d49c5b8622ad284f71aa9" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
W20260709 13:04:16.738175  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 57583.6us
I20260709 13:04:16.738229  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.738627  8503 raft_consensus.cc:3060] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:16.743836  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.749229  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.751748  8503 raft_consensus.cc:2468] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:04:16.752831 16837 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.754015  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:16.754787  8503 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:04:16.736714 16836 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:16.757053 16836 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.757444 16836 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:16.764851 16782 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:16.765304 16782 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.765663 16782 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:16.731951 16830 raft_consensus.cc:515] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.722132 16829 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.770856  8579 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
W20260709 13:04:16.773417  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 78814.7us
I20260709 13:04:16.748543 16791 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.774595 16822 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.774411 16791 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:16.775161  8550 leader_election.cc:336] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.775085 16822 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.776789 16791 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.776958 16820 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.777555 16820 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.778419 16803 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.779630 16820 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:16.780375 16790 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.780936 16790 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.773813 16787 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:16.782522 16787 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.782912 16787 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:16.783133 16830 leader_election.cc:290] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.783478 16790 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.778482 16822 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:16.785737  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.786339  8579 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 26.
W20260709 13:04:16.786597  8476 leader_election.cc:336] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.794041  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.794843  8581 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
I20260709 13:04:16.791618  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.796986 16827 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.797310  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:16.797567  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:16.797565 16827 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.799882  9094 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 22.
I20260709 13:04:16.800300  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: 
I20260709 13:04:16.805061 16830 consensus_queue.cc:1048] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:04:16.806444  8550 leader_election.cc:336] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:16.806963  8550 leader_election.cc:336] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:16.808481  8476 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:16.808535 16790 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:04:16.809068  8476 leader_election.cc:336] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.809259 16790 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:04:16.809592  8476 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.809834 16790 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:04:16.810105  8476 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.810688 16787 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.789604 16829 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.817498 16829 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.818166  9101 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 19.
W20260709 13:04:16.818743  8550 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.820056 16822 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:04:16.820466 16822 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.820816 16822 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:16.830102  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:16.831635 16787 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:16.810737  8476 leader_election.cc:336] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.837316  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.838970  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.839264  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.839641  8577 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 22.
I20260709 13:04:16.841394  8502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:16.849269 16836 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.854754  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:16.859402  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd9d456ec5e4a83be19a678fcfc50f1" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:16.865394  8579 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 16.
I20260709 13:04:16.865787  8503 raft_consensus.cc:3060] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:16.860435  8501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:16.861033 16838 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:04:16.870280  8320 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 102041us
I20260709 13:04:16.870375 16838 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.871012 16838 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:16.862416  8577 raft_consensus.cc:1275] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:16.874294  8503 raft_consensus.cc:2468] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 25.
I20260709 13:04:16.874891 16827 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.796370 16832 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:16.883536  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.884322 16829 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:16.880324 16838 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.884727 16829 raft_consensus.cc:493] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.884516 16782 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.885164 16829 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:16.886266 16822 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.888103 16838 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.888438  8502 raft_consensus.cc:2393] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 27: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:16.889194 16822 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 27 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:16.890054  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 155591us
I20260709 13:04:16.890612  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.894490  8547 leader_election.cc:304] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.898873 16790 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.900537  8501 raft_consensus.cc:2393] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 25: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:16.900449  8508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:16.901067 16790 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.901166  8508 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 19.
I20260709 13:04:16.901556 16841 raft_consensus.cc:2804] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:16.902098 16841 raft_consensus.cc:697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 25 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:16.902961 16841 consensus_queue.cc:237] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:16.904053 16801 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:16.904605  7335 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8456)
I20260709 13:04:16.895489  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.906170 16801 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.906708 16820 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:16.905845 16778 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:16.907083  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.907401 16778 raft_consensus.cc:493] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:04:16.907785  8320 catalog_manager.cc:4755] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet adc232408fec446f9379aa9fb2c04164: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.907960 16791 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:16.908391 16791 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.908772 16791 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:16.909134 16782 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:16.910171  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f25688d717bb4dae964fead4a15af269" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:16.910768  9094 raft_consensus.cc:3060] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:16.907122 16820 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.914543 16820 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:16.917965  9094 raft_consensus.cc:2468] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:04:16.919284  8549 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.907814 16778 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:16.920671  9101 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 21: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:16.920996 16787 raft_consensus.cc:2804] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:16.919685 16836 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:16.922865 16787 raft_consensus.cc:697] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:16.923853 16787 consensus_queue.cc:237] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.927294  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:16.928545  8476 consensus_peers.cc:597] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.928958  8550 leader_election.cc:336] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.929812  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6" is_pre_election: true
I20260709 13:04:16.931285  8503 raft_consensus.cc:2393] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ffc86752d264d0c81f68028e6413a91 in current term 25: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:16.932556  9065 leader_election.cc:304] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.933538  8547 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.934320  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.935973  8576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:16.940475  8579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df86b8c30ce74df593c44831a29d2f9f" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:16.941018  8579 raft_consensus.cc:3060] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:16.941908  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.944003 16832 raft_consensus.cc:3060] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:04:16.941789  8575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45dd878477224acc8d0d4dca5d5d4f02" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:16.945259 16842 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:04:16.945680 16842 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:16.946007 16842 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:04:16.940982 16828 raft_consensus.cc:2804] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:16.950403 16828 raft_consensus.cc:697] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:04:16.950676  8581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4b315396764044bd73a9cb7f985b2b" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:16.951249  8581 raft_consensus.cc:3060] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:16.951259 16828 consensus_queue.cc:237] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.954416  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e89695d22445b4b40c4e3c0d792325" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:16.954979  8582 raft_consensus.cc:3060] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:04:16.952138  8579 raft_consensus.cc:2468] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 25.
W20260709 13:04:16.967672  8476 leader_election.cc:336] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.968411  8581 raft_consensus.cc:2468] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 25.
W20260709 13:04:16.968748  8476 leader_election.cc:336] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:16.969853  8476 consensus_peers.cc:597] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:16.970485  8476 leader_election.cc:336] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.932260 16782 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:04:16.974804 16822 consensus_queue.cc:1048] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:16.970350 16827 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:16.978154  8475 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:16.983008  8476 leader_election.cc:336] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:16.986351  8582 raft_consensus.cc:2468] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 25.
W20260709 13:04:16.991780  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:16.993229  8475 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.994504  8547 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:16.982926 16832 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:16.995690  8576 raft_consensus.cc:2393] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 21: Already voted for candidate 5ffc86752d264d0c81f68028e6413a91 in this term.
I20260709 13:04:16.997198  8475 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:17.012207  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53357.2us
W20260709 13:04:17.017983  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:17.019236 16820 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:16.995286 16801 raft_consensus.cc:2804] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:17.031116 16801 raft_consensus.cc:697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:17.032043 16801 consensus_queue.cc:237] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:17.012126 16790 raft_consensus.cc:2804] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:17.037038  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:16.985657 16842 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:17.022202 16821 raft_consensus.cc:2804] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:04:17.035499 16790 raft_consensus.cc:697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:17.022519 16782 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:17.048295 16778 raft_consensus.cc:515] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:17.056073 16820 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:17.081635  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 74813.9us
I20260709 13:04:17.084189  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:17.085103  9101 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 23: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:17.047837 16803 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:17.057778 16778 leader_election.cc:290] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:17.094175  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 58769.8us
I20260709 13:04:17.109148 16856 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:17.063964 16821 raft_consensus.cc:697] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:17.095278 16803 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
W20260709 13:04:17.141763  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 44014.5us
W20260709 13:04:17.142526  8550 leader_election.cc:336] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.074784 16829 raft_consensus.cc:515] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:17.145659  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 109648us
I20260709 13:04:17.141875 16803 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:17.157408  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7ceb457b3b46b096de1a7a57adccde" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:17.160377  8577 raft_consensus.cc:3060] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:17.164098  8575 raft_consensus.cc:2468] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 27.
I20260709 13:04:17.119259 16856 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:17.199630  8577 raft_consensus.cc:2468] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 17.
I20260709 13:04:17.213449  9067 leader_election.cc:304] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:17.215332 16821 consensus_queue.cc:237] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:17.216511 16842 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:17.221247 16836 raft_consensus.cc:2804] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:17.221796 16836 raft_consensus.cc:697] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
I20260709 13:04:17.222684 16836 consensus_queue.cc:237] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:17.226294  9068 leader_election.cc:336] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:17.227324  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.153326 16790 consensus_queue.cc:237] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:17.275281 16829 leader_election.cc:290] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:17.276328  8577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a12a506b127d40b1acc72c04ae2f5a40" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91"
I20260709 13:04:17.276939  8577 raft_consensus.cc:3060] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:04:17.286646  8475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 143490us
I20260709 13:04:17.287765  8577 raft_consensus.cc:2468] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6930e07cbba2484ca2bf800a58acdbb0 in term 23.
I20260709 13:04:17.291617 16791 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:17.296625  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:17.297653  8503 raft_consensus.cc:2393] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 23: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:17.289394  9067 leader_election.cc:304] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:17.302354  9101 raft_consensus.cc:1275] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
W20260709 13:04:17.306803  8476 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.300033  8332 catalog_manager.cc:5697] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 21 to 22, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 22 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.307296  8476 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:17.321581 16803 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:17.313319 16791 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:17.330536  8550 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.335206 16856 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:17.343165  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:17.346004  8503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0b9f7467deed4381835a85ffd0e88af6"
I20260709 13:04:17.346899  8503 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6930e07cbba2484ca2bf800a58acdbb0 in current term 20: Already voted for candidate 0b9f7467deed4381835a85ffd0e88af6 in this term.
I20260709 13:04:17.345718  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:17.348174  9101 raft_consensus.cc:2393] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b9f7467deed4381835a85ffd0e88af6 in current term 20: Already voted for candidate 6930e07cbba2484ca2bf800a58acdbb0 in this term.
I20260709 13:04:17.344005  9100 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 18.
I20260709 13:04:17.350946 16868 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:04:17.306911 16836 raft_consensus.cc:2804] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:04:17.352603 16836 raft_consensus.cc:697] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 LEADER]: Becoming Leader. State: Replica: 6930e07cbba2484ca2bf800a58acdbb0, State: Running, Role: LEADER
W20260709 13:04:17.353770  9068 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.353492 16836 consensus_queue.cc:237] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:17.354296  9068 leader_election.cc:336] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:17.354979  9068 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:17.355633  9068 leader_election.cc:336] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:17.356288  9068 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.356403  8333 catalog_manager.cc:5697] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 24 to 25, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 25 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.356668  9068 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:17.363098 16803 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:17.363716  9068 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:17.364614  9068 leader_election.cc:336] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:17.365442  9068 leader_election.cc:336] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.357729 16850 consensus_queue.cc:1048] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.009s
I20260709 13:04:17.359791  8475 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:17.383877  9068 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:17.387188  9068 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.387600  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:17.389065  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:17.396471 16789 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:04:17.397284  8476 consensus_peers.cc:597] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.398820  9100 raft_consensus.cc:1275] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:04:17.363729 16803 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:17.387480 16820 raft_consensus.cc:2804] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:04:17.404913  9068 leader_election.cc:336] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.396849 16843 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:04:17.410179  9068 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.413578  9068 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:17.398746 16789 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dacb523538a14c7cb335ab9c18f4111b)
I20260709 13:04:17.425120 16789 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:17.429807 16820 raft_consensus.cc:697] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:17.430958 16820 consensus_queue.cc:237] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:17.436816  8476 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.437263  8476 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6; no voters: 6930e07cbba2484ca2bf800a58acdbb0, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:17.439118  9068 leader_election.cc:336] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:17.440004  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:17.440434  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:17.440892  9068 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.442773 16829 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:04:17.441244  9068 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:17.446194 16790 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:04:17.434366 16856 consensus_queue.cc:1048] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 13:04:17.449216  8329 catalog_manager.cc:5697] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 24 to 25, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 25 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:17.450340  8550 consensus_peers.cc:597] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:17.447098  9068 leader_election.cc:336] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.451462  9068 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:17.451023  8329 catalog_manager.cc:5697] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 24 to 25, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 25 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:17.452288  9068 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.452997 16837 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:17.452585  8329 catalog_manager.cc:5697] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 24 to 25, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 25 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:17.473814  9068 leader_election.cc:336] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:17.474612  9068 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.474983  9068 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:17.487735  8550 consensus_peers.cc:597] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.482231 16829 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:04:17.508227 16843 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:17.456585 16789 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:17.518784  8503 raft_consensus.cc:1275] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:04:17.521564 16837 consensus_queue.cc:1048] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:04:17.527171  8501 raft_consensus.cc:1275] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:04:17.528616 16789 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:17.528565 16856 consensus_queue.cc:1048] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:17.530879  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f4890aeba446ef8cf170616e61d6ab" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:17.531610  9101 raft_consensus.cc:3060] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:17.534646  8550 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:17.554103  9101 raft_consensus.cc:2468] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:04:17.555652  8549 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:17.559859  9068 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.560894 16856 raft_consensus.cc:2804] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:17.562384 16856 raft_consensus.cc:697] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:17.563346 16856 consensus_queue.cc:237] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:17.582861 16876 log.cc:927] Time spent T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:04:17.603451  8476 consensus_peers.cc:597] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.626962  8581 raft_consensus.cc:1275] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:04:17.631225 16820 consensus_queue.cc:1048] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:17.640314  8332 catalog_manager.cc:5697] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 22 to 23, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 23 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.642786  8332 catalog_manager.cc:5697] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 16 to 17, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196). New cstate: current_term: 17 leader_uuid: "6930e07cbba2484ca2bf800a58acdbb0" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.644980  8332 catalog_manager.cc:5697] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 reported cstate change: term changed from 21 to 22, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 22 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } } }
W20260709 13:04:17.690722  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:17.696148  8575 raft_consensus.cc:1275] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:04:17.699288 16865 consensus_queue.cc:1048] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:04:17.699903  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:17.709877  9068 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:17.722520  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:17.757637  8476 consensus_peers.cc:597] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.760564  8333 catalog_manager.cc:5697] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 18 to 19, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 19 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.806973  8329 catalog_manager.cc:5697] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 26 to 27, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 27 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.823953  8575 raft_consensus.cc:1275] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:17.829257 16857 consensus_queue.cc:1048] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:17.840756  8581 raft_consensus.cc:1275] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:04:17.844277 16790 consensus_queue.cc:1048] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:17.865481  8575 raft_consensus.cc:1275] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:04:17.876205 16865 consensus_queue.cc:1048] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
W20260709 13:04:17.898141  8550 consensus_peers.cc:597] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:17.905112  7335 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:17.922058  8476 consensus_peers.cc:597] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:17.948972  9068 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:17.958643  8476 consensus_peers.cc:597] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.962177  8581 raft_consensus.cc:1275] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Refusing update from remote peer 6930e07cbba2484ca2bf800a58acdbb0: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:04:17.963601 16836 consensus_queue.cc:1048] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:04:17.983798  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:17.984344  8550 consensus_peers.cc:597] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:17.991461 16887 log.cc:927] Time spent T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:04:18.028975  8476 consensus_peers.cc:597] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:18.092054  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:18.097344  9094 raft_consensus.cc:1275] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 13:04:18.099841 16841 consensus_queue.cc:1048] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:04:18.159823  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:18.163266  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:18.276386  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:18.306087  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:18.308696  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:18.377024  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:18.397330  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:18.459524  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:18.585233 16856 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.585793 16856 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:18.589174  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:18.589839  9094 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 21.
I20260709 13:04:18.591634  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:18.592710 16787 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:04:18.593092 16787 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.593458 16787 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:04:18.602229  8550 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:18.603029 16856 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:18.605747 16787 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:18.628612  8550 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:18.631105  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86829baeb70423ab45311ca8cb560c8" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:18.631793  9094 raft_consensus.cc:3060] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:04:18.641216  9094 raft_consensus.cc:2468] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 22.
I20260709 13:04:18.645166  8549 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:18.645961 16841 raft_consensus.cc:2804] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:04:18.646478 16841 raft_consensus.cc:697] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:18.647308 16841 consensus_queue.cc:237] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:18.658648 16787 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 22 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:18.671443  8329 catalog_manager.cc:5697] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 reported cstate change: term changed from 20 to 22, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195). New cstate: current_term: 22 leader_uuid: "5ffc86752d264d0c81f68028e6413a91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:18.905596  7335 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:18.944903  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:18.950802  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:19.008857 16865 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.014360 16865 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:19.016778 16865 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:19.017896  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:19.018631  9094 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 23.
I20260709 13:04:19.019575  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:19.021320 16790 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:19.021682 16790 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.021917 16790 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:04:19.028061  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:19.029080 16790 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:19.030956  8320 catalog_manager.cc:4755] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet adc232408fec446f9379aa9fb2c04164: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:19.032229 16790 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:19.032382  8476 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:19.032449  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c808e5ae17447f4a32fc1b5624cc91a" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:19.033133  9094 raft_consensus.cc:3060] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:04:19.037688  8476 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:19.039758  9094 raft_consensus.cc:2468] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 24.
I20260709 13:04:19.042212  8475 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:19.043126 16790 raft_consensus.cc:2804] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:19.043859 16790 raft_consensus.cc:697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 24 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:19.044759 16790 consensus_queue.cc:237] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:19.061709 16896 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.062345 16896 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:19.064621 16896 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:19.070819  9094 raft_consensus.cc:1275] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Refusing update from remote peer 5ffc86752d264d0c81f68028e6413a91: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:04:19.073289  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:19.073184 16856 consensus_queue.cc:1048] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:19.074074  9094 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 20.
I20260709 13:04:19.077857  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:19.079351 16865 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:19.079885 16865 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.080579 16865 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:19.107376  8476 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:19.114434  8550 consensus_peers.cc:597] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:19.120625  8550 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111) [suppressed 380 similar messages]
W20260709 13:04:19.162431  8550 consensus_peers.cc:597] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:19.177124 16865 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:19.180040 16865 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Requested vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:19.186601  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37072d40853c44b1b312489112c9250e" candidate_uuid: "0b9f7467deed4381835a85ffd0e88af6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:19.187292  9100 raft_consensus.cc:3060] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:04:19.196251  8476 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:19.198930  8329 catalog_manager.cc:5697] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 22 to 24, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 24 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:19.219939  8476 consensus_peers.cc:597] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:19.204607  9100 raft_consensus.cc:2468] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b9f7467deed4381835a85ffd0e88af6 in term 21.
I20260709 13:04:19.231894  8475 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0; no voters: dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:19.233166 16900 raft_consensus.cc:2804] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:04:19.233752 16900 raft_consensus.cc:697] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Becoming Leader. State: Replica: 0b9f7467deed4381835a85ffd0e88af6, State: Running, Role: LEADER
I20260709 13:04:19.234741 16900 consensus_queue.cc:237] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:19.246426  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:19.274487  8332 catalog_manager.cc:5697] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 reported cstate change: term changed from 19 to 21, leader changed from dacb523538a14c7cb335ab9c18f4111b (127.7.41.193) to 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194). New cstate: current_term: 21 leader_uuid: "0b9f7467deed4381835a85ffd0e88af6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:19.322341  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:19.418390  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:19.428366  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:19.432374  9068 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:19.451238  8476 consensus_peers.cc:597] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:19.482865  8476 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:19.561553  8476 consensus_peers.cc:597] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:19.578325  9094 raft_consensus.cc:1275] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 13:04:19.584160  8476 consensus_peers.cc:597] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:19.608238 16865 consensus_queue.cc:1048] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:04:19.671643  8476 consensus_peers.cc:597] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:19.691574  9068 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:19.851253  9094 raft_consensus.cc:1275] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Refusing update from remote peer 0b9f7467deed4381835a85ffd0e88af6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:04:19.906294  7335 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:19.927917  8476 consensus_peers.cc:597] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:19.937352  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:19.988135 16790 consensus_queue.cc:1048] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
W20260709 13:04:20.006417  8550 consensus_peers.cc:597] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:20.013269  8476 consensus_peers.cc:597] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:20.105002  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.110438  9068 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:20.117403  8550 consensus_peers.cc:597] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:20.140121  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.219858  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.392210  9068 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:20.439088  8476 consensus_peers.cc:597] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:20.458868  8476 consensus_peers.cc:597] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:20.496676  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.512750  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:20.513530  8550 consensus_peers.cc:597] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:20.518863  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.526821  9068 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:20.592474  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.628888  8476 consensus_peers.cc:597] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.633476  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.692523  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.749323  8476 consensus_peers.cc:597] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:20.781733  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.875231  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.907021  7335 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:20.918900  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:20.977177  8550 consensus_peers.cc:597] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:21.052256  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:21.297814  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:21.366604  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:21.509766  8476 consensus_peers.cc:597] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:21.564108  8550 consensus_peers.cc:597] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:21.587868  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:21.595005  8550 consensus_peers.cc:597] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:21.735661  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:21.844846  8476 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:21.907491  7335 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:21.936281  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:21.982721  8476 consensus_peers.cc:597] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.021140  9068 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.026058  9068 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.072180  8476 consensus_peers.cc:597] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.072180  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:22.127094  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 53388.3us
W20260709 13:04:22.212574  8476 consensus_peers.cc:597] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.239076  8476 consensus_peers.cc:597] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.276872  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:22.305685  8476 consensus_peers.cc:597] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.465888  8550 consensus_peers.cc:597] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.516873  8550 consensus_peers.cc:597] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.520684  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:22.528154  9068 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.529234  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:22.590189  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:22.661502  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:22.808960  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:22.812132  8476 consensus_peers.cc:597] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.856654  9068 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.864025  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:22.908677  7335 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:22.941771  8476 consensus_peers.cc:597] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:22.959573  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:22.960875  8550 consensus_peers.cc:597] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:23.001093  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:23.012681  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:23.042472  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:23.073441  8476 consensus_peers.cc:597] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:23.096602  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:23.111389  9068 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:23.194196  8320 catalog_manager.cc:4755] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet adc232408fec446f9379aa9fb2c04164: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:23.208726  8476 consensus_peers.cc:597] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:23.232236  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:23.383257  8476 consensus_peers.cc:597] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:23.461807  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:23.531636  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:23.800489  8550 consensus_peers.cc:597] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:23.853071  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:23.909188  7335 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:23.984422  8550 consensus_peers.cc:597] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:23.996826  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:24.164224  8550 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111) [suppressed 443 similar messages]
W20260709 13:04:24.167408  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:24.207824  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:24.222295  8476 consensus_peers.cc:597] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:24.330361  8550 consensus_peers.cc:597] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:24.355775  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:24.448100  8476 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:24.461927  9067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:41653, user_credentials={real_user=slave}} blocked reactor thread for 60688.5us
W20260709 13:04:24.468307  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 63897.7us
W20260709 13:04:24.491431  9068 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:24.587657  8476 consensus_peers.cc:597] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:24.629703  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:24.668121  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:24.780478  8476 consensus_peers.cc:597] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:24.796643  9068 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:24.806013  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:24.825441  8476 consensus_peers.cc:597] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:24.888552  8476 consensus_peers.cc:597] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:24.891041  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:24.909747  7335 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:24.942530  9068 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:24.993093  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:24.998603  8550 consensus_peers.cc:597] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:25.093391  8476 consensus_peers.cc:597] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:25.150473  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:25.180578  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:25.184782  8550 consensus_peers.cc:597] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:25.314647  8476 consensus_peers.cc:597] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:25.315392  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:25.324236  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:25.397769  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:25.424091  8476 consensus_peers.cc:597] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:25.424968  8550 consensus_peers.cc:597] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:25.462195  8476 consensus_peers.cc:597] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:25.474488  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:25.568013  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:25.611918  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:25.643221  9068 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:25.656203  9068 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:25.733705  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:25.750145  8476 consensus_peers.cc:597] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:25.910277  7335 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:25.911782  8476 consensus_peers.cc:597] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:26.009951  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:26.299398  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:26.544858  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:26.547859  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:26.548640  8550 consensus_peers.cc:597] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:26.666694  9068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:41353, user_credentials={real_user=slave}} blocked reactor thread for 269197us
W20260709 13:04:26.680794  8550 consensus_peers.cc:597] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:26.773283  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:26.830260  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:26.910905  7335 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:27.072832  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:27.077157  9068 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:27.102212  8476 consensus_peers.cc:597] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:27.196846  8476 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:27.273979  8476 consensus_peers.cc:597] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:27.289839  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:27.353514  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:27.366053  8476 consensus_peers.cc:597] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:27.416467  9068 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:27.417721  8550 consensus_peers.cc:597] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:27.515127  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:27.582892  8476 consensus_peers.cc:597] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:04:27.608172  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:27.634307  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:27.686533  9068 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:27.702833  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08000e2d80 after lost signal to thread 7338
W20260709 13:04:27.704010  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0640 after lost signal to thread 8367
W20260709 13:04:27.705358  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad1a0 after lost signal to thread 8534
W20260709 13:04:27.707228  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08003ee340 after lost signal to thread 8608
W20260709 13:04:27.713193  9123 debug-util.cc:398] Leaking SignalData structure 0x7b08001d11e0 after lost signal to thread 9126
W20260709 13:04:27.752377  8476 consensus_peers.cc:597] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:27.822290  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:27.827946  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:27.865491  8550 consensus_peers.cc:597] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:27.907404  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:27.911895  9068 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:27.914567  7335 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:28.223495  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 80269.8us
W20260709 13:04:28.515763  9068 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:28.794960  8549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:40061, user_credentials={real_user=slave}} blocked reactor thread for 138005us
W20260709 13:04:28.803385  8550 consensus_peers.cc:597] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:28.803920  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:28.804543  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:28.810209  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:28.811357  8550 consensus_peers.cc:597] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:28.815368  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:28.871618  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:28.892772  8476 consensus_peers.cc:597] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:28.893507  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:28.894075  8476 consensus_peers.cc:597] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:28.895117  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:28.895634  8476 consensus_peers.cc:597] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:28.896107  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:28.903527  8476 consensus_peers.cc:597] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:28.915050  7335 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:29.155223  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:29.155695  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:29.171610  8476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111) [suppressed 382 similar messages]
W20260709 13:04:29.176672  8476 consensus_peers.cc:597] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:29.265586  8476 consensus_peers.cc:597] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:29.296891  8550 consensus_peers.cc:597] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:04:29.547398  8322 maintenance_manager.cc:419] P 9ac2f5f0926d4b9294bfce4452124031: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033338
W20260709 13:04:29.602207  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800257500 after lost signal to thread 7338
W20260709 13:04:29.603399  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08002575c0 after lost signal to thread 8367
W20260709 13:04:29.604764  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08001b0b40 after lost signal to thread 8534
W20260709 13:04:29.605934  8531 debug-util.cc:398] Leaking SignalData structure 0x7b0800084ea0 after lost signal to thread 8608
W20260709 13:04:29.607189  8531 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef2c0 after lost signal to thread 9126
W20260709 13:04:29.704252  8550 consensus_peers.cc:597] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:29.729751  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:29.744566  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:29.804687  9068 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:04:29.791826  8321 maintenance_manager.cc:643] P 9ac2f5f0926d4b9294bfce4452124031: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.243s	user 0.035s	sys 0.016s Metrics: {"bytes_written":6492,"delete_count":0,"lbm_write_time_us":1601,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":14458,"threads_started":1,"update_count":266,"wal-append.queue_time_us":15538}
I20260709 13:04:29.807485  8322 maintenance_manager.cc:419] P 9ac2f5f0926d4b9294bfce4452124031: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.317471
W20260709 13:04:29.886626  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:29.952625  7335 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:29.987689  8476 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:30.015106  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800308380 after lost signal to thread 7338
W20260709 13:04:30.017233  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08003f1b40 after lost signal to thread 8367
W20260709 13:04:30.027115  8550 consensus_peers.cc:597] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.037281  8364 debug-util.cc:398] Leaking SignalData structure 0x7b0800349c80 after lost signal to thread 8534
W20260709 13:04:30.047677  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08003967a0 after lost signal to thread 8608
W20260709 13:04:30.050056  8364 debug-util.cc:398] Leaking SignalData structure 0x7b08002c27e0 after lost signal to thread 9126
W20260709 13:04:30.058406  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:30.249014  8476 consensus_peers.cc:597] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:30.253481  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:30.243273  8321 maintenance_manager.cc:643] P 9ac2f5f0926d4b9294bfce4452124031: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.428s	user 0.114s	sys 0.028s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":27407,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":59584,"dirs.run_cpu_time_us":623,"dirs.run_wall_time_us":8596,"lbm_read_time_us":2196,"lbm_reads_lt_1ms":25,"lbm_write_time_us":16003,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":10,"peak_mem_usage":297317,"reinsert_count":0,"thread_start_us":47703,"threads_started":2,"update_count":275}
I20260709 13:04:30.255963  8322 maintenance_manager.cc:419] P 9ac2f5f0926d4b9294bfce4452124031: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:04:30.260129  8321 maintenance_manager.cc:643] P 9ac2f5f0926d4b9294bfce4452124031: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:04:30.308139  9068 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:30.374428  9068 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:30.379458  8476 consensus_peers.cc:597] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.384524  8476 consensus_peers.cc:597] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:30.405440  9068 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:30.592814  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:30.669160  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:30.681370  8476 consensus_peers.cc:597] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:04:30.693383  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:30.701800  8550 consensus_peers.cc:597] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:30.755996  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:30.756532  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:30.805282  8476 consensus_peers.cc:597] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:30.899039  9068 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:30.953907  7335 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:30.987061  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:31.016393  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:31.019418  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:31.061183  8550 consensus_peers.cc:597] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:31.145699  8476 consensus_peers.cc:597] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:31.154346  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:31.189589  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:31.213812  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:31.238547  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:31.356192  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:31.403891  8476 consensus_peers.cc:597] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:31.423688  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:31.469538  8550 consensus_peers.cc:597] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:31.503261  8476 consensus_peers.cc:597] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:31.517729  8476 consensus_peers.cc:597] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:31.521184  8320 catalog_manager.cc:4755] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet adc232408fec446f9379aa9fb2c04164: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:31.616228  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:31.676481  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:31.786196  8550 consensus_peers.cc:597] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:31.808547  9065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 73734.4us
W20260709 13:04:31.954525  7335 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:32.003315  8476 consensus_peers.cc:597] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:32.008589  8476 consensus_peers.cc:597] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:32.123342  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:32.128074  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:32.332443  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:32.424068  9068 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:32.445927  8476 consensus_peers.cc:597] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:32.484037  8476 consensus_peers.cc:597] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:32.497694  8550 consensus_peers.cc:597] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:32.672864  8476 consensus_peers.cc:597] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:32.705888  8550 consensus_peers.cc:597] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:32.737881  8476 consensus_peers.cc:597] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:32.793867  9068 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:32.889758  9068 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:32.955024  7335 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 8456)
W20260709 13:04:33.030437  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:33.056588  8476 consensus_peers.cc:597] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.074994  8476 consensus_peers.cc:597] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:33.126228  8550 consensus_peers.cc:597] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:33.132330  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:33.156838  8476 consensus_peers.cc:597] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:04:33.186882  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:33.208069  9068 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:33.330127  8550 consensus_peers.cc:597] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:33.363605  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:33.503501  9068 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:33.552148  7335 tablet_server.cc:196] TabletServer@127.7.41.193:0 shutdown complete.
W20260709 13:04:33.553184  8476 consensus_peers.cc:597] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:33.557536  8550 consensus_peers.cc:597] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:33.668056  8476 consensus_peers.cc:597] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:33.679116  8550 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:33.680065  8476 consensus_peers.cc:597] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:33.680761  8476 consensus_peers.cc:597] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:33.735050  8550 consensus_peers.cc:597] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:33.765599  8550 consensus_peers.cc:597] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:33.786010  8476 consensus_peers.cc:597] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:33.789631  7335 tablet_server.cc:179] TabletServer@127.7.41.194:0 shutting down...
W20260709 13:04:33.802733  9065 consensus_peers.cc:597] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.804152  8547 consensus_peers.cc:597] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.822755  9065 consensus_peers.cc:597] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.826588  9065 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.847394  9065 consensus_peers.cc:597] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.856412  8547 consensus_peers.cc:597] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.865898  9065 consensus_peers.cc:597] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.874784  9065 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.879168  8547 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.889564  9065 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.896265  8476 consensus_peers.cc:597] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:33.906534  8550 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:33.922636  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.926204  7335 tablet_replica.cc:333] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.927479  7335 raft_consensus.cc:2243] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.928563  7335 raft_consensus.cc:2272] T f2a5011db54b4e9f85a54c19ade01aa8 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.933276  7335 tablet_replica.cc:333] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.934391  7335 raft_consensus.cc:2243] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.936084  7335 raft_consensus.cc:2272] T 6a195e69bd9b4a1a80805249b3c0c304 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.939359  7335 tablet_replica.cc:333] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.940524  7335 raft_consensus.cc:2243] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:33.940733  9065 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.941452  7335 raft_consensus.cc:2272] T cbe0cd8e445e4958b026f85c697843e8 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.944619  7335 tablet_replica.cc:333] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.945585  7335 raft_consensus.cc:2243] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.948189  7335 raft_consensus.cc:2272] T d56fc8bb927a4cdd8b35293e875e2856 P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.953744  7335 tablet_replica.cc:333] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.954797  7335 raft_consensus.cc:2243] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.955674  7335 raft_consensus.cc:2272] T 0a2b7b0063404db89eb6c3acc48e3abf P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.959033  7335 tablet_replica.cc:333] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.960124  7335 raft_consensus.cc:2243] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.961043  7335 raft_consensus.cc:2272] T 6230ca5c82634f7abb78b594dab8da24 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.965643  7335 tablet_replica.cc:333] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.966821  7335 raft_consensus.cc:2243] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.968072  7335 raft_consensus.cc:2272] T 8e1186d8dca7484f8fd5714b4489ce99 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.972050  8547 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.973871  7335 tablet_replica.cc:333] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.975008  7335 raft_consensus.cc:2243] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.975998  7335 raft_consensus.cc:2272] T adc232408fec446f9379aa9fb2c04164 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.979166  7335 tablet_replica.cc:333] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.980020  7335 raft_consensus.cc:2243] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.980999  7335 raft_consensus.cc:2272] T d9ee2138cf46471e96358439600aaa0c P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.986434  7335 tablet_replica.cc:333] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.987331  7335 raft_consensus.cc:2243] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.988863  7335 raft_consensus.cc:2272] T cf4548803154450a8b2b2d3ee14dd41a P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.991735  7335 tablet_replica.cc:333] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.992592  7335 raft_consensus.cc:2243] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.993891  7335 raft_consensus.cc:2272] T 8fff54c32b2248dca5e70dc82b71155d P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.997040  7335 tablet_replica.cc:333] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:33.998222  7335 raft_consensus.cc:2243] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.998952  7335 raft_consensus.cc:2272] T ec1a6df183ea46c0b7b35ceaa22ed236 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.002202  7335 tablet_replica.cc:333] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.003111  7335 raft_consensus.cc:2243] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.004295  7335 raft_consensus.cc:2272] T a4e89695d22445b4b40c4e3c0d792325 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.007110  7335 tablet_replica.cc:333] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.007984  7335 raft_consensus.cc:2243] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.009328  7335 raft_consensus.cc:2272] T b9e03855c7c944d6a2bd32561a407196 P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.012151  7335 tablet_replica.cc:333] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.013028  7335 raft_consensus.cc:2243] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.013988  7335 raft_consensus.cc:2272] T 337d7e57df5f492daf49939f167561a0 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.025103  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:34.030632  9065 consensus_peers.cc:597] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.036132  7335 tablet_replica.cc:333] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.041095  7335 raft_consensus.cc:2243] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.042289  7335 raft_consensus.cc:2272] T 652dfe8b7bb64be896563cb525d678d1 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.044695  8476 consensus_peers.cc:597] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:34.045423  7335 tablet_replica.cc:333] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.046429  7335 raft_consensus.cc:2243] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.047752  7335 raft_consensus.cc:2272] T c783a77969844f0b82c1b365e456c651 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.050941  7335 tablet_replica.cc:333] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.051792  7335 raft_consensus.cc:2243] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.052615  7335 raft_consensus.cc:2272] T 44116e7a54d141108511e22185400ffe P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.055655  7335 tablet_replica.cc:333] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.056480  7335 raft_consensus.cc:2243] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.057274  7335 raft_consensus.cc:2272] T f518d1b1d4c2478b9d4fc2483806952e P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.060061  7335 tablet_replica.cc:333] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.060935  7335 raft_consensus.cc:2243] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.062711  7335 raft_consensus.cc:2272] T 20fa0c62ae854ede982769f8be4f5421 P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.065761  7335 tablet_replica.cc:333] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.067741  7335 raft_consensus.cc:2243] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.070248  7335 raft_consensus.cc:2272] T b34810c9636748309cee2bf3d1eb6bdb P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.073786  8550 consensus_peers.cc:597] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:34.074100  7335 tablet_replica.cc:333] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
W20260709 13:04:34.082244  8550 consensus_peers.cc:597] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:34.082907  7335 raft_consensus.cc:2243] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 LEADER]: Raft consensus shutting down.
W20260709 13:04:34.083884  8547 consensus_peers.cc:597] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.084497  7335 raft_consensus.cc:2272] T bc7e6e656d324c0bad9eee744f6f1886 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.087805  7335 tablet_replica.cc:333] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.088920  7335 raft_consensus.cc:2243] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.090277  7335 raft_consensus.cc:2272] T 45dd878477224acc8d0d4dca5d5d4f02 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.094787  7335 tablet_replica.cc:333] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.096160  7335 raft_consensus.cc:2243] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.096801  7335 raft_consensus.cc:2272] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.099383  7335 tablet_replica.cc:333] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.100240  7335 raft_consensus.cc:2243] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.101464  7335 raft_consensus.cc:2272] T 7c808e5ae17447f4a32fc1b5624cc91a P 0b9f7467deed4381835a85ffd0e88af6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.105253  7335 tablet_replica.cc:333] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.107205  7335 raft_consensus.cc:2243] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.107877  7335 raft_consensus.cc:2272] T 7c79fc54c7a44921afa731a1720c6b3b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.110749  7335 tablet_replica.cc:333] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.114348  7335 raft_consensus.cc:2243] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.116567  7335 raft_consensus.cc:2272] T 094f99cd1bce4f88ab569c64b32b03b1 P 0b9f7467deed4381835a85ffd0e88af6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.120498  7335 tablet_replica.cc:333] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.121479  7335 raft_consensus.cc:2243] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.123441  7335 raft_consensus.cc:2272] T 1d9ecda5b5b04bbebb108bfcee54439e P 0b9f7467deed4381835a85ffd0e88af6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.126109  7335 tablet_replica.cc:333] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.127825  7335 raft_consensus.cc:2243] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.129232  7335 raft_consensus.cc:2272] T 09de6eee9632412ebe0a904f65cd2a3c P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.129995  8547 consensus_peers.cc:597] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.132085  7335 tablet_replica.cc:333] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
W20260709 13:04:34.134693  8550 consensus_peers.cc:597] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:04:34.136130  7335 raft_consensus.cc:2243] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.139891  7335 raft_consensus.cc:2272] T f6c83778726d49c5b8622ad284f71aa9 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.141640  8547 consensus_peers.cc:597] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.143324  8547 consensus_peers.cc:597] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.144546  7335 tablet_replica.cc:333] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
W20260709 13:04:34.144603  9065 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.145776  7335 raft_consensus.cc:2243] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.146603  7335 raft_consensus.cc:2272] T 8e2febf027be449183830c318fbd6012 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.149539  7335 tablet_replica.cc:333] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.150354  7335 raft_consensus.cc:2243] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.151500  7335 raft_consensus.cc:2272] T 8e9df238f56e482f9ad6efc0c2bd6014 P 0b9f7467deed4381835a85ffd0e88af6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.154719  7335 tablet_replica.cc:333] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.155476  7335 raft_consensus.cc:2243] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.156689  7335 raft_consensus.cc:2272] T 9d8ec20c8aeb4915950772c6add9f352 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.159454  7335 tablet_replica.cc:333] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.160173  7335 raft_consensus.cc:2243] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.161091  7335 raft_consensus.cc:2272] T 1e038af5e5154b3e8ae9503fdedbb44b P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.163942  7335 tablet_replica.cc:333] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.164783  7335 raft_consensus.cc:2243] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.165566  7335 raft_consensus.cc:2272] T 0254141f106e4023bb2d8ba99024140c P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.168435  7335 tablet_replica.cc:333] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.169260  7335 raft_consensus.cc:2243] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.170660  7335 raft_consensus.cc:2272] T 6d4b315396764044bd73a9cb7f985b2b P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.173830  7335 tablet_replica.cc:333] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
W20260709 13:04:34.174357  8547 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 451 similar messages]
I20260709 13:04:34.174649  7335 raft_consensus.cc:2243] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.176285  7335 raft_consensus.cc:2272] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 0b9f7467deed4381835a85ffd0e88af6 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.177155  8547 consensus_peers.cc:597] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.179148  7335 tablet_replica.cc:333] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.180016  7335 raft_consensus.cc:2243] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.181700  7335 raft_consensus.cc:2272] T 956b0163855b4f329c033879d86cd33b P 0b9f7467deed4381835a85ffd0e88af6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.184733  7335 tablet_replica.cc:333] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.185554  7335 raft_consensus.cc:2243] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.186304  7335 raft_consensus.cc:2272] T c4156673eede4435930a1d9fd63f78a3 P 0b9f7467deed4381835a85ffd0e88af6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.189203  7335 tablet_replica.cc:333] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.190011  7335 raft_consensus.cc:2243] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.191182  7335 raft_consensus.cc:2272] T 77b025d136d04841aa2759be7b816f77 P 0b9f7467deed4381835a85ffd0e88af6 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.195039  9065 consensus_peers.cc:597] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.195078  7335 tablet_replica.cc:333] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.198009  7335 raft_consensus.cc:2243] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.200361  7335 raft_consensus.cc:2272] T df86b8c30ce74df593c44831a29d2f9f P 0b9f7467deed4381835a85ffd0e88af6 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.202350  9065 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.203675  7335 tablet_replica.cc:333] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.204449  7335 raft_consensus.cc:2243] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.205523  7335 raft_consensus.cc:2272] T 141901f3b86847429c9dead6a62a4b04 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.209474  7335 tablet_replica.cc:333] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.210273  7335 raft_consensus.cc:2243] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.210932  7335 raft_consensus.cc:2272] T 42b1603f302f4b188a0a19190c49fed2 P 0b9f7467deed4381835a85ffd0e88af6 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.215360  7335 tablet_replica.cc:333] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.216092  7335 raft_consensus.cc:2243] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.217779  7335 raft_consensus.cc:2272] T 057641ab553c4ec08538f2ed159ba000 P 0b9f7467deed4381835a85ffd0e88af6 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.221730  7335 tablet_replica.cc:333] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6: stopping tablet replica
I20260709 13:04:34.222406  7335 raft_consensus.cc:2243] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.223722  7335 raft_consensus.cc:2272] T 37072d40853c44b1b312489112c9250e P 0b9f7467deed4381835a85ffd0e88af6 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.227547  8547 consensus_peers.cc:597] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.267174  8547 consensus_peers.cc:597] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.334888  8474 connection.cc:466] server connection from 127.0.0.1:55892 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55892 (request call id 2365) could send its response
W20260709 13:04:34.408140  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:34.854912  8550 consensus_peers.cc:597] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:34.858850  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:34.944734 16978 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:34.945353 16978 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:34.948556 16978 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:34.952988  9068 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:34.957701  8550 consensus_peers.cc:597] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:34.959705  9065 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:34.965245  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:34.966049 16978 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:35.025388  9068 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:35.055271  8550 consensus_peers.cc:597] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:35.142494 16995 raft_consensus.cc:493] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.143033 16995 raft_consensus.cc:515] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:35.145009 16995 leader_election.cc:290] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:35.149827  8550 consensus_peers.cc:597] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:04:35.150287  8550 leader_election.cc:336] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.150702 16995 raft_consensus.cc:493] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.154564 16978 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.152303 16995 raft_consensus.cc:515] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:35.155112 16978 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.156931 16995 leader_election.cc:290] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:35.152007  8547 leader_election.cc:336] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.160576  8547 leader_election.cc:304] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.162189 16995 raft_consensus.cc:2749] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:35.163163  9065 leader_election.cc:336] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.166620 16978 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:35.168932  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:35.169979  7335 tablet_server.cc:196] TabletServer@127.7.41.194:0 shutdown complete.
W20260709 13:04:35.170868  8550 leader_election.cc:336] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.171446  9067 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:35.173211 17001 raft_consensus.cc:2749] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:35.175592  8547 leader_election.cc:336] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.176087  8547 leader_election.cc:304] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.177353 16993 raft_consensus.cc:2749] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:35.188278 17001 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.188990 17001 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.191118 17001 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:35.193652  9068 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:35.204984  9068 leader_election.cc:336] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.209491 16978 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.210178 16978 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:35.211231  9065 leader_election.cc:336] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.214917  9065 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.216286 17001 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:35.217361 17001 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.218048 17001 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.213889 16978 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:35.228587  9068 leader_election.cc:336] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.230739  8582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "6930e07cbba2484ca2bf800a58acdbb0" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5ffc86752d264d0c81f68028e6413a91" is_pre_election: true
I20260709 13:04:35.237282 17001 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:35.248858  9065 leader_election.cc:336] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.249399  9065 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:35.249992 17001 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:04:35.250872  9065 leader_election.cc:336] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.250752 17001 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.252296  9065 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.253660 16978 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:35.251655 17005 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:35.256735 17001 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:35.262939  9068 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:35.266316  9065 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.266878  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.267709 17001 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:35.275537 16978 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.278759  7335 tablet_server.cc:179] TabletServer@127.7.41.195:0 shutting down...
I20260709 13:04:35.279820 16978 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.284866 16978 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:35.290632  9065 leader_election.cc:336] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:35.291072  9068 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:35.291219  9067 leader_election.cc:336] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:35.291739  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:35.292742 17001 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:35.296298 16995 raft_consensus.cc:493] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.296929 16995 raft_consensus.cc:515] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:35.304557  8550 leader_election.cc:336] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.302371 16995 leader_election.cc:290] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:35.305886 16993 raft_consensus.cc:493] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.308739 16993 raft_consensus.cc:515] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
W20260709 13:04:35.310475  8547 leader_election.cc:336] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.310992  8547 leader_election.cc:304] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.311085 16993 leader_election.cc:290] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:35.313027 16993 raft_consensus.cc:2749] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:35.321197  8547 leader_election.cc:336] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:35.323217  8550 leader_election.cc:336] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.323659  8550 leader_election.cc:304] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.324790 16993 raft_consensus.cc:2749] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:04:35.326216  9067 consensus_peers.cc:597] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.347658 16978 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.348278 16978 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.350461 16978 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:35.351709 16993 raft_consensus.cc:493] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.352387 16993 raft_consensus.cc:515] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:35.357007 16993 leader_election.cc:290] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:35.357646  9065 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:35.358853  9068 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.359265  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:35.360121  8547 leader_election.cc:336] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.360381 16978 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:35.364413 17001 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:04:35.364626  8550 leader_election.cc:336] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.365108  8550 leader_election.cc:304] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.364959 17001 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.367033 17001 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:35.367946  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:35.369303 16995 raft_consensus.cc:2749] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:35.374493  9067 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:35.374960  9065 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:35.375069  9067 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.376376  7335 tablet_replica.cc:333] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.377358  7335 raft_consensus.cc:2243] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.377990  7335 raft_consensus.cc:2272] T 6a195e69bd9b4a1a80805249b3c0c304 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.378438  9068 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.378854  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.379465 16978 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:35.380967  7335 tablet_replica.cc:333] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.381806  7335 raft_consensus.cc:2243] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.382984  7335 raft_consensus.cc:2272] T d9390750b3d3442e888055fd39566ef1 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.385941  7335 tablet_replica.cc:333] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.386744  7335 raft_consensus.cc:2243] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.386971 16995 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.387537  7335 raft_consensus.cc:2272] T 18349b8506fc4ede84bfb527fb6e8a68 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.387499 16995 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.389710 16995 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:35.390230  7335 tablet_replica.cc:333] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.391101  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9df238f56e482f9ad6efc0c2bd6014" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:35.391422  7335 raft_consensus.cc:2243] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.392500  7335 raft_consensus.cc:2272] T 8e1186d8dca7484f8fd5714b4489ce99 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.395174  7335 tablet_replica.cc:333] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.395889  7335 raft_consensus.cc:2243] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.396019 16995 raft_consensus.cc:493] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:04:35.395905  8547 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.396792  7335 raft_consensus.cc:2272] T 6230ca5c82634f7abb78b594dab8da24 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.396595 16995 raft_consensus.cc:515] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:35.397193  8547 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, 6930e07cbba2484ca2bf800a58acdbb0
I20260709 13:04:35.398499 16993 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:35.399117 16995 leader_election.cc:290] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:35.400317  7335 tablet_replica.cc:333] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.401161  7335 raft_consensus.cc:2243] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.401907  7335 raft_consensus.cc:2272] T adc232408fec446f9379aa9fb2c04164 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.403782  8550 leader_election.cc:336] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.404633  7335 tablet_replica.cc:333] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.405367  7335 raft_consensus.cc:2243] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.406466  7335 raft_consensus.cc:2272] T d9ee2138cf46471e96358439600aaa0c P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.408936  7335 tablet_replica.cc:333] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
W20260709 13:04:35.409518  8547 leader_election.cc:336] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.410118  7335 raft_consensus.cc:2243] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.411638  8547 leader_election.cc:304] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.460660  7335 raft_consensus.cc:2272] T cf4548803154450a8b2b2d3ee14dd41a P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.452975 16978 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.692459 16978 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.469777 17005 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.660631 17007 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.684137 17008 raft_consensus.cc:493] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
W20260709 13:04:35.690670  8547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38749, user_credentials={real_user=slave}} blocked reactor thread for 281169us
I20260709 13:04:35.695588 17005 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.695716 17007 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.695745 17008 raft_consensus.cc:515] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:35.700753 17005 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:35.703904  7335 tablet_replica.cc:333] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.705068  7335 raft_consensus.cc:2243] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.705714 17001 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.707036 16978 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:35.707093 17001 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.709476  7335 raft_consensus.cc:2272] T f25688d717bb4dae964fead4a15af269 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.712728 17001 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:35.694684 17013 raft_consensus.cc:2749] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:35.718987 17013 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.719511 17013 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.721496 17017 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.721720 17013 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:35.726115  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:35.726742  9094 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 16.
I20260709 13:04:35.729161 17009 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.729600  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:35.729710 17009 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.730829 17011 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:35.731318 17011 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.731706 17009 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:35.731875 17011 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:35.734899 17008 leader_election.cc:290] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:35.736989  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:35.737615  9094 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
W20260709 13:04:35.738704  9068 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:35.739487  9065 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:35.740139  9065 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.740438  7335 tablet_replica.cc:333] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.743752 17007 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:35.741631  7335 raft_consensus.cc:2243] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:35.748260  9068 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.747152  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09de6eee9632412ebe0a904f65cd2a3c" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
I20260709 13:04:35.748713  7335 raft_consensus.cc:2272] T 4c7ceb457b3b46b096de1a7a57adccde P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.748909  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.749109  9100 raft_consensus.cc:2468] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 19.
I20260709 13:04:35.749687 17001 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:04:35.745929  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:04:35.750643  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:35.751057 17007 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:35.751410 17007 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.751760  7335 tablet_replica.cc:333] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.751837 17012 raft_consensus.cc:493] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.752416 17012 raft_consensus.cc:515] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } }
I20260709 13:04:35.752878  7335 raft_consensus.cc:2243] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.751776 17007 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:35.753593  7335 raft_consensus.cc:2272] T 435c81d2d1f346bea90c20030455900c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.754525 17012 leader_election.cc:290] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:35.756209  7335 tablet_replica.cc:333] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.757087  7335 raft_consensus.cc:2243] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.762764  7335 raft_consensus.cc:2272] T 337d7e57df5f492daf49939f167561a0 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.740563  9065 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.763243  9065 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.764111 17001 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:35.763231 17007 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.766408 17007 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:35.766808 17017 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.768836 17017 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:35.766458  8547 leader_election.cc:336] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:35.769781  8547 leader_election.cc:336] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:35.770428  8547 leader_election.cc:336] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:35.775794  8547 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:35.776554  8547 leader_election.cc:336] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.777798  7335 tablet_replica.cc:333] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.778599  7335 raft_consensus.cc:2243] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.779096  7335 raft_consensus.cc:2272] T 652dfe8b7bb64be896563cb525d678d1 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.750159  8550 consensus_peers.cc:597] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:35.781092  8550 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.781510  8550 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.782676 17017 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:04:35.782815  8550 leader_election.cc:336] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.785583  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34810c9636748309cee2bf3d1eb6bdb" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:35.786217  9094 raft_consensus.cc:3060] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:35.781141  7335 tablet_replica.cc:333] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.787735 17015 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.788249 17015 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.790822 17015 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
I20260709 13:04:35.787390  7335 raft_consensus.cc:2243] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.792716  7335 raft_consensus.cc:2272] T 18f59320c7be4aea96b523f7f5083650 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.792619 17011 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.795163  8550 leader_election.cc:304] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.795804  7335 tablet_replica.cc:333] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.795892 17017 raft_consensus.cc:2749] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:04:35.796793  7335 raft_consensus.cc:2243] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.797892  7335 raft_consensus.cc:2272] T ec1a6df183ea46c0b7b35ceaa22ed236 P 5ffc86752d264d0c81f68028e6413a91 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.799786  9094 raft_consensus.cc:2468] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 20.
I20260709 13:04:35.800654  7335 tablet_replica.cc:333] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.801501  7335 raft_consensus.cc:2243] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.802151  7335 raft_consensus.cc:2272] T a4e89695d22445b4b40c4e3c0d792325 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.803047  9094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0" is_pre_election: true
W20260709 13:04:35.803785  9068 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.801527  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b025d136d04841aa2759be7b816f77" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:35.804541  9100 raft_consensus.cc:3060] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:35.804703  7335 tablet_replica.cc:333] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.805558  7335 raft_consensus.cc:2243] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.806665  7335 raft_consensus.cc:2272] T f86829baeb70423ab45311ca8cb560c8 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.809229  7335 tablet_replica.cc:333] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.809880 17011 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
I20260709 13:04:35.810011  7335 raft_consensus.cc:2243] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.811436  8549 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
W20260709 13:04:35.813575  9065 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.803844  9094 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 23.
I20260709 13:04:35.819145  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:35.813943  9067 consensus_peers.cc:597] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.819820 16978 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:35.815076  9100 raft_consensus.cc:2468] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 17.
W20260709 13:04:35.820191  9067 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:35.820778  9067 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:35.821163  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:35.821857 17011 raft_consensus.cc:2804] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:35.822415 17011 raft_consensus.cc:697] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
W20260709 13:04:35.823429  8550 leader_election.cc:336] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:35.824604  7335 raft_consensus.cc:2272] T 45dd878477224acc8d0d4dca5d5d4f02 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.823261 17011 consensus_queue.cc:237] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
W20260709 13:04:35.821444  8547 leader_election.cc:336] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:35.829856  8547 leader_election.cc:336] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.824652  8550 leader_election.cc:304] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:35.830892 17017 raft_consensus.cc:2749] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:04:35.832454 16978 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:04:35.832830  9067 consensus_peers.cc:597] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:35.833418  9067 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:35.833889  9067 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:35.834089  8547 leader_election.cc:336] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.834968  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
I20260709 13:04:35.835777 17017 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:04:35.836134 17017 raft_consensus.cc:493] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:35.836474 17017 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:35.839905  8549 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6
W20260709 13:04:35.840441  9068 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:35.827427  7335 tablet_replica.cc:333] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.841216 17011 raft_consensus.cc:2804] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:35.844058  7335 raft_consensus.cc:2243] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.844163 17011 raft_consensus.cc:697] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:35.844782  7335 raft_consensus.cc:2272] T 44116e7a54d141108511e22185400ffe P 5ffc86752d264d0c81f68028e6413a91 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.845448 17011 consensus_queue.cc:237] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.845679 17017 raft_consensus.cc:515] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.851253 17017 leader_election.cc:290] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Requested vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 6930e07cbba2484ca2bf800a58acdbb0 (127.7.41.196:40061)
W20260709 13:04:35.848837  9067 consensus_peers.cc:597] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:35.853159  9067 consensus_peers.cc:597] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:35.854054  9067 consensus_peers.cc:597] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:35.856925  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956b0163855b4f329c033879d86cd33b" candidate_uuid: "5ffc86752d264d0c81f68028e6413a91" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6930e07cbba2484ca2bf800a58acdbb0"
I20260709 13:04:35.857496  9100 raft_consensus.cc:3060] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:04:35.847543  7335 tablet_replica.cc:333] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.859613  7335 raft_consensus.cc:2243] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.864884  9100 raft_consensus.cc:2468] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ffc86752d264d0c81f68028e6413a91 in term 24.
I20260709 13:04:35.866638  8549 leader_election.cc:304] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffc86752d264d0c81f68028e6413a91, 6930e07cbba2484ca2bf800a58acdbb0; no voters: 
I20260709 13:04:35.867486 17012 raft_consensus.cc:2804] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:04:35.867967 17012 raft_consensus.cc:697] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Becoming Leader. State: Replica: 5ffc86752d264d0c81f68028e6413a91, State: Running, Role: LEADER
I20260709 13:04:35.868896 17012 consensus_queue.cc:237] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:35.871665  7335 raft_consensus.cc:2272] T 9dd9d456ec5e4a83be19a678fcfc50f1 P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.876103  7335 tablet_replica.cc:333] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.877288  7335 raft_consensus.cc:2243] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.878816  7335 raft_consensus.cc:2272] T 7c79fc54c7a44921afa731a1720c6b3b P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.882194  7335 tablet_replica.cc:333] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
W20260709 13:04:35.882215  8547 leader_election.cc:336] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:35.883448  7335 raft_consensus.cc:2243] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.884289  7335 raft_consensus.cc:2272] T 094f99cd1bce4f88ab569c64b32b03b1 P 5ffc86752d264d0c81f68028e6413a91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.886806  7335 tablet_replica.cc:333] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.887471  7335 raft_consensus.cc:2243] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.888031  7335 raft_consensus.cc:2272] T 09de6eee9632412ebe0a904f65cd2a3c P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.890141  7335 tablet_replica.cc:333] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.890744  7335 raft_consensus.cc:2243] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.891319  7335 raft_consensus.cc:2272] T 8e9df238f56e482f9ad6efc0c2bd6014 P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.893324  7335 tablet_replica.cc:333] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.893903  7335 raft_consensus.cc:2243] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.894871  7335 raft_consensus.cc:2272] T 8e2febf027be449183830c318fbd6012 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.896770  7335 tablet_replica.cc:333] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.897384  7335 raft_consensus.cc:2243] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.898284  7335 raft_consensus.cc:2272] T 20fa0c62ae854ede982769f8be4f5421 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.900147  7335 tablet_replica.cc:333] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.900704  7335 raft_consensus.cc:2243] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.901520  7335 pending_rounds.cc:70] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Trying to abort 1 pending ops.
I20260709 13:04:35.901774  7335 pending_rounds.cc:77] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91: Aborting op as it isn't in flight: id { term: 20 index: 14 } timestamp: 7305634921796464640 op_type: NO_OP noop_request { }
I20260709 13:04:35.902195  7335 raft_consensus.cc:2889] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:35.902510  7335 raft_consensus.cc:2272] T b34810c9636748309cee2bf3d1eb6bdb P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.904951  7335 tablet_replica.cc:333] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.905834  7335 raft_consensus.cc:2243] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.906453  7335 raft_consensus.cc:2272] T a12a506b127d40b1acc72c04ae2f5a40 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.909440  7335 tablet_replica.cc:333] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.910400  7335 raft_consensus.cc:2243] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.911096  7335 raft_consensus.cc:2272] T 9d8ec20c8aeb4915950772c6add9f352 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.912199  8550 consensus_peers.cc:597] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:04:35.913990  7335 tablet_replica.cc:333] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.914963  7335 raft_consensus.cc:2243] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.916141  7335 raft_consensus.cc:2272] T 0254141f106e4023bb2d8ba99024140c P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.919240  7335 tablet_replica.cc:333] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.920214  7335 raft_consensus.cc:2243] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.920919  7335 raft_consensus.cc:2272] T 6d4b315396764044bd73a9cb7f985b2b P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.923918  7335 tablet_replica.cc:333] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.924877  7335 raft_consensus.cc:2243] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.926119  7335 raft_consensus.cc:2272] T bd1c8798b6794858b96202fe8f7264d6 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:35.928344  9068 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:04:35.929225  7335 tablet_replica.cc:333] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.931496  7335 raft_consensus.cc:2243] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.932767  7335 raft_consensus.cc:2272] T 64f4890aeba446ef8cf170616e61d6ab P 5ffc86752d264d0c81f68028e6413a91 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.935791  7335 tablet_replica.cc:333] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.936707  7335 raft_consensus.cc:2243] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.937964  7335 raft_consensus.cc:2272] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.940733  7335 tablet_replica.cc:333] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.941627  7335 raft_consensus.cc:2243] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.942713  7335 pending_rounds.cc:70] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Trying to abort 1 pending ops.
I20260709 13:04:35.943033  7335 pending_rounds.cc:77] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91: Aborting op as it isn't in flight: id { term: 24 index: 19 } timestamp: 7305634921971675136 op_type: NO_OP noop_request { }
I20260709 13:04:35.943455  7335 raft_consensus.cc:2889] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:35.943871  7335 raft_consensus.cc:2272] T 956b0163855b4f329c033879d86cd33b P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.947010  7335 tablet_replica.cc:333] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.947846  7335 raft_consensus.cc:2243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.949007  7335 raft_consensus.cc:2272] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 5ffc86752d264d0c81f68028e6413a91 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.951869  7335 tablet_replica.cc:333] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.952667  7335 raft_consensus.cc:2243] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.953835  7335 raft_consensus.cc:2272] T c4156673eede4435930a1d9fd63f78a3 P 5ffc86752d264d0c81f68028e6413a91 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.956713  7335 tablet_replica.cc:333] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.957546  7335 raft_consensus.cc:2243] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.958802  7335 raft_consensus.cc:2272] T c0a41ce5cf754ad58e31f5e764daa48f P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.961532  7335 tablet_replica.cc:333] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.962335  7335 raft_consensus.cc:2243] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.963248  7335 pending_rounds.cc:70] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Trying to abort 1 pending ops.
I20260709 13:04:35.963541  7335 pending_rounds.cc:77] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91: Aborting op as it isn't in flight: id { term: 17 index: 15 } timestamp: 7305634921874776064 op_type: NO_OP noop_request { }
I20260709 13:04:35.963928  7335 raft_consensus.cc:2889] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:35.964308  7335 raft_consensus.cc:2272] T 77b025d136d04841aa2759be7b816f77 P 5ffc86752d264d0c81f68028e6413a91 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.967506  7335 tablet_replica.cc:333] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.968369  7335 raft_consensus.cc:2243] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.969067  7335 raft_consensus.cc:2272] T 141901f3b86847429c9dead6a62a4b04 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.971868  7335 tablet_replica.cc:333] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.972695  7335 raft_consensus.cc:2243] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.973497  7335 raft_consensus.cc:2272] T 42b1603f302f4b188a0a19190c49fed2 P 5ffc86752d264d0c81f68028e6413a91 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.976285  7335 tablet_replica.cc:333] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.977017  7335 raft_consensus.cc:2243] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.978086  7335 raft_consensus.cc:2272] T 057641ab553c4ec08538f2ed159ba000 P 5ffc86752d264d0c81f68028e6413a91 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.980867  7335 tablet_replica.cc:333] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.981598  7335 raft_consensus.cc:2243] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.983012  7335 raft_consensus.cc:2272] T 0318f5ccc3c5462784199f043fe82842 P 5ffc86752d264d0c81f68028e6413a91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.985970  7335 tablet_replica.cc:333] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.986987  7335 raft_consensus.cc:2243] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.988197  7335 raft_consensus.cc:2272] T b7dfd08eb514418f81f0ba7777a079e8 P 5ffc86752d264d0c81f68028e6413a91 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.990932  7335 tablet_replica.cc:333] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91: stopping tablet replica
I20260709 13:04:35.991639  7335 raft_consensus.cc:2243] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:35.992540  7335 raft_consensus.cc:2272] T df86b8c30ce74df593c44831a29d2f9f P 5ffc86752d264d0c81f68028e6413a91 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:36.081475  9065 consensus_peers.cc:597] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.185691  9065 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.204123  9068 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:04:36.232926  9065 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.260947  9065 consensus_peers.cc:597] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.345968  9065 consensus_peers.cc:597] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.405416  9065 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.479501  8605 debug-util.cc:398] Leaking SignalData structure 0x7b0800215f40 after lost signal to thread 7338
W20260709 13:04:36.480526  8605 debug-util.cc:398] Leaking SignalData structure 0x7b08000e1ee0 after lost signal to thread 8367
W20260709 13:04:36.481082  8605 debug-util.cc:398] Leaking SignalData structure 0x7b08003711c0 after lost signal to thread 8608
W20260709 13:04:36.482265  8605 debug-util.cc:398] Leaking SignalData structure 0x7b08002a0940 after lost signal to thread 9126
W20260709 13:04:36.483637  9065 consensus_peers.cc:597] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:36.514628 16978 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:36.515295 16978 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:36.517709 16978 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:36.520869  9068 leader_election.cc:336] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:36.522550  9067 leader_election.cc:336] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:36.522990  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:36.523612 17016 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:36.526847  9065 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:36.553182 17016 raft_consensus.cc:493] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:36.553694 17016 raft_consensus.cc:515] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:36.555465 17016 leader_election.cc:290] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:36.559058  9065 leader_election.cc:336] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:36.559535  9067 leader_election.cc:336] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:36.559877  9067 leader_election.cc:304] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:36.560464 17016 raft_consensus.cc:2749] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:36.655359 16978 raft_consensus.cc:493] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
W20260709 13:04:36.656092  9068 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:36.655934 16978 raft_consensus.cc:515] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:36.658123 16978 leader_election.cc:290] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:36.659050  9065 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.661135  9065 leader_election.cc:336] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:36.663130  9067 leader_election.cc:336] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:36.663596  9067 leader_election.cc:304] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:36.664345 16978 raft_consensus.cc:2749] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:36.717386  9065 consensus_peers.cc:597] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.737454  9065 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:36.829360  9065 consensus_peers.cc:597] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Couldn't send request to peer 0b9f7467deed4381835a85ffd0e88af6. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:36.860026 16978 raft_consensus.cc:493] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:36.860527 16978 raft_consensus.cc:515] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:36.862128 16978 leader_election.cc:290] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:36.865487  9068 leader_election.cc:336] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:36.865887  9067 leader_election.cc:336] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:36.866288  9067 leader_election.cc:304] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:36.866859 16978 raft_consensus.cc:2749] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:04:36.883646 16978 raft_consensus.cc:493] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:36.884186 16978 raft_consensus.cc:515] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:36.886199 16978 leader_election.cc:290] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:36.889560  9065 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:36.890015  9068 leader_election.cc:336] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:36.890381  9068 leader_election.cc:304] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:36.890931 16978 raft_consensus.cc:2749] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:36.894563 16978 raft_consensus.cc:493] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:36.895071 16978 raft_consensus.cc:515] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:36.897118 16978 leader_election.cc:290] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:36.898792 16978 raft_consensus.cc:493] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:36.899215 16978 raft_consensus.cc:515] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:36.900988 16978 leader_election.cc:290] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:36.901947  9065 leader_election.cc:336] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:36.903422  9067 leader_election.cc:336] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:36.903874  9067 leader_election.cc:304] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:36.905614 16978 raft_consensus.cc:2749] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:36.905766  9068 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:36.906364  9065 leader_election.cc:336] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:36.907464  9065 leader_election.cc:304] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:36.908177 16978 raft_consensus.cc:2749] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:36.908944 16978 raft_consensus.cc:493] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:36.909317 16978 raft_consensus.cc:515] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:36.912554 16978 leader_election.cc:290] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:36.914280  9068 leader_election.cc:336] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:36.916102  9067 leader_election.cc:336] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:36.916531  9067 leader_election.cc:304] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:36.917399 17016 raft_consensus.cc:2749] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:36.965409 16978 raft_consensus.cc:493] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:36.965881 16978 raft_consensus.cc:515] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:36.969658 16978 leader_election.cc:290] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:36.971596  9065 leader_election.cc:336] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:36.972115  9068 leader_election.cc:336] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:36.972538  9068 leader_election.cc:304] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:36.973097 16978 raft_consensus.cc:2749] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:04:37.044978  9068 consensus_peers.cc:597] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:04:37.108266 16978 raft_consensus.cc:493] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:37.108755 16978 raft_consensus.cc:515] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.110601 16978 leader_election.cc:290] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:37.114352  9065 leader_election.cc:336] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:37.115296  9068 leader_election.cc:336] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:37.115643  9068 leader_election.cc:304] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:37.116243 16978 raft_consensus.cc:2749] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:04:37.118866  7335 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8605)
I20260709 13:04:37.224745 16978 raft_consensus.cc:493] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:37.225337 16978 raft_consensus.cc:515] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.226989 17016 raft_consensus.cc:493] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:37.227561 17016 raft_consensus.cc:515] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.228201 16978 leader_election.cc:290] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:37.229713 17016 leader_election.cc:290] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:37.231935  9068 leader_election.cc:336] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:37.232867  9067 leader_election.cc:336] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:37.233328  9067 leader_election.cc:304] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:37.234246  9067 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:37.234587 17016 raft_consensus.cc:2749] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:37.235155  9068 leader_election.cc:336] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:37.235590  9068 leader_election.cc:304] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:37.236294 16978 raft_consensus.cc:2749] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:37.254352 16978 raft_consensus.cc:493] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:37.254848 16978 raft_consensus.cc:515] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.256407 16978 leader_election.cc:290] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:37.260845  9067 leader_election.cc:336] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
W20260709 13:04:37.261353  9068 leader_election.cc:336] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:37.261744  9068 leader_election.cc:304] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:37.262331 16978 raft_consensus.cc:2749] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:04:37.273754 16978 raft_consensus.cc:493] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:37.274322 16978 raft_consensus.cc:515] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.275104 17016 raft_consensus.cc:493] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:37.275586 17016 raft_consensus.cc:515] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.276340 16978 leader_election.cc:290] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:37.278228 17016 leader_election.cc:290] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653), dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353)
W20260709 13:04:37.282714  9067 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
W20260709 13:04:37.283272  9068 leader_election.cc:336] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:37.283268  9067 leader_election.cc:336] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:37.283820  9068 leader_election.cc:304] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:37.284431 17022 raft_consensus.cc:493] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:37.284359 17016 raft_consensus.cc:493] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:37.284899 16978 raft_consensus.cc:493] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:37.285192 17022 raft_consensus.cc:515] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.285290 17016 raft_consensus.cc:515] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.285405 16978 raft_consensus.cc:515] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.287410 16978 leader_election.cc:290] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:37.287868 16978 raft_consensus.cc:493] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:37.288363 16978 raft_consensus.cc:515] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.290297 17022 leader_election.cc:290] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:37.287429 17016 leader_election.cc:290] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:37.291589 16978 leader_election.cc:290] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:37.292237 16978 raft_consensus.cc:2749] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:37.293315  9068 leader_election.cc:336] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:37.293802  9068 leader_election.cc:304] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:37.294102  9067 leader_election.cc:336] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:37.294592 16978 raft_consensus.cc:2749] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:37.295284  9067 leader_election.cc:336] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
W20260709 13:04:37.296032  9065 leader_election.cc:336] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:37.297106  9065 leader_election.cc:304] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:37.297899 16978 raft_consensus.cc:2749] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:04:37.298130  9065 leader_election.cc:336] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:37.299041  9067 leader_election.cc:336] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:37.299590  9067 leader_election.cc:304] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:37.300335 16978 raft_consensus.cc:2749] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:37.300529  9067 leader_election.cc:336] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
W20260709 13:04:37.301704  9068 leader_election.cc:336] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:37.302141  9068 leader_election.cc:304] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:37.302690 16978 raft_consensus.cc:2749] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:04:37.302896  9068 leader_election.cc:336] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:37.303418 16978 raft_consensus.cc:493] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.303402  9068 leader_election.cc:304] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:37.303967 16978 raft_consensus.cc:515] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.304248 17016 raft_consensus.cc:2749] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:37.305820 16978 leader_election.cc:290] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:37.309572  9065 leader_election.cc:336] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:37.310060  9067 leader_election.cc:336] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:37.310521  9067 leader_election.cc:304] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:37.311228 16978 raft_consensus.cc:2749] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:37.336294  9068 consensus_peers.cc:597] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:04:37.396391 16978 raft_consensus.cc:493] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:37.396852 16978 raft_consensus.cc:515] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.398553 16978 leader_election.cc:290] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:37.402410  9068 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:37.402984  9065 leader_election.cc:336] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:37.403407  9065 leader_election.cc:304] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:37.403988 16978 raft_consensus.cc:2749] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:04:37.451315  9068 consensus_peers.cc:597] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:37.553834 17016 raft_consensus.cc:493] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:37.554459 17016 raft_consensus.cc:515] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.556769 17016 leader_election.cc:290] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:37.561136  9065 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:37.561982  9068 leader_election.cc:336] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:37.562472  9068 leader_election.cc:304] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:37.563253 17016 raft_consensus.cc:2749] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:04:37.655928  9068 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:04:37.662520 17016 raft_consensus.cc:493] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:37.663160 17016 raft_consensus.cc:515] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.665385 17016 leader_election.cc:290] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:37.669118  9068 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:37.669688  9065 leader_election.cc:336] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:37.670112  9065 leader_election.cc:304] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:37.670735 17016 raft_consensus.cc:2749] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:04:37.716955 17016 raft_consensus.cc:493] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:37.717509 17016 raft_consensus.cc:515] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } attrs { replace: true } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.721767 17016 leader_election.cc:290] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:37.728389  9067 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
W20260709 13:04:37.729156  9068 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:37.729596  9068 leader_election.cc:304] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
W20260709 13:04:37.730041  9065 leader_election.cc:336] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
I20260709 13:04:37.730207 17016 raft_consensus.cc:2749] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:37.776083 16978 raft_consensus.cc:493] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:37.776497 16978 raft_consensus.cc:515] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.780138 16978 leader_election.cc:290] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:37.782608  9065 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:37.783118  9067 leader_election.cc:336] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:37.783522  9067 leader_election.cc:304] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:37.784240 16978 raft_consensus.cc:2749] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:37.794216 16978 raft_consensus.cc:493] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.794728 16978 raft_consensus.cc:515] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.796270 16978 leader_election.cc:290] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
W20260709 13:04:37.800400  9065 leader_election.cc:336] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:37.800921  9067 leader_election.cc:336] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:37.801286  9067 leader_election.cc:304] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, 5ffc86752d264d0c81f68028e6413a91
I20260709 13:04:37.801826 16978 raft_consensus.cc:2749] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:37.827472 17016 raft_consensus.cc:493] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0b9f7467deed4381835a85ffd0e88af6)
I20260709 13:04:37.828017 17016 raft_consensus.cc:515] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "0b9f7467deed4381835a85ffd0e88af6" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38749 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:37.830057 17016 leader_election.cc:290] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749)
W20260709 13:04:37.832002  9067 consensus_peers.cc:597] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:37.833566  9065 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:37.835306  9068 leader_election.cc:336] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:37.835697  9068 leader_election.cc:304] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 0b9f7467deed4381835a85ffd0e88af6, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:37.836347 17016 raft_consensus.cc:2749] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:04:37.859006  9068 consensus_peers.cc:597] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:37.967356  9067 consensus_peers.cc:597] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:37.991976  9067 consensus_peers.cc:597] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:38.050410  9067 consensus_peers.cc:597] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:38.103746  9067 consensus_peers.cc:597] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:38.212316  9067 consensus_peers.cc:597] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:38.261072  9067 consensus_peers.cc:597] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:38.327844  9068 consensus_peers.cc:597] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:04:38.329547  7335 tablet_server.cc:196] TabletServer@127.7.41.195:0 shutdown complete.
W20260709 13:04:38.348398  9067 consensus_peers.cc:597] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:38.365417  9067 consensus_peers.cc:597] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:38.381244  9068 consensus_peers.cc:597] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Couldn't send request to peer dacb523538a14c7cb335ab9c18f4111b. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:04:38.396324  9067 consensus_peers.cc:597] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 -> Peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Couldn't send request to peer 5ffc86752d264d0c81f68028e6413a91. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:38.405426  7335 tablet_server.cc:179] TabletServer@127.7.41.196:0 shutting down...
I20260709 13:04:38.455147  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:38.455852  7335 tablet_replica.cc:333] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.456590  7335 raft_consensus.cc:2243] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.457414  7335 raft_consensus.cc:2272] T 6230ca5c82634f7abb78b594dab8da24 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.459408  7335 tablet_replica.cc:333] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.459962  7335 raft_consensus.cc:2243] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.460407  7335 raft_consensus.cc:2272] T 18f59320c7be4aea96b523f7f5083650 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.461573 16978 raft_consensus.cc:493] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5ffc86752d264d0c81f68028e6413a91)
I20260709 13:04:38.461962 16978 raft_consensus.cc:515] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dacb523538a14c7cb335ab9c18f4111b" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 41353 } } peers { permanent_uuid: "5ffc86752d264d0c81f68028e6413a91" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 41653 } } peers { permanent_uuid: "6930e07cbba2484ca2bf800a58acdbb0" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 40061 } attrs { promote: false } }
I20260709 13:04:38.462641  7335 tablet_replica.cc:333] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.463346  7335 raft_consensus.cc:2243] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.463546 16978 leader_election.cc:290] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353), 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653)
I20260709 13:04:38.464020  7335 raft_consensus.cc:2272] T 7c808e5ae17447f4a32fc1b5624cc91a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.466890  7335 tablet_replica.cc:333] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
W20260709 13:04:38.467379  9068 leader_election.cc:336] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:38.467790  7335 raft_consensus.cc:2243] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:38.467880  9067 leader_election.cc:336] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5ffc86752d264d0c81f68028e6413a91 (127.7.41.195:41653): Network error: Client connection negotiation failed: client connection to 127.7.41.195:41653: connect: Connection refused (error 111)
I20260709 13:04:38.468340  9067 leader_election.cc:304] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6930e07cbba2484ca2bf800a58acdbb0; no voters: 5ffc86752d264d0c81f68028e6413a91, dacb523538a14c7cb335ab9c18f4111b
I20260709 13:04:38.468457  7335 raft_consensus.cc:2272] T 8fff54c32b2248dca5e70dc82b71155d P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.468953 16978 raft_consensus.cc:2749] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:04:38.470973  7335 tablet_replica.cc:333] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.471598  7335 raft_consensus.cc:2243] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.472056  7335 raft_consensus.cc:2272] T bc7e6e656d324c0bad9eee744f6f1886 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.473903  7335 tablet_replica.cc:333] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.474519  7335 raft_consensus.cc:2243] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.475404  7335 raft_consensus.cc:2272] T cf4548803154450a8b2b2d3ee14dd41a P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.477123  7335 tablet_replica.cc:333] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.477591  7335 raft_consensus.cc:2243] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.478325  7335 raft_consensus.cc:2272] T 44116e7a54d141108511e22185400ffe P 6930e07cbba2484ca2bf800a58acdbb0 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.479970  7335 tablet_replica.cc:333] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.480454  7335 raft_consensus.cc:2243] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.480860  7335 raft_consensus.cc:2272] T b7dfd08eb514418f81f0ba7777a079e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.482697  7335 tablet_replica.cc:333] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.483163  7335 raft_consensus.cc:2243] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.483937  7335 raft_consensus.cc:2272] T 42b1603f302f4b188a0a19190c49fed2 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.485687  7335 tablet_replica.cc:333] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.486240  7335 raft_consensus.cc:2243] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.486987  7335 raft_consensus.cc:2272] T f2a5011db54b4e9f85a54c19ade01aa8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.488746  7335 tablet_replica.cc:333] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.489288  7335 raft_consensus.cc:2243] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.489737  7335 raft_consensus.cc:2272] T 0318f5ccc3c5462784199f043fe82842 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.491542  7335 tablet_replica.cc:333] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.492022  7335 raft_consensus.cc:2243] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.492429  7335 raft_consensus.cc:2272] T 37072d40853c44b1b312489112c9250e P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.494222  7335 tablet_replica.cc:333] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.494689  7335 raft_consensus.cc:2243] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.495146  7335 raft_consensus.cc:2272] T f25688d717bb4dae964fead4a15af269 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.496868  7335 tablet_replica.cc:333] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.497356  7335 raft_consensus.cc:2243] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.498149  7335 raft_consensus.cc:2272] T 337d7e57df5f492daf49939f167561a0 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.499934  7335 tablet_replica.cc:333] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.500412  7335 raft_consensus.cc:2243] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.501220  7335 raft_consensus.cc:2272] T 435c81d2d1f346bea90c20030455900c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.503012  7335 tablet_replica.cc:333] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.503491  7335 raft_consensus.cc:2243] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.504442  7335 raft_consensus.cc:2272] T a12a506b127d40b1acc72c04ae2f5a40 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.506253  7335 tablet_replica.cc:333] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.506721  7335 raft_consensus.cc:2243] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.507110  7335 raft_consensus.cc:2272] T 20fa0c62ae854ede982769f8be4f5421 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.508728  7335 tablet_replica.cc:333] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.509219  7335 raft_consensus.cc:2243] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.509573  7335 raft_consensus.cc:2272] T b34810c9636748309cee2bf3d1eb6bdb P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.511337  7335 tablet_replica.cc:333] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.511786  7335 raft_consensus.cc:2243] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.512168  7335 raft_consensus.cc:2272] T 8e9df238f56e482f9ad6efc0c2bd6014 P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.513823  7335 tablet_replica.cc:333] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.514298  7335 raft_consensus.cc:2243] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.514645  7335 raft_consensus.cc:2272] T 64f4890aeba446ef8cf170616e61d6ab P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.516367  7335 tablet_replica.cc:333] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.516813  7335 raft_consensus.cc:2243] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.517575  7335 raft_consensus.cc:2272] T cbe0cd8e445e4958b026f85c697843e8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.519634  7335 tablet_replica.cc:333] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.520264  7335 raft_consensus.cc:2243] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.520774  7335 raft_consensus.cc:2272] T d9390750b3d3442e888055fd39566ef1 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.523221  7335 tablet_replica.cc:333] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.523725  7335 raft_consensus.cc:2243] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.524838  7335 raft_consensus.cc:2272] T 1e038af5e5154b3e8ae9503fdedbb44b P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.526793  7335 tablet_replica.cc:333] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.527323  7335 raft_consensus.cc:2243] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.527762  7335 raft_consensus.cc:2272] T d56fc8bb927a4cdd8b35293e875e2856 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.529415  7335 tablet_replica.cc:333] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.529939  7335 raft_consensus.cc:2243] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.530447  7335 raft_consensus.cc:2272] T 9b195ca1ba0c4d7e993f9dc2d1a12629 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.532169  7335 tablet_replica.cc:333] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.532702  7335 raft_consensus.cc:2243] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.533420  7335 raft_consensus.cc:2272] T f518d1b1d4c2478b9d4fc2483806952e P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.535220  7335 tablet_replica.cc:333] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.535720  7335 raft_consensus.cc:2243] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.536193  7335 raft_consensus.cc:2272] T bd1c8798b6794858b96202fe8f7264d6 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.537959  7335 tablet_replica.cc:333] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.538524  7335 raft_consensus.cc:2243] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.539355  7335 raft_consensus.cc:2272] T 4c7ceb457b3b46b096de1a7a57adccde P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.541067  7335 tablet_replica.cc:333] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.541565  7335 raft_consensus.cc:2243] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.542393  7335 raft_consensus.cc:2272] T adc232408fec446f9379aa9fb2c04164 P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.544276  7335 tablet_replica.cc:333] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.544787  7335 raft_consensus.cc:2243] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.545549  7335 raft_consensus.cc:2272] T 0a2b7b0063404db89eb6c3acc48e3abf P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.547425  7335 tablet_replica.cc:333] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.547963  7335 raft_consensus.cc:2243] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.548403  7335 raft_consensus.cc:2272] T b9e03855c7c944d6a2bd32561a407196 P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.550311  7335 tablet_replica.cc:333] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.550885  7335 raft_consensus.cc:2243] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.551362  7335 raft_consensus.cc:2272] T 8e1186d8dca7484f8fd5714b4489ce99 P 6930e07cbba2484ca2bf800a58acdbb0 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.553399  7335 tablet_replica.cc:333] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.553903  7335 raft_consensus.cc:2243] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.554500  7335 raft_consensus.cc:2272] T d9ee2138cf46471e96358439600aaa0c P 6930e07cbba2484ca2bf800a58acdbb0 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.556182  7335 tablet_replica.cc:333] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.556702  7335 raft_consensus.cc:2243] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.557132  7335 raft_consensus.cc:2272] T f86829baeb70423ab45311ca8cb560c8 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.558789  7335 tablet_replica.cc:333] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.559268  7335 raft_consensus.cc:2243] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.560020  7335 raft_consensus.cc:2272] T 18349b8506fc4ede84bfb527fb6e8a68 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.561753  7335 tablet_replica.cc:333] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.562328  7335 raft_consensus.cc:2243] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.562876  7335 raft_consensus.cc:2272] T c783a77969844f0b82c1b365e456c651 P 6930e07cbba2484ca2bf800a58acdbb0 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.564630  7335 tablet_replica.cc:333] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.565136  7335 raft_consensus.cc:2243] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.565629  7335 raft_consensus.cc:2272] T 1d9ecda5b5b04bbebb108bfcee54439e P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.567385  7335 tablet_replica.cc:333] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.567893  7335 raft_consensus.cc:2243] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.568336  7335 raft_consensus.cc:2272] T c0a41ce5cf754ad58e31f5e764daa48f P 6930e07cbba2484ca2bf800a58acdbb0 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.570123  7335 tablet_replica.cc:333] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.570587  7335 raft_consensus.cc:2243] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.571072  7335 raft_consensus.cc:2272] T 77b025d136d04841aa2759be7b816f77 P 6930e07cbba2484ca2bf800a58acdbb0 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.572744  7335 tablet_replica.cc:333] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.573239  7335 raft_consensus.cc:2243] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.573688  7335 raft_consensus.cc:2272] T 956b0163855b4f329c033879d86cd33b P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.575500  7335 tablet_replica.cc:333] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.575974  7335 raft_consensus.cc:2243] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.576555  7335 raft_consensus.cc:2272] T 2240cdfdfc6c47f49f2aaea6aa62b675 P 6930e07cbba2484ca2bf800a58acdbb0 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.578321  7335 tablet_replica.cc:333] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.578764  7335 raft_consensus.cc:2243] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.579341  7335 raft_consensus.cc:2272] T 09de6eee9632412ebe0a904f65cd2a3c P 6930e07cbba2484ca2bf800a58acdbb0 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.581099  7335 tablet_replica.cc:333] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.581532  7335 raft_consensus.cc:2243] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:04:38.582391  7335 raft_consensus.cc:2272] T f6c83778726d49c5b8622ad284f71aa9 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:38.584064  7335 tablet_replica.cc:333] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0: stopping tablet replica
I20260709 13:04:38.584481  7335 raft_consensus.cc:2243] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:38.584964  7335 raft_consensus.cc:2272] T 8e2febf027be449183830c318fbd6012 P 6930e07cbba2484ca2bf800a58acdbb0 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:39.108458  7335 tablet_server.cc:196] TabletServer@127.7.41.196:0 shutdown complete.
I20260709 13:04:39.174891  7335 master.cc:562] Master@127.7.41.254:45431 shutting down...
W20260709 13:04:41.581948  8317 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111) [suppressed 443 similar messages]
W20260709 13:04:41.586280  8317 catalog_manager.cc:4755] TS 0b9f7467deed4381835a85ffd0e88af6 (127.7.41.194:38749): ChangeConfig:REMOVE_PEER RPC failed for tablet 09de6eee9632412ebe0a904f65cd2a3c: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38749: connect: Connection refused (error 111)
W20260709 13:04:47.924695  8320 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
W20260709 13:04:47.930213  8320 catalog_manager.cc:4755] TS dacb523538a14c7cb335ab9c18f4111b (127.7.41.193:41353): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet adc232408fec446f9379aa9fb2c04164: Network error: Client connection negotiation failed: client connection to 127.7.41.193:41353: connect: Connection refused (error 111)
I20260709 13:04:50.107457  7335 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.108682  7335 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.109113  7335 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9ac2f5f0926d4b9294bfce4452124031: stopping tablet replica
I20260709 13:04:50.355683  7335 master.cc:584] Master@127.7.41.254:45431 shutdown complete.
I20260709 13:04:50.406378  7335 test_util.cc:182] -----------------------------------------------
I20260709 13:04:50.406584  7335 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601985998407-7335-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (281483 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:04:50.410012  7335 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.41.254:37309
I20260709 13:04:50.411196  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:50.416874 17031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:50.417399 17032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:50.418449 17034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:50.419400  7335 server_base.cc:1061] running on GCE node
I20260709 13:04:50.422734  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:50.422914  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:50.423023  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602290423012 us; error 0 us; skew 500 ppm
I20260709 13:04:50.423461  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:50.425721  7335 webserver.cc:533] Webserver started at http://127.7.41.254:41913/ using document root <none> and password file <none>
I20260709 13:04:50.426262  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:50.426421  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:50.426635  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:50.427846  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/master-0-root/instance:
uuid: "0a1bc03204a547bfb078faa7ac2d3d89"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-fh5z"
I20260709 13:04:50.432161  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:04:50.435369 17039 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.436080  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:50.436365  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/master-0-root
uuid: "0a1bc03204a547bfb078faa7ac2d3d89"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-fh5z"
I20260709 13:04:50.436643  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:50.450254  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:50.451445  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:50.490370  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.254:37309
I20260709 13:04:50.490494 17090 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.254:37309 every 8 connection(s)
I20260709 13:04:50.494665 17091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:50.505704 17091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89: Bootstrap starting.
I20260709 13:04:50.510567 17091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.514714 17091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89: No bootstrap required, opened a new log
I20260709 13:04:50.516798 17091 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a1bc03204a547bfb078faa7ac2d3d89" member_type: VOTER }
I20260709 13:04:50.517210 17091 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.517385 17091 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a1bc03204a547bfb078faa7ac2d3d89, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.517962 17091 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a1bc03204a547bfb078faa7ac2d3d89" member_type: VOTER }
I20260709 13:04:50.518509 17091 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:50.518718 17091 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:50.518934 17091 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.523298 17091 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a1bc03204a547bfb078faa7ac2d3d89" member_type: VOTER }
I20260709 13:04:50.523763 17091 leader_election.cc:304] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a1bc03204a547bfb078faa7ac2d3d89; no voters: 
I20260709 13:04:50.524813 17091 leader_election.cc:290] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:50.525245 17094 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.526597 17094 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 1 LEADER]: Becoming Leader. State: Replica: 0a1bc03204a547bfb078faa7ac2d3d89, State: Running, Role: LEADER
I20260709 13:04:50.527326 17094 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a1bc03204a547bfb078faa7ac2d3d89" member_type: VOTER }
I20260709 13:04:50.527860 17091 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:50.535148 17095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a1bc03204a547bfb078faa7ac2d3d89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a1bc03204a547bfb078faa7ac2d3d89" member_type: VOTER } }
I20260709 13:04:50.535138 17096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a1bc03204a547bfb078faa7ac2d3d89. Latest consensus state: current_term: 1 leader_uuid: "0a1bc03204a547bfb078faa7ac2d3d89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a1bc03204a547bfb078faa7ac2d3d89" member_type: VOTER } }
I20260709 13:04:50.535997 17095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:50.536149 17096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:50.538069 17104 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:50.542901 17104 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:50.544103  7335 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:50.552451 17104 catalog_manager.cc:1383] Generated new cluster ID: 4edc5bea58b849d1a93fddfb6d752e1b
I20260709 13:04:50.552744 17104 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:50.592799 17104 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:50.594072 17104 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:50.612761 17104 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89: Generated new TSK 0
I20260709 13:04:50.613538 17104 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:50.675652  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:50.682044 17112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:50.682971 17113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:50.685822 17115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:50.687347  7335 server_base.cc:1061] running on GCE node
I20260709 13:04:50.689682  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:50.689870  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:50.689990  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602290689979 us; error 0 us; skew 500 ppm
I20260709 13:04:50.690570  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:50.692947  7335 webserver.cc:533] Webserver started at http://127.7.41.193:35713/ using document root <none> and password file <none>
I20260709 13:04:50.693399  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:50.693552  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:50.693759  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:50.694923  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/instance:
uuid: "de7ec497603d42d0acaf22677ea7f1bd"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-fh5z"
I20260709 13:04:50.699275  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:04:50.702366 17120 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.703101  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:50.703408  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-0-root
uuid: "de7ec497603d42d0acaf22677ea7f1bd"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-fh5z"
I20260709 13:04:50.703681  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:50.747016  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:50.748240  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:50.749763  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:50.752117  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:50.752341  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.752584  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:50.752777  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.793615  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.193:40565
I20260709 13:04:50.793711 17182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.193:40565 every 8 connection(s)
I20260709 13:04:50.798902  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:50.806737 17187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:50.808040 17188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:50.808550 17190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:50.809329  7335 server_base.cc:1061] running on GCE node
I20260709 13:04:50.812192  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:50.812438  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:50.812633  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602290812614 us; error 0 us; skew 500 ppm
I20260709 13:04:50.813196  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:50.816280  7335 webserver.cc:533] Webserver started at http://127.7.41.194:41073/ using document root <none> and password file <none>
I20260709 13:04:50.816916  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:50.817123  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:50.817451  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:50.818127 17183 heartbeater.cc:344] Connected to a master server at 127.7.41.254:37309
I20260709 13:04:50.818614 17183 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:50.819140  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/instance:
uuid: "7e9eba24bc8842099fcba4a2024c2aed"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-fh5z"
I20260709 13:04:50.819591 17183 heartbeater.cc:507] Master 127.7.41.254:37309 requested a full tablet report, sending...
I20260709 13:04:50.822106 17056 ts_manager.cc:194] Registered new tserver with Master: de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:50.824692 17056 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46150
I20260709 13:04:50.825067  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:04:50.829332 17195 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.830245  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:50.830545  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-1-root
uuid: "7e9eba24bc8842099fcba4a2024c2aed"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-fh5z"
I20260709 13:04:50.830785  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:50.840611  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:50.841706  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:50.843086  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:50.845376  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:50.845548  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.845839  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:50.845995  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.886596  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.194:38067
I20260709 13:04:50.886680 17257 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.194:38067 every 8 connection(s)
I20260709 13:04:50.891737  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:50.900987 17261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:50.901544 17262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:50.904812 17264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:50.905511  7335 server_base.cc:1061] running on GCE node
I20260709 13:04:50.906114 17258 heartbeater.cc:344] Connected to a master server at 127.7.41.254:37309
I20260709 13:04:50.906538 17258 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:50.906585  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:50.906914  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:50.907073  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602290907060 us; error 0 us; skew 500 ppm
I20260709 13:04:50.907444 17258 heartbeater.cc:507] Master 127.7.41.254:37309 requested a full tablet report, sending...
I20260709 13:04:50.907717  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:50.909623 17056 ts_manager.cc:194] Registered new tserver with Master: 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:50.910647  7335 webserver.cc:533] Webserver started at http://127.7.41.195:40483/ using document root <none> and password file <none>
I20260709 13:04:50.911180  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:50.911139 17056 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46152
I20260709 13:04:50.911490  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:50.911890  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:50.913228  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/instance:
uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-fh5z"
I20260709 13:04:50.917644  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:50.921144 17269 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.921924  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:50.922287  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-2-root
uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-fh5z"
I20260709 13:04:50.922590  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:50.940949  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:50.942235  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:50.943509  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:50.945772  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:50.946002  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.946265  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:50.946439  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.987866  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.195:38531
I20260709 13:04:50.987962 17331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.195:38531 every 8 connection(s)
I20260709 13:04:50.992964  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.001355 17335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.003569 17336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.007503 17332 heartbeater.cc:344] Connected to a master server at 127.7.41.254:37309
I20260709 13:04:51.008124 17332 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.009527 17332 heartbeater.cc:507] Master 127.7.41.254:37309 requested a full tablet report, sending...
I20260709 13:04:51.012876 17056 ts_manager.cc:194] Registered new tserver with Master: 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:51.014881  7335 server_base.cc:1061] running on GCE node
W20260709 13:04:51.015128 17338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.015199 17056 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46158
I20260709 13:04:51.016472  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.016764  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.016988  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602291016969 us; error 0 us; skew 500 ppm
I20260709 13:04:51.017846  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.020294  7335 webserver.cc:533] Webserver started at http://127.7.41.196:35465/ using document root <none> and password file <none>
I20260709 13:04:51.020721  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.020876  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.021085  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.022369  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-3-root/instance:
uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-fh5z"
I20260709 13:04:51.026703  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:04:51.029805 17343 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.030680  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:51.030927  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-3-root
uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-fh5z"
I20260709 13:04:51.031164  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.044305  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.045460  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.046696  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:51.048844  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:51.049038  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.049319  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:51.049458  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.090011  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.196:39887
I20260709 13:04:51.090258 17405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.196:39887 every 8 connection(s)
I20260709 13:04:51.104429 17406 heartbeater.cc:344] Connected to a master server at 127.7.41.254:37309
I20260709 13:04:51.104833 17406 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.105726 17406 heartbeater.cc:507] Master 127.7.41.254:37309 requested a full tablet report, sending...
I20260709 13:04:51.107609 17056 ts_manager.cc:194] Registered new tserver with Master: 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:51.108189  7335 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01462576s
I20260709 13:04:51.109251 17056 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46164
I20260709 13:04:51.133926 17056 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:04:51.378360 17297 tablet_service.cc:1511] Processing CreateTablet for tablet 9664e129106a424cb0418e3713b1e1fb (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:51.379910 17297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9664e129106a424cb0418e3713b1e1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.383898 17296 tablet_service.cc:1511] Processing CreateTablet for tablet a9fe91dffd9642e48367fdff703aa915 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:51.385361 17296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fe91dffd9642e48367fdff703aa915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.387153 17295 tablet_service.cc:1511] Processing CreateTablet for tablet a8e23f2fe067471e9a52a8f835d7ca1d (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:51.387272 17147 tablet_service.cc:1511] Processing CreateTablet for tablet de6ec102dc0a48c0819f814102f27aa0 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:51.388650 17295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e23f2fe067471e9a52a8f835d7ca1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.388799 17147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6ec102dc0a48c0819f814102f27aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.389258 17371 tablet_service.cc:1511] Processing CreateTablet for tablet 9664e129106a424cb0418e3713b1e1fb (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:51.390705 17371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9664e129106a424cb0418e3713b1e1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.391170 17146 tablet_service.cc:1511] Processing CreateTablet for tablet a8e23f2fe067471e9a52a8f835d7ca1d (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:51.394641 17145 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7341a74f344c90b6c0f9ff657621d5 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:51.395252 17369 tablet_service.cc:1511] Processing CreateTablet for tablet a8e23f2fe067471e9a52a8f835d7ca1d (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:51.385859 17148 tablet_service.cc:1511] Processing CreateTablet for tablet a9fe91dffd9642e48367fdff703aa915 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:51.396644 17369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e23f2fe067471e9a52a8f835d7ca1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.398727 17144 tablet_service.cc:1511] Processing CreateTablet for tablet 44c3a626d41640f2b0ca7233c56f8bbc (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:51.387440 17370 tablet_service.cc:1511] Processing CreateTablet for tablet de6ec102dc0a48c0819f814102f27aa0 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:51.399216 17368 tablet_service.cc:1511] Processing CreateTablet for tablet 44c3a626d41640f2b0ca7233c56f8bbc (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:51.400687 17370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6ec102dc0a48c0819f814102f27aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.401849 17367 tablet_service.cc:1511] Processing CreateTablet for tablet bbe458392d4741bf9e3b6893e219031e (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:51.403872 17143 tablet_service.cc:1511] Processing CreateTablet for tablet bbe458392d4741bf9e3b6893e219031e (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:51.393451 17294 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7341a74f344c90b6c0f9ff657621d5 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:51.406284 17294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7341a74f344c90b6c0f9ff657621d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.406459 17367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe458392d4741bf9e3b6893e219031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.414891 17222 tablet_service.cc:1511] Processing CreateTablet for tablet a9fe91dffd9642e48367fdff703aa915 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:51.416350 17222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fe91dffd9642e48367fdff703aa915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.407887 17293 tablet_service.cc:1511] Processing CreateTablet for tablet bbe458392d4741bf9e3b6893e219031e (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:51.418910 17293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe458392d4741bf9e3b6893e219031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.406319 17146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e23f2fe067471e9a52a8f835d7ca1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.411540 17223 tablet_service.cc:1511] Processing CreateTablet for tablet 9664e129106a424cb0418e3713b1e1fb (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:51.421797 17368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c3a626d41640f2b0ca7233c56f8bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.423820 17221 tablet_service.cc:1511] Processing CreateTablet for tablet de6ec102dc0a48c0819f814102f27aa0 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:51.409991 17292 tablet_service.cc:1511] Processing CreateTablet for tablet 96679e4b73a441eaa803ed3a16a1a35f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:51.425967 17292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96679e4b73a441eaa803ed3a16a1a35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.422739 17223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9664e129106a424cb0418e3713b1e1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.423285 17145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7341a74f344c90b6c0f9ff657621d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.430549 17143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe458392d4741bf9e3b6893e219031e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.432121 17221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de6ec102dc0a48c0819f814102f27aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.432505 17148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fe91dffd9642e48367fdff703aa915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.433483 17144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c3a626d41640f2b0ca7233c56f8bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.439942 17220 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7341a74f344c90b6c0f9ff657621d5 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:51.441502 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7341a74f344c90b6c0f9ff657621d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.445226 17366 tablet_service.cc:1511] Processing CreateTablet for tablet 96679e4b73a441eaa803ed3a16a1a35f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:51.448223 17142 tablet_service.cc:1511] Processing CreateTablet for tablet c0b8248b5a4d4becb690235d23b259e4 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:51.449589 17142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b8248b5a4d4becb690235d23b259e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.451682 17219 tablet_service.cc:1511] Processing CreateTablet for tablet 44c3a626d41640f2b0ca7233c56f8bbc (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:51.453056 17219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c3a626d41640f2b0ca7233c56f8bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.454771 17366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96679e4b73a441eaa803ed3a16a1a35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.462952 17218 tablet_service.cc:1511] Processing CreateTablet for tablet 96679e4b73a441eaa803ed3a16a1a35f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:51.464376 17218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96679e4b73a441eaa803ed3a16a1a35f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.471740 17217 tablet_service.cc:1511] Processing CreateTablet for tablet c0b8248b5a4d4becb690235d23b259e4 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:51.473160 17217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b8248b5a4d4becb690235d23b259e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.477102 17291 tablet_service.cc:1511] Processing CreateTablet for tablet c0b8248b5a4d4becb690235d23b259e4 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:51.478502 17291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b8248b5a4d4becb690235d23b259e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.493834 17365 tablet_service.cc:1511] Processing CreateTablet for tablet a21af78b15714161898e0f709c8a5834 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:51.495362 17365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a21af78b15714161898e0f709c8a5834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.499269 17141 tablet_service.cc:1511] Processing CreateTablet for tablet a21af78b15714161898e0f709c8a5834 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:51.501014 17141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a21af78b15714161898e0f709c8a5834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.514513 17216 tablet_service.cc:1511] Processing CreateTablet for tablet a21af78b15714161898e0f709c8a5834 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:51.515862 17216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a21af78b15714161898e0f709c8a5834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.525089 17364 tablet_service.cc:1511] Processing CreateTablet for tablet 079278fbd6474dea98fac1aaa536bb7c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:51.527060 17364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079278fbd6474dea98fac1aaa536bb7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.533272 17148 tablet_service.cc:1511] Processing CreateTablet for tablet 079278fbd6474dea98fac1aaa536bb7c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:51.535188 17148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079278fbd6474dea98fac1aaa536bb7c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:51.539223 17103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:51.544634 17294 tablet_service.cc:1511] Processing CreateTablet for tablet 079278fbd6474dea98fac1aaa536bb7c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:51.546092 17294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079278fbd6474dea98fac1aaa536bb7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.562844 17427 tablet_bootstrap.cc:492] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:51.564787 17219 tablet_service.cc:1511] Processing CreateTablet for tablet 385f3dec424f482bbb969fb08e7d5509 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:51.567083 17219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385f3dec424f482bbb969fb08e7d5509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.567849 17295 tablet_service.cc:1511] Processing CreateTablet for tablet 385f3dec424f482bbb969fb08e7d5509 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:51.569128 17295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385f3dec424f482bbb969fb08e7d5509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.571193 17363 tablet_service.cc:1511] Processing CreateTablet for tablet 385f3dec424f482bbb969fb08e7d5509 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:51.572525 17363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385f3dec424f482bbb969fb08e7d5509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.578730 17146 tablet_service.cc:1511] Processing CreateTablet for tablet a7b6348ed73e48b2a0efba1da6d17c66 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:51.580106 17146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b6348ed73e48b2a0efba1da6d17c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.600948 17220 tablet_service.cc:1511] Processing CreateTablet for tablet a7b6348ed73e48b2a0efba1da6d17c66 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:51.602896 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b6348ed73e48b2a0efba1da6d17c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.619240 17427 tablet_bootstrap.cc:654] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.640976 17426 tablet_bootstrap.cc:492] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:51.642452 17297 tablet_service.cc:1511] Processing CreateTablet for tablet a7b6348ed73e48b2a0efba1da6d17c66 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:51.643769 17297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b6348ed73e48b2a0efba1da6d17c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.648217 17426 tablet_bootstrap.cc:654] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.650888 17428 tablet_bootstrap.cc:492] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:51.660616 17428 tablet_bootstrap.cc:654] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.673030 17427 tablet_bootstrap.cc:492] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:51.673161 17430 tablet_bootstrap.cc:492] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:51.673575 17427 ts_tablet_manager.cc:1403] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.015s
I20260709 13:04:51.674958 17426 tablet_bootstrap.cc:492] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:51.675463 17426 ts_tablet_manager.cc:1403] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.009s
I20260709 13:04:51.675141 17145 tablet_service.cc:1511] Processing CreateTablet for tablet 4c83cdeb244b4fada6bff4050bdd4fcd (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:51.676669 17145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c83cdeb244b4fada6bff4050bdd4fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.676884 17427 raft_consensus.cc:359] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:51.677656 17427 raft_consensus.cc:385] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.677953 17427 raft_consensus.cc:740] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.678725 17427 consensus_queue.cc:260] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:51.679661 17363 tablet_service.cc:1511] Processing CreateTablet for tablet 4c83cdeb244b4fada6bff4050bdd4fcd (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:51.680928 17363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c83cdeb244b4fada6bff4050bdd4fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.681193 17430 tablet_bootstrap.cc:654] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.684484 17426 raft_consensus.cc:359] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:51.685905 17426 raft_consensus.cc:385] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.685995 17427 ts_tablet_manager.cc:1434] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.005s
I20260709 13:04:51.686352 17426 raft_consensus.cc:740] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.686898 17332 heartbeater.cc:499] Master 127.7.41.254:37309 was elected leader, sending a full tablet report...
I20260709 13:04:51.687213 17427 tablet_bootstrap.cc:492] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:51.687335 17426 consensus_queue.cc:260] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:51.696341 17427 tablet_bootstrap.cc:654] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.696487 17426 ts_tablet_manager.cc:1434] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.005s
I20260709 13:04:51.697383 17183 heartbeater.cc:499] Master 127.7.41.254:37309 was elected leader, sending a full tablet report...
I20260709 13:04:51.697677 17426 tablet_bootstrap.cc:492] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:51.706889 17426 tablet_bootstrap.cc:654] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.708276 17427 tablet_bootstrap.cc:492] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:51.708880 17427 ts_tablet_manager.cc:1403] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.001s
I20260709 13:04:51.712770 17427 raft_consensus.cc:359] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:51.713933 17427 raft_consensus.cc:385] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.714424 17427 raft_consensus.cc:740] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.715655 17427 consensus_queue.cc:260] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:51.718986 17427 ts_tablet_manager.cc:1434] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:51.720326 17427 tablet_bootstrap.cc:492] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:51.720343 17428 tablet_bootstrap.cc:492] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:51.724972 17428 ts_tablet_manager.cc:1403] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.006s
I20260709 13:04:51.729365 17428 raft_consensus.cc:359] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:51.732946 17428 raft_consensus.cc:385] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.733441 17428 raft_consensus.cc:740] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.733829 17223 tablet_service.cc:1511] Processing CreateTablet for tablet 4c83cdeb244b4fada6bff4050bdd4fcd (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:51.734656 17428 consensus_queue.cc:260] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:51.735793 17223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c83cdeb244b4fada6bff4050bdd4fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.741174 17427 tablet_bootstrap.cc:654] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.741487 17406 heartbeater.cc:499] Master 127.7.41.254:37309 was elected leader, sending a full tablet report...
W20260709 13:04:51.742398 17333 tablet.cc:2406] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:51.745680 17428 ts_tablet_manager.cc:1434] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:04:51.746726 17428 tablet_bootstrap.cc:492] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:51.755468 17428 tablet_bootstrap.cc:654] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.758728 17427 tablet_bootstrap.cc:492] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:51.763173 17427 ts_tablet_manager.cc:1403] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.004s
I20260709 13:04:51.767588 17427 raft_consensus.cc:359] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:51.768654 17427 raft_consensus.cc:385] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.769140 17427 raft_consensus.cc:740] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.770406 17427 consensus_queue.cc:260] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:51.773844 17427 ts_tablet_manager.cc:1434] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:04:51.779376 17427 tablet_bootstrap.cc:492] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:51.777832 17428 tablet_bootstrap.cc:492] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:51.780225 17428 ts_tablet_manager.cc:1403] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.002s
I20260709 13:04:51.784305 17428 raft_consensus.cc:359] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:51.790169 17433 raft_consensus.cc:493] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.791013 17433 raft_consensus.cc:515] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:51.796351 17428 raft_consensus.cc:385] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.797367 17428 raft_consensus.cc:740] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.814363 17433 leader_election.cc:290] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:51.817479 17427 tablet_bootstrap.cc:654] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.818658 17148 tablet_service.cc:1511] Processing CreateTablet for tablet 470d0807d3ce4a87bc3de4350bab91d9 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:51.820477 17148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470d0807d3ce4a87bc3de4350bab91d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.820761 17428 consensus_queue.cc:260] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:51.823261 17428 ts_tablet_manager.cc:1434] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.043s	user 0.000s	sys 0.012s
I20260709 13:04:51.824417 17428 tablet_bootstrap.cc:492] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:51.825470 17371 tablet_service.cc:1511] Processing CreateTablet for tablet 470d0807d3ce4a87bc3de4350bab91d9 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:51.826782 17371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470d0807d3ce4a87bc3de4350bab91d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.828845 17220 tablet_service.cc:1511] Processing CreateTablet for tablet 12c2736e41a64de2825d60818a0c19de (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:51.830260 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c2736e41a64de2825d60818a0c19de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.831611 17141 tablet_service.cc:1511] Processing CreateTablet for tablet 12c2736e41a64de2825d60818a0c19de (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:51.825773 17368 tablet_service.cc:1511] Processing CreateTablet for tablet 3dfa8e7c39704056b111af9fbc19e16f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:51.834275 17428 tablet_bootstrap.cc:654] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.828848 17219 tablet_service.cc:1511] Processing CreateTablet for tablet 3dfa8e7c39704056b111af9fbc19e16f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:51.835539 17219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dfa8e7c39704056b111af9fbc19e16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.835999 17142 tablet_service.cc:1511] Processing CreateTablet for tablet e66fd7f2e6494980b0c33606bc363fe8 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:51.837888 17368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dfa8e7c39704056b111af9fbc19e16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.839506 17222 tablet_service.cc:1511] Processing CreateTablet for tablet e66fd7f2e6494980b0c33606bc363fe8 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:51.839738 17367 tablet_service.cc:1511] Processing CreateTablet for tablet e66fd7f2e6494980b0c33606bc363fe8 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:51.840760 17222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66fd7f2e6494980b0c33606bc363fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.840987 17367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66fd7f2e6494980b0c33606bc363fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.848877 17427 tablet_bootstrap.cc:492] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:51.849444 17427 ts_tablet_manager.cc:1403] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.009s
I20260709 13:04:51.850320 17141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c2736e41a64de2825d60818a0c19de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.852556 17427 raft_consensus.cc:359] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:51.853304 17427 raft_consensus.cc:385] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.853592 17427 raft_consensus.cc:740] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.858549 17427 consensus_queue.cc:260] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:51.863023 17433 raft_consensus.cc:493] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.863603 17433 raft_consensus.cc:515] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:51.869396 17366 tablet_service.cc:1511] Processing CreateTablet for tablet 16e21576805d4de796420b8d8190fd91 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:51.870613 17142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66fd7f2e6494980b0c33606bc363fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.870748 17366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e21576805d4de796420b8d8190fd91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.879374 17426 tablet_bootstrap.cc:492] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:51.880040 17426 ts_tablet_manager.cc:1403] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.183s	user 0.060s	sys 0.070s
I20260709 13:04:51.888005 17426 raft_consensus.cc:359] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:51.889029 17426 raft_consensus.cc:385] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.889413 17426 raft_consensus.cc:740] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.893920 17433 leader_election.cc:290] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:51.906397 17146 tablet_service.cc:1511] Processing CreateTablet for tablet 16e21576805d4de796420b8d8190fd91 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:51.906863 17216 tablet_service.cc:1511] Processing CreateTablet for tablet 1de8dcf334364214b6b6115fe416ec2b (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:51.907778 17146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e21576805d4de796420b8d8190fd91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.908075 17216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1de8dcf334364214b6b6115fe416ec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.912747 17297 tablet_service.cc:1511] Processing CreateTablet for tablet 470d0807d3ce4a87bc3de4350bab91d9 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:51.914109 17297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470d0807d3ce4a87bc3de4350bab91d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.913960 17258 heartbeater.cc:499] Master 127.7.41.254:37309 was elected leader, sending a full tablet report...
I20260709 13:04:51.898782 17426 consensus_queue.cc:260] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:51.920483 17426 ts_tablet_manager.cc:1434] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:04:51.929666 17430 tablet_bootstrap.cc:492] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:51.930260 17430 ts_tablet_manager.cc:1403] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.257s	user 0.044s	sys 0.112s
I20260709 13:04:51.933375 17430 raft_consensus.cc:359] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:51.936707 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:51.937427 17364 tablet_service.cc:1511] Processing CreateTablet for tablet 1de8dcf334364214b6b6115fe416ec2b (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
W20260709 13:04:51.938561 17270 leader_election.cc:343] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:51.938961 17364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1de8dcf334364214b6b6115fe416ec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.939379 17292 tablet_service.cc:1511] Processing CreateTablet for tablet 3dfa8e7c39704056b111af9fbc19e16f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:51.940738 17292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dfa8e7c39704056b111af9fbc19e16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.935446 17430 raft_consensus.cc:385] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.945883 17430 raft_consensus.cc:740] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.946906 17430 consensus_queue.cc:260] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:51.957311 17143 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7a56b7669944ce91c6ad8b8f7c439c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:51.958967 17143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7a56b7669944ce91c6ad8b8f7c439c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.961625 17438 raft_consensus.cc:493] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.962190 17438 raft_consensus.cc:515] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:51.968719 17221 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7a56b7669944ce91c6ad8b8f7c439c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:51.977084 17426 tablet_bootstrap.cc:492] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:51.969386 17438 leader_election.cc:290] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:51.985481 17221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7a56b7669944ce91c6ad8b8f7c439c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.987509 17427 ts_tablet_manager.cc:1434] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.138s	user 0.011s	sys 0.016s
I20260709 13:04:51.989212 17296 tablet_service.cc:1511] Processing CreateTablet for tablet 16e21576805d4de796420b8d8190fd91 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:52.011763 17296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16e21576805d4de796420b8d8190fd91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.011826 17427 tablet_bootstrap.cc:492] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:52.014817 17426 tablet_bootstrap.cc:654] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.994666 17291 tablet_service.cc:1511] Processing CreateTablet for tablet 1de8dcf334364214b6b6115fe416ec2b (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:52.016269 17291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1de8dcf334364214b6b6115fe416ec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.991111 17294 tablet_service.cc:1511] Processing CreateTablet for tablet 12c2736e41a64de2825d60818a0c19de (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:51.995795 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7341a74f344c90b6c0f9ff657621d5" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:51.999956 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:52.029016 17430 ts_tablet_manager.cc:1434] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.012s
I20260709 13:04:52.030575 17294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c2736e41a64de2825d60818a0c19de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:52.035424 17271 leader_election.cc:343] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:52.037827 17271 leader_election.cc:343] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.038331 17271 leader_election.cc:304] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:52.039958 17444 raft_consensus.cc:2749] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.043715 17428 tablet_bootstrap.cc:492] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:52.044193 17428 ts_tablet_manager.cc:1403] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.220s	user 0.019s	sys 0.012s
I20260709 13:04:52.053046 17428 raft_consensus.cc:359] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.053802 17428 raft_consensus.cc:385] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.055552 17428 raft_consensus.cc:740] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.057600 17428 consensus_queue.cc:260] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.059893 17428 ts_tablet_manager.cc:1434] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:04:52.060900 17428 tablet_bootstrap.cc:492] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:52.063855 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7341a74f344c90b6c0f9ff657621d5" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:52.066586 17272 leader_election.cc:343] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.067052 17272 leader_election.cc:304] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:52.068188 17444 raft_consensus.cc:2749] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.073673 17427 tablet_bootstrap.cc:654] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.105139 17428 tablet_bootstrap.cc:654] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.086201 17291 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7a56b7669944ce91c6ad8b8f7c439c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:52.115285 17291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7a56b7669944ce91c6ad8b8f7c439c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.116889 17428 tablet_bootstrap.cc:492] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:52.117421 17428 ts_tablet_manager.cc:1403] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.011s
I20260709 13:04:52.086915 17366 tablet_service.cc:1511] Processing CreateTablet for tablet f67d94cad84c4419a7f21c6c0b35c7cb (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:52.095454 17364 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4c5c12c8844ad7877fca4c9d59dec6 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:52.123273 17427 tablet_bootstrap.cc:492] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:52.124030 17366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67d94cad84c4419a7f21c6c0b35c7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.124387 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:52.124715 17364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4c5c12c8844ad7877fca4c9d59dec6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:52.126010 17345 leader_election.cc:343] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.122742 17428 raft_consensus.cc:359] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.126874 17428 raft_consensus.cc:385] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.127250 17428 raft_consensus.cc:740] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.128135 17428 consensus_queue.cc:260] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.128713 17221 tablet_service.cc:1511] Processing CreateTablet for tablet 74084e0afb264747a12252fbdaf660a9 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:52.129978 17221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74084e0afb264747a12252fbdaf660a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.130541 17371 tablet_service.cc:1511] Processing CreateTablet for tablet 74084e0afb264747a12252fbdaf660a9 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:52.131855 17371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74084e0afb264747a12252fbdaf660a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.133042 17220 tablet_service.cc:1511] Processing CreateTablet for tablet c43cf64dce604011933dfed0af0fa571 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:52.133332 17292 tablet_service.cc:1511] Processing CreateTablet for tablet 74084e0afb264747a12252fbdaf660a9 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:52.099479 17142 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4c5c12c8844ad7877fca4c9d59dec6 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:52.134335 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43cf64dce604011933dfed0af0fa571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.134852 17142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4c5c12c8844ad7877fca4c9d59dec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.134521 17292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74084e0afb264747a12252fbdaf660a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.104347 17426 tablet_bootstrap.cc:492] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:52.137562 17426 ts_tablet_manager.cc:1403] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.192s	user 0.013s	sys 0.024s
I20260709 13:04:52.085911 17430 tablet_bootstrap.cc:492] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:52.089924 17143 tablet_service.cc:1511] Processing CreateTablet for tablet f67d94cad84c4419a7f21c6c0b35c7cb (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:52.143318 17143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67d94cad84c4419a7f21c6c0b35c7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.091460 17223 tablet_service.cc:1511] Processing CreateTablet for tablet f67d94cad84c4419a7f21c6c0b35c7cb (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:52.147339 17223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67d94cad84c4419a7f21c6c0b35c7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.130914 17428 ts_tablet_manager.cc:1434] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.008s
I20260709 13:04:52.149812 17438 raft_consensus.cc:493] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.133353 17145 tablet_service.cc:1511] Processing CreateTablet for tablet c43cf64dce604011933dfed0af0fa571 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:52.150561 17435 raft_consensus.cc:493] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.150393 17438 raft_consensus.cc:515] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.151352 17145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43cf64dce604011933dfed0af0fa571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.151093 17435 raft_consensus.cc:515] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.152786 17438 leader_election.cc:290] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:52.157492 17430 tablet_bootstrap.cc:654] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.161319 17435 leader_election.cc:290] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:52.096053 17297 tablet_service.cc:1511] Processing CreateTablet for tablet 2d4c5c12c8844ad7877fca4c9d59dec6 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:52.167469 17297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4c5c12c8844ad7877fca4c9d59dec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.168967 17426 raft_consensus.cc:359] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.171090 17426 raft_consensus.cc:385] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.172869 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:52.173444 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:52.174456 17346 leader_election.cc:343] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.174993 17346 leader_election.cc:304] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:52.175964 17438 raft_consensus.cc:2749] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:52.176438 17346 leader_election.cc:343] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.173010 17426 raft_consensus.cc:740] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.178778 17426 consensus_queue.cc:260] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.180941 17426 ts_tablet_manager.cc:1434] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:04:52.181991 17426 tablet_bootstrap.cc:492] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:52.188894 17444 raft_consensus.cc:493] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.200963 17444 raft_consensus.cc:515] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.189186 17292 tablet_service.cc:1511] Processing CreateTablet for tablet c43cf64dce604011933dfed0af0fa571 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:52.203562 17292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43cf64dce604011933dfed0af0fa571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.212837 17444 leader_election.cc:290] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:52.213925 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:52.195001 17366 tablet_service.cc:1511] Processing CreateTablet for tablet 573c9ef51ca24504be6b34051b2a0607 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:52.215791 17366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573c9ef51ca24504be6b34051b2a0607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.195283 17221 tablet_service.cc:1511] Processing CreateTablet for tablet 573c9ef51ca24504be6b34051b2a0607 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:52.219419 17221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573c9ef51ca24504be6b34051b2a0607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.214677 17381 raft_consensus.cc:2468] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:52.221537 17270 leader_election.cc:304] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:52.222548 17444 raft_consensus.cc:2804] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.222994 17444 raft_consensus.cc:493] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.223389 17444 raft_consensus.cc:3060] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.194839 17427 ts_tablet_manager.cc:1403] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.183s	user 0.015s	sys 0.011s
I20260709 13:04:52.227340 17428 tablet_bootstrap.cc:492] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:52.232234 17430 tablet_bootstrap.cc:492] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:52.232873 17430 ts_tablet_manager.cc:1403] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.147s	user 0.005s	sys 0.009s
I20260709 13:04:52.234200 17145 tablet_service.cc:1511] Processing CreateTablet for tablet 573c9ef51ca24504be6b34051b2a0607 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:52.235500 17145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 573c9ef51ca24504be6b34051b2a0607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.235582 17291 tablet_service.cc:1511] Processing CreateTablet for tablet 968dc4dd3ad542808481bf0dad333ac7 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:52.236027 17430 raft_consensus.cc:359] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.252744 17426 tablet_bootstrap.cc:654] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.283070 17294 tablet_service.cc:1511] Processing CreateTablet for tablet 314a4e267fa44771932ef3f2482aa590 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:52.242220 17367 tablet_service.cc:1511] Processing CreateTablet for tablet 968dc4dd3ad542808481bf0dad333ac7 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:52.280782 17148 tablet_service.cc:1511] Processing CreateTablet for tablet 968dc4dd3ad542808481bf0dad333ac7 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:52.243201 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:52.270536 17433 raft_consensus.cc:493] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.289328 17367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968dc4dd3ad542808481bf0dad333ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.289479 17148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968dc4dd3ad542808481bf0dad333ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.286227 17444 raft_consensus.cc:515] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.290711 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:52.291352 17381 raft_consensus.cc:2468] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:52.253564 17221 tablet_service.cc:1511] Processing CreateTablet for tablet 314a4e267fa44771932ef3f2482aa590 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:52.293231 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:52.293643 17444 leader_election.cc:290] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:52.293823 17157 raft_consensus.cc:3060] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.289373 17433 raft_consensus.cc:515] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:52.236848 17430 raft_consensus.cc:385] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.295915 17430 raft_consensus.cc:740] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.296065 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:52.296629 17381 raft_consensus.cc:3060] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.297219 17368 tablet_service.cc:1511] Processing CreateTablet for tablet 314a4e267fa44771932ef3f2482aa590 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:52.296756 17430 consensus_queue.cc:260] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.298555 17368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314a4e267fa44771932ef3f2482aa590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.298302 17433 leader_election.cc:290] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:52.299796 17430 ts_tablet_manager.cc:1434] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:04:52.300776 17430 tablet_bootstrap.cc:492] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:52.300994 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b8248b5a4d4becb690235d23b259e4" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:52.236873 17291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968dc4dd3ad542808481bf0dad333ac7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:52.304216 17272 leader_election.cc:343] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.305940 17294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314a4e267fa44771932ef3f2482aa590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.293668 17221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 314a4e267fa44771932ef3f2482aa590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.320629 17157 raft_consensus.cc:2468] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:52.320937 17430 tablet_bootstrap.cc:654] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.247175 17427 raft_consensus.cc:359] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.332124 17427 raft_consensus.cc:385] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.332690 17427 raft_consensus.cc:740] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.333797 17427 consensus_queue.cc:260] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.335872 17220 tablet_service.cc:1511] Processing CreateTablet for tablet dacbd66665ce48a39ba07db89854bc1c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:52.331583 17435 raft_consensus.cc:493] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.337419 17435 raft_consensus.cc:515] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.339805 17435 leader_election.cc:290] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:52.341055 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacbd66665ce48a39ba07db89854bc1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.336798 17427 ts_tablet_manager.cc:1434] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.110s	user 0.000s	sys 0.011s
I20260709 13:04:52.330045 17121 leader_election.cc:304] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:52.352322 17297 tablet_service.cc:1511] Processing CreateTablet for tablet dacbd66665ce48a39ba07db89854bc1c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:52.353478 17448 raft_consensus.cc:493] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.353727 17297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacbd66665ce48a39ba07db89854bc1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.354046 17448 raft_consensus.cc:515] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.354331 17366 tablet_service.cc:1511] Processing CreateTablet for tablet 74ea231d707840749fc902bd3d111e34 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:52.355578 17366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ea231d707840749fc902bd3d111e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.357667 17448 leader_election.cc:290] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:52.359089 17438 raft_consensus.cc:493] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.359570 17438 raft_consensus.cc:515] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.361639 17438 leader_election.cc:290] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:52.329113 17381 raft_consensus.cc:2468] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:52.366657 17435 raft_consensus.cc:2764] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:52.377125 17271 leader_election.cc:304] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:52.366629 17448 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.378078 17433 raft_consensus.cc:2804] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.378620 17433 raft_consensus.cc:697] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:52.378327 17448 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:52.379607 17433 consensus_queue.cc:237] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.388306 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:52.384986 17435 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.388950 17426 tablet_bootstrap.cc:492] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:52.389509 17426 ts_tablet_manager.cc:1403] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.208s	user 0.009s	sys 0.025s
I20260709 13:04:52.389096 17435 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:52.390669 17427 tablet_bootstrap.cc:492] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:52.391857 17435 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
W20260709 13:04:52.392378 17346 leader_election.cc:343] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.392881 17346 leader_election.cc:304] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:52.392953 17426 raft_consensus.cc:359] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.382861 17448 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:52.394413 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b8248b5a4d4becb690235d23b259e4" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:52.394546 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21af78b15714161898e0f709c8a5834" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
W20260709 13:04:52.395851 17271 leader_election.cc:343] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.396333 17271 leader_election.cc:304] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:04:52.396370 17345 leader_election.cc:343] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.393877 17426 raft_consensus.cc:385] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.397176 17444 raft_consensus.cc:2749] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.397769 17438 raft_consensus.cc:2749] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.400507 17148 tablet_service.cc:1511] Processing CreateTablet for tablet dacbd66665ce48a39ba07db89854bc1c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:52.401823 17148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacbd66665ce48a39ba07db89854bc1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.397307 17426 raft_consensus.cc:740] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.404368 17426 consensus_queue.cc:260] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.406751 17426 ts_tablet_manager.cc:1434] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:52.407734 17426 tablet_bootstrap.cc:492] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:52.411484 17143 tablet_service.cc:1511] Processing CreateTablet for tablet 74ea231d707840749fc902bd3d111e34 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:52.413102 17143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ea231d707840749fc902bd3d111e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.413440 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:52.415481 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:52.416066 17232 raft_consensus.cc:2468] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:52.416790 17426 tablet_bootstrap.cc:654] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:52.418391 17123 leader_election.cc:343] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.419166 17123 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:52.420339 17428 tablet_bootstrap.cc:654] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.420015 17435 raft_consensus.cc:2804] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.420935 17435 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.421645 17435 raft_consensus.cc:3060] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.425063 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:52.425741 17381 raft_consensus.cc:2468] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:52.427052 17121 leader_election.cc:304] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:52.437091 17223 tablet_service.cc:1511] Processing CreateTablet for tablet 74ea231d707840749fc902bd3d111e34 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:52.437979 17294 tablet_service.cc:1511] Processing CreateTablet for tablet 12cc194559d445f4859ac3e1c764ff4a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:52.438982 17223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ea231d707840749fc902bd3d111e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.439308 17294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cc194559d445f4859ac3e1c764ff4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.439445 17430 tablet_bootstrap.cc:492] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:52.439966 17430 ts_tablet_manager.cc:1403] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.028s
I20260709 13:04:52.444579 17430 raft_consensus.cc:359] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.445281 17430 raft_consensus.cc:385] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.445562 17430 raft_consensus.cc:740] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.464772 17469 raft_consensus.cc:2804] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.465412 17469 raft_consensus.cc:493] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.465827 17469 raft_consensus.cc:3060] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.474460 17469 raft_consensus.cc:515] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.496662 17296 tablet_service.cc:1511] Processing CreateTablet for tablet d51f7c4d9c6e4ebb8b62960986f87768 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:52.498102 17296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51f7c4d9c6e4ebb8b62960986f87768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.515422 17468 raft_consensus.cc:493] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.515672 17142 tablet_service.cc:1511] Processing CreateTablet for tablet 12cc194559d445f4859ac3e1c764ff4a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:52.515990 17468 raft_consensus.cc:515] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.517033 17142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cc194559d445f4859ac3e1c764ff4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.517669 17468 leader_election.cc:290] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:52.518436 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:52.519268 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:52.519914 17232 raft_consensus.cc:2468] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:52.520351 17371 tablet_service.cc:1511] Processing CreateTablet for tablet d51f7c4d9c6e4ebb8b62960986f87768 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:52.520821 17368 tablet_service.cc:1511] Processing CreateTablet for tablet 12cc194559d445f4859ac3e1c764ff4a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:52.521646 17371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51f7c4d9c6e4ebb8b62960986f87768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.523335 17220 tablet_service.cc:1511] Processing CreateTablet for tablet d51f7c4d9c6e4ebb8b62960986f87768 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:52.524627 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51f7c4d9c6e4ebb8b62960986f87768. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:52.526001 17121 leader_election.cc:343] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.527691 17123 leader_election.cc:304] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d
I20260709 13:04:52.534587 17055 catalog_manager.cc:5697] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.488665 17430 consensus_queue.cc:260] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.537611 17430 ts_tablet_manager.cc:1434] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.000s
I20260709 13:04:52.539377 17430 tablet_bootstrap.cc:492] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:52.541944 17427 tablet_bootstrap.cc:654] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:52.548008 17103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:52.549707 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:52.550750 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:52.542353 17368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cc194559d445f4859ac3e1c764ff4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.534603 17435 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:52.563774 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21af78b15714161898e0f709c8a5834" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:52.564248 17435 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:52.565025 17158 raft_consensus.cc:2393] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:04:52.567616 17294 tablet_service.cc:1511] Processing CreateTablet for tablet 245dcb50741d45dca44ea02ed447057a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:52.568512 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:52.568997 17294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245dcb50741d45dca44ea02ed447057a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:52.571038 17346 leader_election.cc:343] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.571552 17346 leader_election.cc:304] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:52.572340 17438 raft_consensus.cc:2749] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:52.571702 17123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 44124.6us
I20260709 13:04:52.573413 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:52.574002 17223 tablet_service.cc:1511] Processing CreateTablet for tablet 245dcb50741d45dca44ea02ed447057a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:04:52.574980 17196 leader_election.cc:343] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.575338 17223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245dcb50741d45dca44ea02ed447057a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.575628 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:52.576191 17232 raft_consensus.cc:3060] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.583667 17232 raft_consensus.cc:2468] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:52.541733 17468 raft_consensus.cc:2804] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.585830 17468 raft_consensus.cc:493] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.586251 17468 raft_consensus.cc:3060] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.587194 17143 tablet_service.cc:1511] Processing CreateTablet for tablet 245dcb50741d45dca44ea02ed447057a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:52.587963 17469 leader_election.cc:290] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:52.588724 17143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245dcb50741d45dca44ea02ed447057a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.588621 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:52.589443 17381 raft_consensus.cc:3060] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:52.589916 17466 log.cc:927] Time spent T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c: Append to log took a long time: real 0.115s	user 0.001s	sys 0.003s
I20260709 13:04:52.593243 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:52.594545 17306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:52.596022 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:52.610189 17366 tablet_service.cc:1511] Processing CreateTablet for tablet 8b355c1a40d24e6387c364c6964fbb99 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:52.611531 17366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b355c1a40d24e6387c364c6964fbb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.614128 17221 tablet_service.cc:1511] Processing CreateTablet for tablet 8b355c1a40d24e6387c364c6964fbb99 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:52.614838 17430 tablet_bootstrap.cc:654] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.615643 17221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b355c1a40d24e6387c364c6964fbb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.619217 17426 tablet_bootstrap.cc:492] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
W20260709 13:04:52.616768 17198 leader_election.cc:343] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.631145 17426 ts_tablet_manager.cc:1403] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.224s	user 0.036s	sys 0.064s
I20260709 13:04:52.638300 17367 tablet_service.cc:1511] Processing CreateTablet for tablet c38fd5f3f7224fde8c02ed2f1e9de777 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:52.639719 17367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38fd5f3f7224fde8c02ed2f1e9de777. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:52.645151 17123 leader_election.cc:343] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:52.645964 17123 leader_election.cc:343] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.648406 17426 raft_consensus.cc:359] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:52.648854 17216 tablet_service.cc:1511] Processing CreateTablet for tablet 7d21695723a94f56863565fdec1d8600 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:52.649323 17426 raft_consensus.cc:385] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.649678 17426 raft_consensus.cc:740] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.643492 17198 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:52.650417 17216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d21695723a94f56863565fdec1d8600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.650926 17448 raft_consensus.cc:2749] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:52.651158 17198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 44252.4us
I20260709 13:04:52.652926 17297 tablet_service.cc:1511] Processing CreateTablet for tablet 7d21695723a94f56863565fdec1d8600 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:52.654337 17297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d21695723a94f56863565fdec1d8600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.657635 17381 raft_consensus.cc:2468] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:52.667109 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:52.669145 17428 tablet_bootstrap.cc:492] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:52.669682 17123 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:52.672554 17430 tablet_bootstrap.cc:492] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:52.672716 17471 raft_consensus.cc:2804] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.673369 17471 raft_consensus.cc:697] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:52.673508 17364 tablet_service.cc:1511] Processing CreateTablet for tablet 7d21695723a94f56863565fdec1d8600 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:52.674814 17364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d21695723a94f56863565fdec1d8600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.674543 17471 consensus_queue.cc:237] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:52.673383 17430 ts_tablet_manager.cc:1403] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.134s	user 0.007s	sys 0.013s
I20260709 13:04:52.669880 17427 tablet_bootstrap.cc:492] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:52.678951 17426 consensus_queue.cc:260] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:52.678993 17427 ts_tablet_manager.cc:1403] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.297s	user 0.011s	sys 0.014s
I20260709 13:04:52.668885 17296 tablet_service.cc:1511] Processing CreateTablet for tablet c38fd5f3f7224fde8c02ed2f1e9de777 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:52.669945 17428 ts_tablet_manager.cc:1403] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.443s	user 0.012s	sys 0.009s
I20260709 13:04:52.687713 17296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38fd5f3f7224fde8c02ed2f1e9de777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.671393 17468 raft_consensus.cc:515] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.691951 17157 raft_consensus.cc:2393] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:04:52.692173 17145 tablet_service.cc:1511] Processing CreateTablet for tablet c38fd5f3f7224fde8c02ed2f1e9de777 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:52.693657 17145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38fd5f3f7224fde8c02ed2f1e9de777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.694356 17121 leader_election.cc:304] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:52.695261 17469 raft_consensus.cc:2804] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.695725 17469 raft_consensus.cc:697] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:52.695796 17197 leader_election.cc:304] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:52.696906 17469 consensus_queue.cc:237] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.696921 17448 raft_consensus.cc:3060] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.703137 17427 raft_consensus.cc:359] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:52.703289 17363 tablet_service.cc:1511] Processing CreateTablet for tablet ddf498205a5942dd9c8ec8f97f6f8c67 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:52.704053 17427 raft_consensus.cc:385] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.704423 17427 raft_consensus.cc:740] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.704785 17363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddf498205a5942dd9c8ec8f97f6f8c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.704505 17222 tablet_service.cc:1511] Processing CreateTablet for tablet 85badce89ef744e995d4b4307b661464 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:52.705665 17427 consensus_queue.cc:260] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:52.706254 17292 tablet_service.cc:1511] Processing CreateTablet for tablet 85badce89ef744e995d4b4307b661464 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:52.710517 17430 raft_consensus.cc:359] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:52.711341 17430 raft_consensus.cc:385] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.711673 17430 raft_consensus.cc:740] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.714861 17448 raft_consensus.cc:2749] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.715895 17222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85badce89ef744e995d4b4307b661464. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:52.708169 17123 leader_election.cc:343] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.725025 17148 tablet_service.cc:1511] Processing CreateTablet for tablet 85badce89ef744e995d4b4307b661464 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:52.726517 17148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85badce89ef744e995d4b4307b661464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.727370 17146 tablet_service.cc:1511] Processing CreateTablet for tablet ddf498205a5942dd9c8ec8f97f6f8c67 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:52.728819 17146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddf498205a5942dd9c8ec8f97f6f8c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.729684 17291 tablet_service.cc:1511] Processing CreateTablet for tablet b04afb5955d549318f7fe723b79f1d3b (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:52.731046 17291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04afb5955d549318f7fe723b79f1d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.732366 17292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85badce89ef744e995d4b4307b661464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.734838 17223 tablet_service.cc:1511] Processing CreateTablet for tablet ddf498205a5942dd9c8ec8f97f6f8c67 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:52.737605 17371 tablet_service.cc:1511] Processing CreateTablet for tablet b04afb5955d549318f7fe723b79f1d3b (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:52.739289 17371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04afb5955d549318f7fe723b79f1d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.740664 17428 raft_consensus.cc:359] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:52.741566 17428 raft_consensus.cc:385] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.741678 17223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddf498205a5942dd9c8ec8f97f6f8c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.741940 17428 raft_consensus.cc:740] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.742807 17428 consensus_queue.cc:260] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:52.745401 17428 ts_tablet_manager.cc:1434] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.000s
I20260709 13:04:52.754379 17426 ts_tablet_manager.cc:1434] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.000s
I20260709 13:04:52.755612 17426 tablet_bootstrap.cc:492] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:52.755069 17141 tablet_service.cc:1511] Processing CreateTablet for tablet b04afb5955d549318f7fe723b79f1d3b (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:52.756711 17448 raft_consensus.cc:493] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.757284 17448 raft_consensus.cc:515] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.756754 17141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04afb5955d549318f7fe723b79f1d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.758644 17468 leader_election.cc:290] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:52.760345 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:52.760354 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
W20260709 13:04:52.762902 17121 leader_election.cc:343] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.761850 17448 leader_election.cc:290] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
W20260709 13:04:52.763031 17198 leader_election.cc:343] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.763242 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:52.764103 17381 raft_consensus.cc:2468] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:52.763934 17430 consensus_queue.cc:260] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:52.768622 17428 tablet_bootstrap.cc:492] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:52.769524 17142 tablet_service.cc:1511] Processing CreateTablet for tablet 8b355c1a40d24e6387c364c6964fbb99 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:52.770968 17142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b355c1a40d24e6387c364c6964fbb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.771818 17430 ts_tablet_manager.cc:1434] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.095s	user 0.003s	sys 0.003s
I20260709 13:04:52.773119 17430 tablet_bootstrap.cc:492] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:52.776294 17428 tablet_bootstrap.cc:654] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.776686 17196 leader_election.cc:304] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:52.779659 17448 raft_consensus.cc:2804] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.780066 17448 raft_consensus.cc:493] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.780412 17448 raft_consensus.cc:3060] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.787868 17438 raft_consensus.cc:493] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.788458 17438 raft_consensus.cc:515] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:52.794524 17448 raft_consensus.cc:515] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.806589 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079278fbd6474dea98fac1aaa536bb7c" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:52.809865 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:52.816351 17297 tablet_service.cc:1511] Processing CreateTablet for tablet ccf8ff673def486c94896905e592b78f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:52.817721 17297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf8ff673def486c94896905e592b78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.796527 17438 leader_election.cc:290] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:52.819424 17427 ts_tablet_manager.cc:1434] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.137s	user 0.007s	sys 0.001s
I20260709 13:04:52.820538 17427 tablet_bootstrap.cc:492] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:52.820097 17216 tablet_service.cc:1511] Processing CreateTablet for tablet ccf8ff673def486c94896905e592b78f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:52.821570 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079278fbd6474dea98fac1aaa536bb7c" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
W20260709 13:04:52.823055 17345 leader_election.cc:343] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.827275 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:52.829082 17426 tablet_bootstrap.cc:654] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.829353 17433 raft_consensus.cc:493] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.829898 17433 raft_consensus.cc:515] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:52.832217 17433 leader_election.cc:290] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:52.822005 17216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf8ff673def486c94896905e592b78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.834156 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f3dec424f482bbb969fb08e7d5509" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:52.835762 17272 leader_election.cc:343] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:52.836726 17346 leader_election.cc:343] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.837531 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f3dec424f482bbb969fb08e7d5509" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:52.837226 17346 leader_election.cc:304] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:04:52.839206 17270 leader_election.cc:343] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.839680 17270 leader_election.cc:304] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
W20260709 13:04:52.840795 17198 leader_election.cc:343] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.841043 17448 leader_election.cc:290] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:52.842293 17438 raft_consensus.cc:2749] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.843200 17433 raft_consensus.cc:2749] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.846266 17232 raft_consensus.cc:2468] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:52.847468 17123 leader_election.cc:304] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d
I20260709 13:04:52.848652 17469 raft_consensus.cc:2804] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.849217 17469 raft_consensus.cc:697] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:52.850083 17469 consensus_queue.cc:237] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:52.856386 17427 tablet_bootstrap.cc:654] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.877547 17054 catalog_manager.cc:5697] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.879074 17364 tablet_service.cc:1511] Processing CreateTablet for tablet ccf8ff673def486c94896905e592b78f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:52.888813 17364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf8ff673def486c94896905e592b78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.892647 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:52.896905 17381 raft_consensus.cc:3060] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.893808 17222 tablet_service.cc:1511] Processing CreateTablet for tablet 6f1b381c59ed4f258e1b8e6e37096abc (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:52.923440 17142 tablet_service.cc:1511] Processing CreateTablet for tablet 6f1b381c59ed4f258e1b8e6e37096abc (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:52.924877 17142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f1b381c59ed4f258e1b8e6e37096abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.925992 17428 tablet_bootstrap.cc:492] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:52.926537 17428 ts_tablet_manager.cc:1403] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.158s	user 0.016s	sys 0.008s
I20260709 13:04:52.927464 17371 tablet_service.cc:1511] Processing CreateTablet for tablet 69e81dc6421d4fdf8dcff43b8a449587 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:52.936358 17371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e81dc6421d4fdf8dcff43b8a449587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.943450 17294 tablet_service.cc:1511] Processing CreateTablet for tablet 6f1b381c59ed4f258e1b8e6e37096abc (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:52.945398 17294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f1b381c59ed4f258e1b8e6e37096abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.927795 17222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f1b381c59ed4f258e1b8e6e37096abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.953907 17426 tablet_bootstrap.cc:492] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:52.955106 17426 ts_tablet_manager.cc:1403] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.200s	user 0.012s	sys 0.014s
I20260709 13:04:52.957558 17430 tablet_bootstrap.cc:654] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.960093 17428 raft_consensus.cc:359] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:52.960680 17428 raft_consensus.cc:385] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.960883 17428 raft_consensus.cc:740] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.961544 17428 consensus_queue.cc:260] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:52.968962 17428 ts_tablet_manager.cc:1434] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 13:04:52.970206 17428 tablet_bootstrap.cc:492] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
W20260709 13:04:52.978734 17482 log.cc:927] Time spent T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:04:52.982244 17433 consensus_queue.cc:1048] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.983718 17367 tablet_service.cc:1511] Processing CreateTablet for tablet b54b1ed764894db8bb28922faa095abf (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:52.982532 17381 raft_consensus.cc:2468] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:52.985054 17367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54b1ed764894db8bb28922faa095abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.987468 17196 leader_election.cc:304] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:52.987926 17141 tablet_service.cc:1511] Processing CreateTablet for tablet b54b1ed764894db8bb28922faa095abf (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:52.988252 17448 raft_consensus.cc:2804] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.989347 17141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54b1ed764894db8bb28922faa095abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.991262 17427 tablet_bootstrap.cc:492] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:52.991801 17427 ts_tablet_manager.cc:1403] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.171s	user 0.022s	sys 0.021s
I20260709 13:04:52.991721 17223 tablet_service.cc:1511] Processing CreateTablet for tablet 69e81dc6421d4fdf8dcff43b8a449587 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:52.993712 17223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e81dc6421d4fdf8dcff43b8a449587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.997152 17366 tablet_service.cc:1511] Processing CreateTablet for tablet 611590896f024a4a8f1ee24e522dbd0a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:52.998780 17366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611590896f024a4a8f1ee24e522dbd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.002872 17430 tablet_bootstrap.cc:492] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:53.002789 17148 tablet_service.cc:1511] Processing CreateTablet for tablet 69e81dc6421d4fdf8dcff43b8a449587 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:53.003545 17430 ts_tablet_manager.cc:1403] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.231s	user 0.012s	sys 0.005s
I20260709 13:04:53.004179 17148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e81dc6421d4fdf8dcff43b8a449587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.003978 17433 consensus_queue.cc:1048] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.008589 17220 tablet_service.cc:1511] Processing CreateTablet for tablet 611590896f024a4a8f1ee24e522dbd0a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:53.008841 17297 tablet_service.cc:1511] Processing CreateTablet for tablet 611590896f024a4a8f1ee24e522dbd0a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:53.010293 17297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611590896f024a4a8f1ee24e522dbd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.019052 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611590896f024a4a8f1ee24e522dbd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.035197 17292 tablet_service.cc:1511] Processing CreateTablet for tablet b54b1ed764894db8bb28922faa095abf (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:53.040544 17055 catalog_manager.cc:5697] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.043188 17292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54b1ed764894db8bb28922faa095abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.044461 17142 tablet_service.cc:1511] Processing CreateTablet for tablet bbdd6a649a514be4a7e5dd077219ffed (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:53.043460 17055 catalog_manager.cc:5697] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.045809 17142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbdd6a649a514be4a7e5dd077219ffed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.055467 17427 raft_consensus.cc:359] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:53.056430 17427 raft_consensus.cc:385] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.056126 17430 raft_consensus.cc:359] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.056727 17427 raft_consensus.cc:740] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.056880 17430 raft_consensus.cc:385] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.057408 17430 raft_consensus.cc:740] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.058176 17430 consensus_queue.cc:260] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.057684 17427 consensus_queue.cc:260] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:53.062638 17216 tablet_service.cc:1511] Processing CreateTablet for tablet bbdd6a649a514be4a7e5dd077219ffed (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:53.067011 17426 raft_consensus.cc:359] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.067757 17426 raft_consensus.cc:385] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.068045 17426 raft_consensus.cc:740] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.070480 17428 tablet_bootstrap.cc:654] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.064030 17216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbdd6a649a514be4a7e5dd077219ffed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.083976 17427 ts_tablet_manager.cc:1434] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.003s
I20260709 13:04:53.087352 17427 tablet_bootstrap.cc:492] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:53.088799 17367 tablet_service.cc:1511] Processing CreateTablet for tablet 1d30a413a6924c3ea6027b6d3b4adc86 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:53.090142 17367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d30a413a6924c3ea6027b6d3b4adc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.094722 17427 tablet_bootstrap.cc:654] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.100117 17487 raft_consensus.cc:493] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.100765 17487 raft_consensus.cc:515] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.103422 17487 leader_election.cc:290] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:53.105005 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7341a74f344c90b6c0f9ff657621d5" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:53.105342 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7341a74f344c90b6c0f9ff657621d5" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:53.106052 17307 raft_consensus.cc:2468] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:53.107008 17146 tablet_service.cc:1511] Processing CreateTablet for tablet 1d30a413a6924c3ea6027b6d3b4adc86 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:53.107751 17198 leader_election.cc:304] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:53.108321 17146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d30a413a6924c3ea6027b6d3b4adc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.109418 17297 tablet_service.cc:1511] Processing CreateTablet for tablet bbdd6a649a514be4a7e5dd077219ffed (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:04:53.110882 17197 leader_election.cc:343] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.111586 17297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbdd6a649a514be4a7e5dd077219ffed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.124513 17471 raft_consensus.cc:493] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.125946 17471 raft_consensus.cc:515] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:53.118582 17487 raft_consensus.cc:2804] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.163290 17487 raft_consensus.cc:493] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.142894 17468 consensus_queue.cc:1048] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.131585 17471 leader_election.cc:290] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:53.149591 17296 tablet_service.cc:1511] Processing CreateTablet for tablet 6f853b6d09494a16a5ae6cc1110d7f3f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:53.155565 17433 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.160342 17364 tablet_service.cc:1511] Processing CreateTablet for tablet 6f853b6d09494a16a5ae6cc1110d7f3f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:53.193011 17364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f853b6d09494a16a5ae6cc1110d7f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.161900 17220 tablet_service.cc:1511] Processing CreateTablet for tablet 1d30a413a6924c3ea6027b6d3b4adc86 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:53.082260 17426 consensus_queue.cc:260] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.198702 17433 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.199252 17426 ts_tablet_manager.cc:1434] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.244s	user 0.006s	sys 0.002s
I20260709 13:04:53.200304 17426 tablet_bootstrap.cc:492] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:53.200879 17433 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:53.201584 17469 raft_consensus.cc:493] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.139344 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:53.202093 17469 raft_consensus.cc:515] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.114244 17448 raft_consensus.cc:697] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:04:53.203361 17448 consensus_queue.cc:237] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:53.204538 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d30a413a6924c3ea6027b6d3b4adc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.175897 17141 tablet_service.cc:1511] Processing CreateTablet for tablet 6f853b6d09494a16a5ae6cc1110d7f3f (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 13:04:53.189119 17270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 76336.3us
I20260709 13:04:53.190860 17494 raft_consensus.cc:493] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.202361 17380 raft_consensus.cc:2468] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:53.165393 17430 ts_tablet_manager.cc:1434] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.162s	user 0.010s	sys 0.018s
I20260709 13:04:53.203570 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:53.188897 17428 tablet_bootstrap.cc:492] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:53.185606 17487 raft_consensus.cc:3060] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.248503 17427 tablet_bootstrap.cc:492] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:53.249063 17427 ts_tablet_manager.cc:1403] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.164s	user 0.007s	sys 0.004s
I20260709 13:04:53.252828 17426 tablet_bootstrap.cc:654] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.220778 17305 raft_consensus.cc:3060] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.215641 17430 tablet_bootstrap.cc:492] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:53.222288 17296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f853b6d09494a16a5ae6cc1110d7f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.231252 17428 ts_tablet_manager.cc:1403] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.261s	user 0.009s	sys 0.007s
I20260709 13:04:53.218803 17141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f853b6d09494a16a5ae6cc1110d7f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.260202 17427 raft_consensus.cc:359] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.265365 17427 raft_consensus.cc:385] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.265770 17427 raft_consensus.cc:740] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.220427 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:53.217496 17216 tablet_service.cc:1511] Processing CreateTablet for tablet b7cac27834104ce3980fe87e7e6e00ec (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:53.272998 17216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cac27834104ce3980fe87e7e6e00ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.276800 17428 raft_consensus.cc:359] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.277631 17428 raft_consensus.cc:385] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.278417 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:53.278434 17123 consensus_peers.cc:597] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:53.290144 17307 raft_consensus.cc:2468] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:53.293167 17054 catalog_manager.cc:5697] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 1 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.295003 17469 leader_election.cc:290] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:53.277989 17428 raft_consensus.cc:740] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.298416 17428 consensus_queue.cc:260] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.299893 17367 tablet_service.cc:1511] Processing CreateTablet for tablet b7cac27834104ce3980fe87e7e6e00ec (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:53.301182 17367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cac27834104ce3980fe87e7e6e00ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.302417 17294 tablet_service.cc:1511] Processing CreateTablet for tablet b7cac27834104ce3980fe87e7e6e00ec (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:53.303699 17294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cac27834104ce3980fe87e7e6e00ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.312350 17428 ts_tablet_manager.cc:1434] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:04:53.313431 17428 tablet_bootstrap.cc:492] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:53.316113 17427 consensus_queue.cc:260] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.229060 17494 raft_consensus.cc:515] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:53.324561 17428 tablet_bootstrap.cc:654] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.326051 17427 ts_tablet_manager.cc:1434] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:04:53.218866 17121 leader_election.cc:304] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:53.332732 17427 tablet_bootstrap.cc:492] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:53.338444 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b6348ed73e48b2a0efba1da6d17c66" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:53.340829 17468 raft_consensus.cc:2804] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.349784 17427 tablet_bootstrap.cc:654] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.352419 17220 tablet_service.cc:1511] Processing CreateTablet for tablet 0650da7040f44f1ea1d37f44e9e5900a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:53.340015 17469 consensus_queue.cc:1048] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:04:53.341275 17468 raft_consensus.cc:493] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.367786 17468 raft_consensus.cc:3060] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.363168 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b6348ed73e48b2a0efba1da6d17c66" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:53.340195 17494 leader_election.cc:290] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
W20260709 13:04:53.355551 17121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 136769us
W20260709 13:04:53.355948 17123 leader_election.cc:343] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.367779 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079278fbd6474dea98fac1aaa536bb7c" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:53.371883 17438 raft_consensus.cc:493] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.372012 17380 raft_consensus.cc:2468] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:53.365247 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0650da7040f44f1ea1d37f44e9e5900a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.372642 17438 raft_consensus.cc:515] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.374809 17270 leader_election.cc:304] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:53.376669 17493 raft_consensus.cc:2804] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.377071 17271 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:53.377911 17433 raft_consensus.cc:2749] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:53.372225 17123 leader_election.cc:343] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.366699 17294 tablet_service.cc:1511] Processing CreateTablet for tablet 0650da7040f44f1ea1d37f44e9e5900a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:53.377187 17493 raft_consensus.cc:493] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.358676 17371 tablet_service.cc:1511] Processing CreateTablet for tablet 86b2a5e865cd45b0a86c5a59f00e57a1 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:53.379678 17294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0650da7040f44f1ea1d37f44e9e5900a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.385229 17371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b2a5e865cd45b0a86c5a59f00e57a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.386317 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079278fbd6474dea98fac1aaa536bb7c" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:53.382217 17123 leader_election.cc:304] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:53.389396 17435 raft_consensus.cc:2749] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.392575 17222 tablet_service.cc:1511] Processing CreateTablet for tablet 86b2a5e865cd45b0a86c5a59f00e57a1 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:53.382215 17493 raft_consensus.cc:3060] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.394513 17222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b2a5e865cd45b0a86c5a59f00e57a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.397949 17435 consensus_queue.cc:1048] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:53.399478 17271 leader_election.cc:343] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.392871 17146 tablet_service.cc:1511] Processing CreateTablet for tablet 86b2a5e865cd45b0a86c5a59f00e57a1 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:53.406008 17146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b2a5e865cd45b0a86c5a59f00e57a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.360603 17148 tablet_service.cc:1511] Processing CreateTablet for tablet 0650da7040f44f1ea1d37f44e9e5900a (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:53.418838 17438 leader_election.cc:290] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:53.419587 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:53.420058 17148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0650da7040f44f1ea1d37f44e9e5900a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.424239 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:53.430164 17346 leader_election.cc:304] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:53.430987 17469 consensus_queue.cc:1048] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.431370 17438 raft_consensus.cc:2749] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:53.432838 17426 tablet_bootstrap.cc:492] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:53.433358 17426 ts_tablet_manager.cc:1403] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.233s	user 0.019s	sys 0.018s
I20260709 13:04:53.434880 17292 tablet_service.cc:1511] Processing CreateTablet for tablet b0f611e5491b4876b5239b70747dc109 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:53.436472 17292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f611e5491b4876b5239b70747dc109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.436416 17426 raft_consensus.cc:359] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.436918 17141 tablet_service.cc:1511] Processing CreateTablet for tablet b0f611e5491b4876b5239b70747dc109 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:53.437291 17426 raft_consensus.cc:385] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.437688 17426 raft_consensus.cc:740] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.438510 17426 consensus_queue.cc:260] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.439429 17141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f611e5491b4876b5239b70747dc109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.440582 17367 tablet_service.cc:1511] Processing CreateTablet for tablet b0f611e5491b4876b5239b70747dc109 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:53.441847 17367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f611e5491b4876b5239b70747dc109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.441670 17487 raft_consensus.cc:515] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.444258 17487 leader_election.cc:290] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:53.444897 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7341a74f344c90b6c0f9ff657621d5" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:53.445601 17468 raft_consensus.cc:515] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:04:53.446281 17197 leader_election.cc:343] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.446069 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7341a74f344c90b6c0f9ff657621d5" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:53.447086 17307 raft_consensus.cc:3060] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.447973 17468 leader_election.cc:290] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:53.449031 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:53.449599 17381 raft_consensus.cc:3060] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.455574 17306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:53.456389 17306 raft_consensus.cc:3060] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.459087 17430 tablet_bootstrap.cc:654] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.422638 17493 raft_consensus.cc:515] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:53.463927 17487 raft_consensus.cc:493] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.488512 17220 tablet_service.cc:1511] Processing CreateTablet for tablet fcfa6b6de693472bbeaab44d7af92532 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:53.490326 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcfa6b6de693472bbeaab44d7af92532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.474481 17487 raft_consensus.cc:515] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.490381 17381 raft_consensus.cc:2468] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:53.501318 17426 ts_tablet_manager.cc:1434] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:04:53.503662 17426 tablet_bootstrap.cc:492] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:53.500396 17142 tablet_service.cc:1511] Processing CreateTablet for tablet 7b39f71b242b42f986fa68287bf62ba8 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:53.505743 17379 raft_consensus.cc:3060] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.507624 17143 tablet_service.cc:1511] Processing CreateTablet for tablet 43f244e037b7426793547977135a3e68 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:53.509074 17493 leader_election.cc:290] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:53.509444 17223 tablet_service.cc:1511] Processing CreateTablet for tablet 7b39f71b242b42f986fa68287bf62ba8 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:53.510903 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079278fbd6474dea98fac1aaa536bb7c" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:53.511557 17378 raft_consensus.cc:3060] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.514603 17142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b39f71b242b42f986fa68287bf62ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.515448 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079278fbd6474dea98fac1aaa536bb7c" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:53.515398 17366 tablet_service.cc:1511] Processing CreateTablet for tablet 43f244e037b7426793547977135a3e68 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:53.516922 17366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f244e037b7426793547977135a3e68. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:53.517081 17271 leader_election.cc:343] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.518090 17296 tablet_service.cc:1511] Processing CreateTablet for tablet fcfa6b6de693472bbeaab44d7af92532 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:53.510931 17223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b39f71b242b42f986fa68287bf62ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.519451 17296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcfa6b6de693472bbeaab44d7af92532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.496026 17364 tablet_service.cc:1511] Processing CreateTablet for tablet fcfa6b6de693472bbeaab44d7af92532 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:53.522656 17121 leader_election.cc:304] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:53.523947 17143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f244e037b7426793547977135a3e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.525061 17468 raft_consensus.cc:2804] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.522701 17364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcfa6b6de693472bbeaab44d7af92532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.525816 17468 raft_consensus.cc:697] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:53.526830 17468 consensus_queue.cc:237] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:53.533725 17428 tablet_bootstrap.cc:492] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:53.534667 17428 ts_tablet_manager.cc:1403] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.221s	user 0.029s	sys 0.057s
I20260709 13:04:53.534550 17307 raft_consensus.cc:2468] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:53.539569 17426 tablet_bootstrap.cc:654] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.540199 17198 leader_election.cc:304] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:53.541869 17448 raft_consensus.cc:2804] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.542564 17448 raft_consensus.cc:697] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:04:53.543535 17448 consensus_queue.cc:237] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.550586 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b8248b5a4d4becb690235d23b259e4" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:53.551430 17157 raft_consensus.cc:2468] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:53.552654 17197 leader_election.cc:304] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:53.553647 17490 raft_consensus.cc:2804] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.554008 17490 raft_consensus.cc:493] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.554314 17490 raft_consensus.cc:3060] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.560406 17428 raft_consensus.cc:359] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.561295 17428 raft_consensus.cc:385] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.561590 17428 raft_consensus.cc:740] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.561786 17490 raft_consensus.cc:515] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.564217 17487 leader_election.cc:290] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:53.564662 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b8248b5a4d4becb690235d23b259e4" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:53.565310 17157 raft_consensus.cc:3060] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:53.569118 17042 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 66788.7us
I20260709 13:04:53.569304 17306 raft_consensus.cc:2468] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:53.571784 17221 tablet_service.cc:1511] Processing CreateTablet for tablet 43f244e037b7426793547977135a3e68 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:53.572160 17297 tablet_service.cc:1511] Processing CreateTablet for tablet 9c29266dacd348e593e9ece686e2e4e6 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:04:53.572755 17103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:53.573171 17221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f244e037b7426793547977135a3e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.573297 17297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c29266dacd348e593e9ece686e2e4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.579869 17145 tablet_service.cc:1511] Processing CreateTablet for tablet 9c29266dacd348e593e9ece686e2e4e6 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:53.581121 17145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c29266dacd348e593e9ece686e2e4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.584690 17363 tablet_service.cc:1511] Processing CreateTablet for tablet 9c29266dacd348e593e9ece686e2e4e6 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:53.585992 17363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c29266dacd348e593e9ece686e2e4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.590587 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b8248b5a4d4becb690235d23b259e4" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:53.591537 17307 raft_consensus.cc:2468] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:53.592900 17471 consensus_queue.cc:1048] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:53.596370 17368 tablet_service.cc:1511] Processing CreateTablet for tablet ae1031f0c4bc4e48be05d8012957b6ac (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:53.597687 17368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1031f0c4bc4e48be05d8012957b6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.601542 17294 tablet_service.cc:1511] Processing CreateTablet for tablet 7b39f71b242b42f986fa68287bf62ba8 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:53.610262 17291 tablet_service.cc:1511] Processing CreateTablet for tablet ae1031f0c4bc4e48be05d8012957b6ac (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:53.606506 17294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b39f71b242b42f986fa68287bf62ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.600560 17428 consensus_queue.cc:260] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.635284 17291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1031f0c4bc4e48be05d8012957b6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.645972 17148 tablet_service.cc:1511] Processing CreateTablet for tablet fb81c4e8cd7b4230ac749fa80efc56c5 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:53.651568 17490 leader_election.cc:290] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:53.653672 17222 tablet_service.cc:1511] Processing CreateTablet for tablet ae1031f0c4bc4e48be05d8012957b6ac (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:53.662187 17428 ts_tablet_manager.cc:1434] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.127s	user 0.010s	sys 0.000s
I20260709 13:04:53.662820 17427 tablet_bootstrap.cc:492] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:53.664438 17427 ts_tablet_manager.cc:1403] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.336s	user 0.017s	sys 0.002s
I20260709 13:04:53.664757 17426 tablet_bootstrap.cc:492] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:53.668151 17493 raft_consensus.cc:493] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.663820 17428 tablet_bootstrap.cc:492] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:53.669117 17493 raft_consensus.cc:515] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.670723 17426 ts_tablet_manager.cc:1403] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.022s
I20260709 13:04:53.672519 17493 leader_election.cc:290] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:53.672837 17378 raft_consensus.cc:2468] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:53.674628 17270 leader_election.cc:304] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:53.676030 17493 raft_consensus.cc:2804] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.676759 17493 raft_consensus.cc:697] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:53.678341 17295 tablet_service.cc:1511] Processing CreateTablet for tablet fb81c4e8cd7b4230ac749fa80efc56c5 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:53.679697 17295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb81c4e8cd7b4230ac749fa80efc56c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.678738 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9664e129106a424cb0418e3713b1e1fb" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:53.686173 17157 raft_consensus.cc:2468] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:53.686796 17380 raft_consensus.cc:2468] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:53.687875 17490 consensus_queue.cc:1048] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:53.688750 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b8248b5a4d4becb690235d23b259e4" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:53.689357 17305 raft_consensus.cc:3060] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:53.690286 17040 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 59643.5us
I20260709 13:04:53.692652 17371 tablet_service.cc:1511] Processing CreateTablet for tablet f0ddeea989c64b70a533198455dc0b6c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:53.693872 17371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ddeea989c64b70a533198455dc0b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.695582 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9664e129106a424cb0418e3713b1e1fb" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:53.696089 17426 raft_consensus.cc:359] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.696760 17426 raft_consensus.cc:385] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:53.697089 17272 leader_election.cc:343] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:53.696973 17366 tablet_service.cc:1511] Processing CreateTablet for tablet e8692f804ad346579cc888efbc5c2bae (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:53.698387 17366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8692f804ad346579cc888efbc5c2bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.700589 17222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1031f0c4bc4e48be05d8012957b6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.703027 17216 tablet_service.cc:1511] Processing CreateTablet for tablet f0ddeea989c64b70a533198455dc0b6c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:53.704761 17216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ddeea989c64b70a533198455dc0b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.706462 17148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb81c4e8cd7b4230ac749fa80efc56c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.706889 17293 tablet_service.cc:1511] Processing CreateTablet for tablet e8692f804ad346579cc888efbc5c2bae (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:53.708071 17293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8692f804ad346579cc888efbc5c2bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.710170 17305 raft_consensus.cc:2468] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:53.711577 17198 leader_election.cc:304] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:53.712353 17490 raft_consensus.cc:2804] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.712852 17490 raft_consensus.cc:697] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:04:53.713182 17270 leader_election.cc:304] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:53.713670 17490 consensus_queue.cc:237] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.714536 17492 raft_consensus.cc:2804] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.714928 17492 raft_consensus.cc:493] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.715247 17492 raft_consensus.cc:3060] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.722393 17492 raft_consensus.cc:515] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.697014 17426 raft_consensus.cc:740] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.677634 17493 consensus_queue.cc:237] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:53.685844 17220 tablet_service.cc:1511] Processing CreateTablet for tablet fb81c4e8cd7b4230ac749fa80efc56c5 (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:53.733590 17220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb81c4e8cd7b4230ac749fa80efc56c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.751063 17426 consensus_queue.cc:260] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.764416 17427 raft_consensus.cc:359] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:53.778802 17427 raft_consensus.cc:385] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.779126 17427 raft_consensus.cc:740] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.780817 17427 consensus_queue.cc:260] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:53.782994 17426 ts_tablet_manager.cc:1434] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.000s
I20260709 13:04:53.793766 17142 tablet_service.cc:1511] Processing CreateTablet for tablet e8692f804ad346579cc888efbc5c2bae (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:53.795001 17142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8692f804ad346579cc888efbc5c2bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.776307 17053 catalog_manager.cc:5697] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:53.799422 17492 leader_election.cc:290] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:53.801190 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9664e129106a424cb0418e3713b1e1fb" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:53.803740 17427 ts_tablet_manager.cc:1434] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.135s	user 0.005s	sys 0.003s
I20260709 13:04:53.806797 17427 tablet_bootstrap.cc:492] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:53.810865 17141 tablet_service.cc:1511] Processing CreateTablet for tablet f0ddeea989c64b70a533198455dc0b6c (DEFAULT_TABLE table=test-workload [id=eef442e809814b078d75295aeab62d9f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:53.812206 17141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ddeea989c64b70a533198455dc0b6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:53.809801 17272 leader_election.cc:343] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:53.817133 17198 consensus_peers.cc:597] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:53.820884 17426 tablet_bootstrap.cc:492] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:53.816476 17054 catalog_manager.cc:5697] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 1 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.847963 17430 tablet_bootstrap.cc:492] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:53.848543 17430 ts_tablet_manager.cc:1403] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.633s	user 0.044s	sys 0.083s
I20260709 13:04:53.803587 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9664e129106a424cb0418e3713b1e1fb" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:53.850692 17380 raft_consensus.cc:3060] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.870554 17428 tablet_bootstrap.cc:654] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.880417 17430 raft_consensus.cc:359] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.881541 17430 raft_consensus.cc:385] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.883780 17430 raft_consensus.cc:740] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.887449 17430 consensus_queue.cc:260] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.891558 17427 tablet_bootstrap.cc:654] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.897416 17426 tablet_bootstrap.cc:654] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.899221 17430 ts_tablet_manager.cc:1434] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.002s
I20260709 13:04:53.902631 17430 tablet_bootstrap.cc:492] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:53.908473 17380 raft_consensus.cc:2468] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:53.910328 17270 leader_election.cc:304] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:53.913885 17493 raft_consensus.cc:2804] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.914654 17493 raft_consensus.cc:697] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:53.915700 17493 consensus_queue.cc:237] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.921990 17427 tablet_bootstrap.cc:492] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:53.922698 17427 ts_tablet_manager.cc:1403] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.005s
I20260709 13:04:53.926200 17427 raft_consensus.cc:359] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.927085 17427 raft_consensus.cc:385] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.927410 17427 raft_consensus.cc:740] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.928225 17427 consensus_queue.cc:260] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:53.929741 17471 consensus_queue.cc:1048] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.932231 17427 ts_tablet_manager.cc:1434] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:04:53.933595 17427 tablet_bootstrap.cc:492] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:53.939983 17430 tablet_bootstrap.cc:654] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.940585 17428 tablet_bootstrap.cc:492] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:53.941123 17428 ts_tablet_manager.cc:1403] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.277s	user 0.028s	sys 0.012s
I20260709 13:04:53.946931 17428 raft_consensus.cc:359] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:53.947594 17428 raft_consensus.cc:385] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.947855 17428 raft_consensus.cc:740] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.948540 17428 consensus_queue.cc:260] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:53.952353 17426 tablet_bootstrap.cc:492] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:53.953060 17426 ts_tablet_manager.cc:1403] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.132s	user 0.007s	sys 0.009s
I20260709 13:04:53.953109 17428 ts_tablet_manager.cc:1434] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:53.955292 17428 tablet_bootstrap.cc:492] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:53.957013 17426 raft_consensus.cc:359] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.957995 17426 raft_consensus.cc:385] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.958602 17427 tablet_bootstrap.cc:654] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.962561 17428 tablet_bootstrap.cc:654] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.963008 17426 raft_consensus.cc:740] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.962661 17056 catalog_manager.cc:5697] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.964079 17426 consensus_queue.cc:260] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.966717 17426 ts_tablet_manager.cc:1434] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:04:53.967749 17426 tablet_bootstrap.cc:492] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:53.969272 17053 catalog_manager.cc:5697] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 1 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.971266 17427 tablet_bootstrap.cc:492] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:53.971673 17428 tablet_bootstrap.cc:492] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:53.971752 17427 ts_tablet_manager.cc:1403] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
I20260709 13:04:53.972368 17428 ts_tablet_manager.cc:1403] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:04:53.974825 17427 raft_consensus.cc:359] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:53.975539 17427 raft_consensus.cc:385] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.975128 17428 raft_consensus.cc:359] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.975831 17427 raft_consensus.cc:740] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.976084 17428 raft_consensus.cc:385] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.976522 17428 raft_consensus.cc:740] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.976703 17427 consensus_queue.cc:260] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:53.977242 17428 consensus_queue.cc:260] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:53.979230 17427 ts_tablet_manager.cc:1434] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:53.980160 17427 tablet_bootstrap.cc:492] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:53.981765 17469 consensus_queue.cc:1048] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.984529 17428 ts_tablet_manager.cc:1434] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:04:53.985548 17428 tablet_bootstrap.cc:492] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:53.986963 17427 tablet_bootstrap.cc:654] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.992240 17428 tablet_bootstrap.cc:654] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.992377 17426 tablet_bootstrap.cc:654] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.001942 17487 raft_consensus.cc:493] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.002688 17487 raft_consensus.cc:515] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.006901 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:54.006877 17487 leader_election.cc:290] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:54.010659 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:54.012298 17197 leader_election.cc:304] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:54.013726 17487 raft_consensus.cc:2749] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.020917 17426 tablet_bootstrap.cc:492] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:54.021588 17426 ts_tablet_manager.cc:1403] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.002s
I20260709 13:04:54.021996 17427 tablet_bootstrap.cc:492] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:54.022511 17427 ts_tablet_manager.cc:1403] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.017s
I20260709 13:04:54.025211 17426 raft_consensus.cc:359] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.025838 17427 raft_consensus.cc:359] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.026342 17426 raft_consensus.cc:385] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.026590 17427 raft_consensus.cc:385] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.026820 17426 raft_consensus.cc:740] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.026225 17052 catalog_manager.cc:5697] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.026943 17427 raft_consensus.cc:740] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.027947 17427 consensus_queue.cc:260] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.027987 17426 consensus_queue.cc:260] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.030352 17427 ts_tablet_manager.cc:1434] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:54.031263 17427 tablet_bootstrap.cc:492] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:54.033890 17426 ts_tablet_manager.cc:1434] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:04:54.034595 17428 tablet_bootstrap.cc:492] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:54.035035 17426 tablet_bootstrap.cc:492] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:54.035138 17428 ts_tablet_manager.cc:1403] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.050s	user 0.024s	sys 0.023s
I20260709 13:04:54.035498 17469 raft_consensus.cc:493] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.035984 17469 raft_consensus.cc:515] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.037827 17430 tablet_bootstrap.cc:492] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:54.038501 17430 ts_tablet_manager.cc:1403] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.003s
I20260709 13:04:54.039350 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7341a74f344c90b6c0f9ff657621d5" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:54.038086 17428 raft_consensus.cc:359] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.038007 17469 leader_election.cc:290] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:54.040933 17428 raft_consensus.cc:385] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.041293 17428 raft_consensus.cc:740] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.042213 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7341a74f344c90b6c0f9ff657621d5" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:54.041992 17428 consensus_queue.cc:260] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.042970 17307 raft_consensus.cc:2393] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 1: Already voted for candidate 7e9eba24bc8842099fcba4a2024c2aed in this term.
I20260709 13:04:54.044126 17123 leader_election.cc:304] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:54.044437 17428 ts_tablet_manager.cc:1434] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:04:54.045205 17469 raft_consensus.cc:3060] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.045374 17428 tablet_bootstrap.cc:492] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:54.047956 17430 raft_consensus.cc:359] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.048728 17430 raft_consensus.cc:385] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.049064 17430 raft_consensus.cc:740] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.050799 17427 tablet_bootstrap.cc:654] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.051673 17428 tablet_bootstrap.cc:654] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.054711 17430 consensus_queue.cc:260] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.063192 17428 tablet_bootstrap.cc:492] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:54.063731 17428 ts_tablet_manager.cc:1403] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:04:54.065222 17426 tablet_bootstrap.cc:654] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.066250 17430 ts_tablet_manager.cc:1434] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:04:54.066840 17428 raft_consensus.cc:359] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.067584 17428 raft_consensus.cc:385] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.067852 17428 raft_consensus.cc:740] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.068636 17428 consensus_queue.cc:260] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.070914 17428 ts_tablet_manager.cc:1434] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:54.071761 17428 tablet_bootstrap.cc:492] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:54.072412 17427 tablet_bootstrap.cc:492] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:54.072836 17469 raft_consensus.cc:2749] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.073009 17427 ts_tablet_manager.cc:1403] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.042s	user 0.023s	sys 0.004s
I20260709 13:04:54.074671 17426 tablet_bootstrap.cc:492] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:54.075122 17426 ts_tablet_manager.cc:1403] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.002s
I20260709 13:04:54.076170 17427 raft_consensus.cc:359] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.076884 17427 raft_consensus.cc:385] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.077203 17427 raft_consensus.cc:740] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.077543 17428 tablet_bootstrap.cc:654] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.077769 17426 raft_consensus.cc:359] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.078457 17426 raft_consensus.cc:385] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.077986 17427 consensus_queue.cc:260] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.078737 17426 raft_consensus.cc:740] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.079627 17426 consensus_queue.cc:260] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.080396 17427 ts_tablet_manager.cc:1434] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:04:54.081403 17430 tablet_bootstrap.cc:492] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:54.082640 17427 tablet_bootstrap.cc:492] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:54.084326 17426 ts_tablet_manager.cc:1434] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:54.085283 17426 tablet_bootstrap.cc:492] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:54.088905 17427 tablet_bootstrap.cc:654] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.090229 17493 raft_consensus.cc:493] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.090780 17493 raft_consensus.cc:515] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.093199 17493 leader_election.cc:290] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:54.093997 17426 tablet_bootstrap.cc:654] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.095281 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:54.097400 17438 raft_consensus.cc:493] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.098106 17438 raft_consensus.cc:515] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.101854 17430 tablet_bootstrap.cc:654] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.102051 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:54.106643 17272 leader_election.cc:304] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:54.108760 17492 raft_consensus.cc:2749] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.115111 17438 leader_election.cc:290] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:54.119923 17430 tablet_bootstrap.cc:492] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:54.120465 17430 ts_tablet_manager.cc:1403] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.009s
I20260709 13:04:54.123327 17430 raft_consensus.cc:359] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.123991 17430 raft_consensus.cc:385] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.124257 17430 raft_consensus.cc:740] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.124907 17430 consensus_queue.cc:260] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.125414 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21af78b15714161898e0f709c8a5834" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:54.126556 17487 consensus_queue.cc:1048] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.126878 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21af78b15714161898e0f709c8a5834" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:54.127511 17232 raft_consensus.cc:2468] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:54.128748 17346 leader_election.cc:304] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:54.129616 17438 raft_consensus.cc:2804] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.129987 17438 raft_consensus.cc:493] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.130339 17438 raft_consensus.cc:3060] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.131783 17492 raft_consensus.cc:493] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.137130 17492 raft_consensus.cc:515] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.140502 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1de8dcf334364214b6b6115fe416ec2b" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
W20260709 13:04:54.142127 17270 leader_election.cc:343] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.142797 17492 leader_election.cc:290] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:54.143266 17492 raft_consensus.cc:493] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.143680 17492 raft_consensus.cc:515] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.146332 17438 raft_consensus.cc:515] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.149585 17156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21af78b15714161898e0f709c8a5834" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:54.136097 17157 raft_consensus.cc:2468] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:54.152086 17430 ts_tablet_manager.cc:1434] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 13:04:54.152558 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1de8dcf334364214b6b6115fe416ec2b" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:54.146356 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
W20260709 13:04:54.155721 17270 leader_election.cc:343] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:54.154315 17272 leader_election.cc:343] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.156672 17272 leader_election.cc:304] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:54.157398 17433 raft_consensus.cc:2749] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.162945 17430 tablet_bootstrap.cc:492] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:54.164319 17307 raft_consensus.cc:3060] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.165364 17438 leader_election.cc:290] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:54.166658 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21af78b15714161898e0f709c8a5834" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:54.167343 17232 raft_consensus.cc:3060] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.170502 17430 tablet_bootstrap.cc:654] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.179188 17487 consensus_queue.cc:1048] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.180178 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
W20260709 13:04:54.181625 17271 leader_election.cc:343] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.182071 17271 leader_election.cc:304] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:54.183166 17433 raft_consensus.cc:2749] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.187819 17492 leader_election.cc:290] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:54.197489 17232 raft_consensus.cc:2468] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:54.239135 17346 leader_election.cc:304] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:54.208817 17430 tablet_bootstrap.cc:492] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:54.217072 17487 raft_consensus.cc:493] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.241514 17430 ts_tablet_manager.cc:1403] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.006s
I20260709 13:04:54.241780 17487 raft_consensus.cc:515] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.243980 17487 leader_election.cc:290] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:54.244529 17438 raft_consensus.cc:2804] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.244297 17430 raft_consensus.cc:359] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.244990 17430 raft_consensus.cc:385] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.245282 17430 raft_consensus.cc:740] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.245911 17430 consensus_queue.cc:260] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.235739 17490 consensus_queue.cc:1048] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.248157 17430 ts_tablet_manager.cc:1434] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:54.249097 17430 tablet_bootstrap.cc:492] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:54.246294 17306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b6348ed73e48b2a0efba1da6d17c66" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:54.250663 17306 raft_consensus.cc:2468] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:54.222250 17428 tablet_bootstrap.cc:492] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:54.253564 17428 ts_tablet_manager.cc:1403] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.182s	user 0.031s	sys 0.055s
I20260709 13:04:54.255666 17430 tablet_bootstrap.cc:654] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.258170 17487 consensus_queue.cc:1048] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:54.256312 17428 raft_consensus.cc:359] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.266388 17428 raft_consensus.cc:385] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.256635 17543 raft_consensus.cc:493] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.267122 17543 raft_consensus.cc:515] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.268497 17428 raft_consensus.cc:740] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.269658 17543 leader_election.cc:290] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:54.270185 17543 raft_consensus.cc:493] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.261431 17198 leader_election.cc:304] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:54.270609 17543 raft_consensus.cc:515] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.271059 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:54.271386 17487 raft_consensus.cc:2804] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:54.278942 17346 leader_election.cc:343] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.279240 17543 leader_election.cc:290] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:54.280452 17156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c83cdeb244b4fada6bff4050bdd4fcd" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
W20260709 13:04:54.281860 17345 leader_election.cc:343] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.278249 17487 raft_consensus.cc:493] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.282886 17487 raft_consensus.cc:3060] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.283010 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:54.285351 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c83cdeb244b4fada6bff4050bdd4fcd" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:54.288525 17430 tablet_bootstrap.cc:492] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:54.271103 17428 consensus_queue.cc:260] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:04:54.294652 17346 leader_election.cc:343] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.295327 17346 leader_election.cc:304] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:54.296304 17428 ts_tablet_manager.cc:1434] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.005s
I20260709 13:04:54.296818 17543 raft_consensus.cc:2749] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.297791 17428 tablet_bootstrap.cc:492] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:54.298413 17233 raft_consensus.cc:3060] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.302543 17492 consensus_queue.cc:1048] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.303615 17430 ts_tablet_manager.cc:1403] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.001s
I20260709 13:04:54.305241 17543 raft_consensus.cc:493] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.305733 17543 raft_consensus.cc:515] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.307025 17430 raft_consensus.cc:359] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.307809 17543 leader_election.cc:290] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:54.309082 17469 raft_consensus.cc:493] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.309201 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470d0807d3ce4a87bc3de4350bab91d9" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:54.313602 17469 raft_consensus.cc:515] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.314419 17304 raft_consensus.cc:2468] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:54.316298 17469 leader_election.cc:290] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:54.317050 17430 raft_consensus.cc:385] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.317471 17430 raft_consensus.cc:740] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.318092 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c2736e41a64de2825d60818a0c19de" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:54.318427 17430 consensus_queue.cc:260] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:04:54.320231 17123 leader_election.cc:343] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.322768 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c2736e41a64de2825d60818a0c19de" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
W20260709 13:04:54.324872 17123 leader_election.cc:343] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.325564 17123 leader_election.cc:304] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:54.326691 17469 raft_consensus.cc:2749] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.327610 17430 ts_tablet_manager.cc:1434] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:04:54.328902 17430 tablet_bootstrap.cc:492] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:54.325099 17428 tablet_bootstrap.cc:654] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.327340 17346 leader_election.cc:304] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:54.310325 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470d0807d3ce4a87bc3de4350bab91d9" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
W20260709 13:04:54.334232 17345 leader_election.cc:343] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.335155 17543 raft_consensus.cc:2804] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.335671 17543 raft_consensus.cc:493] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.336094 17543 raft_consensus.cc:3060] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.277136 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b6348ed73e48b2a0efba1da6d17c66" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:54.343829 17158 raft_consensus.cc:2468] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:54.311972 17487 raft_consensus.cc:515] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
W20260709 13:04:54.342988 17346 leader_election.cc:343] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.346819 17346 leader_election.cc:304] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:54.353021 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b6348ed73e48b2a0efba1da6d17c66" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:54.354722 17158 raft_consensus.cc:3060] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.365768 17487 leader_election.cc:290] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:54.368244 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b6348ed73e48b2a0efba1da6d17c66" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:54.369197 17304 raft_consensus.cc:3060] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.351737 17543 raft_consensus.cc:515] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.378310 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470d0807d3ce4a87bc3de4350bab91d9" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:54.379040 17303 raft_consensus.cc:3060] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.381054 17430 tablet_bootstrap.cc:654] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.382550 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470d0807d3ce4a87bc3de4350bab91d9" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:54.383035 17543 leader_election.cc:290] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:54.383641 17156 raft_consensus.cc:3060] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.390244 17303 raft_consensus.cc:2468] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:54.391515 17346 leader_election.cc:304] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
W20260709 13:04:54.398900 17538 log.cc:927] Time spent T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:04:54.400133 17426 tablet_bootstrap.cc:492] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:54.400668 17426 ts_tablet_manager.cc:1403] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.316s	user 0.048s	sys 0.086s
W20260709 13:04:54.404491 17539 log.cc:927] Time spent T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:04:54.401423 17543 raft_consensus.cc:2749] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.405696 17543 raft_consensus.cc:493] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.407189 17543 raft_consensus.cc:515] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.425235 17158 raft_consensus.cc:2468] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:54.425740 17438 raft_consensus.cc:697] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:54.436990 17427 tablet_bootstrap.cc:492] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:54.437494 17427 ts_tablet_manager.cc:1403] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.355s	user 0.058s	sys 0.114s
I20260709 13:04:54.430879 17471 raft_consensus.cc:493] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.438056 17471 raft_consensus.cc:515] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.438823 17197 leader_election.cc:304] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:54.439881 17487 raft_consensus.cc:2804] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.440469 17487 raft_consensus.cc:697] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:04:54.440725 17471 leader_election.cc:290] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:54.441411 17487 consensus_queue.cc:237] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.442553 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079278fbd6474dea98fac1aaa536bb7c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:54.443424 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079278fbd6474dea98fac1aaa536bb7c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:54.444828 17427 raft_consensus.cc:359] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.445499 17427 raft_consensus.cc:385] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.445746 17427 raft_consensus.cc:740] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.446125 17123 leader_election.cc:304] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:54.446620 17427 consensus_queue.cc:260] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.447623 17469 raft_consensus.cc:2749] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:54.448647 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 57233.7us
I20260709 13:04:54.450989 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f3dec424f482bbb969fb08e7d5509" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:54.451833 17305 raft_consensus.cc:2468] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:54.455124 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f3dec424f482bbb969fb08e7d5509" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:54.456004 17232 raft_consensus.cc:2468] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:54.426272 17542 raft_consensus.cc:2804] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.431861 17304 raft_consensus.cc:2468] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:54.432592 17492 consensus_queue.cc:1048] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:54.433561 17345 leader_election.cc:343] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.457814 17542 raft_consensus.cc:697] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:54.435858 17428 tablet_bootstrap.cc:492] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:54.459003 17428 ts_tablet_manager.cc:1403] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.162s	user 0.012s	sys 0.007s
I20260709 13:04:54.458854 17542 consensus_queue.cc:237] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.436836 17438 consensus_queue.cc:237] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.480091 17427 ts_tablet_manager.cc:1434] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:04:54.481398 17427 tablet_bootstrap.cc:492] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:54.484112 17346 leader_election.cc:304] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:54.484472 17430 tablet_bootstrap.cc:492] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:54.485080 17430 ts_tablet_manager.cc:1403] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.156s	user 0.024s	sys 0.024s
I20260709 13:04:54.486387 17550 raft_consensus.cc:2804] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.486239 17426 raft_consensus.cc:359] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.486820 17550 raft_consensus.cc:493] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.487020 17426 raft_consensus.cc:385] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.487197 17550 raft_consensus.cc:3060] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.487339 17426 raft_consensus.cc:740] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.488070 17426 consensus_queue.cc:260] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.431674 17543 leader_election.cc:290] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:54.471197 17428 raft_consensus.cc:359] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.489089 17428 raft_consensus.cc:385] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.489409 17428 raft_consensus.cc:740] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.490314 17428 consensus_queue.cc:260] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.492695 17428 ts_tablet_manager.cc:1434] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.002s
I20260709 13:04:54.493772 17428 tablet_bootstrap.cc:492] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:54.493561 17493 consensus_queue.cc:1048] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.495179 17550 raft_consensus.cc:515] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.498095 17550 leader_election.cc:290] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:54.504642 17430 raft_consensus.cc:359] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.505554 17430 raft_consensus.cc:385] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.505883 17430 raft_consensus.cc:740] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.506736 17430 consensus_queue.cc:260] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.511763 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f3dec424f482bbb969fb08e7d5509" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:54.512387 17304 raft_consensus.cc:3060] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.513373 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385f3dec424f482bbb969fb08e7d5509" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:54.509052 17430 ts_tablet_manager.cc:1434] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:04:54.514262 17428 tablet_bootstrap.cc:654] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.514094 17232 raft_consensus.cc:3060] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.515288 17430 tablet_bootstrap.cc:492] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:54.518543 17053 catalog_manager.cc:5697] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.514087 17233 raft_consensus.cc:3060] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.525754 17304 raft_consensus.cc:2468] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:54.531355 17427 tablet_bootstrap.cc:654] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.529814 17346 leader_election.cc:304] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:54.532580 17438 raft_consensus.cc:2804] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.537472 17438 raft_consensus.cc:697] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:54.538406 17438 consensus_queue.cc:237] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.541220 17426 ts_tablet_manager.cc:1434] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.007s
I20260709 13:04:54.545437 17426 tablet_bootstrap.cc:492] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:54.554311 17427 tablet_bootstrap.cc:492] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:54.554847 17427 ts_tablet_manager.cc:1403] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 13:04:54.557502 17427 raft_consensus.cc:359] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.558182 17427 raft_consensus.cc:385] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.558410 17427 raft_consensus.cc:740] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.559012 17427 consensus_queue.cc:260] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.560856 17427 ts_tablet_manager.cc:1434] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:54.561534 17426 tablet_bootstrap.cc:654] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.541976 17430 tablet_bootstrap.cc:654] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.571076 17427 tablet_bootstrap.cc:492] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:54.561555 17054 catalog_manager.cc:5697] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 1 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.573741 17426 tablet_bootstrap.cc:492] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:54.574357 17426 ts_tablet_manager.cc:1403] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.006s
I20260709 13:04:54.577422 17426 raft_consensus.cc:359] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.581727 17426 raft_consensus.cc:385] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.582055 17426 raft_consensus.cc:740] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.582743 17426 consensus_queue.cc:260] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.584921 17426 ts_tablet_manager.cc:1434] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:04:54.585865 17426 tablet_bootstrap.cc:492] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:54.594218 17428 tablet_bootstrap.cc:492] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:54.595100 17428 ts_tablet_manager.cc:1403] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.102s	user 0.024s	sys 0.034s
I20260709 13:04:54.598227 17428 raft_consensus.cc:359] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.598989 17428 raft_consensus.cc:385] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.589687 17233 raft_consensus.cc:2468] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:54.599289 17493 consensus_queue.cc:1048] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.599332 17428 raft_consensus.cc:740] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.602670 17428 consensus_queue.cc:260] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.608002 17430 tablet_bootstrap.cc:492] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:54.608093 17426 tablet_bootstrap.cc:654] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.608623 17430 ts_tablet_manager.cc:1403] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.003s
I20260709 13:04:54.609012 17448 raft_consensus.cc:493] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.609593 17448 raft_consensus.cc:515] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.611693 17542 raft_consensus.cc:493] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.611910 17448 leader_election.cc:290] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:54.609156 17428 ts_tablet_manager.cc:1434] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:04:54.613579 17428 tablet_bootstrap.cc:492] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:54.613767 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:54.621317 17304 raft_consensus.cc:2468] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:54.612185 17542 raft_consensus.cc:515] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.622535 17426 tablet_bootstrap.cc:492] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:54.623106 17426 ts_tablet_manager.cc:1403] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.000s
I20260709 13:04:54.623772 17542 leader_election.cc:290] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:54.613615 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:54.624840 17198 leader_election.cc:304] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:54.625159 17380 raft_consensus.cc:2468] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:54.626310 17448 raft_consensus.cc:2804] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.626250 17426 raft_consensus.cc:359] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.626917 17448 raft_consensus.cc:493] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.627291 17426 raft_consensus.cc:385] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.627363 17448 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.627758 17426 raft_consensus.cc:740] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.627315 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66fd7f2e6494980b0c33606bc363fe8" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:54.628585 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66fd7f2e6494980b0c33606bc363fe8" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:54.616019 17430 raft_consensus.cc:359] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:04:54.608013 17103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:04:54.629963 17345 leader_election.cc:343] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.587195 17427 tablet_bootstrap.cc:654] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.630556 17430 raft_consensus.cc:385] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.627969 17428 tablet_bootstrap.cc:654] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.630995 17430 raft_consensus.cc:740] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.619879 17055 catalog_manager.cc:5697] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.630071 17426 consensus_queue.cc:260] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.631887 17430 consensus_queue.cc:260] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.633203 17233 raft_consensus.cc:2468] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:54.642189 17426 ts_tablet_manager.cc:1434] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:04:54.643446 17448 raft_consensus.cc:515] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.633606 17055 catalog_manager.cc:5697] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.644089 17427 tablet_bootstrap.cc:492] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:54.644490 17426 tablet_bootstrap.cc:492] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:54.644646 17427 ts_tablet_manager.cc:1403] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.008s
I20260709 13:04:54.646447 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:54.636776 17346 leader_election.cc:304] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:54.647117 17304 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.642644 17430 ts_tablet_manager.cc:1434] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260709 13:04:54.648399 17430 tablet_bootstrap.cc:492] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:54.649158 17542 raft_consensus.cc:2804] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.649564 17542 raft_consensus.cc:493] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.649892 17542 raft_consensus.cc:3060] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.657459 17448 leader_election.cc:290] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:54.657728 17304 raft_consensus.cc:2468] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:54.659314 17198 leader_election.cc:304] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:54.659777 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:54.660419 17380 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.661981 17430 tablet_bootstrap.cc:654] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.671098 17426 tablet_bootstrap.cc:654] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.672775 17380 raft_consensus.cc:2468] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:54.660396 17448 raft_consensus.cc:2804] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.674929 17448 raft_consensus.cc:697] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:04:54.676177 17448 consensus_queue.cc:237] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.688289 17426 tablet_bootstrap.cc:492] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:54.688934 17426 ts_tablet_manager.cc:1403] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.001s
I20260709 13:04:54.699427 17427 raft_consensus.cc:359] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.699791 17428 tablet_bootstrap.cc:492] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:54.700721 17428 ts_tablet_manager.cc:1403] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.000s
I20260709 13:04:54.701285 17426 raft_consensus.cc:359] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.701989 17426 raft_consensus.cc:385] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.702271 17426 raft_consensus.cc:740] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.693806 17542 raft_consensus.cc:515] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.705382 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66fd7f2e6494980b0c33606bc363fe8" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:54.706575 17542 leader_election.cc:290] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:54.704871 17428 raft_consensus.cc:359] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.700245 17427 raft_consensus.cc:385] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.707289 17428 raft_consensus.cc:385] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.707552 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66fd7f2e6494980b0c33606bc363fe8" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:54.707976 17428 raft_consensus.cc:740] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.708225 17233 raft_consensus.cc:3060] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.707355 17427 raft_consensus.cc:740] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.709309 17427 consensus_queue.cc:260] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.709102 17428 consensus_queue.cc:260] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.712217 17428 ts_tablet_manager.cc:1434] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:54.707844 17426 consensus_queue.cc:260] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.714243 17158 raft_consensus.cc:3060] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.717149 17426 ts_tablet_manager.cc:1434] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:04:54.718616 17426 tablet_bootstrap.cc:492] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:54.721613 17158 raft_consensus.cc:2468] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:54.721946 17428 tablet_bootstrap.cc:492] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:54.722892 17427 ts_tablet_manager.cc:1434] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:04:54.724174 17427 tablet_bootstrap.cc:492] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:54.733853 17345 leader_election.cc:304] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:54.734848 17542 raft_consensus.cc:2804] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.735317 17542 raft_consensus.cc:697] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:54.736150 17542 consensus_queue.cc:237] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.742604 17427 tablet_bootstrap.cc:654] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.745316 17428 tablet_bootstrap.cc:654] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.736135 17426 tablet_bootstrap.cc:654] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.754475 17233 raft_consensus.cc:2468] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:54.757565 17430 tablet_bootstrap.cc:492] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:54.758167 17430 ts_tablet_manager.cc:1403] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.110s	user 0.034s	sys 0.066s
I20260709 13:04:54.761354 17430 raft_consensus.cc:359] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.762104 17430 raft_consensus.cc:385] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.762475 17430 raft_consensus.cc:740] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.763254 17430 consensus_queue.cc:260] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.761821 17056 catalog_manager.cc:5697] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 1 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.765407 17430 ts_tablet_manager.cc:1434] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:54.766396 17430 tablet_bootstrap.cc:492] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:54.772145 17430 tablet_bootstrap.cc:654] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.778980 17428 tablet_bootstrap.cc:492] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:54.779531 17428 ts_tablet_manager.cc:1403] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.010s
I20260709 13:04:54.788447 17428 raft_consensus.cc:359] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.789290 17428 raft_consensus.cc:385] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.789588 17428 raft_consensus.cc:740] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.792583 17428 consensus_queue.cc:260] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.795092 17428 ts_tablet_manager.cc:1434] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:54.796155 17055 catalog_manager.cc:5697] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.797264 17427 tablet_bootstrap.cc:492] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:54.796142 17428 tablet_bootstrap.cc:492] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:54.801152 17426 tablet_bootstrap.cc:492] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:54.801683 17426 ts_tablet_manager.cc:1403] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.083s	user 0.017s	sys 0.013s
I20260709 13:04:54.806047 17428 tablet_bootstrap.cc:654] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.809255 17426 raft_consensus.cc:359] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.810184 17426 raft_consensus.cc:385] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.810526 17426 raft_consensus.cc:740] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.811465 17426 consensus_queue.cc:260] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.814007 17426 ts_tablet_manager.cc:1434] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:04:54.797956 17427 ts_tablet_manager.cc:1403] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.009s
I20260709 13:04:54.819208 17428 tablet_bootstrap.cc:492] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:54.819761 17428 ts_tablet_manager.cc:1403] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 13:04:54.819906 17426 tablet_bootstrap.cc:492] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:54.819768 17427 raft_consensus.cc:359] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.821205 17427 raft_consensus.cc:385] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.821482 17427 raft_consensus.cc:740] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.822341 17427 consensus_queue.cc:260] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.822741 17428 raft_consensus.cc:359] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.823901 17428 raft_consensus.cc:385] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.824250 17428 raft_consensus.cc:740] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.824962 17428 consensus_queue.cc:260] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:54.827142 17428 ts_tablet_manager.cc:1434] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:54.828096 17428 tablet_bootstrap.cc:492] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:54.831696 17427 ts_tablet_manager.cc:1434] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:54.827150 17426 tablet_bootstrap.cc:654] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.833879 17430 tablet_bootstrap.cc:492] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:54.833642 17427 tablet_bootstrap.cc:492] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:54.847725 17490 consensus_queue.cc:1048] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.840092 17428 tablet_bootstrap.cc:654] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.841984 17430 ts_tablet_manager.cc:1403] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.028s
I20260709 13:04:54.853027 17427 tablet_bootstrap.cc:654] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.854990 17542 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.855680 17542 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:54.853426 17430 raft_consensus.cc:359] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.858199 17430 raft_consensus.cc:385] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.858708 17430 raft_consensus.cc:740] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.859328 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
W20260709 13:04:54.861227 17345 leader_election.cc:343] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.860067 17430 consensus_queue.cc:260] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.864049 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:54.865887 17346 leader_election.cc:343] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.866545 17346 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:54.867607 17438 raft_consensus.cc:2749] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.874333 17542 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:54.878007 17430 ts_tablet_manager.cc:1434] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:04:54.883764 17426 tablet_bootstrap.cc:492] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:54.884266 17426 ts_tablet_manager.cc:1403] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.065s	user 0.005s	sys 0.007s
I20260709 13:04:54.887066 17426 raft_consensus.cc:359] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.887719 17426 raft_consensus.cc:385] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.888000 17426 raft_consensus.cc:740] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.888585 17542 consensus_queue.cc:1048] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.888695 17426 consensus_queue.cc:260] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.890090 17490 consensus_queue.cc:1048] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:54.892421 17430 tablet_bootstrap.cc:492] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:54.892832 17492 raft_consensus.cc:493] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.893369 17492 raft_consensus.cc:515] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:54.896040 17492 leader_election.cc:290] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:54.897459 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c2736e41a64de2825d60818a0c19de" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:54.900015 17272 leader_election.cc:343] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.900836 17426 ts_tablet_manager.cc:1434] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:04:54.902011 17156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c2736e41a64de2825d60818a0c19de" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:54.902930 17156 raft_consensus.cc:2468] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:54.903828 17430 tablet_bootstrap.cc:654] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.905815 17271 leader_election.cc:304] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:54.907015 17493 raft_consensus.cc:2804] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.907371 17493 raft_consensus.cc:493] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.907689 17493 raft_consensus.cc:3060] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.910897 17426 tablet_bootstrap.cc:492] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:54.919986 17156 raft_consensus.cc:3060] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.938953 17426 tablet_bootstrap.cc:654] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.946777 17542 consensus_queue.cc:1048] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:54.951634 17433 raft_consensus.cc:493] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.952363 17433 raft_consensus.cc:515] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:54.963590 17433 leader_election.cc:290] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:54.965579 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74084e0afb264747a12252fbdaf660a9" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:54.967185 17272 leader_election.cc:343] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.968381 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74084e0afb264747a12252fbdaf660a9" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
W20260709 13:04:54.977890 17270 leader_election.cc:343] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.978572 17270 leader_election.cc:304] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:54.984660 17492 raft_consensus.cc:2749] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.987673 17542 raft_consensus.cc:493] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.988323 17542 raft_consensus.cc:515] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.023960 17433 raft_consensus.cc:493] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.027074 17438 raft_consensus.cc:493] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.035939 17438 raft_consensus.cc:515] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.029600 17433 raft_consensus.cc:515] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.042881 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7a56b7669944ce91c6ad8b8f7c439c" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:55.043057 17550 consensus_queue.cc:1048] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.041817 17433 leader_election.cc:290] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:55.043711 17157 raft_consensus.cc:2468] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:55.027500 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.044796 17304 raft_consensus.cc:2468] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:55.045351 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7a56b7669944ce91c6ad8b8f7c439c" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:55.045943 17542 leader_election.cc:290] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:55.046694 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1de8dcf334364214b6b6115fe416ec2b" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.030390 17493 raft_consensus.cc:515] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.047456 17303 raft_consensus.cc:2468] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:55.046742 17271 leader_election.cc:304] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
W20260709 13:04:55.048844 17272 leader_election.cc:343] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.048993 17346 leader_election.cc:304] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:55.049407 17493 leader_election.cc:290] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:55.049913 17346 leader_election.cc:304] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:55.050244 17493 raft_consensus.cc:2804] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.043093 17438 leader_election.cc:290] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:55.051270 17438 raft_consensus.cc:2804] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.050812 17493 raft_consensus.cc:493] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.051669 17438 raft_consensus.cc:493] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.051781 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c2736e41a64de2825d60818a0c19de" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:55.051879 17493 raft_consensus.cc:3060] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.053349 17550 raft_consensus.cc:2804] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:55.053484 17272 leader_election.cc:343] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.053786 17550 raft_consensus.cc:493] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.054203 17550 raft_consensus.cc:3060] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.054446 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c2736e41a64de2825d60818a0c19de" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:55.055071 17157 raft_consensus.cc:3060] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.057003 17490 raft_consensus.cc:493] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.057495 17490 raft_consensus.cc:515] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:55.059609 17490 leader_election.cc:290] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:55.060896 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c83cdeb244b4fada6bff4050bdd4fcd" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:55.061616 17155 raft_consensus.cc:2468] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:55.062891 17197 leader_election.cc:304] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:55.063205 17493 raft_consensus.cc:515] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.052199 17438 raft_consensus.cc:3060] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.064301 17490 raft_consensus.cc:2804] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.064671 17490 raft_consensus.cc:493] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.065034 17490 raft_consensus.cc:3060] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.067031 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7a56b7669944ce91c6ad8b8f7c439c" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:55.067418 17493 leader_election.cc:290] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:55.067663 17155 raft_consensus.cc:3060] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.071218 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7a56b7669944ce91c6ad8b8f7c439c" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
W20260709 13:04:55.072757 17272 leader_election.cc:343] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.073626 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1de8dcf334364214b6b6115fe416ec2b" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:55.074349 17232 raft_consensus.cc:2468] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:55.075454 17438 raft_consensus.cc:515] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.076845 17550 raft_consensus.cc:515] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.077934 17438 leader_election.cc:290] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
W20260709 13:04:55.084383 17270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 50441.8us
W20260709 13:04:55.083178 17123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 147095us
I20260709 13:04:55.102470 17427 tablet_bootstrap.cc:492] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:55.103207 17427 ts_tablet_manager.cc:1403] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.270s	user 0.029s	sys 0.048s
I20260709 13:04:55.106868 17428 tablet_bootstrap.cc:492] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:55.107394 17428 ts_tablet_manager.cc:1403] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.280s	user 0.049s	sys 0.064s
I20260709 13:04:55.111320 17430 tablet_bootstrap.cc:492] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:55.111954 17430 ts_tablet_manager.cc:1403] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.220s	user 0.016s	sys 0.014s
I20260709 13:04:55.113080 17550 leader_election.cc:290] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:55.114699 17426 tablet_bootstrap.cc:492] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:55.115195 17426 ts_tablet_manager.cc:1403] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.204s	user 0.012s	sys 0.015s
W20260709 13:04:55.107054 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 57215.7us
I20260709 13:04:55.124198 17469 raft_consensus.cc:493] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.121966 17585 raft_consensus.cc:493] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.134272 17426 raft_consensus.cc:359] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.134800 17426 raft_consensus.cc:385] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.135046 17426 raft_consensus.cc:740] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.137307 17426 consensus_queue.cc:260] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.125970 17582 raft_consensus.cc:493] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.132503 17585 raft_consensus.cc:515] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.144619 17585 leader_election.cc:290] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:55.146528 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:55.147195 17304 raft_consensus.cc:3060] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.126917 17469 raft_consensus.cc:515] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.149087 17428 raft_consensus.cc:359] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.145291 17427 raft_consensus.cc:359] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.150916 17427 raft_consensus.cc:385] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.151300 17426 ts_tablet_manager.cc:1434] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.003s
I20260709 13:04:55.151198 17428 raft_consensus.cc:385] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.149741 17582 raft_consensus.cc:515] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.151521 17427 raft_consensus.cc:740] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.154178 17426 tablet_bootstrap.cc:492] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:55.154747 17157 raft_consensus.cc:2468] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:55.156507 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1de8dcf334364214b6b6115fe416ec2b" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:55.171399 17232 raft_consensus.cc:3060] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.173038 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470d0807d3ce4a87bc3de4350bab91d9" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:55.157169 17590 consensus_queue.cc:1048] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.157986 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c83cdeb244b4fada6bff4050bdd4fcd" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:55.159837 17156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:55.160665 17154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:55.161134 17158 raft_consensus.cc:3060] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.161199 17448 consensus_queue.cc:1048] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.162307 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1de8dcf334364214b6b6115fe416ec2b" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:55.190111 17487 consensus_queue.cc:1048] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.190462 17305 raft_consensus.cc:3060] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.175638 17550 consensus_queue.cc:1048] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:04:55.152166 17428 raft_consensus.cc:740] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.194540 17428 consensus_queue.cc:260] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.170449 17427 consensus_queue.cc:260] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.164361 17469 leader_election.cc:290] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:55.187893 17381 raft_consensus.cc:2468] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:55.188575 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.201005 17304 raft_consensus.cc:2468] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:55.201391 17428 ts_tablet_manager.cc:1434] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.002s
I20260709 13:04:55.197458 17156 raft_consensus.cc:2468] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:55.194473 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:55.214442 17428 tablet_bootstrap.cc:492] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:55.215889 17427 ts_tablet_manager.cc:1434] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.000s
I20260709 13:04:55.217211 17427 tablet_bootstrap.cc:492] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:55.221485 17426 tablet_bootstrap.cc:654] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.223834 17427 tablet_bootstrap.cc:654] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.228657 17430 raft_consensus.cc:359] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.229451 17430 raft_consensus.cc:385] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.229799 17430 raft_consensus.cc:740] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.237934 17430 consensus_queue.cc:260] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.214780 17271 leader_election.cc:304] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:55.240499 17550 raft_consensus.cc:493] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.243142 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "470d0807d3ce4a87bc3de4350bab91d9" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.258551 17430 ts_tablet_manager.cc:1434] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.146s	user 0.009s	sys 0.005s
I20260709 13:04:55.251585 17492 raft_consensus.cc:2804] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:55.267678 17123 leader_election.cc:343] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.278772 17430 tablet_bootstrap.cc:492] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
W20260709 13:04:55.254971 17271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 58822.4us
I20260709 13:04:55.294509 17426 tablet_bootstrap.cc:492] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:55.253829 17550 raft_consensus.cc:515] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:55.303447 17426 ts_tablet_manager.cc:1403] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.150s	user 0.024s	sys 0.003s
I20260709 13:04:55.296105 17427 tablet_bootstrap.cc:492] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:55.305205 17427 ts_tablet_manager.cc:1403] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.009s
I20260709 13:04:55.282423 17492 raft_consensus.cc:697] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
W20260709 13:04:55.268690 17123 leader_election.cc:343] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.270531 17155 raft_consensus.cc:2468] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:55.265628 17346 leader_election.cc:304] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:55.305948 17433 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.323632 17589 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.272734 17490 raft_consensus.cc:515] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:55.324229 17589 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.315742 17305 raft_consensus.cc:2468] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:55.347194 17589 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:55.349722 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c83cdeb244b4fada6bff4050bdd4fcd" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:55.350565 17155 raft_consensus.cc:3060] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.348978 17490 leader_election.cc:290] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:55.366932 17550 leader_election.cc:290] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:55.368520 17550 raft_consensus.cc:2804] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.341811 17590 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.353353 17427 raft_consensus.cc:359] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.372025 17427 raft_consensus.cc:385] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.372329 17427 raft_consensus.cc:740] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.372670 17430 tablet_bootstrap.cc:654] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.373045 17427 consensus_queue.cc:260] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.319651 17123 leader_election.cc:304] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
W20260709 13:04:55.346153 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 88247.9us
I20260709 13:04:55.326963 17433 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.390347 17427 ts_tablet_manager.cc:1434] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.003s
I20260709 13:04:55.392732 17427 tablet_bootstrap.cc:492] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:55.375675 17550 raft_consensus.cc:697] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:55.391909 17589 raft_consensus.cc:2749] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.387399 17155 raft_consensus.cc:2468] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:55.375560 17492 consensus_queue.cc:237] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.374717 17590 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.399777 17595 raft_consensus.cc:493] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:55.400225 17345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 112114us
W20260709 13:04:55.399951 17123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 131271us
I20260709 13:04:55.413939 17590 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:55.414542 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c9ef51ca24504be6b34051b2a0607" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:55.415652 17582 leader_election.cc:290] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:55.417972 17197 leader_election.cc:304] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:55.418291 17271 leader_election.cc:304] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:55.419209 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:55.419356 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:55.419878 17380 raft_consensus.cc:2468] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:55.420679 17490 raft_consensus.cc:2804] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.421202 17490 raft_consensus.cc:697] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:04:55.422251 17121 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:55.422111 17490 consensus_queue.cc:237] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:55.424584 17589 raft_consensus.cc:2804] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.424955 17589 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.425292 17589 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.425631 17607 raft_consensus.cc:2804] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.426169 17607 raft_consensus.cc:697] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:55.426960 17607 consensus_queue.cc:237] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.428678 17426 raft_consensus.cc:359] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:55.429378 17426 raft_consensus.cc:385] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.429649 17426 raft_consensus.cc:740] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.411084 17232 raft_consensus.cc:2468] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:55.421939 17428 tablet_bootstrap.cc:654] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.433161 17426 consensus_queue.cc:260] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:55.411878 17550 consensus_queue.cc:237] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.408084 17595 raft_consensus.cc:515] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.453761 17426 ts_tablet_manager.cc:1434] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.000s
I20260709 13:04:55.454727 17426 tablet_bootstrap.cc:492] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:55.456190 17611 consensus_queue.cc:1048] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:04:55.456526 17123 leader_election.cc:304] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:55.459276 17595 leader_election.cc:290] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
W20260709 13:04:55.452046 17345 leader_election.cc:343] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.460704 17430 tablet_bootstrap.cc:492] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:55.461181 17430 ts_tablet_manager.cc:1403] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.004s
I20260709 13:04:55.461755 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c83cdeb244b4fada6bff4050bdd4fcd" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:55.462613 17378 raft_consensus.cc:3060] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.463243 17611 consensus_queue.cc:1048] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.464493 17430 raft_consensus.cc:359] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.465174 17430 raft_consensus.cc:385] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.465440 17430 raft_consensus.cc:740] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.469674 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:55.473443 17430 consensus_queue.cc:260] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.482800 17427 tablet_bootstrap.cc:654] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.456625 17346 leader_election.cc:304] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:55.486763 17430 ts_tablet_manager.cc:1434] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:04:55.490432 17611 raft_consensus.cc:2804] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.479238 17469 raft_consensus.cc:2749] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:55.491184 17611 raft_consensus.cc:697] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:55.492374 17611 consensus_queue.cc:237] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.473166 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c9ef51ca24504be6b34051b2a0607" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:55.501720 17271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 82247.2us
I20260709 13:04:55.506317 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.507304 17305 raft_consensus.cc:2468] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:55.510524 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:55.511185 17381 raft_consensus.cc:2468] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:55.516810 17426 tablet_bootstrap.cc:654] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.551561 17487 raft_consensus.cc:493] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.554925 17487 raft_consensus.cc:515] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.555413 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74084e0afb264747a12252fbdaf660a9" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.555567 17156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:55.556226 17303 raft_consensus.cc:2468] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:55.557128 17487 leader_election.cc:290] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:55.543773 17378 raft_consensus.cc:2468] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:55.557965 17156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c2736e41a64de2825d60818a0c19de" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:55.558782 17156 raft_consensus.cc:2393] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:55.559782 17604 consensus_queue.cc:1048] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.561153 17433 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:55.546873 17430 tablet_bootstrap.cc:492] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:55.538957 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74084e0afb264747a12252fbdaf660a9" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:55.559844 17346 leader_election.cc:343] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.595834 17589 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:04:55.606423 17270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 91667.2us
I20260709 13:04:55.621982 17153 raft_consensus.cc:2393] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:04:55.624938 17427 tablet_bootstrap.cc:492] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:55.625658 17427 ts_tablet_manager.cc:1403] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.234s	user 0.014s	sys 0.005s
I20260709 13:04:55.605796 17346 leader_election.cc:304] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:55.641798 17589 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:55.645428 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:55.646178 17379 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:55.649085 17103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:55.652575 17427 raft_consensus.cc:359] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.653461 17427 raft_consensus.cc:385] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.653734 17427 raft_consensus.cc:740] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.654533 17427 consensus_queue.cc:260] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.656320 17430 tablet_bootstrap.cc:654] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.668558 17428 tablet_bootstrap.cc:492] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:55.669092 17428 ts_tablet_manager.cc:1403] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.459s	user 0.036s	sys 0.057s
I20260709 13:04:55.659770 17379 raft_consensus.cc:2468] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:55.672986 17427 ts_tablet_manager.cc:1434] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:04:55.669734 17595 raft_consensus.cc:2749] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.674372 17427 tablet_bootstrap.cc:492] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:55.678951 17056 catalog_manager.cc:5697] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:55.672646 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 112864us
I20260709 13:04:55.681311 17056 catalog_manager.cc:5697] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.682404 17121 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:55.685638 17435 raft_consensus.cc:2804] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.686197 17435 raft_consensus.cc:697] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:55.687196 17435 consensus_queue.cc:237] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:04:55.691388 17618 log.cc:927] Time spent T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: Append to log took a long time: real 0.083s	user 0.002s	sys 0.006s
I20260709 13:04:55.692689 17427 tablet_bootstrap.cc:654] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.695252 17430 tablet_bootstrap.cc:492] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:55.695788 17430 ts_tablet_manager.cc:1403] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.149s	user 0.021s	sys 0.007s
I20260709 13:04:55.698680 17430 raft_consensus.cc:359] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.698558 17493 raft_consensus.cc:493] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.699769 17430 raft_consensus.cc:385] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.700275 17430 raft_consensus.cc:740] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.700112 17493 raft_consensus.cc:515] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.702220 17346 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:55.706305 17493 leader_election.cc:290] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:55.706666 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314a4e267fa44771932ef3f2482aa590" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:55.672083 17270 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:04:55.712034 17270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 49334.4us
I20260709 13:04:55.713631 17604 raft_consensus.cc:2764] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:55.714118 17620 raft_consensus.cc:2804] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.714738 17620 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.715190 17620 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.717325 17346 leader_election.cc:304] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:55.725297 17604 raft_consensus.cc:2804] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.725718 17604 raft_consensus.cc:493] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.726086 17604 raft_consensus.cc:3060] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:55.726366 17272 leader_election.cc:343] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.726583 17426 tablet_bootstrap.cc:492] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:55.727250 17426 ts_tablet_manager.cc:1403] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.273s	user 0.041s	sys 0.031s
I20260709 13:04:55.730790 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.731973 17303 raft_consensus.cc:2393] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 1: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:04:55.731833 17426 raft_consensus.cc:359] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.732676 17426 raft_consensus.cc:385] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.733150 17426 raft_consensus.cc:740] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.734048 17426 consensus_queue.cc:260] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.735585 17430 consensus_queue.cc:260] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.736302 17426 ts_tablet_manager.cc:1434] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:04:55.735862 17428 raft_consensus.cc:359] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.738104 17428 raft_consensus.cc:385] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.738479 17428 raft_consensus.cc:740] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.738801 17426 tablet_bootstrap.cc:492] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:55.739496 17428 consensus_queue.cc:260] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
W20260709 13:04:55.741429 17346 leader_election.cc:343] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.745144 17428 ts_tablet_manager.cc:1434] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:04:55.747361 17428 tablet_bootstrap.cc:492] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:55.745863 17430 ts_tablet_manager.cc:1434] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.006s
I20260709 13:04:55.728708 17620 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.751433 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.755405 17053 catalog_manager.cc:5697] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.761648 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:55.757546 17426 tablet_bootstrap.cc:654] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.763284 17435 raft_consensus.cc:493] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.764096 17435 raft_consensus.cc:515] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.765494 17430 tablet_bootstrap.cc:492] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:55.767009 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314a4e267fa44771932ef3f2482aa590" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:55.767692 17379 raft_consensus.cc:2468] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:55.745498 17604 raft_consensus.cc:515] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.770537 17123 leader_election.cc:304] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:55.781860 17589 raft_consensus.cc:3060] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.783257 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c2736e41a64de2825d60818a0c19de" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.775452 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:55.775815 17303 raft_consensus.cc:2393] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:55.778419 17620 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:55.788540 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:55.792469 17381 raft_consensus.cc:2393] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79ae3773b2274d75b3f71364c0aa6d9c in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:04:55.789060 17487 raft_consensus.cc:493] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.800560 17427 tablet_bootstrap.cc:492] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:55.801113 17427 ts_tablet_manager.cc:1403] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.049s
I20260709 13:04:55.786227 17435 leader_election.cc:290] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:55.803478 17428 tablet_bootstrap.cc:654] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.796561 17487 raft_consensus.cc:515] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.803893 17427 raft_consensus.cc:359] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.804665 17427 raft_consensus.cc:385] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.787266 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968dc4dd3ad542808481bf0dad333ac7" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:55.805213 17427 raft_consensus.cc:740] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
W20260709 13:04:55.806212 17121 leader_election.cc:343] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.806082 17427 consensus_queue.cc:260] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.807413 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7a56b7669944ce91c6ad8b8f7c439c" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:55.808161 17155 raft_consensus.cc:2393] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:55.808238 17589 raft_consensus.cc:2749] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.809109 17427 ts_tablet_manager.cc:1434] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:55.806226 17487 leader_election.cc:290] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:55.810441 17427 tablet_bootstrap.cc:492] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:55.810724 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74084e0afb264747a12252fbdaf660a9" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:55.811733 17230 raft_consensus.cc:3060] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.817201 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74084e0afb264747a12252fbdaf660a9" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:55.817497 17427 tablet_bootstrap.cc:654] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.817703 17430 tablet_bootstrap.cc:654] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.817860 17303 raft_consensus.cc:3060] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.824859 17487 consensus_queue.cc:1048] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.826282 17604 leader_election.cc:290] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:55.837801 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968dc4dd3ad542808481bf0dad333ac7" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.836056 17427 tablet_bootstrap.cc:492] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:55.837163 17198 leader_election.cc:304] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:55.840106 17230 raft_consensus.cc:2468] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:55.840447 17427 ts_tablet_manager.cc:1403] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.011s
I20260709 13:04:55.842267 17487 raft_consensus.cc:3060] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.832697 17428 tablet_bootstrap.cc:492] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:55.843652 17428 ts_tablet_manager.cc:1403] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.012s
I20260709 13:04:55.844122 17427 raft_consensus.cc:359] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.844861 17427 raft_consensus.cc:385] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.845178 17427 raft_consensus.cc:740] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.846210 17427 consensus_queue.cc:260] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.849545 17427 ts_tablet_manager.cc:1434] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:55.850612 17427 tablet_bootstrap.cc:492] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:55.850543 17303 raft_consensus.cc:2468] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:55.852169 17428 raft_consensus.cc:359] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.852833 17428 raft_consensus.cc:385] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.853096 17428 raft_consensus.cc:740] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.836277 17426 tablet_bootstrap.cc:492] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:55.854737 17426 ts_tablet_manager.cc:1403] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.116s	user 0.027s	sys 0.014s
I20260709 13:04:55.857739 17427 tablet_bootstrap.cc:654] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.838368 17270 leader_election.cc:304] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:55.839541 17305 raft_consensus.cc:2468] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:55.841771 17346 leader_election.cc:304] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:55.858750 17620 raft_consensus.cc:2804] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.859232 17620 raft_consensus.cc:493] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.859576 17620 raft_consensus.cc:3060] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.860260 17426 raft_consensus.cc:359] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.860931 17426 raft_consensus.cc:385] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.861196 17426 raft_consensus.cc:740] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.861868 17426 consensus_queue.cc:260] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:55.864193 17426 ts_tablet_manager.cc:1434] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:55.862213 17550 raft_consensus.cc:2804] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.864831 17550 raft_consensus.cc:697] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:55.865329 17487 raft_consensus.cc:2749] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.865686 17550 consensus_queue.cc:237] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.865108 17426 tablet_bootstrap.cc:492] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:55.868948 17428 consensus_queue.cc:260] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:55.873901 17270 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:55.874986 17493 raft_consensus.cc:2749] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.881183 17426 tablet_bootstrap.cc:654] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.881564 17055 catalog_manager.cc:5697] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.885077 17428 ts_tablet_manager.cc:1434] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:04:55.886188 17428 tablet_bootstrap.cc:492] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:55.890615 17123 leader_election.cc:304] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d
I20260709 13:04:55.897081 17589 raft_consensus.cc:2804] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.897529 17589 raft_consensus.cc:493] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.897883 17589 raft_consensus.cc:3060] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.906723 17620 raft_consensus.cc:515] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.912451 17430 tablet_bootstrap.cc:492] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:55.913192 17430 ts_tablet_manager.cc:1403] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.148s	user 0.034s	sys 0.024s
I20260709 13:04:55.896617 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7a56b7669944ce91c6ad8b8f7c439c" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:55.923439 17198 leader_election.cc:304] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:55.925087 17490 raft_consensus.cc:3060] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.926158 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314a4e267fa44771932ef3f2482aa590" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:55.927125 17435 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.927624 17435 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:55.928169 17493 consensus_queue.cc:1048] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.929699 17435 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:55.930966 17602 consensus_queue.cc:1048] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:55.935755 17272 leader_election.cc:343] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.931576 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:55.936918 17378 raft_consensus.cc:2468] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:55.938278 17121 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:55.939780 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:55.940758 17604 consensus_queue.cc:1048] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.940356 17589 raft_consensus.cc:515] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:04:55.942308 17123 leader_election.cc:343] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.940943 17435 raft_consensus.cc:2804] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.943051 17435 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.943315 17589 leader_election.cc:290] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:55.943464 17435 raft_consensus.cc:3060] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.945878 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968dc4dd3ad542808481bf0dad333ac7" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:55.954878 17427 tablet_bootstrap.cc:492] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:55.954944 17305 raft_consensus.cc:3060] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.955456 17428 tablet_bootstrap.cc:654] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.946998 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968dc4dd3ad542808481bf0dad333ac7" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:55.958297 17378 raft_consensus.cc:3060] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.955480 17427 ts_tablet_manager.cc:1403] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.105s	user 0.007s	sys 0.011s
I20260709 13:04:55.960356 17620 leader_election.cc:290] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:55.961623 17620 consensus_queue.cc:1048] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.963599 17430 raft_consensus.cc:359] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:55.964329 17430 raft_consensus.cc:385] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.963613 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "314a4e267fa44771932ef3f2482aa590" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:55.964646 17430 raft_consensus.cc:740] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.965451 17430 consensus_queue.cc:260] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:55.982857 17427 raft_consensus.cc:359] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.985674 17427 raft_consensus.cc:385] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.986071 17427 raft_consensus.cc:740] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.986959 17427 consensus_queue.cc:260] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:55.964962 17379 raft_consensus.cc:3060] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.022200 17427 ts_tablet_manager.cc:1434] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.011s
I20260709 13:04:56.025843 17492 consensus_queue.cc:1048] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.032310 17427 tablet_bootstrap.cc:492] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:56.040380 17427 tablet_bootstrap.cc:654] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.061491 17428 tablet_bootstrap.cc:492] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:56.062206 17428 ts_tablet_manager.cc:1403] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.176s	user 0.028s	sys 0.006s
I20260709 13:04:56.070505 17430 ts_tablet_manager.cc:1434] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.157s	user 0.007s	sys 0.001s
I20260709 13:04:56.072384 17430 tablet_bootstrap.cc:492] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:56.069154 17493 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.082965 17550 consensus_queue.cc:1048] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:56.085117 17305 raft_consensus.cc:2468] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:56.085811 17428 raft_consensus.cc:359] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.086566 17493 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.087085 17123 leader_election.cc:304] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:56.088028 17589 raft_consensus.cc:2804] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.088868 17589 raft_consensus.cc:697] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:56.086578 17428 raft_consensus.cc:385] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.089326 17493 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:56.089587 17428 raft_consensus.cc:740] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.090097 17156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:56.090426 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:56.100754 17054 catalog_manager.cc:5697] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 1 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.103468 17550 consensus_queue.cc:1048] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:56.103951 17271 leader_election.cc:343] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.089847 17589 consensus_queue.cc:237] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.105974 17379 raft_consensus.cc:2468] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:56.101724 17428 consensus_queue.cc:260] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.111418 17642 raft_consensus.cc:493] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.113925 17642 raft_consensus.cc:515] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.120169 17427 tablet_bootstrap.cc:492] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:56.120612 17427 ts_tablet_manager.cc:1403] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.022s
W20260709 13:04:56.122574 17270 leader_election.cc:343] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.123282 17270 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:56.124652 17270 leader_election.cc:304] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:56.125416 17492 raft_consensus.cc:2749] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.126096 17492 raft_consensus.cc:2804] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.126519 17492 raft_consensus.cc:697] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:56.127321 17492 consensus_queue.cc:237] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.129011 17642 leader_election.cc:290] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:56.131675 17426 tablet_bootstrap.cc:492] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:56.132505 17426 ts_tablet_manager.cc:1403] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.268s	user 0.031s	sys 0.041s
I20260709 13:04:56.132879 17156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c9ef51ca24504be6b34051b2a0607" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:56.135334 17426 raft_consensus.cc:359] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.136032 17426 raft_consensus.cc:385] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.136286 17426 raft_consensus.cc:740] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
W20260709 13:04:56.140465 17645 log.cc:927] Time spent T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:04:56.141928 17614 raft_consensus.cc:493] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.142462 17614 raft_consensus.cc:515] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.143471 17428 ts_tablet_manager.cc:1434] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:04:56.144490 17428 tablet_bootstrap.cc:492] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:56.145267 17614 leader_election.cc:290] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:56.147136 17490 raft_consensus.cc:2749] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.147354 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:56.148806 17272 leader_election.cc:343] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.149037 17435 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.152143 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:56.154335 17435 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:56.157850 17426 consensus_queue.cc:260] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.155829 17595 consensus_queue.cc:1048] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:04:56.171808 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:56.172197 17426 ts_tablet_manager.cc:1434] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:04:56.172454 17380 raft_consensus.cc:3060] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.173249 17426 tablet_bootstrap.cc:492] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:56.175858 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:56.175963 17156 raft_consensus.cc:2468] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
W20260709 13:04:56.177527 17270 leader_election.cc:343] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.178009 17270 leader_election.cc:304] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
W20260709 13:04:56.178133 17123 leader_election.cc:343] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.179101 17378 raft_consensus.cc:2468] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:56.176162 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c9ef51ca24504be6b34051b2a0607" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:56.190932 17197 leader_election.cc:304] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:56.192073 17642 raft_consensus.cc:2804] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.192430 17642 raft_consensus.cc:493] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.192759 17642 raft_consensus.cc:3060] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.187757 17493 raft_consensus.cc:2749] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.197916 17379 raft_consensus.cc:2468] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:56.193612 17589 consensus_queue.cc:1048] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:04:56.193691 17620 consensus_queue.cc:1048] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:04:56.224238 17426 tablet_bootstrap.cc:654] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.224628 17611 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.230209 17611 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.233201 17611 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:56.236368 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:56.233839 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:56.238209 17589 consensus_queue.cc:1048] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.239231 17427 raft_consensus.cc:359] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
W20260709 13:04:56.240123 17346 leader_election.cc:343] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.240250 17427 raft_consensus.cc:385] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.240723 17427 raft_consensus.cc:740] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.241856 17427 consensus_queue.cc:260] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.235157 17430 tablet_bootstrap.cc:654] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:56.243153 17345 leader_election.cc:343] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.258930 17380 raft_consensus.cc:2468] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:56.274369 17657 raft_consensus.cc:493] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.274890 17657 raft_consensus.cc:515] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.275563 17428 tablet_bootstrap.cc:654] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.277099 17657 leader_election.cc:290] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:56.278949 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:56.280539 17272 leader_election.cc:343] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.253501 17345 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:56.281508 17611 raft_consensus.cc:2749] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.284045 17427 ts_tablet_manager.cc:1434] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.163s	user 0.009s	sys 0.001s
I20260709 13:04:56.285344 17427 tablet_bootstrap.cc:492] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:56.292232 17055 catalog_manager.cc:5697] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.250371 17642 raft_consensus.cc:515] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.319661 17642 leader_election.cc:290] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:56.321811 17430 tablet_bootstrap.cc:492] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:56.322583 17430 ts_tablet_manager.cc:1403] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.251s	user 0.014s	sys 0.007s
I20260709 13:04:56.325695 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c9ef51ca24504be6b34051b2a0607" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:56.325518 17430 raft_consensus.cc:359] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.326321 17430 raft_consensus.cc:385] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.326373 17380 raft_consensus.cc:3060] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.326660 17430 raft_consensus.cc:740] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.327477 17430 consensus_queue.cc:260] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.328866 17595 consensus_queue.cc:1048] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.329912 17430 ts_tablet_manager.cc:1434] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:56.330960 17430 tablet_bootstrap.cc:492] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:56.331760 17427 tablet_bootstrap.cc:654] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.340189 17054 catalog_manager.cc:5697] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } }
I20260709 13:04:56.351363 17156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:56.351876 17471 raft_consensus.cc:493] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.352119 17156 raft_consensus.cc:2468] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:56.352389 17471 raft_consensus.cc:515] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.352679 17054 catalog_manager.cc:5697] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.354578 17471 leader_election.cc:290] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:56.364456 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c9ef51ca24504be6b34051b2a0607" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:56.365216 17155 raft_consensus.cc:3060] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.368412 17380 raft_consensus.cc:2468] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:56.371189 17196 leader_election.cc:304] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:56.374261 17490 raft_consensus.cc:2804] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.374782 17490 raft_consensus.cc:697] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:04:56.375605 17490 consensus_queue.cc:237] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.378337 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:56.379752 17123 leader_election.cc:343] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.380201 17428 tablet_bootstrap.cc:492] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:56.380699 17428 ts_tablet_manager.cc:1403] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.236s	user 0.017s	sys 0.010s
I20260709 13:04:56.381172 17155 raft_consensus.cc:2468] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:56.382187 17121 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:56.383080 17582 raft_consensus.cc:2804] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.383600 17582 raft_consensus.cc:697] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:56.384213 17271 leader_election.cc:304] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:56.384397 17582 consensus_queue.cc:237] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.385480 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:56.385963 17614 raft_consensus.cc:2804] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.386144 17303 raft_consensus.cc:2468] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:56.386422 17614 raft_consensus.cc:493] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.386850 17614 raft_consensus.cc:3060] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.388621 17428 raft_consensus.cc:359] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.389339 17428 raft_consensus.cc:385] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.389622 17428 raft_consensus.cc:740] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.390321 17123 leader_election.cc:304] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:56.390549 17428 consensus_queue.cc:260] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.395849 17428 ts_tablet_manager.cc:1434] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:56.397192 17428 tablet_bootstrap.cc:492] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:56.394472 17435 raft_consensus.cc:2804] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.406821 17435 raft_consensus.cc:493] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.408275 17435 raft_consensus.cc:3060] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.411799 17426 tablet_bootstrap.cc:492] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:56.412281 17426 ts_tablet_manager.cc:1403] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.239s	user 0.018s	sys 0.026s
I20260709 13:04:56.412264 17604 consensus_queue.cc:1048] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.415800 17614 raft_consensus.cc:515] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.431836 17426 raft_consensus.cc:359] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.432917 17426 raft_consensus.cc:385] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.433297 17426 raft_consensus.cc:740] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.433784 17435 raft_consensus.cc:515] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.436014 17435 leader_election.cc:290] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:56.437590 17426 consensus_queue.cc:260] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.440995 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
W20260709 13:04:56.444332 17272 leader_election.cc:343] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.423539 17614 leader_election.cc:290] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:56.449394 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:56.450073 17307 raft_consensus.cc:3060] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.451471 17426 ts_tablet_manager.cc:1434] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:04:56.452457 17426 tablet_bootstrap.cc:492] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:56.455791 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
W20260709 13:04:56.457229 17123 leader_election.cc:343] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.458758 17430 tablet_bootstrap.cc:654] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.461990 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:56.462669 17153 raft_consensus.cc:3060] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.461122 17428 tablet_bootstrap.cc:654] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.467253 17426 tablet_bootstrap.cc:654] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.469141 17427 tablet_bootstrap.cc:492] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:56.469678 17427 ts_tablet_manager.cc:1403] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.185s	user 0.011s	sys 0.001s
I20260709 13:04:56.469892 17430 tablet_bootstrap.cc:492] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:56.470444 17430 ts_tablet_manager.cc:1403] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.001s
I20260709 13:04:56.470330 17055 catalog_manager.cc:5697] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.476480 17430 raft_consensus.cc:359] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.477211 17430 raft_consensus.cc:385] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.477475 17430 raft_consensus.cc:740] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.472018 17307 raft_consensus.cc:2468] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:56.479316 17123 leader_election.cc:304] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:56.480404 17589 raft_consensus.cc:2804] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.480845 17589 raft_consensus.cc:697] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:56.481621 17589 consensus_queue.cc:237] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.484055 17053 catalog_manager.cc:5697] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.485296 17153 raft_consensus.cc:2468] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:56.488240 17430 consensus_queue.cc:260] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.489236 17490 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.489718 17271 leader_election.cc:304] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:56.490489 17430 ts_tablet_manager.cc:1434] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:04:56.491420 17430 tablet_bootstrap.cc:492] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:56.489764 17490 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.495589 17490 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:56.496945 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:56.497848 17614 raft_consensus.cc:2804] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.499624 17380 raft_consensus.cc:2393] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:04:56.501643 17614 raft_consensus.cc:697] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:56.503952 17614 consensus_queue.cc:237] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.504984 17054 catalog_manager.cc:5697] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 1 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.507550 17426 tablet_bootstrap.cc:492] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:56.507893 17426 ts_tablet_manager.cc:1403] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.001s
I20260709 13:04:56.518292 17426 raft_consensus.cc:359] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.519008 17426 raft_consensus.cc:385] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.519359 17426 raft_consensus.cc:740] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.519172 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:56.520751 17197 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:56.520855 17427 raft_consensus.cc:359] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.521550 17427 raft_consensus.cc:385] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.521065 17056 catalog_manager.cc:5697] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.521847 17427 raft_consensus.cc:740] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.522571 17490 raft_consensus.cc:3060] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.522737 17426 consensus_queue.cc:260] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.525537 17430 tablet_bootstrap.cc:654] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.527962 17426 ts_tablet_manager.cc:1434] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:04:56.530423 17428 tablet_bootstrap.cc:492] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:56.542505 17428 ts_tablet_manager.cc:1403] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.146s	user 0.021s	sys 0.015s
I20260709 13:04:56.522608 17427 consensus_queue.cc:260] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.547824 17490 raft_consensus.cc:2749] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.548357 17428 raft_consensus.cc:359] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.549909 17427 ts_tablet_manager.cc:1434] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.001s
I20260709 13:04:56.551786 17427 tablet_bootstrap.cc:492] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:56.550524 17428 raft_consensus.cc:385] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.528992 17426 tablet_bootstrap.cc:492] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:56.555405 17428 raft_consensus.cc:740] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.556618 17428 consensus_queue.cc:260] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.560880 17426 tablet_bootstrap.cc:654] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.562290 17428 ts_tablet_manager.cc:1434] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:56.562558 17430 tablet_bootstrap.cc:492] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:56.563066 17430 ts_tablet_manager.cc:1403] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.006s
I20260709 13:04:56.565809 17430 raft_consensus.cc:359] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.566675 17430 raft_consensus.cc:385] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.563297 17428 tablet_bootstrap.cc:492] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:56.567023 17427 tablet_bootstrap.cc:654] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.567041 17430 raft_consensus.cc:740] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.572464 17430 consensus_queue.cc:260] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.574064 17056 catalog_manager.cc:5697] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.574937 17430 ts_tablet_manager.cc:1434] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:56.577553 17430 tablet_bootstrap.cc:492] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:56.580284 17426 tablet_bootstrap.cc:492] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:56.580783 17426 ts_tablet_manager.cc:1403] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.011s
I20260709 13:04:56.583232 17430 tablet_bootstrap.cc:654] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.585078 17589 consensus_queue.cc:1048] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.583587 17426 raft_consensus.cc:359] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.583992 17428 tablet_bootstrap.cc:654] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.589097 17426 raft_consensus.cc:385] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.589416 17426 raft_consensus.cc:740] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.590266 17426 consensus_queue.cc:260] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.591876 17426 ts_tablet_manager.cc:1434] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:04:56.592995 17426 tablet_bootstrap.cc:492] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:56.597514 17427 tablet_bootstrap.cc:492] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:56.598273 17427 ts_tablet_manager.cc:1403] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.001s
I20260709 13:04:56.598968 17426 tablet_bootstrap.cc:654] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.607499 17428 tablet_bootstrap.cc:492] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:56.607185 17427 raft_consensus.cc:359] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.608045 17427 raft_consensus.cc:385] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.608119 17428 ts_tablet_manager.cc:1403] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.009s
I20260709 13:04:56.608474 17427 raft_consensus.cc:740] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.609292 17427 consensus_queue.cc:260] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.611159 17428 raft_consensus.cc:359] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.613610 17427 ts_tablet_manager.cc:1434] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:56.612967 17428 raft_consensus.cc:385] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.616290 17428 raft_consensus.cc:740] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.614662 17427 tablet_bootstrap.cc:492] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:56.618818 17428 consensus_queue.cc:260] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.618095 17430 tablet_bootstrap.cc:492] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:56.619823 17430 ts_tablet_manager.cc:1403] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.000s
I20260709 13:04:56.622687 17430 raft_consensus.cc:359] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.624985 17427 tablet_bootstrap.cc:654] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.625509 17430 raft_consensus.cc:385] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.625869 17430 raft_consensus.cc:740] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.626776 17430 consensus_queue.cc:260] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.625039 17428 ts_tablet_manager.cc:1434] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:04:56.628700 17428 tablet_bootstrap.cc:492] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:56.630529 17430 ts_tablet_manager.cc:1434] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:56.634912 17430 tablet_bootstrap.cc:492] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:56.640511 17428 tablet_bootstrap.cc:654] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.647527 17427 tablet_bootstrap.cc:492] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:56.645053 17430 tablet_bootstrap.cc:654] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.648128 17427 ts_tablet_manager.cc:1403] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.004s
I20260709 13:04:56.651686 17427 raft_consensus.cc:359] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.652737 17427 raft_consensus.cc:385] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.653138 17427 raft_consensus.cc:740] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.656595 17427 consensus_queue.cc:260] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.658393 17430 tablet_bootstrap.cc:492] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:56.661832 17430 ts_tablet_manager.cc:1403] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 13:04:56.659432 17427 ts_tablet_manager.cc:1434] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:56.664647 17427 tablet_bootstrap.cc:492] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:56.666272 17430 raft_consensus.cc:359] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.663483 17428 tablet_bootstrap.cc:492] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:56.667332 17428 ts_tablet_manager.cc:1403] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.005s
I20260709 13:04:56.670065 17428 raft_consensus.cc:359] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.670748 17428 raft_consensus.cc:385] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.671067 17428 raft_consensus.cc:740] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.671806 17428 consensus_queue.cc:260] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.678470 17428 ts_tablet_manager.cc:1434] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.004s
I20260709 13:04:56.679751 17428 tablet_bootstrap.cc:492] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:56.680240 17427 tablet_bootstrap.cc:654] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.682821 17448 raft_consensus.cc:493] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.683386 17448 raft_consensus.cc:515] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.685472 17448 leader_election.cc:290] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:56.685688 17428 tablet_bootstrap.cc:654] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.687150 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:56.687935 17153 raft_consensus.cc:2393] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:56.689756 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:56.689947 17604 raft_consensus.cc:493] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.690440 17604 raft_consensus.cc:515] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.691373 17589 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.691856 17589 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.692509 17604 leader_election.cc:290] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:56.693897 17589 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:56.695565 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:56.695719 17197 leader_election.cc:304] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:56.696267 17305 raft_consensus.cc:2468] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:56.678818 17430 raft_consensus.cc:385] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.697088 17430 raft_consensus.cc:740] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.697664 17123 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:56.697973 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b355c1a40d24e6387c364c6964fbb99" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:56.698312 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b355c1a40d24e6387c364c6964fbb99" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:56.699632 17346 leader_election.cc:343] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.699692 17435 raft_consensus.cc:2804] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.700350 17435 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.700718 17435 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:56.702306 17345 leader_election.cc:343] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.704463 17345 leader_election.cc:304] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:56.706277 17589 consensus_queue.cc:1048] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.708066 17595 raft_consensus.cc:2749] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.708417 17435 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.709496 17430 consensus_queue.cc:260] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.713068 17490 raft_consensus.cc:3060] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.717054 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:56.717756 17380 raft_consensus.cc:2468] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:56.720108 17232 raft_consensus.cc:3060] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.722244 17430 ts_tablet_manager.cc:1434] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:04:56.723117 17430 tablet_bootstrap.cc:492] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:56.720369 17490 raft_consensus.cc:2749] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.732992 17614 consensus_queue.cc:1048] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.733603 17426 tablet_bootstrap.cc:492] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:56.734125 17426 ts_tablet_manager.cc:1403] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.141s	user 0.035s	sys 0.032s
I20260709 13:04:56.743284 17426 raft_consensus.cc:359] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.744004 17426 raft_consensus.cc:385] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.744277 17426 raft_consensus.cc:740] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.744908 17426 consensus_queue.cc:260] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.745239 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:56.746158 17307 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.747330 17426 ts_tablet_manager.cc:1434] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:56.748353 17426 tablet_bootstrap.cc:492] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:56.760577 17614 consensus_queue.cc:1048] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:56.761099 17103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:56.764567 17435 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:56.766950 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:56.767539 17307 raft_consensus.cc:2468] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:56.767679 17379 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.774050 17430 tablet_bootstrap.cc:654] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.777201 17435 consensus_queue.cc:1048] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.784281 17123 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:56.785246 17426 tablet_bootstrap.cc:654] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.785876 17589 raft_consensus.cc:493] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.786453 17589 raft_consensus.cc:515] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.788404 17589 leader_election.cc:290] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:56.788893 17589 raft_consensus.cc:2804] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.790766 17589 raft_consensus.cc:697] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:56.791576 17589 consensus_queue.cc:237] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.795730 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:56.797757 17123 leader_election.cc:343] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.798947 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:56.799916 17307 raft_consensus.cc:2468] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:56.801136 17123 leader_election.cc:304] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:56.802316 17582 raft_consensus.cc:2804] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.802713 17582 raft_consensus.cc:493] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.803014 17582 raft_consensus.cc:3060] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.803756 17379 raft_consensus.cc:2468] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:56.807622 17589 raft_consensus.cc:493] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.809777 17589 raft_consensus.cc:515] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.812027 17589 leader_election.cc:290] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:56.813918 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd5f3f7224fde8c02ed2f1e9de777" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
W20260709 13:04:56.816156 17121 leader_election.cc:343] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.818228 17427 tablet_bootstrap.cc:492] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:56.818765 17427 ts_tablet_manager.cc:1403] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.154s	user 0.032s	sys 0.010s
I20260709 13:04:56.820465 17430 tablet_bootstrap.cc:492] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:56.831220 17427 raft_consensus.cc:359] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.831974 17427 raft_consensus.cc:385] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.821976 17056 catalog_manager.cc:5697] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.836203 17589 consensus_queue.cc:1048] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.832258 17427 raft_consensus.cc:740] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.844691 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd5f3f7224fde8c02ed2f1e9de777" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:56.844926 17427 consensus_queue.cc:260] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.845909 17307 raft_consensus.cc:2468] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:56.848140 17427 ts_tablet_manager.cc:1434] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.004s
I20260709 13:04:56.849062 17427 tablet_bootstrap.cc:492] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:56.838479 17428 tablet_bootstrap.cc:492] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:56.827176 17426 tablet_bootstrap.cc:492] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:56.828501 17430 ts_tablet_manager.cc:1403] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.001s
I20260709 13:04:56.853567 17595 raft_consensus.cc:493] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.855607 17430 raft_consensus.cc:359] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.856309 17430 raft_consensus.cc:385] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.856559 17430 raft_consensus.cc:740] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.857124 17595 raft_consensus.cc:515] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.859220 17595 leader_election.cc:290] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:56.860275 17490 raft_consensus.cc:493] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.860766 17490 raft_consensus.cc:515] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:56.857183 17430 consensus_queue.cc:260] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.862438 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:56.870580 17307 raft_consensus.cc:2468] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:56.871912 17346 leader_election.cc:304] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:56.872274 17430 ts_tablet_manager.cc:1434] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:04:56.863286 17428 ts_tablet_manager.cc:1403] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.174s	user 0.011s	sys 0.011s
I20260709 13:04:56.872759 17595 raft_consensus.cc:2804] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.873196 17427 tablet_bootstrap.cc:654] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.864065 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:56.868464 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:56.862834 17490 leader_election.cc:290] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:56.840724 17582 raft_consensus.cc:515] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
W20260709 13:04:56.875283 17346 leader_election.cc:343] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.876518 17430 tablet_bootstrap.cc:492] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:56.877532 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:56.875144 17428 raft_consensus.cc:359] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.863386 17602 consensus_queue.cc:1048] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:56.878753 17123 leader_election.cc:343] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.878978 17428 raft_consensus.cc:385] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.879381 17428 raft_consensus.cc:740] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.880250 17582 leader_election.cc:290] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:56.880110 17428 consensus_queue.cc:260] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.883873 17428 ts_tablet_manager.cc:1434] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:04:56.884929 17428 tablet_bootstrap.cc:492] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:56.886286 17426 ts_tablet_manager.cc:1403] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.138s	user 0.015s	sys 0.001s
I20260709 13:04:56.888978 17426 raft_consensus.cc:359] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.889691 17426 raft_consensus.cc:385] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.873160 17595 raft_consensus.cc:493] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.892805 17595 raft_consensus.cc:3060] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.893618 17604 raft_consensus.cc:493] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.894526 17604 raft_consensus.cc:515] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.896250 17430 tablet_bootstrap.cc:654] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.896850 17604 leader_election.cc:290] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:56.889955 17426 raft_consensus.cc:740] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.899777 17426 consensus_queue.cc:260] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.903439 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf498205a5942dd9c8ec8f97f6f8c67" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:56.905426 17428 tablet_bootstrap.cc:654] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.901919 17426 ts_tablet_manager.cc:1434] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
W20260709 13:04:56.911301 17346 leader_election.cc:343] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.913708 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf498205a5942dd9c8ec8f97f6f8c67" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:56.914486 17153 raft_consensus.cc:2468] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:56.914857 17427 tablet_bootstrap.cc:492] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:56.915393 17427 ts_tablet_manager.cc:1403] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.017s
I20260709 13:04:56.915539 17345 leader_election.cc:304] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:56.916410 17426 tablet_bootstrap.cc:492] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:56.916746 17604 raft_consensus.cc:2804] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.916935 17123 leader_election.cc:304] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d
I20260709 13:04:56.917165 17604 raft_consensus.cc:493] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.917693 17604 raft_consensus.cc:3060] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.918201 17427 raft_consensus.cc:359] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.918887 17427 raft_consensus.cc:385] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.919140 17427 raft_consensus.cc:740] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.919762 17427 consensus_queue.cc:260] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.925442 17642 consensus_queue.cc:1048] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.926398 17426 tablet_bootstrap.cc:654] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.927960 17427 ts_tablet_manager.cc:1434] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 13:04:56.928921 17427 tablet_bootstrap.cc:492] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:56.930735 17471 raft_consensus.cc:2804] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.931131 17471 raft_consensus.cc:493] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.931438 17471 raft_consensus.cc:3060] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.933635 17657 raft_consensus.cc:493] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.934144 17657 raft_consensus.cc:515] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.936055 17604 raft_consensus.cc:515] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.936993 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:56.940724 17307 raft_consensus.cc:3060] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.940990 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:56.941816 17305 raft_consensus.cc:2393] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:04:56.936110 17657 leader_election.cc:290] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:56.946796 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d21695723a94f56863565fdec1d8600" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:56.948110 17272 leader_election.cc:343] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.953028 17657 consensus_queue.cc:1048] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.953060 17693 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.956324 17693 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:56.958881 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:56.959259 17693 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:56.959546 17379 raft_consensus.cc:2468] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:56.961558 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:56.962188 17232 raft_consensus.cc:2468] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:56.963395 17123 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:56.966835 17307 raft_consensus.cc:2468] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:56.967578 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d21695723a94f56863565fdec1d8600" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:56.989689 17430 tablet_bootstrap.cc:492] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:56.990334 17657 raft_consensus.cc:493] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.991951 17430 ts_tablet_manager.cc:1403] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.025s
I20260709 13:04:56.992139 17657 raft_consensus.cc:515] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:56.994377 17657 leader_election.cc:290] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:56.968194 17693 raft_consensus.cc:2804] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.969732 17198 leader_election.cc:304] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:56.972255 17427 tablet_bootstrap.cc:654] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.995260 17693 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.995359 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04afb5955d549318f7fe723b79f1d3b" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:56.995713 17693 raft_consensus.cc:3060] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.972085 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf498205a5942dd9c8ec8f97f6f8c67" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:56.996656 17155 raft_consensus.cc:3060] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.996944 17642 raft_consensus.cc:3060] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.000662 17430 raft_consensus.cc:359] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.001485 17430 raft_consensus.cc:385] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.001791 17430 raft_consensus.cc:740] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.002506 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf498205a5942dd9c8ec8f97f6f8c67" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:57.004417 17595 raft_consensus.cc:515] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
W20260709 13:04:57.005081 17271 leader_election.cc:343] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.974237 17428 tablet_bootstrap.cc:492] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:57.010396 17428 ts_tablet_manager.cc:1403] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.005s
I20260709 13:04:57.011101 17471 raft_consensus.cc:515] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.002545 17430 consensus_queue.cc:260] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.013527 17428 raft_consensus.cc:359] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:56.979323 17604 leader_election.cc:290] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:57.014423 17428 raft_consensus.cc:385] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.014715 17428 raft_consensus.cc:740] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.015372 17428 consensus_queue.cc:260] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.017067 17428 ts_tablet_manager.cc:1434] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:04:57.017975 17428 tablet_bootstrap.cc:492] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:57.023861 17155 raft_consensus.cc:2468] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
W20260709 13:04:57.024642 17346 leader_election.cc:343] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.027549 17430 ts_tablet_manager.cc:1434] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:04:57.028523 17430 tablet_bootstrap.cc:492] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:57.028352 17657 consensus_queue.cc:1048] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.028827 17345 leader_election.cc:304] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:57.033619 17604 raft_consensus.cc:2804] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.033972 17471 leader_election.cc:290] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:57.034385 17604 raft_consensus.cc:697] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:57.034991 17642 raft_consensus.cc:2749] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.035605 17693 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:57.035521 17604 consensus_queue.cc:237] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:57.037348 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
W20260709 13:04:57.030222 17270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 55231.4us
I20260709 13:04:57.030134 17595 leader_election.cc:290] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:57.037819 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:57.038726 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:57.038932 17123 leader_election.cc:304] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:57.039314 17379 raft_consensus.cc:3060] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:57.039783 17270 leader_election.cc:343] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.040036 17307 raft_consensus.cc:3060] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.040264 17270 leader_election.cc:304] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:57.032517 17426 tablet_bootstrap.cc:492] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:57.043705 17426 ts_tablet_manager.cc:1403] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.027s
I20260709 13:04:57.044340 17428 tablet_bootstrap.cc:654] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.044148 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04afb5955d549318f7fe723b79f1d3b" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:57.047072 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd5f3f7224fde8c02ed2f1e9de777" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:57.047216 17693 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:57.047334 17426 raft_consensus.cc:359] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.047744 17305 raft_consensus.cc:3060] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.047940 17693 raft_consensus.cc:2804] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.048472 17693 raft_consensus.cc:697] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:57.048705 17307 raft_consensus.cc:2468] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:57.048771 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:57.051142 17233 raft_consensus.cc:3060] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.052225 17693 consensus_queue.cc:237] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.055105 17305 raft_consensus.cc:2468] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:57.050566 17430 tablet_bootstrap.cc:654] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.056030 17655 raft_consensus.cc:2749] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.058701 17123 leader_election.cc:304] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
W20260709 13:04:57.060721 17270 leader_election.cc:343] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.061076 17435 raft_consensus.cc:2804] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.061172 17270 leader_election.cc:304] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:57.061753 17435 raft_consensus.cc:697] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:57.062637 17435 consensus_queue.cc:237] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.063355 17657 raft_consensus.cc:2749] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.067059 17426 raft_consensus.cc:385] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.067370 17426 raft_consensus.cc:740] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.067989 17233 raft_consensus.cc:2468] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:57.069154 17123 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:57.069919 17589 raft_consensus.cc:2804] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.070436 17589 raft_consensus.cc:697] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:57.068200 17426 consensus_queue.cc:260] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.071254 17589 consensus_queue.cc:237] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:57.073184 17426 ts_tablet_manager.cc:1434] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:04:57.074172 17426 tablet_bootstrap.cc:492] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:57.075372 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd5f3f7224fde8c02ed2f1e9de777" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:57.076026 17380 raft_consensus.cc:3060] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.078982 17589 consensus_queue.cc:1048] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.081151 17426 tablet_bootstrap.cc:654] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.084909 17379 raft_consensus.cc:2468] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
W20260709 13:04:57.086635 17346 leader_election.cc:343] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.087638 17346 leader_election.cc:304] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:57.088721 17604 raft_consensus.cc:2804] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.089442 17604 raft_consensus.cc:697] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:57.090541 17604 consensus_queue.cc:237] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.110560 17053 catalog_manager.cc:5697] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.146219 17430 tablet_bootstrap.cc:492] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:57.146790 17430 ts_tablet_manager.cc:1403] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.118s	user 0.021s	sys 0.000s
I20260709 13:04:57.150892 17582 consensus_queue.cc:1048] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.151655 17430 raft_consensus.cc:359] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.152351 17430 raft_consensus.cc:385] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.152624 17430 raft_consensus.cc:740] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.153410 17430 consensus_queue.cc:260] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.155529 17430 ts_tablet_manager.cc:1434] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:57.156401 17430 tablet_bootstrap.cc:492] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:57.159578 17595 raft_consensus.cc:493] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.113709 17380 raft_consensus.cc:2468] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:57.160148 17595 raft_consensus.cc:515] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.181046 17430 tablet_bootstrap.cc:654] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.182420 17448 raft_consensus.cc:493] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.185134 17448 raft_consensus.cc:515] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.196070 17426 tablet_bootstrap.cc:492] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:57.196609 17426 ts_tablet_manager.cc:1403] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.123s	user 0.030s	sys 0.021s
I20260709 13:04:57.197219 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:57.199230 17595 leader_election.cc:290] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:57.199326 17426 raft_consensus.cc:359] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:57.200114 17426 raft_consensus.cc:385] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.200389 17426 raft_consensus.cc:740] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.201058 17426 consensus_queue.cc:260] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:57.203325 17426 ts_tablet_manager.cc:1434] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:57.204188 17426 tablet_bootstrap.cc:492] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:57.204916 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d21695723a94f56863565fdec1d8600" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:57.205749 17305 raft_consensus.cc:2468] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:57.207690 17346 leader_election.cc:304] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:57.208774 17595 raft_consensus.cc:2804] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.209187 17595 raft_consensus.cc:493] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.209522 17595 raft_consensus.cc:3060] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.209972 17426 tablet_bootstrap.cc:654] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.212049 17427 tablet_bootstrap.cc:492] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:57.212610 17427 ts_tablet_manager.cc:1403] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.284s	user 0.035s	sys 0.066s
I20260709 13:04:57.214732 17448 leader_election.cc:290] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:57.217626 17428 tablet_bootstrap.cc:492] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:57.218246 17428 ts_tablet_manager.cc:1403] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.200s	user 0.011s	sys 0.014s
I20260709 13:04:57.219250 17427 raft_consensus.cc:359] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.225602 17427 raft_consensus.cc:385] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.226666 17427 raft_consensus.cc:740] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.228391 17053 catalog_manager.cc:5697] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.230646 17053 catalog_manager.cc:5697] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.233052 17427 consensus_queue.cc:260] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.241366 17595 raft_consensus.cc:515] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.243541 17595 leader_election.cc:290] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:57.248003 17589 consensus_queue.cc:1048] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.248406 17602 raft_consensus.cc:493] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.248925 17602 raft_consensus.cc:515] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:57.229957 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:57.250248 17307 raft_consensus.cc:2393] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:04:57.250959 17602 leader_election.cc:290] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:57.252466 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b355c1a40d24e6387c364c6964fbb99" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:57.253049 17155 raft_consensus.cc:2468] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:57.253945 17197 leader_election.cc:304] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:57.254779 17602 raft_consensus.cc:2804] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.255141 17602 raft_consensus.cc:493] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.256141 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b355c1a40d24e6387c364c6964fbb99" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:57.256793 17380 raft_consensus.cc:2468] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:04:57.258108 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d21695723a94f56863565fdec1d8600" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:57.258911 17305 raft_consensus.cc:3060] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.258989 17602 raft_consensus.cc:3060] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.261914 17055 catalog_manager.cc:5697] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.269444 17055 catalog_manager.cc:5697] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.230793 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d21695723a94f56863565fdec1d8600" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:57.279245 17427 ts_tablet_manager.cc:1434] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.001s
I20260709 13:04:57.280230 17427 tablet_bootstrap.cc:492] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:57.296396 17428 raft_consensus.cc:359] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.297149 17428 raft_consensus.cc:385] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.297381 17428 raft_consensus.cc:740] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.298517 17428 consensus_queue.cc:260] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.299805 17428 ts_tablet_manager.cc:1434] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 13:04:57.300678 17428 tablet_bootstrap.cc:492] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:57.284971 17602 raft_consensus.cc:515] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:57.310272 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d21695723a94f56863565fdec1d8600" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:57.311178 17427 tablet_bootstrap.cc:654] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.321185 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b355c1a40d24e6387c364c6964fbb99" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:57.321853 17153 raft_consensus.cc:3060] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.313730 17602 leader_election.cc:290] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:57.328315 17305 raft_consensus.cc:2468] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:57.328320 17198 leader_election.cc:304] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:57.344444 17448 raft_consensus.cc:3060] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.353570 17426 tablet_bootstrap.cc:492] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:57.354094 17426 ts_tablet_manager.cc:1403] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.150s	user 0.027s	sys 0.041s
I20260709 13:04:57.355132 17153 raft_consensus.cc:2468] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:57.359009 17693 consensus_queue.cc:1048] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.359730 17428 tablet_bootstrap.cc:654] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.359362 17426 raft_consensus.cc:359] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.360142 17426 raft_consensus.cc:385] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.360415 17426 raft_consensus.cc:740] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.361042 17426 consensus_queue.cc:260] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.363076 17426 ts_tablet_manager.cc:1434] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:04:57.363926 17426 tablet_bootstrap.cc:492] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:57.359305 17197 leader_election.cc:304] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:57.370571 17602 raft_consensus.cc:2804] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.371191 17602 raft_consensus.cc:697] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
W20260709 13:04:57.371315 17346 leader_election.cc:343] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.372251 17602 consensus_queue.cc:237] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:57.376763 17426 tablet_bootstrap.cc:654] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:57.372267 17346 leader_election.cc:343] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.379580 17346 leader_election.cc:304] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:57.380656 17718 raft_consensus.cc:2804] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.381310 17718 raft_consensus.cc:697] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:57.382134 17718 consensus_queue.cc:237] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.387377 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b355c1a40d24e6387c364c6964fbb99" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:57.388127 17379 raft_consensus.cc:3060] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.394299 17427 tablet_bootstrap.cc:492] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:57.394836 17427 ts_tablet_manager.cc:1403] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.014s
I20260709 13:04:57.399163 17379 raft_consensus.cc:2468] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:04:57.400187 17427 raft_consensus.cc:359] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.400786 17614 raft_consensus.cc:493] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.401448 17614 raft_consensus.cc:515] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.403390 17428 tablet_bootstrap.cc:492] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:57.397074 17657 raft_consensus.cc:493] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.407533 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85badce89ef744e995d4b4307b661464" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:57.408252 17428 ts_tablet_manager.cc:1403] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.108s	user 0.020s	sys 0.000s
I20260709 13:04:57.400933 17427 raft_consensus.cc:385] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.418454 17427 raft_consensus.cc:740] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.419301 17427 consensus_queue.cc:260] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.410827 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85badce89ef744e995d4b4307b661464" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:57.421032 17427 ts_tablet_manager.cc:1434] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
W20260709 13:04:57.412520 17272 leader_election.cc:343] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.407691 17614 leader_election.cc:290] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:57.408344 17657 raft_consensus.cc:515] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.416779 17430 tablet_bootstrap.cc:492] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:57.426277 17430 ts_tablet_manager.cc:1403] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.270s	user 0.029s	sys 0.007s
I20260709 13:04:57.418013 17448 raft_consensus.cc:2749] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.421588 17153 raft_consensus.cc:2468] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:57.427175 17053 catalog_manager.cc:5697] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.422470 17427 tablet_bootstrap.cc:492] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:57.417025 17428 raft_consensus.cc:359] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.431879 17428 raft_consensus.cc:385] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.432235 17428 raft_consensus.cc:740] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.432343 17055 catalog_manager.cc:5697] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 1 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.433954 17271 leader_election.cc:304] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:57.434762 17657 leader_election.cc:290] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:57.435573 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf8ff673def486c94896905e592b78f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:57.437536 17272 leader_election.cc:343] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.439221 17657 raft_consensus.cc:2804] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.439672 17657 raft_consensus.cc:493] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.440073 17657 raft_consensus.cc:3060] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.446736 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf8ff673def486c94896905e592b78f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:57.448460 17430 raft_consensus.cc:359] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.449496 17430 raft_consensus.cc:385] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.449818 17430 raft_consensus.cc:740] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.453989 17430 consensus_queue.cc:260] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.456449 17430 ts_tablet_manager.cc:1434] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 13:04:57.456773 17657 raft_consensus.cc:515] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.452325 17426 tablet_bootstrap.cc:492] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:57.457473 17430 tablet_bootstrap.cc:492] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:57.460218 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85badce89ef744e995d4b4307b661464" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:57.460472 17657 leader_election.cc:290] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:57.460813 17153 raft_consensus.cc:3060] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.461115 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85badce89ef744e995d4b4307b661464" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:57.461216 17428 consensus_queue.cc:260] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.462339 17379 raft_consensus.cc:2468] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
W20260709 13:04:57.462678 17272 leader_election.cc:343] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.463366 17718 raft_consensus.cc:493] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.463871 17718 raft_consensus.cc:515] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.465207 17428 ts_tablet_manager.cc:1434] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:04:57.465533 17270 leader_election.cc:304] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:57.466799 17428 tablet_bootstrap.cc:492] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:57.465819 17426 ts_tablet_manager.cc:1403] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.102s	user 0.025s	sys 0.005s
I20260709 13:04:57.467075 17427 tablet_bootstrap.cc:654] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.469985 17657 raft_consensus.cc:2804] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.470474 17657 raft_consensus.cc:493] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.470934 17718 leader_election.cc:290] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:57.470878 17657 raft_consensus.cc:3060] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.472497 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf8ff673def486c94896905e592b78f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:57.476218 17346 leader_election.cc:343] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.470338 17448 raft_consensus.cc:493] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.472440 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf8ff673def486c94896905e592b78f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:57.478968 17153 raft_consensus.cc:2468] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:57.479451 17426 raft_consensus.cc:359] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.480988 17426 raft_consensus.cc:385] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.480788 17271 leader_election.cc:304] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:57.481372 17426 raft_consensus.cc:740] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.482088 17614 raft_consensus.cc:2804] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.482599 17614 raft_consensus.cc:697] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:57.483445 17614 consensus_queue.cc:237] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.486222 17430 tablet_bootstrap.cc:654] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.488777 17426 consensus_queue.cc:260] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.489671 17582 raft_consensus.cc:493] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.490132 17582 raft_consensus.cc:515] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.492744 17582 leader_election.cc:290] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:57.495249 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1b381c59ed4f258e1b8e6e37096abc" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:57.495428 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1b381c59ed4f258e1b8e6e37096abc" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
W20260709 13:04:57.496807 17123 leader_election.cc:343] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:57.497581 17123 leader_election.cc:343] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.498011 17123 leader_election.cc:304] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:57.499089 17426 ts_tablet_manager.cc:1434] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.032s	user 0.002s	sys 0.005s
I20260709 13:04:57.499363 17582 raft_consensus.cc:2749] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.500003 17427 tablet_bootstrap.cc:492] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:57.500413 17426 tablet_bootstrap.cc:492] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:57.500521 17427 ts_tablet_manager.cc:1403] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.003s
I20260709 13:04:57.480741 17657 raft_consensus.cc:515] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.503436 17305 raft_consensus.cc:2393] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:57.510135 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf8ff673def486c94896905e592b78f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:57.510671 17426 tablet_bootstrap.cc:654] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.509553 17346 leader_election.cc:304] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
W20260709 13:04:57.511757 17272 leader_election.cc:343] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.511991 17718 raft_consensus.cc:3060] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.514405 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf8ff673def486c94896905e592b78f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:57.517395 17427 raft_consensus.cc:359] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.515571 17657 leader_election.cc:290] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:57.477356 17448 raft_consensus.cc:515] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
W20260709 13:04:57.519305 17346 consensus_peers.cc:597] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:57.518201 17427 raft_consensus.cc:385] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.525235 17427 raft_consensus.cc:740] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.525791 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:57.526199 17427 consensus_queue.cc:260] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.526962 17305 raft_consensus.cc:2393] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:04:57.529266 17427 ts_tablet_manager.cc:1434] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:04:57.530740 17427 tablet_bootstrap.cc:492] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:57.531790 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:57.532577 17582 raft_consensus.cc:493] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.536368 17430 tablet_bootstrap.cc:492] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:57.536942 17196 leader_election.cc:304] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:57.533111 17582 raft_consensus.cc:515] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.539726 17602 raft_consensus.cc:3060] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.541112 17582 leader_election.cc:290] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:57.543021 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04afb5955d549318f7fe723b79f1d3b" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:57.538779 17428 tablet_bootstrap.cc:654] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.543876 17378 raft_consensus.cc:2468] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:57.545723 17121 leader_election.cc:304] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:57.538870 17430 ts_tablet_manager.cc:1403] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.016s
I20260709 13:04:57.543021 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04afb5955d549318f7fe723b79f1d3b" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:57.546845 17305 raft_consensus.cc:2468] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:57.547021 17582 raft_consensus.cc:2804] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.547451 17582 raft_consensus.cc:493] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.547833 17582 raft_consensus.cc:3060] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.547993 17602 raft_consensus.cc:2749] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.533638 17448 leader_election.cc:290] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:57.551668 17430 raft_consensus.cc:359] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.552407 17430 raft_consensus.cc:385] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.552701 17430 raft_consensus.cc:740] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.553431 17430 consensus_queue.cc:260] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.554867 17428 tablet_bootstrap.cc:492] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:57.555392 17428 ts_tablet_manager.cc:1403] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.000s
I20260709 13:04:57.555889 17582 raft_consensus.cc:515] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.556118 17055 catalog_manager.cc:5697] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.558014 17428 raft_consensus.cc:359] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.558723 17428 raft_consensus.cc:385] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.558759 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04afb5955d549318f7fe723b79f1d3b" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:57.559123 17428 raft_consensus.cc:740] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.559418 17305 raft_consensus.cc:3060] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.559823 17428 consensus_queue.cc:260] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.561371 17430 ts_tablet_manager.cc:1434] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:57.562140 17428 ts_tablet_manager.cc:1434] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:57.562487 17430 tablet_bootstrap.cc:492] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:57.563040 17428 tablet_bootstrap.cc:492] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:57.572228 17427 tablet_bootstrap.cc:654] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.573032 17426 tablet_bootstrap.cc:492] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:57.573585 17426 ts_tablet_manager.cc:1403] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.002s
I20260709 13:04:57.573534 17305 raft_consensus.cc:2468] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:57.576390 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04afb5955d549318f7fe723b79f1d3b" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:57.576491 17582 leader_election.cc:290] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:57.576983 17426 raft_consensus.cc:359] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.577777 17426 raft_consensus.cc:385] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.578132 17426 raft_consensus.cc:740] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.578998 17426 consensus_queue.cc:260] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.577353 17378 raft_consensus.cc:3060] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.581367 17426 ts_tablet_manager.cc:1434] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:57.583192 17430 tablet_bootstrap.cc:654] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.576669 17123 leader_election.cc:304] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:57.586756 17582 raft_consensus.cc:2804] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.587767 17582 raft_consensus.cc:697] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:57.589036 17582 consensus_queue.cc:237] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.589893 17604 consensus_queue.cc:1048] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.597175 17718 raft_consensus.cc:2749] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.597482 17693 consensus_queue.cc:1048] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.600271 17595 consensus_queue.cc:1048] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.603184 17378 raft_consensus.cc:2468] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:57.576365 17428 tablet_bootstrap.cc:654] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.613750 17426 tablet_bootstrap.cc:492] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:57.639487 17448 raft_consensus.cc:493] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.620822 17379 raft_consensus.cc:2468] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:57.640350 17448 raft_consensus.cc:515] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.650903 17055 catalog_manager.cc:5697] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.655987 17426 tablet_bootstrap.cc:654] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.658859 17427 tablet_bootstrap.cc:492] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:57.659409 17427 ts_tablet_manager.cc:1403] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.129s	user 0.024s	sys 0.002s
I20260709 13:04:57.663254 17270 leader_election.cc:304] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:57.664731 17657 raft_consensus.cc:2804] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:57.665218 17657 raft_consensus.cc:697] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:57.666050 17657 consensus_queue.cc:237] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.672052 17427 raft_consensus.cc:359] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.672837 17427 raft_consensus.cc:385] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.673131 17427 raft_consensus.cc:740] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.673774 17427 consensus_queue.cc:260] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.683682 17427 ts_tablet_manager.cc:1434] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:04:57.686568 17427 tablet_bootstrap.cc:492] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:57.675220 17693 consensus_queue.cc:1048] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:57.690178 17430 tablet_bootstrap.cc:492] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:57.690646 17430 ts_tablet_manager.cc:1403] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.128s	user 0.027s	sys 0.013s
I20260709 13:04:57.682541 17550 consensus_queue.cc:1048] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:57.702329 17428 tablet_bootstrap.cc:492] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:57.703085 17428 ts_tablet_manager.cc:1403] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.140s	user 0.013s	sys 0.008s
I20260709 13:04:57.724969 17427 tablet_bootstrap.cc:654] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.728139 17448 leader_election.cc:290] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:57.729300 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85badce89ef744e995d4b4307b661464" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:57.738719 17428 raft_consensus.cc:359] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.739653 17428 raft_consensus.cc:385] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.739979 17428 raft_consensus.cc:740] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.737236 17430 raft_consensus.cc:359] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:57.741308 17430 raft_consensus.cc:385] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.741642 17430 raft_consensus.cc:740] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.743101 17428 consensus_queue.cc:260] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.747125 17428 ts_tablet_manager.cc:1434] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:04:57.742434 17430 consensus_queue.cc:260] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:57.749486 17430 ts_tablet_manager.cc:1434] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:04:57.750717 17430 tablet_bootstrap.cc:492] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:57.752838 17582 consensus_queue.cc:1048] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.757807 17430 tablet_bootstrap.cc:654] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.727766 17589 consensus_queue.cc:1048] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.763971 17428 tablet_bootstrap.cc:492] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
W20260709 13:04:57.784482 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 107529us
I20260709 13:04:57.797933 17448 raft_consensus.cc:493] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.807736 17655 raft_consensus.cc:493] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.808296 17655 raft_consensus.cc:515] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.796955 17737 raft_consensus.cc:493] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.811914 17737 raft_consensus.cc:515] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:57.813989 17737 leader_election.cc:290] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:57.833570 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b1ed764894db8bb28922faa095abf" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:57.805234 17448 raft_consensus.cc:515] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
W20260709 13:04:57.836175 17346 leader_election.cc:343] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.847008 17427 tablet_bootstrap.cc:492] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:57.847572 17427 ts_tablet_manager.cc:1403] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.012s
I20260709 13:04:57.837852 17655 leader_election.cc:290] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:57.850489 17471 consensus_queue.cc:1048] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:57.853727 17055 catalog_manager.cc:5697] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.856680 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611590896f024a4a8f1ee24e522dbd0a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:57.862267 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611590896f024a4a8f1ee24e522dbd0a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:57.873075 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85badce89ef744e995d4b4307b661464" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:57.864354 17426 tablet_bootstrap.cc:492] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:57.881568 17155 raft_consensus.cc:2393] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:57.881739 17426 ts_tablet_manager.cc:1403] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.295s	user 0.019s	sys 0.008s
I20260709 13:04:57.883430 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b1ed764894db8bb28922faa095abf" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:57.884184 17153 raft_consensus.cc:2468] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:57.884516 17426 raft_consensus.cc:359] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.885179 17426 raft_consensus.cc:385] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.885425 17426 raft_consensus.cc:740] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.864986 17582 consensus_queue.cc:1048] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.866765 17702 raft_consensus.cc:493] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.886245 17702 raft_consensus.cc:515] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.888157 17378 raft_consensus.cc:2468] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:57.888391 17702 leader_election.cc:290] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:57.891088 17270 leader_election.cc:304] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:57.893431 17614 raft_consensus.cc:2804] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.893803 17614 raft_consensus.cc:493] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.893757 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d21695723a94f56863565fdec1d8600" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:57.894508 17614 raft_consensus.cc:3060] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.895341 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdd6a649a514be4a7e5dd077219ffed" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:57.896772 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d21695723a94f56863565fdec1d8600" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:57.897552 17307 raft_consensus.cc:2393] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:04:57.899152 17490 consensus_queue.cc:1048] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.899781 17428 tablet_bootstrap.cc:654] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:57.902705 17198 leader_election.cc:304] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
W20260709 13:04:57.899670 17272 leader_election.cc:343] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.902964 17426 consensus_queue.cc:260] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:57.871448 17448 leader_election.cc:290] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:57.914822 17490 raft_consensus.cc:493] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.916752 17490 raft_consensus.cc:515] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:04:57.928548 17272 leader_election.cc:343] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:57.935210 17426 ts_tablet_manager.cc:1434] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 13:04:57.907626 17602 raft_consensus.cc:3060] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.939565 17426 tablet_bootstrap.cc:492] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:57.962467 17430 tablet_bootstrap.cc:492] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:57.963083 17430 ts_tablet_manager.cc:1403] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.213s	user 0.017s	sys 0.005s
I20260709 13:04:57.964138 17345 leader_election.cc:304] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:57.966524 17595 raft_consensus.cc:2804] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:57.966897 17595 raft_consensus.cc:493] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.967228 17595 raft_consensus.cc:3060] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.968699 17430 raft_consensus.cc:359] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.969427 17430 raft_consensus.cc:385] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:57.969676 17430 raft_consensus.cc:740] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:57.970774 17430 consensus_queue.cc:260] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.974089 17430 ts_tablet_manager.cc:1434] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:57.974596 17490 leader_election.cc:290] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:57.976715 17430 tablet_bootstrap.cc:492] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:57.950378 17614 raft_consensus.cc:515] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:57.996663 17702 raft_consensus.cc:493] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.996801 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf498205a5942dd9c8ec8f97f6f8c67" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:58.003571 17702 raft_consensus.cc:515] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:58.007146 17229 raft_consensus.cc:3060] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.009332 17230 raft_consensus.cc:3060] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:57.997128 17550 consensus_queue.cc:1048] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:04:58.017238 17430 tablet_bootstrap.cc:654] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.026769 17657 consensus_queue.cc:1048] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:58.002782 17740 log.cc:927] Time spent T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:04:58.033913 17702 leader_election.cc:290] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:58.059368 17427 raft_consensus.cc:359] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:58.061244 17427 raft_consensus.cc:385] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.061553 17427 raft_consensus.cc:740] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.062304 17427 consensus_queue.cc:260] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:58.033317 17595 raft_consensus.cc:515] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:58.080101 17427 ts_tablet_manager.cc:1434] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.232s	user 0.007s	sys 0.000s
I20260709 13:04:58.081694 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf498205a5942dd9c8ec8f97f6f8c67" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:58.084416 17427 tablet_bootstrap.cc:492] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:58.088850 17426 tablet_bootstrap.cc:654] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.091465 17657 raft_consensus.cc:493] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.091997 17657 raft_consensus.cc:515] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:58.092304 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1b381c59ed4f258e1b8e6e37096abc" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:58.092425 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611590896f024a4a8f1ee24e522dbd0a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:58.097678 17657 leader_election.cc:290] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
W20260709 13:04:58.099886 17272 leader_election.cc:343] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:58.100638 17272 leader_election.cc:343] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.102394 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:58.107906 17595 leader_election.cc:290] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:58.108846 17197 leader_election.cc:304] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:58.109791 17428 tablet_bootstrap.cc:492] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:58.118468 17428 ts_tablet_manager.cc:1403] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.355s	user 0.015s	sys 0.013s
I20260709 13:04:58.131953 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdd6a649a514be4a7e5dd077219ffed" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:58.135460 17155 raft_consensus.cc:2468] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:58.112664 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b1ed764894db8bb28922faa095abf" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:58.123888 17602 raft_consensus.cc:2749] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.157598 17614 leader_election.cc:290] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
W20260709 13:04:58.159821 17197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 47856.2us
I20260709 13:04:58.203650 17430 tablet_bootstrap.cc:492] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:58.204794 17430 ts_tablet_manager.cc:1403] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.228s	user 0.015s	sys 0.009s
W20260709 13:04:58.212015 17346 leader_election.cc:343] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.198984 17642 raft_consensus.cc:2749] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.200429 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1b381c59ed4f258e1b8e6e37096abc" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:58.219501 17427 tablet_bootstrap.cc:654] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.220026 17155 raft_consensus.cc:2468] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:58.222002 17197 leader_election.cc:304] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:58.226310 17428 raft_consensus.cc:359] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.226799 17227 raft_consensus.cc:3060] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.227108 17428 raft_consensus.cc:385] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.227449 17428 raft_consensus.cc:740] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.228089 17428 consensus_queue.cc:260] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.229445 17490 consensus_queue.cc:1048] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.232532 17430 raft_consensus.cc:359] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.233167 17430 raft_consensus.cc:385] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.233413 17430 raft_consensus.cc:740] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.234607 17271 leader_election.cc:304] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:58.234869 17430 consensus_queue.cc:260] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.236124 17271 leader_election.cc:304] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:58.236986 17430 ts_tablet_manager.cc:1434] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:04:58.238253 17755 raft_consensus.cc:2804] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.238678 17755 raft_consensus.cc:493] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.239003 17755 raft_consensus.cc:3060] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:58.239269 17270 leader_election.cc:343] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.240247 17430 tablet_bootstrap.cc:492] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:58.246769 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:58.247051 17428 ts_tablet_manager.cc:1434] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.128s	user 0.006s	sys 0.001s
I20260709 13:04:58.248064 17428 tablet_bootstrap.cc:492] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:58.248116 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b1ed764894db8bb28922faa095abf" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:58.248945 17614 raft_consensus.cc:2804] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.249356 17614 raft_consensus.cc:493] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.249658 17614 raft_consensus.cc:3060] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.248795 17153 raft_consensus.cc:3060] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.246584 17702 consensus_queue.cc:1048] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.253916 17702 consensus_queue.cc:1048] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.254781 17602 raft_consensus.cc:2749] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.260607 17471 consensus_queue.cc:1048] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.290967 17595 raft_consensus.cc:493] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.291105 17604 consensus_queue.cc:1048] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.291569 17595 raft_consensus.cc:515] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.293653 17595 leader_election.cc:290] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:58.296051 17426 tablet_bootstrap.cc:492] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:58.296602 17426 ts_tablet_manager.cc:1403] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.360s	user 0.010s	sys 0.011s
I20260709 13:04:58.297088 17153 raft_consensus.cc:2468] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
W20260709 13:04:58.298834 17103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:58.297851 17430 tablet_bootstrap.cc:654] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:58.306263 17271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 69088.1us
I20260709 13:04:58.289733 17614 raft_consensus.cc:515] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:58.327833 17755 raft_consensus.cc:515] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:58.338712 17426 raft_consensus.cc:359] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.339468 17426 raft_consensus.cc:385] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.339701 17426 raft_consensus.cc:740] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
W20260709 13:04:58.322466 17270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 81501.9us
I20260709 13:04:58.343206 17426 consensus_queue.cc:260] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.351078 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e81dc6421d4fdf8dcff43b8a449587" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:58.351837 17231 raft_consensus.cc:2468] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:58.354139 17755 leader_election.cc:290] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:58.355338 17154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e81dc6421d4fdf8dcff43b8a449587" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:58.356328 17345 leader_election.cc:304] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:58.357620 17738 raft_consensus.cc:2804] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.358268 17738 raft_consensus.cc:697] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:58.359131 17346 leader_election.cc:304] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:58.359362 17738 consensus_queue.cc:237] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:58.360793 17744 raft_consensus.cc:2804] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.361164 17744 raft_consensus.cc:493] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.361498 17744 raft_consensus.cc:3060] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.371340 17614 leader_election.cc:290] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:58.377297 17428 tablet_bootstrap.cc:654] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:58.365239 17345 leader_election.cc:343] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.379752 17426 ts_tablet_manager.cc:1434] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.002s
I20260709 13:04:58.395347 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611590896f024a4a8f1ee24e522dbd0a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:58.396088 17381 raft_consensus.cc:3060] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:58.377562 17271 leader_election.cc:343] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.422659 17426 tablet_bootstrap.cc:492] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:58.426564 17381 raft_consensus.cc:2468] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:58.407835 17614 consensus_queue.cc:1048] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:04:58.408144 17582 consensus_queue.cc:1048] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:04:58.446425 17744 raft_consensus.cc:515] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.449440 17642 raft_consensus.cc:493] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.449608 17744 leader_election.cc:290] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:58.450151 17427 tablet_bootstrap.cc:492] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:58.449990 17642 raft_consensus.cc:515] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:58.450644 17427 ts_tablet_manager.cc:1403] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.369s	user 0.020s	sys 0.011s
I20260709 13:04:58.452232 17642 leader_election.cc:290] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:58.452594 17430 tablet_bootstrap.cc:492] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:58.462265 17430 ts_tablet_manager.cc:1403] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.222s	user 0.009s	sys 0.006s
I20260709 13:04:58.416383 17271 leader_election.cc:304] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:58.458516 17427 raft_consensus.cc:359] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:58.467072 17427 raft_consensus.cc:385] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.467391 17427 raft_consensus.cc:740] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.468930 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e81dc6421d4fdf8dcff43b8a449587" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
W20260709 13:04:58.468950 17271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 92836.6us
I20260709 13:04:58.469120 17614 raft_consensus.cc:2749] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.472931 17229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e81dc6421d4fdf8dcff43b8a449587" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:58.473510 17229 raft_consensus.cc:3060] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.473869 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf8ff673def486c94896905e592b78f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:58.473521 17270 leader_election.cc:304] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:58.468122 17427 consensus_queue.cc:260] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:04:58.485988 17345 leader_election.cc:343] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.472931 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf8ff673def486c94896905e592b78f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:58.490626 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdd6a649a514be4a7e5dd077219ffed" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:58.490888 17755 raft_consensus.cc:2804] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.491653 17755 raft_consensus.cc:697] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:58.492743 17755 consensus_queue.cc:237] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:58.494674 17196 leader_election.cc:304] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:58.510340 17155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdd6a649a514be4a7e5dd077219ffed" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
W20260709 13:04:58.511498 17123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 68466.7us
I20260709 13:04:58.515079 17155 raft_consensus.cc:3060] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.515786 17427 ts_tablet_manager.cc:1434] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.065s	user 0.003s	sys 0.004s
I20260709 13:04:58.518402 17430 raft_consensus.cc:359] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:58.519143 17430 raft_consensus.cc:385] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.519362 17430 raft_consensus.cc:740] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.519928 17430 consensus_queue.cc:260] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:58.521574 17430 ts_tablet_manager.cc:1434] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.059s	user 0.001s	sys 0.002s
I20260709 13:04:58.528177 17229 raft_consensus.cc:2468] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:58.528090 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1b381c59ed4f258e1b8e6e37096abc" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:58.510717 17153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1b381c59ed4f258e1b8e6e37096abc" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:58.532476 17430 tablet_bootstrap.cc:492] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:58.533856 17426 tablet_bootstrap.cc:654] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.553784 17428 tablet_bootstrap.cc:492] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:58.554356 17428 ts_tablet_manager.cc:1403] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.306s	user 0.021s	sys 0.056s
I20260709 13:04:58.557618 17428 raft_consensus.cc:359] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.558537 17428 raft_consensus.cc:385] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.558799 17428 raft_consensus.cc:740] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.559671 17428 consensus_queue.cc:260] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.575110 17427 tablet_bootstrap.cc:492] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:58.562628 17153 raft_consensus.cc:3060] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.576644 17756 raft_consensus.cc:2749] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:58.577926 17428 ts_tablet_manager.cc:1434] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:04:58.579341 17428 tablet_bootstrap.cc:492] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
W20260709 13:04:58.550647 17272 leader_election.cc:343] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.585870 17346 leader_election.cc:304] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:58.590307 17604 raft_consensus.cc:2804] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.593092 17755 raft_consensus.cc:493] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.635366 17777 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.635939 17777 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.630918 17604 raft_consensus.cc:697] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:58.650279 17426 tablet_bootstrap.cc:492] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
W20260709 13:04:58.650591 17778 log.cc:927] Time spent T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:58.652668 17153 raft_consensus.cc:2468] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
W20260709 13:04:58.645223 17121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 86813.1us
I20260709 13:04:58.650825 17426 ts_tablet_manager.cc:1403] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.232s	user 0.008s	sys 0.021s
I20260709 13:04:58.630668 17755 raft_consensus.cc:515] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:58.678220 17604 consensus_queue.cc:237] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.650635 17777 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:58.700397 17428 tablet_bootstrap.cc:654] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.703481 17755 leader_election.cc:290] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:58.708235 17430 tablet_bootstrap.cc:654] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.710924 17426 raft_consensus.cc:359] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:58.711643 17426 raft_consensus.cc:385] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.711902 17426 raft_consensus.cc:740] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.712520 17426 consensus_queue.cc:260] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:04:58.713704 17123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 122584us
I20260709 13:04:58.714408 17427 tablet_bootstrap.cc:654] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.716085 17426 ts_tablet_manager.cc:1434] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.000s
I20260709 13:04:58.718266 17426 tablet_bootstrap.cc:492] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:58.724764 17155 raft_consensus.cc:2468] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:58.713466 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b1ed764894db8bb28922faa095abf" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:58.730603 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:58.741417 17123 leader_election.cc:343] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.744815 17426 tablet_bootstrap.cc:654] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.749708 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:58.750476 17380 raft_consensus.cc:2468] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
W20260709 13:04:58.756587 17272 leader_election.cc:343] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:58.762373 17271 leader_election.cc:304] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:58.764164 17657 raft_consensus.cc:2804] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.776355 17304 raft_consensus.cc:3060] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.809033 17657 raft_consensus.cc:697] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:58.834362 17738 consensus_queue.cc:1048] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:58.837230 17271 leader_election.cc:304] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:58.838212 17755 raft_consensus.cc:2804] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.838945 17755 raft_consensus.cc:697] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:58.838830 17642 raft_consensus.cc:493] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.839838 17642 raft_consensus.cc:515] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:58.840184 17755 consensus_queue.cc:237] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:58.844025 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611590896f024a4a8f1ee24e522dbd0a" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:58.850013 17642 leader_election.cc:290] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:58.811964 17657 consensus_queue.cc:237] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:58.882956 17764 consensus_queue.cc:1048] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:58.888298 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611590896f024a4a8f1ee24e522dbd0a" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:58.893007 17196 leader_election.cc:304] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:58.894575 17642 raft_consensus.cc:2749] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:58.946864 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b1ed764894db8bb28922faa095abf" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:58.951005 17428 tablet_bootstrap.cc:492] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:58.951519 17428 ts_tablet_manager.cc:1403] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.372s	user 0.018s	sys 0.020s
I20260709 13:04:58.952944 17430 tablet_bootstrap.cc:492] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:58.953460 17430 ts_tablet_manager.cc:1403] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.421s	user 0.025s	sys 0.046s
I20260709 13:04:58.953230 17121 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:58.962481 17157 raft_consensus.cc:2393] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79ae3773b2274d75b3f71364c0aa6d9c in current term 1: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:04:58.956444 17786 raft_consensus.cc:2804] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:58.975567 17786 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.976047 17428 raft_consensus.cc:359] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:58.976330 17430 raft_consensus.cc:359] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:58.977116 17430 raft_consensus.cc:385] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.976789 17428 raft_consensus.cc:385] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.977415 17430 raft_consensus.cc:740] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.977660 17428 raft_consensus.cc:740] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.978442 17430 consensus_queue.cc:260] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:58.979849 17056 catalog_manager.cc:5697] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.984613 17056 catalog_manager.cc:5697] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.984658 17428 consensus_queue.cc:260] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:58.975941 17786 raft_consensus.cc:3060] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.993955 17428 ts_tablet_manager.cc:1434] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 13:04:58.995328 17428 tablet_bootstrap.cc:492] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:59.001679 17430 ts_tablet_manager.cc:1434] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.003s
I20260709 13:04:59.006404 17430 tablet_bootstrap.cc:492] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:59.009747 17779 raft_consensus.cc:493] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.014843 17426 tablet_bootstrap.cc:492] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:59.015470 17426 ts_tablet_manager.cc:1403] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.299s	user 0.016s	sys 0.023s
I20260709 13:04:59.019861 17427 tablet_bootstrap.cc:492] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:59.020329 17427 ts_tablet_manager.cc:1403] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.445s	user 0.035s	sys 0.006s
I20260709 13:04:59.024492 17271 leader_election.cc:304] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:59.026261 17765 raft_consensus.cc:2749] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.027180 17428 tablet_bootstrap.cc:654] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.016646 17779 raft_consensus.cc:515] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.031216 17738 consensus_queue.cc:1048] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.033190 17779 leader_election.cc:290] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:59.061344 17786 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.062718 17229 raft_consensus.cc:3060] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.066366 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e81dc6421d4fdf8dcff43b8a449587" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:59.067690 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e81dc6421d4fdf8dcff43b8a449587" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:59.068540 17228 raft_consensus.cc:2393] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 1: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:04:59.072578 17430 tablet_bootstrap.cc:654] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.073661 17426 raft_consensus.cc:359] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.079425 17426 raft_consensus.cc:385] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.079799 17426 raft_consensus.cc:740] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.080699 17426 consensus_queue.cc:260] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.077273 17428 tablet_bootstrap.cc:492] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:59.078052 17123 leader_election.cc:304] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:59.082697 17428 ts_tablet_manager.cc:1403] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.013s
I20260709 13:04:59.087857 17426 ts_tablet_manager.cc:1434] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.001s
I20260709 13:04:59.089169 17426 tablet_bootstrap.cc:492] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:59.095324 17435 raft_consensus.cc:3060] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.105228 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:59.105921 17377 raft_consensus.cc:3060] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.106746 17764 consensus_queue.cc:1048] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.107713 17427 raft_consensus.cc:359] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.108412 17427 raft_consensus.cc:385] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.108667 17427 raft_consensus.cc:740] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.114930 17427 consensus_queue.cc:260] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.125778 17427 ts_tablet_manager.cc:1434] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.105s	user 0.008s	sys 0.000s
I20260709 13:04:59.128461 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:59.131479 17427 tablet_bootstrap.cc:492] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:59.123824 17377 raft_consensus.cc:2468] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:59.134294 17121 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
W20260709 13:04:59.139469 17123 leader_election.cc:343] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.144850 17773 raft_consensus.cc:2804] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.145390 17738 consensus_queue.cc:1048] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.146251 17428 raft_consensus.cc:359] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.147022 17428 raft_consensus.cc:385] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.147312 17428 raft_consensus.cc:740] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.147964 17428 consensus_queue.cc:260] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.145499 17773 raft_consensus.cc:697] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:59.153167 17773 consensus_queue.cc:237] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.154409 17786 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:59.160318 17435 raft_consensus.cc:2749] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.165164 17428 ts_tablet_manager.cc:1434] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.001s
I20260709 13:04:59.165997 17428 tablet_bootstrap.cc:492] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:59.171060 17426 tablet_bootstrap.cc:654] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.178187 17427 tablet_bootstrap.cc:654] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.194370 17430 tablet_bootstrap.cc:492] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:59.194943 17430 ts_tablet_manager.cc:1403] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.192s	user 0.017s	sys 0.034s
I20260709 13:04:59.199682 17490 raft_consensus.cc:493] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.202174 17490 raft_consensus.cc:515] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.204283 17490 leader_election.cc:290] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:59.207129 17428 tablet_bootstrap.cc:654] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.210250 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1b381c59ed4f258e1b8e6e37096abc" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:59.211105 17158 raft_consensus.cc:2393] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:59.211838 17430 raft_consensus.cc:359] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.212687 17430 raft_consensus.cc:385] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.213177 17430 raft_consensus.cc:740] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.214490 17430 consensus_queue.cc:260] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.216377 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1b381c59ed4f258e1b8e6e37096abc" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:59.216580 17430 ts_tablet_manager.cc:1434] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:04:59.217595 17430 tablet_bootstrap.cc:492] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:59.218317 17426 tablet_bootstrap.cc:492] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:59.218815 17426 ts_tablet_manager.cc:1403] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.012s
I20260709 13:04:59.221455 17426 raft_consensus.cc:359] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.222141 17426 raft_consensus.cc:385] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.213165 17737 consensus_queue.cc:1048] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.226611 17430 tablet_bootstrap.cc:654] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.226537 17197 leader_election.cc:304] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:59.222393 17426 raft_consensus.cc:740] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.230257 17490 raft_consensus.cc:3060] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.230171 17426 consensus_queue.cc:260] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.230903 17756 raft_consensus.cc:493] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.240295 17756 raft_consensus.cc:515] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.251068 17738 raft_consensus.cc:493] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.251845 17738 raft_consensus.cc:515] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.260605 17426 ts_tablet_manager.cc:1434] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.002s
I20260709 13:04:59.262367 17738 leader_election.cc:290] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:59.264196 17426 tablet_bootstrap.cc:492] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:59.264644 17152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:59.264516 17054 catalog_manager.cc:5697] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.265429 17152 raft_consensus.cc:2468] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:59.266893 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdd6a649a514be4a7e5dd077219ffed" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:59.270059 17756 leader_election.cc:290] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:59.270463 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdd6a649a514be4a7e5dd077219ffed" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:59.271284 17157 raft_consensus.cc:2393] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:59.275403 17345 leader_election.cc:304] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:59.276255 17595 raft_consensus.cc:493] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.276749 17595 raft_consensus.cc:515] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.278672 17426 tablet_bootstrap.cc:654] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.279937 17737 raft_consensus.cc:2804] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.280375 17737 raft_consensus.cc:493] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.280704 17737 raft_consensus.cc:3060] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.282107 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:59.282779 17304 raft_consensus.cc:2468] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:59.285353 17755 raft_consensus.cc:493] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.285331 17197 leader_election.cc:304] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:59.285985 17755 raft_consensus.cc:515] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.287916 17657 consensus_queue.cc:1048] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.291329 17227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cac27834104ce3980fe87e7e6e00ec" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:59.292217 17642 raft_consensus.cc:3060] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.291417 17053 catalog_manager.cc:5697] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:59.294226 17272 leader_election.cc:343] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.288197 17755 leader_election.cc:290] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:59.303081 17642 raft_consensus.cc:2749] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.306763 17595 leader_election.cc:290] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:59.308977 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cac27834104ce3980fe87e7e6e00ec" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:59.309723 17378 raft_consensus.cc:2468] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:59.312376 17270 leader_election.cc:304] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:59.313236 17614 raft_consensus.cc:2804] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.313622 17614 raft_consensus.cc:493] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.313978 17614 raft_consensus.cc:3060] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.318081 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cac27834104ce3980fe87e7e6e00ec" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:59.321165 17737 raft_consensus.cc:515] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.323253 17227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cac27834104ce3980fe87e7e6e00ec" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:59.324990 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:59.325596 17158 raft_consensus.cc:3060] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.331147 17737 leader_election.cc:290] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:59.333804 17158 raft_consensus.cc:2468] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:59.334365 17764 consensus_queue.cc:1048] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.334760 17786 raft_consensus.cc:493] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.335254 17786 raft_consensus.cc:515] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.338174 17345 leader_election.cc:304] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:59.338418 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2a5e865cd45b0a86c5a59f00e57a1" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:04:59.339968 17123 leader_election.cc:343] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.341373 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2a5e865cd45b0a86c5a59f00e57a1" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:59.344123 17490 raft_consensus.cc:2749] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:59.348251 17121 leader_election.cc:343] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.349179 17121 leader_election.cc:304] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:59.349472 17786 leader_election.cc:290] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:59.350003 17786 raft_consensus.cc:2749] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.352319 17737 raft_consensus.cc:2804] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.353368 17737 raft_consensus.cc:697] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:04:59.355207 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:59.354948 17052 catalog_manager.cc:5697] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } }
I20260709 13:04:59.355839 17304 raft_consensus.cc:3060] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:59.357403 17346 leader_election.cc:343] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.348320 17614 raft_consensus.cc:515] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.362996 17428 tablet_bootstrap.cc:492] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:59.363559 17428 ts_tablet_manager.cc:1403] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.198s	user 0.027s	sys 0.023s
I20260709 13:04:59.363713 17307 raft_consensus.cc:2393] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:59.368018 17304 raft_consensus.cc:2468] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:59.369354 17346 leader_election.cc:304] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:59.369894 17428 raft_consensus.cc:359] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.370695 17428 raft_consensus.cc:385] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.370761 17595 raft_consensus.cc:3060] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.378574 17427 tablet_bootstrap.cc:492] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:59.379168 17427 ts_tablet_manager.cc:1403] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.252s	user 0.012s	sys 0.008s
I20260709 13:04:59.380358 17430 tablet_bootstrap.cc:492] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:59.380882 17430 ts_tablet_manager.cc:1403] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.163s	user 0.017s	sys 0.023s
I20260709 13:04:59.382050 17427 raft_consensus.cc:359] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.383836 17427 raft_consensus.cc:385] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.384166 17427 raft_consensus.cc:740] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.384454 17430 raft_consensus.cc:359] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.384984 17427 consensus_queue.cc:260] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.371133 17428 raft_consensus.cc:740] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.369264 17737 consensus_queue.cc:237] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.385450 17430 raft_consensus.cc:385] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.386528 17428 consensus_queue.cc:260] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.387171 17430 raft_consensus.cc:740] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.387897 17430 consensus_queue.cc:260] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.388515 17426 tablet_bootstrap.cc:492] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:59.389302 17426 ts_tablet_manager.cc:1403] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.128s	user 0.025s	sys 0.024s
I20260709 13:04:59.389611 17428 ts_tablet_manager.cc:1434] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:04:59.390981 17428 tablet_bootstrap.cc:492] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:59.392158 17490 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.392614 17490 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.394419 17427 ts_tablet_manager.cc:1434] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:59.394608 17490 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:59.395574 17427 tablet_bootstrap.cc:492] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:59.396582 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:59.397239 17428 tablet_bootstrap.cc:654] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.397709 17426 raft_consensus.cc:359] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.398445 17426 raft_consensus.cc:385] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.398756 17426 raft_consensus.cc:740] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.399535 17426 consensus_queue.cc:260] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.401739 17427 tablet_bootstrap.cc:654] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.401895 17426 ts_tablet_manager.cc:1434] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:04:59.403053 17426 tablet_bootstrap.cc:492] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:59.389917 17430 ts_tablet_manager.cc:1434] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:04:59.404750 17755 consensus_queue.cc:1048] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.405283 17430 tablet_bootstrap.cc:492] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:59.409587 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:59.410600 17378 raft_consensus.cc:2393] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:04:59.411979 17430 tablet_bootstrap.cc:654] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.413075 17428 tablet_bootstrap.cc:492] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:59.413266 17426 tablet_bootstrap.cc:654] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.414188 17428 ts_tablet_manager.cc:1403] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.009s
I20260709 13:04:59.419917 17427 tablet_bootstrap.cc:492] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:59.420490 17427 ts_tablet_manager.cc:1403] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 13:04:59.422623 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cac27834104ce3980fe87e7e6e00ec" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:59.423462 17614 leader_election.cc:290] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:59.423439 17427 raft_consensus.cc:359] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.422472 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cac27834104ce3980fe87e7e6e00ec" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:59.424444 17427 raft_consensus.cc:385] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.424823 17427 raft_consensus.cc:740] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
W20260709 13:04:59.425630 17272 leader_election.cc:343] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.425530 17427 consensus_queue.cc:260] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.427875 17427 ts_tablet_manager.cc:1434] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:59.428869 17427 tablet_bootstrap.cc:492] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:59.433256 17196 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:59.433277 17428 raft_consensus.cc:359] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.434172 17428 raft_consensus.cc:385] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.434453 17428 raft_consensus.cc:740] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.434885 17746 raft_consensus.cc:3060] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.435132 17428 consensus_queue.cc:260] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.437225 17428 ts_tablet_manager.cc:1434] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 13:04:59.442251 17738 raft_consensus.cc:493] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.442795 17738 raft_consensus.cc:515] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.444881 17738 leader_election.cc:290] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:59.445320 17428 tablet_bootstrap.cc:492] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:59.446560 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
W20260709 13:04:59.448138 17345 leader_election.cc:343] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.450609 17595 raft_consensus.cc:2749] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.455503 17428 tablet_bootstrap.cc:654] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.458464 17427 tablet_bootstrap.cc:654] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.459228 17378 raft_consensus.cc:2468] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:59.472581 17270 leader_election.cc:304] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:59.475380 17755 raft_consensus.cc:2804] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.476034 17755 raft_consensus.cc:697] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:59.477067 17755 consensus_queue.cc:237] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.477020 17426 tablet_bootstrap.cc:492] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:59.481107 17426 ts_tablet_manager.cc:1403] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.002s
I20260709 13:04:59.481931 17428 tablet_bootstrap.cc:492] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:59.482496 17428 ts_tablet_manager.cc:1403] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.001s
I20260709 13:04:59.483741 17426 raft_consensus.cc:359] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.485412 17426 raft_consensus.cc:385] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.485699 17426 raft_consensus.cc:740] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.487519 17426 consensus_queue.cc:260] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.487936 17428 raft_consensus.cc:359] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.489615 17428 raft_consensus.cc:385] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.490350 17428 raft_consensus.cc:740] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.491518 17428 consensus_queue.cc:260] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.491978 17430 tablet_bootstrap.cc:492] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:59.493549 17430 ts_tablet_manager.cc:1403] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.035s
I20260709 13:04:59.496379 17430 raft_consensus.cc:359] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.497025 17430 raft_consensus.cc:385] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.497340 17430 raft_consensus.cc:740] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.497918 17430 consensus_queue.cc:260] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.488970 17053 catalog_manager.cc:5697] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.492077 17426 ts_tablet_manager.cc:1434] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:59.520385 17426 tablet_bootstrap.cc:492] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:59.499737 17430 ts_tablet_manager.cc:1434] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:04:59.523870 17430 tablet_bootstrap.cc:492] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:59.526988 17428 ts_tablet_manager.cc:1434] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.001s
I20260709 13:04:59.528817 17746 raft_consensus.cc:2749] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.525547 17055 catalog_manager.cc:5697] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.534058 17430 tablet_bootstrap.cc:654] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.537204 17428 tablet_bootstrap.cc:492] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:59.543676 17428 tablet_bootstrap.cc:654] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.551851 17755 consensus_queue.cc:1048] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.552454 17428 tablet_bootstrap.cc:492] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:59.553864 17428 ts_tablet_manager.cc:1403] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:04:59.556344 17426 tablet_bootstrap.cc:654] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.557222 17428 raft_consensus.cc:359] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.557955 17428 raft_consensus.cc:385] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.558290 17428 raft_consensus.cc:740] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.562404 17430 tablet_bootstrap.cc:492] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:59.562896 17430 ts_tablet_manager.cc:1403] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.001s
I20260709 13:04:59.565366 17430 raft_consensus.cc:359] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.566001 17430 raft_consensus.cc:385] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.566289 17430 raft_consensus.cc:740] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.567013 17428 consensus_queue.cc:260] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.569229 17764 raft_consensus.cc:493] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.569383 17428 ts_tablet_manager.cc:1434] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:04:59.569721 17764 raft_consensus.cc:515] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.570467 17430 consensus_queue.cc:260] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.573166 17430 ts_tablet_manager.cc:1434] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:04:59.573755 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8692f804ad346579cc888efbc5c2bae" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:59.574088 17430 tablet_bootstrap.cc:492] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:59.574483 17377 raft_consensus.cc:2468] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:59.574707 17426 tablet_bootstrap.cc:492] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:59.575224 17426 ts_tablet_manager.cc:1403] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.005s
I20260709 13:04:59.576314 17428 tablet_bootstrap.cc:492] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:59.580611 17430 tablet_bootstrap.cc:654] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.581724 17764 leader_election.cc:290] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:59.583145 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8692f804ad346579cc888efbc5c2bae" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:59.584625 17426 raft_consensus.cc:359] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.585290 17426 raft_consensus.cc:385] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.585537 17426 raft_consensus.cc:740] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.581646 17270 leader_election.cc:304] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:04:59.586194 17426 consensus_queue.cc:260] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
W20260709 13:04:59.586462 17271 leader_election.cc:343] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.588929 17428 tablet_bootstrap.cc:654] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.589303 17614 raft_consensus.cc:2804] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.599361 17614 raft_consensus.cc:493] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.600605 17614 raft_consensus.cc:3060] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:59.607874 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 165840us
I20260709 13:04:59.609403 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:59.591648 17426 ts_tablet_manager.cc:1434] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:04:59.613384 17426 tablet_bootstrap.cc:492] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
W20260709 13:04:59.599416 17814 log.cc:927] Time spent T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:04:59.606598 17818 log.cc:927] Time spent T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:04:59.636097 17786 raft_consensus.cc:493] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.636641 17786 raft_consensus.cc:515] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.640825 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:59.641659 17377 raft_consensus.cc:2468] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:59.642185 17786 leader_election.cc:290] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:59.643146 17121 leader_election.cc:304] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:59.644654 17786 raft_consensus.cc:2804] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.645183 17786 raft_consensus.cc:493] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.645558 17786 raft_consensus.cc:3060] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:59.664148 17346 leader_election.cc:343] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.664861 17346 leader_election.cc:304] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:59.668294 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:59.668743 17738 raft_consensus.cc:2749] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:59.672034 17123 leader_election.cc:343] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.665046 17435 raft_consensus.cc:493] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.679095 17755 raft_consensus.cc:493] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.679665 17755 raft_consensus.cc:515] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.681643 17435 raft_consensus.cc:515] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.684115 17426 tablet_bootstrap.cc:654] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.685150 17227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650da7040f44f1ea1d37f44e9e5900a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:59.685853 17227 raft_consensus.cc:2468] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:59.687079 17595 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.687255 17272 leader_election.cc:304] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:04:59.687608 17595 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.688618 17655 raft_consensus.cc:2804] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.689031 17655 raft_consensus.cc:493] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.689411 17655 raft_consensus.cc:3060] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.689781 17595 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:59.689123 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650da7040f44f1ea1d37f44e9e5900a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:59.694907 17227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:59.695724 17471 raft_consensus.cc:493] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.694478 17755 leader_election.cc:290] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:59.699622 17471 raft_consensus.cc:515] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.707767 17427 tablet_bootstrap.cc:492] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:59.708448 17427 ts_tablet_manager.cc:1403] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.280s	user 0.048s	sys 0.120s
I20260709 13:04:59.714214 17435 leader_election.cc:290] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:59.714735 17430 tablet_bootstrap.cc:492] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:59.715248 17430 ts_tablet_manager.cc:1403] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.028s
I20260709 13:04:59.709965 17157 raft_consensus.cc:2468] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:04:59.714387 17471 leader_election.cc:290] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:59.725629 17055 catalog_manager.cc:5697] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.717857 17430 raft_consensus.cc:359] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.732978 17430 raft_consensus.cc:385] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.734314 17430 raft_consensus.cc:740] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.730705 17427 raft_consensus.cc:359] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.734845 17427 raft_consensus.cc:385] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.735265 17427 raft_consensus.cc:740] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.736292 17427 consensus_queue.cc:260] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.739341 17430 consensus_queue.cc:260] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.742228 17430 ts_tablet_manager.cc:1434] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:04:59.742755 17428 tablet_bootstrap.cc:492] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:59.743256 17428 ts_tablet_manager.cc:1403] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.167s	user 0.032s	sys 0.025s
I20260709 13:04:59.745680 17830 consensus_queue.cc:1048] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.746361 17614 raft_consensus.cc:515] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.748451 17614 leader_election.cc:290] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:04:59.750339 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8692f804ad346579cc888efbc5c2bae" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:59.752127 17427 ts_tablet_manager.cc:1434] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:04:59.752171 17786 raft_consensus.cc:515] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.752966 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8692f804ad346579cc888efbc5c2bae" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:59.753600 17378 raft_consensus.cc:3060] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.721699 17655 raft_consensus.cc:515] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.756942 17227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b39f71b242b42f986fa68287bf62ba8" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:59.758344 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650da7040f44f1ea1d37f44e9e5900a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:59.759166 17307 raft_consensus.cc:2393] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:59.760142 17427 tablet_bootstrap.cc:492] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
W20260709 13:04:59.762296 17271 leader_election.cc:343] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.755314 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650da7040f44f1ea1d37f44e9e5900a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:59.763106 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:59.763520 17233 raft_consensus.cc:2468] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:59.755462 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b39f71b242b42f986fa68287bf62ba8" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:59.764183 17304 raft_consensus.cc:2468] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:04:59.764817 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650da7040f44f1ea1d37f44e9e5900a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:59.765450 17158 raft_consensus.cc:3060] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.766347 17430 tablet_bootstrap.cc:492] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:04:59.769574 17427 tablet_bootstrap.cc:654] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:59.764950 17123 leader_election.cc:343] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.770514 17123 leader_election.cc:304] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:59.772655 17430 tablet_bootstrap.cc:654] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:59.773362 17123 leader_election.cc:343] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.775161 17123 leader_election.cc:304] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:59.775410 17227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0650da7040f44f1ea1d37f44e9e5900a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:59.775880 17773 raft_consensus.cc:2804] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.776119 17227 raft_consensus.cc:3060] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.776348 17773 raft_consensus.cc:493] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.776808 17773 raft_consensus.cc:3060] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.778281 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:04:59.775695 17655 leader_election.cc:290] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:59.779079 17381 raft_consensus.cc:3060] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.779857 17378 raft_consensus.cc:2468] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:59.785049 17158 raft_consensus.cc:2468] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:59.785590 17471 raft_consensus.cc:2764] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:59.776763 17786 leader_election.cc:290] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:59.788008 17746 raft_consensus.cc:493] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.788520 17746 raft_consensus.cc:515] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:04:59.789973 17270 leader_election.cc:304] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:59.790966 17746 leader_election.cc:290] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:04:59.791393 17614 raft_consensus.cc:2804] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.792111 17614 raft_consensus.cc:697] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:59.792970 17614 consensus_queue.cc:237] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.798669 17271 leader_election.cc:304] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:59.799337 17426 tablet_bootstrap.cc:492] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:04:59.799834 17426 ts_tablet_manager.cc:1403] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.187s	user 0.018s	sys 0.009s
I20260709 13:04:59.800248 17755 raft_consensus.cc:2804] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.802496 17755 raft_consensus.cc:697] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:04:59.803179 17773 raft_consensus.cc:515] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.803413 17755 consensus_queue.cc:237] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.810632 17428 raft_consensus.cc:359] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.811563 17428 raft_consensus.cc:385] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.811920 17428 raft_consensus.cc:740] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.813344 17428 consensus_queue.cc:260] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.814882 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cac27834104ce3980fe87e7e6e00ec" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:04:59.814332 17427 tablet_bootstrap.cc:492] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:04:59.815768 17427 ts_tablet_manager.cc:1403] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.002s
I20260709 13:04:59.817888 17227 raft_consensus.cc:2468] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:04:59.818684 17428 ts_tablet_manager.cc:1434] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.001s
I20260709 13:04:59.819675 17428 tablet_bootstrap.cc:492] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:04:59.820297 17381 raft_consensus.cc:2468] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:59.822844 17427 raft_consensus.cc:359] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.829131 17427 raft_consensus.cc:385] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.828975 17121 leader_election.cc:304] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c
W20260709 13:04:59.824507 17346 leader_election.cc:343] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.829571 17427 raft_consensus.cc:740] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.838888 17427 consensus_queue.cc:260] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.854717 17427 ts_tablet_manager.cc:1434] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 13:04:59.855773 17427 tablet_bootstrap.cc:492] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:04:59.857219 17426 raft_consensus.cc:359] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.857798 17426 raft_consensus.cc:385] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.858057 17426 raft_consensus.cc:740] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.858633 17426 consensus_queue.cc:260] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.838971 17830 raft_consensus.cc:2804] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.864285 17738 raft_consensus.cc:493] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.864897 17738 raft_consensus.cc:515] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.866147 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cac27834104ce3980fe87e7e6e00ec" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:04:59.867012 17378 raft_consensus.cc:2393] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:04:59.867342 17426 ts_tablet_manager.cc:1434] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.002s
I20260709 13:04:59.874704 17426 tablet_bootstrap.cc:492] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:04:59.877705 17196 leader_election.cc:304] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:04:59.878568 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b39f71b242b42f986fa68287bf62ba8" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:04:59.879614 17490 raft_consensus.cc:3060] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.882575 17055 catalog_manager.cc:5697] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.889164 17305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b39f71b242b42f986fa68287bf62ba8" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:04:59.889763 17305 raft_consensus.cc:3060] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.892251 17490 raft_consensus.cc:2749] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.873987 17830 raft_consensus.cc:697] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
W20260709 13:04:59.895684 17103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:59.896425 17830 consensus_queue.cc:237] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.880132 17773 leader_election.cc:290] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:04:59.899497 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
W20260709 13:04:59.902652 17123 leader_election.cc:343] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.903229 17428 tablet_bootstrap.cc:654] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:59.903210 17345 leader_election.cc:343] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.906244 17345 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:04:59.907441 17744 raft_consensus.cc:2749] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.907297 17831 consensus_queue.cc:1048] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.911748 17738 leader_election.cc:290] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:59.915298 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2a5e865cd45b0a86c5a59f00e57a1" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:04:59.916024 17158 raft_consensus.cc:2468] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:59.917112 17345 leader_election.cc:304] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:04:59.917902 17744 raft_consensus.cc:2804] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.918292 17744 raft_consensus.cc:493] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.918596 17744 raft_consensus.cc:3060] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.919747 17229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2a5e865cd45b0a86c5a59f00e57a1" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:04:59.920734 17229 raft_consensus.cc:2468] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:04:59.912681 17305 raft_consensus.cc:2468] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:04:59.926900 17123 leader_election.cc:304] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:04:59.928016 17773 raft_consensus.cc:2804] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.928771 17773 raft_consensus.cc:697] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:04:59.928673 17744 raft_consensus.cc:515] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:04:59.929896 17773 consensus_queue.cc:237] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:04:59.931690 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2a5e865cd45b0a86c5a59f00e57a1" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:04:59.932296 17158 raft_consensus.cc:3060] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.944911 17055 catalog_manager.cc:5697] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.948695 17426 tablet_bootstrap.cc:654] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.961977 17427 tablet_bootstrap.cc:654] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.973505 17430 tablet_bootstrap.cc:492] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:04:59.973999 17430 ts_tablet_manager.cc:1403] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.208s	user 0.030s	sys 0.011s
I20260709 13:04:59.977514 17428 tablet_bootstrap.cc:492] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:04:59.978426 17428 ts_tablet_manager.cc:1403] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.159s	user 0.020s	sys 0.004s
I20260709 13:04:59.970309 17744 leader_election.cc:290] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:04:59.992368 17158 raft_consensus.cc:2468] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:04:59.993204 17755 consensus_queue.cc:1048] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.002187 17428 raft_consensus.cc:359] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.004314 17428 raft_consensus.cc:385] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.004552 17428 raft_consensus.cc:740] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.005084 17428 consensus_queue.cc:260] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:04:59.995411 17229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2a5e865cd45b0a86c5a59f00e57a1" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:00.016361 17056 catalog_manager.cc:5697] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.010985 17430 raft_consensus.cc:359] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.025224 17430 raft_consensus.cc:385] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.025704 17430 raft_consensus.cc:740] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.026499 17430 consensus_queue.cc:260] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.009179 17229 raft_consensus.cc:3060] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.034696 17428 ts_tablet_manager.cc:1434] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:05:00.037935 17428 tablet_bootstrap.cc:492] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:05:00.043350 17430 ts_tablet_manager.cc:1434] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 13:05:00.047029 17427 tablet_bootstrap.cc:492] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:05:00.047565 17427 ts_tablet_manager.cc:1403] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.192s	user 0.025s	sys 0.004s
I20260709 13:05:00.047811 17604 consensus_queue.cc:1048] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.048111 17345 leader_election.cc:304] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:00.049117 17737 raft_consensus.cc:493] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.049556 17737 raft_consensus.cc:515] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.050346 17427 raft_consensus.cc:359] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.053900 17427 raft_consensus.cc:385] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.054531 17430 tablet_bootstrap.cc:492] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:05:00.057713 17737 leader_election.cc:290] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:00.050271 17744 raft_consensus.cc:2804] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.059950 17744 raft_consensus.cc:697] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:00.055727 17427 raft_consensus.cc:740] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.062410 17427 consensus_queue.cc:260] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.069449 17744 consensus_queue.cc:237] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.070384 17229 raft_consensus.cc:2468] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:00.070555 17427 ts_tablet_manager.cc:1434] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:05:00.071758 17427 tablet_bootstrap.cc:492] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:05:00.089480 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ddeea989c64b70a533198455dc0b6c" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:00.119387 17426 tablet_bootstrap.cc:492] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:05:00.119958 17426 ts_tablet_manager.cc:1403] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.245s	user 0.025s	sys 0.023s
I20260709 13:05:00.121325 17428 tablet_bootstrap.cc:654] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.122709 17426 raft_consensus.cc:359] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.123441 17426 raft_consensus.cc:385] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.123695 17426 raft_consensus.cc:740] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.125948 17426 consensus_queue.cc:260] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:05:00.116094 17345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 68067.9us
I20260709 13:05:00.131397 17426 ts_tablet_manager.cc:1434] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:00.132361 17426 tablet_bootstrap.cc:492] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
W20260709 13:05:00.135488 17346 leader_election.cc:343] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.145107 17655 consensus_queue.cc:1048] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.151949 17427 tablet_bootstrap.cc:654] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.153268 17152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ddeea989c64b70a533198455dc0b6c" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:05:00.157199 17426 tablet_bootstrap.cc:654] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.164426 17737 consensus_queue.cc:1048] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.166693 17428 tablet_bootstrap.cc:492] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:05:00.167263 17428 ts_tablet_manager.cc:1403] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.130s	user 0.004s	sys 0.016s
W20260709 13:05:00.167276 17345 leader_election.cc:343] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.167994 17345 leader_election.cc:304] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:00.168809 17737 raft_consensus.cc:2749] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.170147 17428 raft_consensus.cc:359] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.170938 17428 raft_consensus.cc:385] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.171312 17428 raft_consensus.cc:740] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.176306 17430 tablet_bootstrap.cc:654] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:00.181826 17271 consensus_peers.cc:597] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:00.187734 17428 consensus_queue.cc:260] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.191002 17428 ts_tablet_manager.cc:1434] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 13:05:00.192273 17428 tablet_bootstrap.cc:492] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Bootstrap starting.
I20260709 13:05:00.197052 17430 tablet_bootstrap.cc:492] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:05:00.199012 17430 ts_tablet_manager.cc:1403] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.001s
I20260709 13:05:00.201704 17430 raft_consensus.cc:359] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:00.202395 17430 raft_consensus.cc:385] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.202643 17430 raft_consensus.cc:740] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.203979 17430 consensus_queue.cc:260] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:00.206805 17426 tablet_bootstrap.cc:492] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:05:00.207407 17426 ts_tablet_manager.cc:1403] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.008s
I20260709 13:05:00.208712 17428 tablet_bootstrap.cc:654] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.210119 17426 raft_consensus.cc:359] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.210956 17426 raft_consensus.cc:385] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.212005 17426 raft_consensus.cc:740] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.212652 17430 ts_tablet_manager.cc:1434] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:05:00.212853 17426 consensus_queue.cc:260] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.213784 17430 tablet_bootstrap.cc:492] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:05:00.216653 17426 ts_tablet_manager.cc:1434] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:00.220343 17426 tablet_bootstrap.cc:492] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:00.233475 17428 tablet_bootstrap.cc:492] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d: No bootstrap required, opened a new log
I20260709 13:05:00.234071 17428 ts_tablet_manager.cc:1403] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.002s
I20260709 13:05:00.235985 17427 tablet_bootstrap.cc:492] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:05:00.236531 17427 ts_tablet_manager.cc:1403] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.013s
I20260709 13:05:00.236958 17428 raft_consensus.cc:359] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.238006 17428 raft_consensus.cc:385] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.238284 17428 raft_consensus.cc:740] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.239027 17427 raft_consensus.cc:359] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.239715 17427 raft_consensus.cc:385] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.239950 17427 raft_consensus.cc:740] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.241120 17430 tablet_bootstrap.cc:654] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.240804 17427 consensus_queue.cc:260] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.239050 17428 consensus_queue.cc:260] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.243485 17427 ts_tablet_manager.cc:1434] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:00.243896 17426 tablet_bootstrap.cc:654] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.244834 17427 tablet_bootstrap.cc:492] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:05:00.243536 17428 ts_tablet_manager.cc:1434] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:00.250089 17430 tablet_bootstrap.cc:492] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:05:00.250617 17430 ts_tablet_manager.cc:1403] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.037s	user 0.024s	sys 0.001s
I20260709 13:05:00.253536 17430 raft_consensus.cc:359] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.254236 17430 raft_consensus.cc:385] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.254498 17430 raft_consensus.cc:740] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.255111 17430 consensus_queue.cc:260] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.255745 17655 raft_consensus.cc:493] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.256271 17655 raft_consensus.cc:515] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.256982 17430 ts_tablet_manager.cc:1434] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:00.257956 17430 tablet_bootstrap.cc:492] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:05:00.258345 17655 leader_election.cc:290] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:00.259335 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c29266dacd348e593e9ece686e2e4e6" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:00.259783 17427 tablet_bootstrap.cc:654] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.260023 17381 raft_consensus.cc:2468] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:05:00.261559 17426 tablet_bootstrap.cc:492] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:05:00.261406 17270 leader_election.cc:304] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:00.262255 17655 raft_consensus.cc:2804] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:00.262498 17426 ts_tablet_manager.cc:1403] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.009s
I20260709 13:05:00.262629 17655 raft_consensus.cc:493] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.263025 17655 raft_consensus.cc:3060] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.264348 17430 tablet_bootstrap.cc:654] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.265295 17426 raft_consensus.cc:359] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.265978 17426 raft_consensus.cc:385] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.266263 17426 raft_consensus.cc:740] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.266916 17426 consensus_queue.cc:260] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.269227 17426 ts_tablet_manager.cc:1434] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:05:00.270119 17426 tablet_bootstrap.cc:492] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:00.271018 17655 raft_consensus.cc:515] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.275228 17655 leader_election.cc:290] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:00.340061 17737 raft_consensus.cc:493] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.341184 17430 tablet_bootstrap.cc:492] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:05:00.351402 17773 raft_consensus.cc:493] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.351977 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c29266dacd348e593e9ece686e2e4e6" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:00.342357 17737 raft_consensus.cc:515] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.352625 17773 raft_consensus.cc:515] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:00.353411 17381 raft_consensus.cc:3060] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.367338 17737 leader_election.cc:290] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:00.368770 17430 ts_tablet_manager.cc:1403] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.111s	user 0.017s	sys 0.004s
I20260709 13:05:00.371079 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:00.372236 17304 raft_consensus.cc:2468] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:05:00.383560 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:00.384822 17228 raft_consensus.cc:2468] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 0.
I20260709 13:05:00.387495 17052 catalog_manager.cc:5697] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.394366 17755 consensus_queue.cc:1048] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.401644 17346 leader_election.cc:304] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:00.396606 17773 leader_election.cc:290] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:00.271739 17427 tablet_bootstrap.cc:492] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:05:00.412533 17152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c29266dacd348e593e9ece686e2e4e6" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:05:00.413784 17152 raft_consensus.cc:3060] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.416821 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c29266dacd348e593e9ece686e2e4e6" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:05:00.413797 17427 ts_tablet_manager.cc:1403] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.169s	user 0.013s	sys 0.006s
I20260709 13:05:00.417752 17426 tablet_bootstrap.cc:654] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.431413 17755 consensus_queue.cc:1048] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.436575 17657 consensus_queue.cc:1048] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.445111 17655 raft_consensus.cc:493] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.445905 17655 raft_consensus.cc:515] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.451478 17655 leader_election.cc:290] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:00.457176 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:00.459538 17379 raft_consensus.cc:2393] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79ae3773b2274d75b3f71364c0aa6d9c in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
W20260709 13:05:00.460326 17345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 46683.5us
I20260709 13:05:00.464265 17430 raft_consensus.cc:359] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:00.465174 17430 raft_consensus.cc:385] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.465512 17430 raft_consensus.cc:740] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.466524 17430 consensus_queue.cc:260] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:00.454370 17737 raft_consensus.cc:2804] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:00.483965 17737 raft_consensus.cc:493] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.490983 17773 raft_consensus.cc:493] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.493624 17773 raft_consensus.cc:515] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.496273 17773 leader_election.cc:290] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:00.507161 17427 raft_consensus.cc:359] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:00.510481 17427 raft_consensus.cc:385] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.510948 17427 raft_consensus.cc:740] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.511963 17427 consensus_queue.cc:260] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:00.515605 17427 ts_tablet_manager.cc:1434] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.005s
I20260709 13:05:00.517481 17427 tablet_bootstrap.cc:492] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c: Bootstrap starting.
I20260709 13:05:00.492065 17737 raft_consensus.cc:3060] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.523267 17381 raft_consensus.cc:2468] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:05:00.525401 17270 leader_election.cc:304] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:00.527906 17864 raft_consensus.cc:2804] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.528601 17864 raft_consensus.cc:697] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:00.531096 17864 consensus_queue.cc:237] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:00.542371 17152 raft_consensus.cc:2468] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:05:00.542944 17746 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.543673 17746 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.544394 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:00.545249 17233 raft_consensus.cc:2468] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:05:00.571347 17157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:05:00.550868 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:00.578596 17303 raft_consensus.cc:2468] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:05:00.582401 17744 raft_consensus.cc:493] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.583125 17744 raft_consensus.cc:515] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.585639 17744 leader_election.cc:290] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:00.589876 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:00.589197 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:00.590824 17381 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
I20260709 13:05:00.592398 17746 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:00.592356 17227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:05:00.592988 17346 leader_election.cc:343] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.594309 17196 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:00.595683 17746 raft_consensus.cc:2804] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:00.596122 17746 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.596459 17746 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.596678 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8692f804ad346579cc888efbc5c2bae" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:00.578613 17430 ts_tablet_manager.cc:1434] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.176s	user 0.011s	sys 0.002s
I20260709 13:05:00.600337 17430 tablet_bootstrap.cc:492] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:05:00.607537 17123 leader_election.cc:304] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:00.609628 17435 raft_consensus.cc:2804] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:00.597735 17346 leader_election.cc:343] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:00.610049 17435 raft_consensus.cc:493] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.610419 17435 raft_consensus.cc:3060] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.610196 17346 leader_election.cc:304] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:00.619534 17846 raft_consensus.cc:2749] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.620590 17471 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.620398 17846 consensus_queue.cc:1048] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.621148 17471 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.623903 17471 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:00.626767 17271 leader_election.cc:304] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:00.627944 17755 raft_consensus.cc:3060] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.634261 17430 tablet_bootstrap.cc:654] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.636078 17435 raft_consensus.cc:515] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:00.642819 17427 tablet_bootstrap.cc:654] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.647274 17152 raft_consensus.cc:3060] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.656387 17490 raft_consensus.cc:493] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.657016 17490 raft_consensus.cc:515] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:00.659083 17490 leader_election.cc:290] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:00.664371 17232 raft_consensus.cc:3060] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.666814 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:00.667618 17378 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
I20260709 13:05:00.672544 17229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:00.675959 17227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:00.676815 17227 raft_consensus.cc:3060] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.681775 17831 consensus_queue.cc:1048] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:00.672860 17755 raft_consensus.cc:2749] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.681578 17121 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:00.690828 17830 raft_consensus.cc:2804] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:00.691219 17830 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.691551 17830 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.699121 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8692f804ad346579cc888efbc5c2bae" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
W20260709 13:05:00.736256 17197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 164780us
I20260709 13:05:00.750229 17430 tablet_bootstrap.cc:492] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:05:00.751066 17430 ts_tablet_manager.cc:1403] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.151s	user 0.020s	sys 0.019s
I20260709 13:05:00.755513 17737 raft_consensus.cc:515] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.758057 17737 leader_election.cc:290] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:00.762995 17435 leader_election.cc:290] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:00.770011 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:00.770834 17232 raft_consensus.cc:3060] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.773846 17435 consensus_queue.cc:1048] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:00.764792 17227 raft_consensus.cc:2468] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:05:00.745604 17830 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.801157 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
W20260709 13:05:00.806978 17868 log.cc:927] Time spent T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:05:00.797067 17746 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.810691 17303 raft_consensus.cc:3060] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.816246 17123 leader_election.cc:304] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:05:00.828035 17773 raft_consensus.cc:2749] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.830945 17426 tablet_bootstrap.cc:492] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: No bootstrap required, opened a new log
I20260709 13:05:00.833390 17229 raft_consensus.cc:2393] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 1: Already voted for candidate 7e9eba24bc8842099fcba4a2024c2aed in this term.
I20260709 13:05:00.833742 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:00.834535 17377 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.836382 17426 ts_tablet_manager.cc:1403] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.566s	user 0.016s	sys 0.030s
I20260709 13:05:00.838513 17435 consensus_queue.cc:1048] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.832013 17830 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:00.841468 17831 consensus_queue.cc:1048] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.842558 17426 raft_consensus.cc:359] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.843261 17426 raft_consensus.cc:385] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.843551 17426 raft_consensus.cc:740] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.843336 17430 raft_consensus.cc:359] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.844139 17430 raft_consensus.cc:385] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.844439 17430 raft_consensus.cc:740] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.844235 17426 consensus_queue.cc:260] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:00.844831 17232 raft_consensus.cc:2468] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:00.845674 17746 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:00.862659 17123 leader_election.cc:304] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:00.866487 17831 raft_consensus.cc:2804] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.866962 17233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:00.867007 17831 raft_consensus.cc:697] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:00.869554 17831 consensus_queue.cc:237] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:00.880781 17306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:00.881464 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b39f71b242b42f986fa68287bf62ba8" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:00.882123 17427 tablet_bootstrap.cc:492] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c: No bootstrap required, opened a new log
I20260709 13:05:00.882594 17304 raft_consensus.cc:2393] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:05:00.880865 17426 ts_tablet_manager.cc:1434] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:05:00.882647 17427 ts_tablet_manager.cc:1403] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent bootstrapping tablet: real 0.366s	user 0.013s	sys 0.002s
I20260709 13:05:00.881531 17306 raft_consensus.cc:3060] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.875473 17377 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:05:00.902629 17430 consensus_queue.cc:260] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.903430 17737 consensus_queue.cc:1048] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.920058 17430 ts_tablet_manager.cc:1434] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.169s	user 0.008s	sys 0.000s
W20260709 13:05:00.926824 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 53455.3us
I20260709 13:05:00.927603 17346 leader_election.cc:304] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:00.940752 17427 raft_consensus.cc:359] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.941748 17427 raft_consensus.cc:385] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.943259 17427 raft_consensus.cc:740] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.955996 17880 raft_consensus.cc:2804] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.956735 17880 raft_consensus.cc:697] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:00.957908 17427 consensus_queue.cc:260] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:00.961895 17156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:05:00.947904 17158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:05:00.966980 17156 raft_consensus.cc:2393] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:05:00.972744 17430 tablet_bootstrap.cc:492] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed: Bootstrap starting.
I20260709 13:05:00.964812 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:00.978567 17381 raft_consensus.cc:2393] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate de7ec497603d42d0acaf22677ea7f1bd in this term.
I20260709 13:05:00.979405 17427 ts_tablet_manager.cc:1434] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.001s
I20260709 13:05:00.990221 17430 tablet_bootstrap.cc:654] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.962957 17880 consensus_queue.cc:237] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:01.025928 17121 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:01.041105 17862 raft_consensus.cc:2804] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.041656 17862 raft_consensus.cc:697] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:01.042604 17862 consensus_queue.cc:237] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:01.054796 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 70442.2us
W20260709 13:05:01.099145 17197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 57736.8us
I20260709 13:05:01.135847 17303 raft_consensus.cc:2468] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:01.150843 17306 raft_consensus.cc:2468] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
W20260709 13:05:01.166903 17883 log.cc:927] Time spent T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: Append to log took a long time: real 0.128s	user 0.003s	sys 0.000s
I20260709 13:05:01.249291 17896 raft_consensus.cc:493] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.250115 17896 raft_consensus.cc:515] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
W20260709 13:05:01.261996 17197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 162123us
I20260709 13:05:01.291249 17830 raft_consensus.cc:493] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.294641 17830 raft_consensus.cc:515] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:01.296867 17830 leader_election.cc:290] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:01.305527 17430 tablet_bootstrap.cc:492] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed: No bootstrap required, opened a new log
I20260709 13:05:01.306128 17430 ts_tablet_manager.cc:1403] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed: Time spent bootstrapping tablet: real 0.360s	user 0.010s	sys 0.020s
W20260709 13:05:01.323598 17197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 60121.1us
W20260709 13:05:01.315850 17271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 125620us
I20260709 13:05:01.289813 17906 consensus_queue.cc:1048] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.134s
I20260709 13:05:01.344632 17197 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:01.368975 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ddeea989c64b70a533198455dc0b6c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:01.375698 17896 leader_election.cc:290] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:01.355842 17864 consensus_queue.cc:1048] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:05:01.382202 17152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b39f71b242b42f986fa68287bf62ba8" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:05:01.391801 17908 raft_consensus.cc:493] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.392416 17908 raft_consensus.cc:515] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:01.396070 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:01.396763 17381 raft_consensus.cc:2468] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:05:01.397871 17908 leader_election.cc:290] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:01.400648 17270 leader_election.cc:304] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
W20260709 13:05:01.413010 17121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 88023.9us
I20260709 13:05:01.416389 17655 raft_consensus.cc:2804] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.435222 17197 leader_election.cc:304] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:01.435997 17123 leader_election.cc:343] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:01.423038 17196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 50038.6us
I20260709 13:05:01.432646 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ddeea989c64b70a533198455dc0b6c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:01.429471 17642 raft_consensus.cc:2749] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.435947 17430 raft_consensus.cc:359] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:01.440985 17430 raft_consensus.cc:385] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:01.441321 17430 raft_consensus.cc:740] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Initialized, Role: FOLLOWER
I20260709 13:05:01.429895 17655 raft_consensus.cc:493] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.472414 17056 catalog_manager.cc:5697] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 1 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.473203 17911 raft_consensus.cc:2749] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.471294 17430 consensus_queue.cc:260] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:01.482690 17430 ts_tablet_manager.cc:1434] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed: Time spent starting tablet: real 0.176s	user 0.006s	sys 0.003s
I20260709 13:05:01.449816 17655 raft_consensus.cc:3060] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.452693 17381 raft_consensus.cc:2468] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 0.
W20260709 13:05:01.498660 17103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:01.505622 17381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:01.506542 17381 raft_consensus.cc:2468] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 0.
W20260709 13:05:01.513804 17272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 71988.1us
I20260709 13:05:01.517683 17226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:01.521993 17226 raft_consensus.cc:2468] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 0.
I20260709 13:05:01.523717 17196 leader_election.cc:304] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:01.525648 17642 raft_consensus.cc:2804] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.526150 17642 raft_consensus.cc:493] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.526546 17642 raft_consensus.cc:3060] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:01.539989 17198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 159902us
W20260709 13:05:01.549446 17123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 48893.8us
I20260709 13:05:01.556653 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:01.571730 17655 raft_consensus.cc:515] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:01.573390 17302 raft_consensus.cc:2393] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:05:01.573957 17655 leader_election.cc:290] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:01.589979 17895 consensus_queue.cc:1048] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:01.602497 17642 raft_consensus.cc:515] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:01.599082 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:01.604995 17230 raft_consensus.cc:2393] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79ae3773b2274d75b3f71364c0aa6d9c in current term 1: Already voted for candidate 7e9eba24bc8842099fcba4a2024c2aed in this term.
I20260709 13:05:01.607188 17642 leader_election.cc:290] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:01.608026 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:01.609632 17895 consensus_queue.cc:1048] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:01.609934 17377 raft_consensus.cc:3060] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.621114 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:01.621451 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:01.621938 17303 raft_consensus.cc:2393] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 1: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:05:01.621845 17121 leader_election.cc:304] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:01.622910 17874 raft_consensus.cc:2804] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:01.623314 17874 raft_consensus.cc:493] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.623694 17874 raft_consensus.cc:3060] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.630635 17270 leader_election.cc:304] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:01.631659 17614 raft_consensus.cc:2749] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:01.633625 17902 consensus_queue.cc:1048] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:01.643090 17377 raft_consensus.cc:2468] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:05:01.658892 17196 leader_election.cc:304] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:05:01.660034 17642 raft_consensus.cc:2804] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.669021 17642 raft_consensus.cc:697] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:01.669325 17744 consensus_queue.cc:1048] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:01.670204 17642 consensus_queue.cc:237] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:01.635460 17874 raft_consensus.cc:515] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:01.678437 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ddeea989c64b70a533198455dc0b6c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:01.679265 17231 raft_consensus.cc:3060] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.681923 17874 leader_election.cc:290] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:01.685814 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ddeea989c64b70a533198455dc0b6c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:01.687255 17377 raft_consensus.cc:3060] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:01.713759 17435 consensus_queue.cc:1048] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:01.769860 17231 raft_consensus.cc:2468] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:05:01.771770 17123 leader_election.cc:304] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:01.772948 17918 raft_consensus.cc:2804] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:01.773490 17918 raft_consensus.cc:697] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:01.775112 17918 consensus_queue.cc:237] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:01.791237 17377 raft_consensus.cc:2468] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 1.
I20260709 13:05:01.823997 17874 consensus_queue.cc:1048] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:01.825686 17053 catalog_manager.cc:5697] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.864012 17053 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46164 (request call id 58) took 1035 ms. Trace:
I20260709 13:05:01.872211 17052 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46150 (request call id 85) took 1089 ms. Trace:
I20260709 13:05:01.864571 17053 rpcz_store.cc:276] 0709 13:05:00.829477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.829703 (+   226us) service_pool.cc:224] Handling call
0709 13:05:01.863946 (+1034243us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:01.829540 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:01.830157 (+   617us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:01.830197 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:05:01.830211 (+    14us) tablet.cc:662] Decoding operations
0709 13:05:01.830572 (+   361us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:01.830637 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:01.830669 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:01.830867 (+   198us) tablet.cc:701] Row locks acquired
0709 13:05:01.830880 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:05:01.831042 (+   162us) write_op.cc:270] Start()
0709 13:05:01.831153 (+   111us) write_op.cc:276] Timestamp: P: 1783602301830996 usec, L: 0
0709 13:05:01.831175 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:05:01.831833 (+   658us) log.cc:844] Serialized 537 byte log entry
0709 13:05:01.833805 (+  1972us) op_driver.cc:464] REPLICATION: finished
0709 13:05:01.839740 (+  5935us) write_op.cc:301] APPLY: starting
0709 13:05:01.839844 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:01.839959 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:01.840083 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:01.840332 (+   249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:01.840513 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:01.840582 (+    69us) write_op.cc:312] APPLY: finished
0709 13:05:01.840775 (+   193us) log.cc:844] Serialized 22 byte log entry
0709 13:05:01.842817 (+  2042us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:01.842907 (+    90us) write_op.cc:454] Released schema lock
0709 13:05:01.842953 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:01.843280 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:01.843316 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":472742,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":5691,"apply.run_cpu_time_us":1664,"apply.run_wall_time_us":3520,"num_ops":1,"prepare.queue_time_us":139,"prepare.run_cpu_time_us":2558,"prepare.run_wall_time_us":2558,"replication_time_us":2493}]]}
I20260709 13:05:01.874121 17052 rpcz_store.cc:276] 0709 13:05:00.782898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.783092 (+   194us) service_pool.cc:224] Handling call
0709 13:05:01.872116 (+1089024us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":474293,"reported_tablets":5}
I20260709 13:05:01.906265 17056 catalog_manager.cc:5697] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } }
I20260709 13:05:01.911777 17056 catalog_manager.cc:5697] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 1 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } }
I20260709 13:05:01.941367 17055 catalog_manager.cc:5697] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } }
I20260709 13:05:01.957875 17052 catalog_manager.cc:5697] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 1 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.999708 17053 catalog_manager.cc:5697] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 1 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:02.199115 17642 consensus_queue.cc:1048] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.215665 17939 consensus_queue.cc:1048] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:02.241282 17918 consensus_queue.cc:1048] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:02.264978 17874 consensus_queue.cc:1048] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:03.537333  7335 tablet_server.cc:179] TabletServer@127.7.41.193:0 shutting down...
I20260709 13:05:03.590826  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:03.591939  7335 tablet_replica.cc:333] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.593034  7335 raft_consensus.cc:2243] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.594214  7335 raft_consensus.cc:2272] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.597404  7335 tablet_replica.cc:333] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.598656  7335 raft_consensus.cc:2243] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.599681  7335 raft_consensus.cc:2272] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.601033 17197 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 13:05:03.602543  7335 tablet_replica.cc:333] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.603605  7335 raft_consensus.cc:2243] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.604691  7335 raft_consensus.cc:2272] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.606176 17197 consensus_peers.cc:597] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.607583  7335 tablet_replica.cc:333] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.608577  7335 raft_consensus.cc:2243] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.609175  7335 raft_consensus.cc:2272] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.612471  7335 tablet_replica.cc:333] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.613406  7335 raft_consensus.cc:2243] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.615517  7335 raft_consensus.cc:2272] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.619199  7335 tablet_replica.cc:333] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.620215  7335 raft_consensus.cc:2243] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.620801  7335 raft_consensus.cc:2272] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.624032  7335 tablet_replica.cc:333] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.624872  7335 raft_consensus.cc:2243] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.625412  7335 raft_consensus.cc:2272] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.627647  7335 tablet_replica.cc:333] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.628228  7335 raft_consensus.cc:2243] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.628957  7335 raft_consensus.cc:2272] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.630971  7335 tablet_replica.cc:333] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.631599  7335 raft_consensus.cc:2243] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.632037  7335 raft_consensus.cc:2272] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.634182  7335 tablet_replica.cc:333] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.634720  7335 raft_consensus.cc:2243] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.635144  7335 raft_consensus.cc:2272] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.637125  7335 tablet_replica.cc:333] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.637770  7335 raft_consensus.cc:2243] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.638284  7335 raft_consensus.cc:2272] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.640364  7335 tablet_replica.cc:333] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.640923  7335 raft_consensus.cc:2243] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.641924  7335 raft_consensus.cc:2272] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.644812  7335 tablet_replica.cc:333] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.645367  7335 raft_consensus.cc:2243] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.645776  7335 raft_consensus.cc:2272] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.647915  7335 tablet_replica.cc:333] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.648766  7335 raft_consensus.cc:2243] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.649945  7335 raft_consensus.cc:2272] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.657034  7335 tablet_replica.cc:333] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.657895  7335 raft_consensus.cc:2243] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.659008  7335 raft_consensus.cc:2272] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.661892  7335 tablet_replica.cc:333] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.662909  7335 raft_consensus.cc:2243] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.663487  7335 raft_consensus.cc:2272] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.667279  7335 tablet_replica.cc:333] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.668282  7335 raft_consensus.cc:2243] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.669659  7335 raft_consensus.cc:2272] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.670640 17345 consensus_peers.cc:597] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.672513  7335 tablet_replica.cc:333] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.673404  7335 raft_consensus.cc:2243] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.673933  7335 raft_consensus.cc:2272] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.674642 17271 consensus_peers.cc:597] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.675923 17271 consensus_peers.cc:597] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.676756  7335 tablet_replica.cc:333] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.677634  7335 raft_consensus.cc:2243] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.678790  7335 raft_consensus.cc:2272] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.681360  7335 tablet_replica.cc:333] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.681871  7335 raft_consensus.cc:2243] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.682641  7335 raft_consensus.cc:2272] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.685099  7335 tablet_replica.cc:333] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.685745  7335 raft_consensus.cc:2243] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.686185  7335 raft_consensus.cc:2272] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.688109  7335 tablet_replica.cc:333] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.688611  7335 raft_consensus.cc:2243] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.689325  7335 raft_consensus.cc:2272] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.691236  7335 tablet_replica.cc:333] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.691761  7335 raft_consensus.cc:2243] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.692123  7335 raft_consensus.cc:2272] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.694900  7335 tablet_replica.cc:333] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.695703  7335 raft_consensus.cc:2243] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.696305  7335 raft_consensus.cc:2272] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.699738 17271 consensus_peers.cc:597] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.700218  7335 tablet_replica.cc:333] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.701105  7335 raft_consensus.cc:2243] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.701499  7335 raft_consensus.cc:2272] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.703578  7335 tablet_replica.cc:333] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.704360  7335 raft_consensus.cc:2243] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.704852  7335 raft_consensus.cc:2272] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.706442 17345 consensus_peers.cc:597] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.707401  7335 tablet_replica.cc:333] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.708235  7335 raft_consensus.cc:2243] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.708746  7335 raft_consensus.cc:2272] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.711596  7335 tablet_replica.cc:333] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.712122  7335 raft_consensus.cc:2243] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.712512  7335 raft_consensus.cc:2272] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.714486  7335 tablet_replica.cc:333] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.715060  7335 raft_consensus.cc:2243] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.715418  7335 raft_consensus.cc:2272] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.717321  7335 tablet_replica.cc:333] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.717824  7335 raft_consensus.cc:2243] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.718255  7335 raft_consensus.cc:2272] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.720288  7335 tablet_replica.cc:333] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.720780  7335 raft_consensus.cc:2243] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.721202  7335 raft_consensus.cc:2272] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.723029  7335 tablet_replica.cc:333] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.723511  7335 raft_consensus.cc:2243] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.724249  7335 raft_consensus.cc:2272] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.726234  7335 tablet_replica.cc:333] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.726718  7335 raft_consensus.cc:2243] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.727088  7335 raft_consensus.cc:2272] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.729247  7335 tablet_replica.cc:333] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.729960  7335 raft_consensus.cc:2243] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.730468  7335 raft_consensus.cc:2272] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.733002  7335 tablet_replica.cc:333] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.733585  7335 raft_consensus.cc:2243] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.734524  7335 raft_consensus.cc:2272] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.737500  7335 tablet_replica.cc:333] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.738265  7335 raft_consensus.cc:2243] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.738749  7335 raft_consensus.cc:2272] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.740871 17345 consensus_peers.cc:597] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.741317  7335 tablet_replica.cc:333] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.741900  7335 raft_consensus.cc:2243] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.742830  7335 raft_consensus.cc:2272] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.745599  7335 tablet_replica.cc:333] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.746307  7335 raft_consensus.cc:2243] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.746791  7335 raft_consensus.cc:2272] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.749217  7335 tablet_replica.cc:333] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.749857  7335 raft_consensus.cc:2243] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.750891  7335 raft_consensus.cc:2272] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.753640  7335 tablet_replica.cc:333] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.754348  7335 raft_consensus.cc:2243] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.755342  7335 raft_consensus.cc:2272] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.755896 17271 consensus_peers.cc:597] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.756567 17345 consensus_peers.cc:597] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.757938  7335 tablet_replica.cc:333] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.758795  7335 raft_consensus.cc:2243] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:05:03.759554 17197 consensus_peers.cc:597] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.759840  7335 raft_consensus.cc:2272] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.762467  7335 tablet_replica.cc:333] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.763168  7335 raft_consensus.cc:2243] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.763777  7335 raft_consensus.cc:2272] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.765573 17345 consensus_peers.cc:597] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.766710  7335 tablet_replica.cc:333] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.767539  7335 raft_consensus.cc:2243] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.768098  7335 raft_consensus.cc:2272] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:03.771072  7335 tablet_replica.cc:333] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.771708  7335 raft_consensus.cc:2243] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:03.772135  7335 raft_consensus.cc:2272] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.774247 17345 consensus_peers.cc:597] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.774627  7335 tablet_replica.cc:333] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: stopping tablet replica
I20260709 13:05:03.775147  7335 raft_consensus.cc:2243] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:03.775967  7335 raft_consensus.cc:2272] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:03.782291 17271 consensus_peers.cc:597] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.800572 17271 consensus_peers.cc:597] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.815718 17271 consensus_peers.cc:597] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.846711 17197 consensus_peers.cc:597] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.850677 17271 consensus_peers.cc:597] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.855228  7335 tablet_server.cc:196] TabletServer@127.7.41.193:0 shutdown complete.
W20260709 13:05:03.863723 17197 consensus_peers.cc:597] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.875385 17345 consensus_peers.cc:597] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.909205 17345 consensus_peers.cc:597] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.931603 17345 consensus_peers.cc:597] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.941416 17271 consensus_peers.cc:597] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.949095  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:03.949720 17271 consensus_peers.cc:597] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:03.956727 17951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:03.957866 17952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:03.961557 17954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:03.963889  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:03.967892  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:03.968202  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:03.968483  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602303968451 us; error 0 us; skew 500 ppm
I20260709 13:05:03.969271  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:05:03.971248 17197 consensus_peers.cc:597] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.973143  7335 webserver.cc:533] Webserver started at http://127.7.41.193:35713/ using document root <none> and password file <none>
I20260709 13:05:03.973770  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:03.973980  7335 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:05:03.977679  7335 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:03.985589 17959 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:03.986487  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:03.986824  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-0-root
uuid: "de7ec497603d42d0acaf22677ea7f1bd"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-fh5z"
I20260709 13:05:03.987286  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601985998407-7335-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:04.018831  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:04.020077  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:04.021579  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:04.026898 17966 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:05:04.028258 17197 consensus_peers.cc:597] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:04.061951 17271 consensus_peers.cc:597] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.311820  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:05:04.312247  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.286s	user 0.006s	sys 0.004s
I20260709 13:05:04.312656  7335 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:05:04.319105 17966 tablet_bootstrap.cc:492] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.342360 17966 tablet_bootstrap.cc:492] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.343334 17966 tablet_bootstrap.cc:492] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.343940 17966 ts_tablet_manager.cc:1403] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.005s
I20260709 13:05:04.346495 17966 raft_consensus.cc:359] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.347186 17966 raft_consensus.cc:740] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.348038 17966 consensus_queue.cc:260] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.379523 17966 ts_tablet_manager.cc:1434] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.035s	user 0.016s	sys 0.019s
I20260709 13:05:04.380381 17966 tablet_bootstrap.cc:492] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.394644 17966 tablet_bootstrap.cc:492] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.395584 17966 tablet_bootstrap.cc:492] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.396224 17966 ts_tablet_manager.cc:1403] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:05:04.398584 17966 raft_consensus.cc:359] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.399225 17966 raft_consensus.cc:740] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.399855 17966 consensus_queue.cc:260] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.401788 17966 ts_tablet_manager.cc:1434] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:05:04.402565 17966 tablet_bootstrap.cc:492] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.418614 17966 tablet_bootstrap.cc:492] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.422422 17966 tablet_bootstrap.cc:492] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.424110 17966 ts_tablet_manager.cc:1403] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 13:05:04.426656 17966 raft_consensus.cc:359] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:04.427301 17966 raft_consensus.cc:740] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.428064 17966 consensus_queue.cc:260] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:04.430550 17966 ts_tablet_manager.cc:1434] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:04.431337 17966 tablet_bootstrap.cc:492] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.443630 17966 tablet_bootstrap.cc:492] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.444391 17966 tablet_bootstrap.cc:492] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.444916 17966 ts_tablet_manager.cc:1403] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:05:04.446872 17966 raft_consensus.cc:359] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.447515 17966 raft_consensus.cc:740] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.448161 17966 consensus_queue.cc:260] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.449980 17966 ts_tablet_manager.cc:1434] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:04.450749 17966 tablet_bootstrap.cc:492] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.477342 17966 tablet_bootstrap.cc:492] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.478307 17966 tablet_bootstrap.cc:492] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.478917 17966 ts_tablet_manager.cc:1403] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 13:05:04.480666 17966 raft_consensus.cc:359] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.481165 17966 raft_consensus.cc:740] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.481761 17966 consensus_queue.cc:260] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.483268 17966 ts_tablet_manager.cc:1434] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:04.483881 17966 tablet_bootstrap.cc:492] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.495734 17966 tablet_bootstrap.cc:492] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.496856 17966 tablet_bootstrap.cc:492] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.497601 17966 ts_tablet_manager.cc:1403] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:05:04.499774 17966 raft_consensus.cc:359] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.500326 17966 raft_consensus.cc:740] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.500914 17966 consensus_queue.cc:260] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.502554 17966 ts_tablet_manager.cc:1434] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:04.503244 17966 tablet_bootstrap.cc:492] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.521864 17966 tablet_bootstrap.cc:492] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.522934 17966 tablet_bootstrap.cc:492] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.523608 17966 ts_tablet_manager.cc:1403] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:05:04.526237 17966 raft_consensus.cc:359] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.526996 17966 raft_consensus.cc:740] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.527666 17966 consensus_queue.cc:260] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.530149 17966 ts_tablet_manager.cc:1434] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:04.530951 17966 tablet_bootstrap.cc:492] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.550230 17966 tablet_bootstrap.cc:492] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.551221 17966 tablet_bootstrap.cc:492] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.551889 17966 ts_tablet_manager.cc:1403] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:05:04.554209 17966 raft_consensus.cc:359] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.554852 17966 raft_consensus.cc:740] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.555593 17966 consensus_queue.cc:260] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.557524 17966 ts_tablet_manager.cc:1434] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:04.558310 17966 tablet_bootstrap.cc:492] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.572431 17966 tablet_bootstrap.cc:492] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.573339 17966 tablet_bootstrap.cc:492] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.573964 17966 ts_tablet_manager.cc:1403] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:05:04.576321 17966 raft_consensus.cc:359] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.576995 17966 raft_consensus.cc:740] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.577656 17966 consensus_queue.cc:260] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.579710 17966 ts_tablet_manager.cc:1434] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:04.580513 17966 tablet_bootstrap.cc:492] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.582469  7335 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:05:04.582914  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.270s	user 0.225s	sys 0.008s
I20260709 13:05:04.596745 17966 tablet_bootstrap.cc:492] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.597656 17966 tablet_bootstrap.cc:492] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.598338 17966 ts_tablet_manager.cc:1403] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:05:04.600661 17966 raft_consensus.cc:359] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.601313 17966 raft_consensus.cc:740] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.601954 17966 consensus_queue.cc:260] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.603801 17966 ts_tablet_manager.cc:1434] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:04.604440 17966 tablet_bootstrap.cc:492] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.615778 17966 tablet_bootstrap.cc:492] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.616658 17966 tablet_bootstrap.cc:492] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.617314 17966 ts_tablet_manager.cc:1403] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:05:04.619751 17966 raft_consensus.cc:359] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.620455 17966 raft_consensus.cc:740] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.621155 17966 consensus_queue.cc:260] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.623198 17966 ts_tablet_manager.cc:1434] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:04.624086 17966 tablet_bootstrap.cc:492] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.630245 17939 raft_consensus.cc:493] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.630820 17939 raft_consensus.cc:515] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.633010 17939 leader_election.cc:290] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:04.640847 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
W20260709 13:05:04.662488 17197 leader_election.cc:336] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:04.663115 17197 leader_election.cc:304] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:04.670356 17939 raft_consensus.cc:2749] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:04.671846 17878 raft_consensus.cc:493] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.672566 17878 raft_consensus.cc:515] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
W20260709 13:05:04.689328 17271 leader_election.cc:336] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:04.697100 17878 leader_election.cc:290] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:04.701736 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:04.705823 17272 leader_election.cc:304] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:04.707487 17971 raft_consensus.cc:2749] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:04.707857 17966 tablet_bootstrap.cc:492] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.708788 17966 tablet_bootstrap.cc:492] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.708632 17971 raft_consensus.cc:493] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.709496 17966 ts_tablet_manager.cc:1403] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.086s	user 0.026s	sys 0.052s
I20260709 13:05:04.709312 17971 raft_consensus.cc:515] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:04.711477 17971 leader_election.cc:290] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:04.712215 17966 raft_consensus.cc:359] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.712911 17966 raft_consensus.cc:740] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.713546 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd5f3f7224fde8c02ed2f1e9de777" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:04.713755 17966 consensus_queue.cc:260] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.716008 17966 ts_tablet_manager.cc:1434] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:04.716850 17966 tablet_bootstrap.cc:492] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.737592 17966 tablet_bootstrap.cc:492] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.738631 17966 tablet_bootstrap.cc:492] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.739375 17966 ts_tablet_manager.cc:1403] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:05:04.741768 17966 raft_consensus.cc:359] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.742496 17966 raft_consensus.cc:740] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.743330 17966 consensus_queue.cc:260] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.745589 17966 ts_tablet_manager.cc:1434] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:04.746469 17966 tablet_bootstrap.cc:492] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:04.774986 17939 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.776849 17967 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.777565 17967 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.780421 17967 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:04.775875 17939 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.784560 17939 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:04.792111 17655 raft_consensus.cc:493] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.792683 17655 raft_consensus.cc:515] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.794525 17655 leader_election.cc:290] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:04.794960 17655 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.795339 17655 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:04.796986 17655 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:04.799667 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:04.800999 17973 raft_consensus.cc:493] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.801723 17973 raft_consensus.cc:515] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.804451 17973 leader_election.cc:290] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:04.805830 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 47460.8us
I20260709 13:05:04.809243 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ddeea989c64b70a533198455dc0b6c" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:04.812942 17842 raft_consensus.cc:493] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.813820 17842 raft_consensus.cc:515] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:04.816697 17842 leader_election.cc:290] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:04.816691 17969 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.818213 17969 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.847019 17969 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:04.827270 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:04.828801 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:04.874998 17378 raft_consensus.cc:2468] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:05:04.832829 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b39f71b242b42f986fa68287bf62ba8" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:04.821476 17878 raft_consensus.cc:493] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.876844 17878 raft_consensus.cc:515] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:04.877285 17196 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
W20260709 13:05:04.876941 17345 leader_election.cc:336] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:04.879951 17345 leader_election.cc:304] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:04.848830 17197 leader_election.cc:336] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:04.877427 17969 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
W20260709 13:05:04.880774 17197 leader_election.cc:336] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:04.881093 17969 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.859764 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:04.863137 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd5f3f7224fde8c02ed2f1e9de777" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:04.883368 17969 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:04.884766 17973 raft_consensus.cc:2749] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:04.868501 17939 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.871078 17966 tablet_bootstrap.cc:492] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.883680 17304 raft_consensus.cc:2468] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:04.885766 17939 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.886549 17966 tablet_bootstrap.cc:492] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:04.867843 17968 raft_consensus.cc:493] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.887354 17966 ts_tablet_manager.cc:1403] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.141s	user 0.050s	sys 0.070s
W20260709 13:05:04.851296 17271 leader_election.cc:336] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:04.887887 17271 leader_election.cc:304] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:04.890069 17655 raft_consensus.cc:2749] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:04.879521 17977 raft_consensus.cc:2804] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:04.891435 17228 raft_consensus.cc:2468] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:04.891623 17939 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:04.866983 18028 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.893059 18028 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.893334 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:04.893364 17966 raft_consensus.cc:359] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.894464 17966 raft_consensus.cc:740] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:04.895077 17377 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:05:04.895511 17966 consensus_queue.cc:260] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.896160 17977 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.897046 17977 raft_consensus.cc:3060] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.894380 17232 raft_consensus.cc:2468] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:04.898276 17966 ts_tablet_manager.cc:1434] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:04.900398 17966 tablet_bootstrap.cc:492] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
W20260709 13:05:04.885793 17345 leader_election.cc:336] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:04.907002 17346 leader_election.cc:304] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:04.895332 18028 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:04.908131 18028 raft_consensus.cc:2804] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:04.908501 18028 raft_consensus.cc:493] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.908595 17196 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:04.887174 17968 raft_consensus.cc:515] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:04.911387 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:04.911901 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04afb5955d549318f7fe723b79f1d3b" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:04.912216 17232 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:04.915925 17346 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:04.917847 18025 raft_consensus.cc:493] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.918836 17968 leader_election.cc:290] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:04.918628 18025 raft_consensus.cc:515] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:04.921770 18025 leader_election.cc:290] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
W20260709 13:05:04.922132 17271 leader_election.cc:336] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:04.922820 17969 raft_consensus.cc:2804] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:04.926390 17969 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.927008 17969 raft_consensus.cc:3060] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.924139 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968dc4dd3ad542808481bf0dad333ac7" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:04.924391 17939 raft_consensus.cc:493] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.934298 17939 raft_consensus.cc:515] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.924836 17878 leader_election.cc:290] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:04.908917 18028 raft_consensus.cc:3060] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.925149 18035 raft_consensus.cc:2804] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:04.938933 18035 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.939476 18035 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:04.941965 17271 leader_election.cc:336] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:04.942587 17271 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:04.944423 17878 raft_consensus.cc:2749] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:04.923621 17346 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:04.950798 17346 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:04.951862 17842 raft_consensus.cc:2804] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:04.952356 17842 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.952804 17842 raft_consensus.cc:3060] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.954135 17977 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:04.954305 17973 raft_consensus.cc:2804] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:04.972813 17973 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.973460 17973 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.962598 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:04.984472 17939 leader_election.cc:290] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:04.988193 17968 raft_consensus.cc:493] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.992144 17968 raft_consensus.cc:515] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:04.995074 17968 leader_election.cc:290] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
W20260709 13:05:04.990188 17345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 52519.7us
W20260709 13:05:04.996479 17345 leader_election.cc:336] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.000135 18035 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.021268 18041 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.027073 17968 raft_consensus.cc:493] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.028267 17272 leader_election.cc:304] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:04.968029 17271 leader_election.cc:336] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.063009 17271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 94991.8us
I20260709 13:05:05.031126 17939 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.032694 17969 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.036382 18044 raft_consensus.cc:493] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.039567 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:05.040433 18040 raft_consensus.cc:493] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.042240 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:05.046103 17977 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.049225 17967 raft_consensus.cc:493] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:04.995141 17842 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.059387 18028 raft_consensus.cc:515] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:05:05.061213 17345 leader_election.cc:336] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.065768 17968 raft_consensus.cc:515] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.069353 17655 raft_consensus.cc:2749] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.048295 17973 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:05.075604 17345 leader_election.cc:336] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.073792 18040 raft_consensus.cc:515] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.073674 18044 raft_consensus.cc:515] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:05:05.082799 17271 leader_election.cc:336] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.083268 18040 leader_election.cc:290] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.083374 17271 leader_election.cc:304] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.083956 18044 leader_election.cc:290] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.084570 17376 raft_consensus.cc:2468] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:05:05.085379 17377 raft_consensus.cc:2393] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 2: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:05:05.085644 17842 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.085952 17971 raft_consensus.cc:2749] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.070253 18041 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.077543 17967 raft_consensus.cc:515] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.074307 17939 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:05.084661 17271 leader_election.cc:336] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.093190 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:05.098466 17304 raft_consensus.cc:2468] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:05.093510 17271 leader_election.cc:304] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.092854 17306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:05.091481 17270 leader_election.cc:304] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
W20260709 13:05:05.106287 17196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 58459.7us
I20260709 13:05:05.106559 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38fd5f3f7224fde8c02ed2f1e9de777" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:05.110334 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:05.111153 17230 raft_consensus.cc:2393] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in current term 2: Already voted for candidate 7e9eba24bc8842099fcba4a2024c2aed in this term.
I20260709 13:05:05.112497 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:05.113272 17231 raft_consensus.cc:2393] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in current term 2: Already voted for candidate 7e9eba24bc8842099fcba4a2024c2aed in this term.
I20260709 13:05:05.113633 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:05.092471 17968 leader_election.cc:290] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.109845 17655 raft_consensus.cc:2804] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.118937 17655 raft_consensus.cc:493] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.119349 17655 raft_consensus.cc:3060] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.092098 17969 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.110461 17304 raft_consensus.cc:3060] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.087961 18028 leader_election.cc:290] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.118139 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:05.090215 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:05.089910 17967 leader_election.cc:290] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.108930 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:05.091027 17973 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.089520 17977 raft_consensus.cc:493] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.120048 17346 leader_election.cc:304] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:05.120853 18045 raft_consensus.cc:493] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.121033 17230 raft_consensus.cc:2468] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:05:05.139506 17977 raft_consensus.cc:515] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.139676 18045 raft_consensus.cc:515] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.140620 17939 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.141346 17377 raft_consensus.cc:2468] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:05:05.141637 17977 leader_election.cc:290] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.141866 18045 leader_election.cc:290] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.121506 18036 raft_consensus.cc:493] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.145159 18036 raft_consensus.cc:515] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.104107 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:05.146198 17228 raft_consensus.cc:3060] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.147285 18036 leader_election.cc:290] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:05.104171 17971 raft_consensus.cc:2749] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.123499 18040 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.149087 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:05.149014 18040 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.089555 18041 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.122906 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:05.149889 17302 raft_consensus.cc:2468] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:05:05.125053 17966 tablet_bootstrap.cc:492] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:05.129565 17967 raft_consensus.cc:493] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.129818 18042 raft_consensus.cc:493] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.151703 17967 raft_consensus.cc:515] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.152212 17966 tablet_bootstrap.cc:492] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:05.145310 17842 raft_consensus.cc:2804] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.151849 18042 raft_consensus.cc:515] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.152643 17842 raft_consensus.cc:493] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.153005 17966 ts_tablet_manager.cc:1403] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.253s	user 0.043s	sys 0.075s
I20260709 13:05:05.153108 17842 raft_consensus.cc:3060] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.130620 17379 raft_consensus.cc:2393] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 2: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:05:05.151288 18040 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.153796 17967 leader_election.cc:290] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:05.154465 17306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968dc4dd3ad542808481bf0dad333ac7" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:05.154796 18043 raft_consensus.cc:493] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.155171 17306 raft_consensus.cc:2468] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:05.155301 18043 raft_consensus.cc:515] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.155781 17966 raft_consensus.cc:359] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.156497 17966 raft_consensus.cc:740] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
W20260709 13:05:05.125957 17197 leader_election.cc:336] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.156872 18042 leader_election.cc:290] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.151331 17198 leader_election.cc:304] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:05.158154 18025 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.158792 18025 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.158794 17967 raft_consensus.cc:2804] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.159123 17306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b39f71b242b42f986fa68287bf62ba8" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:05.161839 17967 raft_consensus.cc:493] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.162091 17306 raft_consensus.cc:2468] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:05:05.162333 18042 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.162928 18042 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.163249 17198 leader_election.cc:304] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:05.163902 18025 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.164076 18036 raft_consensus.cc:2804] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.164503 18036 raft_consensus.cc:493] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.164885 18035 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.164851 18036 raft_consensus.cc:3060] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.162295 17967 raft_consensus.cc:3060] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:05.157126 17197 leader_election.cc:336] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.166014 17197 leader_election.cc:304] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:05.167172 17197 leader_election.cc:336] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.168385 17655 raft_consensus.cc:515] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:05:05.159823 17271 leader_election.cc:336] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.165206 17966 consensus_queue.cc:260] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.169554 17228 raft_consensus.cc:2468] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:05.173605 17966 ts_tablet_manager.cc:1434] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
W20260709 13:05:05.175122 17272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 57151.1us
I20260709 13:05:05.164824 18042 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.197721 17966 tablet_bootstrap.cc:492] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:05.198932 17304 raft_consensus.cc:2468] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
W20260709 13:05:05.199443 17197 leader_election.cc:336] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.202654 17655 leader_election.cc:290] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.202288 17346 leader_election.cc:304] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:05.206521 17346 leader_election.cc:304] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:05.177466 18035 raft_consensus.cc:2749] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.206125 17977 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.208338 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:05.208940 17977 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.209095 17304 raft_consensus.cc:2468] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:05.210598 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:05.197558 18025 raft_consensus.cc:493] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.211995 17346 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:05.212934 17346 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
W20260709 13:05:05.215646 17345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 120907us
I20260709 13:05:05.215066 17232 raft_consensus.cc:2468] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:05.210242 18045 raft_consensus.cc:2804] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.210140 18028 raft_consensus.cc:2804] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.212656 18041 raft_consensus.cc:493] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.220784 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:05.224927 18040 raft_consensus.cc:2804] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.221978 18045 raft_consensus.cc:493] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.211768 17842 raft_consensus.cc:515] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.214701 18025 raft_consensus.cc:515] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.234102 17196 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:05.237545 17196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 106948us
I20260709 13:05:05.238399 17196 leader_election.cc:304] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.239320 17196 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.235594 17228 raft_consensus.cc:2468] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:05:05.232285 18028 raft_consensus.cc:697] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:05.234426 18045 raft_consensus.cc:3060] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.229820 18041 raft_consensus.cc:515] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.247359 18028 consensus_queue.cc:237] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.243443 18046 raft_consensus.cc:2749] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.248106 18025 leader_election.cc:290] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.248687 18046 raft_consensus.cc:493] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.249189 18046 raft_consensus.cc:515] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.251320 18046 leader_election.cc:290] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:05.243152 18047 raft_consensus.cc:2804] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.251322 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:05.251976 18047 raft_consensus.cc:493] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.252375 18047 raft_consensus.cc:3060] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.252507 17379 raft_consensus.cc:2393] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79ae3773b2274d75b3f71364c0aa6d9c in current term 2: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:05:05.238503 18035 raft_consensus.cc:2749] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.247918 18051 raft_consensus.cc:2804] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.256115 18051 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.256578 18051 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:05.257190 17197 leader_election.cc:336] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.257458 17271 leader_election.cc:336] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.258803 17977 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:05.262653 18043 leader_election.cc:290] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.262815 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:05.263244 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:05.263485 17230 raft_consensus.cc:2468] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:05.263856 17304 raft_consensus.cc:2468] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:05:05.264678 18036 raft_consensus.cc:515] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.265748 18041 leader_election.cc:290] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.243611 18040 raft_consensus.cc:697] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:05.267551 18040 consensus_queue.cc:237] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:05.268430 17197 leader_election.cc:336] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.268975 17197 leader_election.cc:336] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.270850 17197 leader_election.cc:336] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.271548 17197 leader_election.cc:336] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.272398 17967 raft_consensus.cc:515] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.274148 17198 leader_election.cc:304] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:05.274976 18039 raft_consensus.cc:2804] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.275337 18039 raft_consensus.cc:493] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.275720 18039 raft_consensus.cc:3060] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.277184 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:05.277818 17304 raft_consensus.cc:2468] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
W20260709 13:05:05.278951 17197 leader_election.cc:336] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.279138 17198 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:05.279475 17967 leader_election.cc:290] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
W20260709 13:05:05.280189 17197 leader_election.cc:336] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.280263 17271 leader_election.cc:336] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.280861 17271 leader_election.cc:336] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.281281 17271 leader_election.cc:304] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:05.282683 17272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 78900.5us
I20260709 13:05:05.283800 17272 leader_election.cc:304] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.284655 17967 raft_consensus.cc:2804] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.284881 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:05.285157 17967 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.285550 17304 raft_consensus.cc:3060] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.285622 17967 raft_consensus.cc:3060] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.288600 18025 raft_consensus.cc:2749] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:05:05.289512 17271 leader_election.cc:336] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.292987 17304 raft_consensus.cc:2468] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:05.294273 17272 leader_election.cc:304] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.294152 17198 leader_election.cc:304] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:05.295810 17655 raft_consensus.cc:2749] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.296201 17272 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.304751 18025 raft_consensus.cc:2804] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.304863 18047 raft_consensus.cc:515] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.302361 17842 leader_election.cc:290] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.305301 18025 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.306592 18025 raft_consensus.cc:3060] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.307034 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:05.306087 17977 raft_consensus.cc:2804] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.307687 17379 raft_consensus.cc:2468] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
W20260709 13:05:05.308599 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 95738us
I20260709 13:05:05.307879 17971 raft_consensus.cc:2804] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.309950 17968 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.310346 17971 raft_consensus.cc:493] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.310680 17968 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.310885 17971 raft_consensus.cc:3060] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.310858 18045 raft_consensus.cc:515] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.310177 17977 raft_consensus.cc:697] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:05.313038 17968 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.313534 17977 consensus_queue.cc:237] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.314435 18039 raft_consensus.cc:515] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
W20260709 13:05:05.319109 17197 leader_election.cc:336] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.328704 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:05.329522 17302 raft_consensus.cc:3060] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.330485 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:05.331295 17307 raft_consensus.cc:2393] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in current term 2: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:05:05.328837 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:05.334923 17230 raft_consensus.cc:2393] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in current term 2: Already voted for candidate 7e9eba24bc8842099fcba4a2024c2aed in this term.
I20260709 13:05:05.329730 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04afb5955d549318f7fe723b79f1d3b" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:05.335492 17303 raft_consensus.cc:2468] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:05.336650 18036 leader_election.cc:290] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:05.339103 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b39f71b242b42f986fa68287bf62ba8" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
W20260709 13:05:05.339547 17271 leader_election.cc:336] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.339715 17301 raft_consensus.cc:3060] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.340020 18025 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.344388 18045 leader_election.cc:290] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.358520 17270 leader_election.cc:304] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.363765 17966 tablet_bootstrap.cc:492] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:05.363701 18049 raft_consensus.cc:2804] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.364279 18049 raft_consensus.cc:493] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
W20260709 13:05:05.367318 17345 leader_election.cc:336] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.367938 17346 leader_election.cc:304] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:05.369721 17346 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:05.326170 18039 leader_election.cc:290] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:05.371716 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:05.371824 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:05.377471 17376 raft_consensus.cc:2393] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 2: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:05:05.376626 17053 catalog_manager.cc:5697] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 2 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:05.364574 18047 leader_election.cc:290] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.372915 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ddeea989c64b70a533198455dc0b6c" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:05.374315 18041 raft_consensus.cc:2804] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:05.374055 17345 leader_election.cc:336] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.375801 17971 raft_consensus.cc:515] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.376271 17301 raft_consensus.cc:2468] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:05.378346 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:05.372231 17973 raft_consensus.cc:2804] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.380450 17196 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.400887 17973 raft_consensus.cc:493] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.382591 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968dc4dd3ad542808481bf0dad333ac7" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:05.401990 17378 raft_consensus.cc:2468] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 1.
I20260709 13:05:05.402282 17303 raft_consensus.cc:3060] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.382540 17377 raft_consensus.cc:2468] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 1.
I20260709 13:05:05.404793 17270 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.401203 17966 tablet_bootstrap.cc:492] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
W20260709 13:05:05.403292 17271 leader_election.cc:336] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.401473 17973 raft_consensus.cc:3060] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.405834 17966 ts_tablet_manager.cc:1403] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.231s	user 0.031s	sys 0.007s
I20260709 13:05:05.364642 18049 raft_consensus.cc:3060] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.408555 17966 raft_consensus.cc:359] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.409222 17966 raft_consensus.cc:740] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.394419 18025 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.409880 18047 raft_consensus.cc:2749] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.401546 18041 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.410802 18041 raft_consensus.cc:3060] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.387692 18051 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:05:05.412312 17197 leader_election.cc:336] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.386835 17052 catalog_manager.cc:5697] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:05.413213 17197 leader_election.cc:336] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.409938 17966 consensus_queue.cc:260] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.416743 17966 ts_tablet_manager.cc:1434] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:05.417052 17198 leader_election.cc:304] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.415686 17346 leader_election.cc:304] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:05.378284 17967 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.419039 18025 raft_consensus.cc:2804] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.421118 18025 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.421509 18025 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.422721 17973 raft_consensus.cc:515] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.387861 17302 raft_consensus.cc:2468] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:05.425208 18028 raft_consensus.cc:2804] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.425727 18028 raft_consensus.cc:493] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.427395 18028 raft_consensus.cc:3060] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.427912 17973 leader_election.cc:290] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.426760 17198 leader_election.cc:304] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.429461 18051 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.429595 17977 raft_consensus.cc:2804] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.426975 17967 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:05.426937 17971 leader_election.cc:290] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.431545 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:05.435992 17302 raft_consensus.cc:2393] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 2: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:05:05.420416 18039 raft_consensus.cc:2804] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.435272 17977 raft_consensus.cc:697] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
W20260709 13:05:05.434788 17345 leader_election.cc:336] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.437780 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c3a626d41640f2b0ca7233c56f8bbc" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:05.438453 17377 raft_consensus.cc:3060] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.439052 18041 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.446055 17977 consensus_queue.cc:237] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.458069 17379 raft_consensus.cc:2393] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e9eba24bc8842099fcba4a2024c2aed in current term 2: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:05:05.434854 18025 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.439857 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
W20260709 13:05:05.446461 17345 leader_election.cc:336] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.439117 17966 tablet_bootstrap.cc:492] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:05.445302 17377 raft_consensus.cc:2468] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:05.460789 17228 raft_consensus.cc:2393] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79ae3773b2274d75b3f71364c0aa6d9c in current term 2: Already voted for candidate 7e9eba24bc8842099fcba4a2024c2aed in this term.
W20260709 13:05:05.448346 17197 leader_election.cc:336] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.461122 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:05.480407 17379 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.445626 18039 raft_consensus.cc:697] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:05.480739 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de6ec102dc0a48c0819f814102f27aa0" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:05.481601 17230 raft_consensus.cc:3060] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.481897 18039 consensus_queue.cc:237] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.477967 18025 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
W20260709 13:05:05.484648 17271 leader_election.cc:336] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.465981 17196 leader_election.cc:304] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.470310 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:05.460811 17345 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.490114 17302 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:05.490706 17345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 44271.7us
W20260709 13:05:05.491217 17345 leader_election.cc:336] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.491585 17345 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.466385 17303 raft_consensus.cc:2468] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
W20260709 13:05:05.492690 17345 leader_election.cc:336] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.492980 17271 leader_election.cc:336] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.493162 17345 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.444033 18028 raft_consensus.cc:515] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.449345 18049 raft_consensus.cc:515] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.498836 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:05.499461 17232 raft_consensus.cc:3060] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.500192 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0f611e5491b4876b5239b70747dc109" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:05.500751 17377 raft_consensus.cc:3060] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.504889 17346 leader_election.cc:304] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:05.505797 17842 raft_consensus.cc:2804] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.506309 17842 raft_consensus.cc:697] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:05.507439 17232 raft_consensus.cc:2468] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:05.507177 17842 consensus_queue.cc:237] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.497354 17196 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.508924 17346 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
W20260709 13:05:05.511063 17345 leader_election.cc:336] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.510712 17196 leader_election.cc:304] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:05.517640 17345 leader_election.cc:336] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.513374 17377 raft_consensus.cc:2468] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 2.
I20260709 13:05:05.476999 18041 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.496702 17967 raft_consensus.cc:2804] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:05.522723 17270 leader_election.cc:304] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
W20260709 13:05:05.523006 17345 leader_election.cc:336] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.523286 18036 raft_consensus.cc:2804] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.516759 17973 raft_consensus.cc:2749] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.520663 17224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:05.517138 17969 raft_consensus.cc:2804] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.524396 18028 leader_election.cc:290] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.519363 17272 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.525337 17303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b04afb5955d549318f7fe723b79f1d3b" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
W20260709 13:05:05.526954 17345 leader_election.cc:336] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.493956 18059 raft_consensus.cc:2749] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.527175 17967 raft_consensus.cc:493] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:05.533334 18036 raft_consensus.cc:697] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:05.542097 17967 raft_consensus.cc:3060] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:05.543618 17345 leader_election.cc:336] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.533437 17968 raft_consensus.cc:2804] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.545085 17968 raft_consensus.cc:697] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:05.538285 17303 raft_consensus.cc:3060] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.544334 17345 leader_election.cc:304] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.517068 17977 raft_consensus.cc:2749] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.533344 17379 raft_consensus.cc:2468] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 2.
W20260709 13:05:05.544359 17197 leader_election.cc:336] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.548239 17197 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.536406 17224 raft_consensus.cc:3060] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.526304 17230 raft_consensus.cc:2468] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:05.532753 17302 raft_consensus.cc:2468] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:05.569069 17303 raft_consensus.cc:2468] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:05.537315 18049 leader_election.cc:290] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:05.573382 17270 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.549880 18045 raft_consensus.cc:2749] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.542881 18036 consensus_queue.cc:237] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.561403 18047 raft_consensus.cc:2749] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.583298 17968 consensus_queue.cc:237] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.584975 17878 raft_consensus.cc:2804] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.585487 17878 raft_consensus.cc:697] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:05.538409 17971 raft_consensus.cc:2749] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.573583 17346 leader_election.cc:304] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:05.536684 17969 raft_consensus.cc:697] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:05.587154 17878 consensus_queue.cc:237] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.594973 17346 leader_election.cc:304] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:05.564711 18028 raft_consensus.cc:2749] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.600222 17346 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:05.613149 17973 raft_consensus.cc:2804] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.613749 17973 raft_consensus.cc:697] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:05.603452 18041 raft_consensus.cc:2804] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.605911 18045 raft_consensus.cc:2804] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.645520 17966 tablet_bootstrap.cc:492] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:05.597510 17969 consensus_queue.cc:237] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.638482 18041 raft_consensus.cc:697] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:05.645503 17224 raft_consensus.cc:2468] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 2.
W20260709 13:05:05.648988 17345 leader_election.cc:336] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.649470 17345 leader_election.cc:304] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.649901 17967 raft_consensus.cc:515] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:05.650403 17345 leader_election.cc:336] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.650484 17272 leader_election.cc:304] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:05.651352 17345 leader_election.cc:336] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.651592 18040 raft_consensus.cc:2749] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.651754 17345 leader_election.cc:304] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.652271 17967 leader_election.cc:290] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
W20260709 13:05:05.652724 17345 leader_election.cc:336] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.652873 18040 raft_consensus.cc:2749] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:05.652941 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ddeea989c64b70a533198455dc0b6c" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:05.660540 17379 raft_consensus.cc:3060] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.641475 18045 raft_consensus.cc:697] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:05.653825 17973 consensus_queue.cc:237] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.654827 18025 raft_consensus.cc:2804] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:05:05.668763 17197 leader_election.cc:336] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.662312 17271 leader_election.cc:336] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.693938 17966 tablet_bootstrap.cc:492] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:05.700628 17966 ts_tablet_manager.cc:1403] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.262s	user 0.022s	sys 0.002s
I20260709 13:05:05.711035 17379 raft_consensus.cc:2468] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:05.712293 17196 leader_election.cc:304] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:05.709535 18025 raft_consensus.cc:697] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:05.721585 18041 consensus_queue.cc:237] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:05.718364 17967 raft_consensus.cc:2804] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.735651 17976 raft_consensus.cc:493] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.735373 17966 raft_consensus.cc:359] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.736657 17966 raft_consensus.cc:740] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:05.736286 17976 raft_consensus.cc:515] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.730655 18045 consensus_queue.cc:237] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.738372 17966 consensus_queue.cc:260] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
W20260709 13:05:05.739959 17345 leader_election.cc:336] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.741101 17345 leader_election.cc:336] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.742395 17345 leader_election.cc:336] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:05.743335 17345 leader_election.cc:336] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:05.754398 17967 raft_consensus.cc:697] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:05.770177 17301 raft_consensus.cc:1275] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:05.773326 17966 ts_tablet_manager.cc:1434] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.071s	user 0.012s	sys 0.004s
I20260709 13:05:05.773798 18041 consensus_queue.cc:1048] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:05.774389 17966 tablet_bootstrap.cc:492] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:05.789665 17055 catalog_manager.cc:5697] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 2 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:05.764760 17967 consensus_queue.cc:237] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:05.796000 18079 log.cc:927] Time spent T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:05:05.796329 17976 leader_election.cc:290] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.831420 17976 raft_consensus.cc:493] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.771968 18025 consensus_queue.cc:237] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:05.856137 17303 raft_consensus.cc:1275] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:05.857672 18036 consensus_queue.cc:1048] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:05.841037 17976 raft_consensus.cc:515] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.907343 17976 leader_election.cc:290] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.942548 17976 raft_consensus.cc:493] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.943106 17976 raft_consensus.cc:515] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.945230 17976 leader_election.cc:290] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.956447 17976 raft_consensus.cc:493] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.956952 17976 raft_consensus.cc:515] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:05.958992 17197 consensus_peers.cc:597] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:05.972076 17345 consensus_peers.cc:597] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.982621 18087 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.979302 17230 raft_consensus.cc:1275] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:05.983950 17197 consensus_peers.cc:597] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:05.988700 18082 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.983218 18087 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:05.992918 17976 leader_election.cc:290] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:05.999711 18082 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:06.051712 17966 tablet_bootstrap.cc:492] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:05:06.052742 17271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 46555.2us
W20260709 13:05:06.056407 17196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 53075.3us
I20260709 13:05:06.054989 17052 catalog_manager.cc:5697] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 2 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.058115 17052 catalog_manager.cc:5697] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 2 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.059578 17052 catalog_manager.cc:5697] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 2 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.060652 18082 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:06.061510 17302 raft_consensus.cc:1275] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.063021 17977 consensus_queue.cc:1048] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:06.063310 18087 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:06.061024 17052 catalog_manager.cc:5697] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 2 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.068854 17966 tablet_bootstrap.cc:492] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:06.069676 17966 ts_tablet_manager.cc:1403] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.296s	user 0.012s	sys 0.010s
I20260709 13:05:06.078688 18040 consensus_queue.cc:1048] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:05:06.084592 17306 raft_consensus.cc:1275] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.086097 18045 consensus_queue.cc:1048] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:06.088433 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66fd7f2e6494980b0c33606bc363fe8" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:06.089478 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c9ef51ca24504be6b34051b2a0607" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:06.089855 17226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e81dc6421d4fdf8dcff43b8a449587" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:06.090124 17229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:06.091001 17229 raft_consensus.cc:2393] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 2: Already voted for candidate 7e9eba24bc8842099fcba4a2024c2aed in this term.
I20260709 13:05:06.089593 17232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf498205a5942dd9c8ec8f97f6f8c67" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:06.116026 17055 catalog_manager.cc:5697] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 2 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.126838 17055 catalog_manager.cc:5697] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 2 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.128376  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.193:40565
I20260709 13:05:06.126761 18087 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.144558 17966 raft_consensus.cc:359] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:06.145342 17966 raft_consensus.cc:740] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.146013 17966 consensus_queue.cc:260] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:06.147306 18106 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.193:40565 every 8 connection(s)
I20260709 13:05:06.150779 17966 ts_tablet_manager.cc:1434] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 13:05:06.152724 17379 raft_consensus.cc:1275] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.156081 17966 tablet_bootstrap.cc:492] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:06.155987 18082 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.162832 18082 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:06.164958 18082 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:06.157931 17939 consensus_queue.cc:1048] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:05:06.168965 18105 log.cc:927] Time spent T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:05:06.183151 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf498205a5942dd9c8ec8f97f6f8c67" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:06.186867 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66fd7f2e6494980b0c33606bc363fe8" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:06.151223 18087 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:06.218288 17303 raft_consensus.cc:1275] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.218876 17379 raft_consensus.cc:1275] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.228708 17379 raft_consensus.cc:1275] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.229558 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "573c9ef51ca24504be6b34051b2a0607" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:06.238853 17381 raft_consensus.cc:1275] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.242619 17224 raft_consensus.cc:1275] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.243433 17052 catalog_manager.cc:5697] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } }
I20260709 13:05:06.225906 18036 consensus_queue.cc:1048] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:05:06.249313 18087 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:06.249580 18047 consensus_queue.cc:1048] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:06.252857 18045 consensus_queue.cc:1048] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:06.260165 18025 consensus_queue.cc:1048] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:06.262277 17380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:06.263147 17380 raft_consensus.cc:2393] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 2: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:05:06.263322 17375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:06.264211 17375 raft_consensus.cc:2393] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 2: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:05:06.265143 17374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:06.265961 17374 raft_consensus.cc:2393] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 2: Already voted for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in this term.
I20260709 13:05:06.287176 18087 raft_consensus.cc:493] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.287776 18087 raft_consensus.cc:515] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:06.292059 17377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:06.291910 17053 catalog_manager.cc:5697] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.256923 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e81dc6421d4fdf8dcff43b8a449587" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:06.294340 17053 catalog_manager.cc:5697] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.295696 17053 catalog_manager.cc:5697] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.296684 17053 catalog_manager.cc:5697] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.299139 18025 consensus_queue.cc:1048] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:06.306156 17053 catalog_manager.cc:5697] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 2, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.289881 18087 leader_election.cc:290] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:06.328173 18087 raft_consensus.cc:493] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.328662 18087 raft_consensus.cc:515] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:06.330888 18087 leader_election.cc:290] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:06.338016 17960 leader_election.cc:304] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:06.351747 18087 raft_consensus.cc:2749] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.352254 17960 leader_election.cc:304] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:06.353303 18087 raft_consensus.cc:2749] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.354213 17302 raft_consensus.cc:1275] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.359786 18059 consensus_queue.cc:1048] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:06.377220 18087 raft_consensus.cc:493] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.377830 18087 raft_consensus.cc:515] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:06.379799 17224 raft_consensus.cc:1275] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.379864 18087 leader_election.cc:290] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:06.394126 17306 raft_consensus.cc:1275] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.397015 17232 raft_consensus.cc:1275] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.399981 17228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:06.400883 17228 raft_consensus.cc:2393] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 2: Already voted for candidate 7e9eba24bc8842099fcba4a2024c2aed in this term.
I20260709 13:05:06.400676 18045 consensus_queue.cc:1048] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:06.402040 17231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:06.402839 17231 raft_consensus.cc:2393] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 2: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:05:06.385425 18040 consensus_queue.cc:1048] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:05:06.415055 18082 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.415205 17968 consensus_queue.cc:1048] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:06.415750 18082 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:06.405212 17224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:06.421139 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:06.368551 17960 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
W20260709 13:05:06.441023 17960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 87025.5us
I20260709 13:05:06.442099 17960 leader_election.cc:304] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:06.443701 17960 leader_election.cc:304] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:06.417804 18082 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:06.465937 17976 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.467790 18087 raft_consensus.cc:2749] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.470112 18082 raft_consensus.cc:2749] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.491833 17225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85badce89ef744e995d4b4307b661464" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
W20260709 13:05:06.580612 17960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 136981us
I20260709 13:05:06.660651 18082 raft_consensus.cc:493] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.670243 18082 raft_consensus.cc:515] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:06.661487 18087 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.674484 18087 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:06.677210 18087 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:06.673621 18082 leader_election.cc:290] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
W20260709 13:05:06.684693 18070 log.cc:927] Time spent T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:05:06.661855 17962 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:06.698150 18082 raft_consensus.cc:3060] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.699915 18018 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.700958 18017 raft_consensus.cc:3060] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.703541 17962 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
W20260709 13:05:06.580914 18117 log.cc:927] Time spent T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:05:06.708964 18017 raft_consensus.cc:1275] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.709709 18015 raft_consensus.cc:3060] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.719816 17374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:06.754835 18015 raft_consensus.cc:1275] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.756999 17966 tablet_bootstrap.cc:492] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:05:06.757665 17271 consensus_peers.cc:597] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.758040 17966 tablet_bootstrap.cc:492] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:06.758740 17966 ts_tablet_manager.cc:1403] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.607s	user 0.026s	sys 0.003s
I20260709 13:05:06.759654 18047 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.750005 17976 raft_consensus.cc:2749] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.760325 18047 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:06.761240 18087 raft_consensus.cc:2749] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:06.762861 18047 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:06.766443 18087 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:06.766847 17271 consensus_peers.cc:597] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:06.766964 18087 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:06.767638 17271 consensus_peers.cc:597] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:06.768657 17271 consensus_peers.cc:597] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:06.769572 18087 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:06.770606 17374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
W20260709 13:05:06.772651 17271 consensus_peers.cc:597] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:06.773438 17271 consensus_peers.cc:597] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:06.774122 17271 consensus_peers.cc:597] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:06.776722 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 73294us
I20260709 13:05:06.777249 18018 raft_consensus.cc:1275] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.780373 17968 consensus_queue.cc:1048] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:06.783357 17271 consensus_peers.cc:597] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:06.791433 17374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:06.791857 17968 consensus_queue.cc:1048] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:06.792199 17374 raft_consensus.cc:2468] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:06.809569 17966 raft_consensus.cc:359] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:06.810722 17966 raft_consensus.cc:740] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.821056 17966 consensus_queue.cc:260] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:06.823298 17196 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:06.832903 17966 ts_tablet_manager.cc:1434] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:05:06.805979 18082 raft_consensus.cc:2749] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:06.870219 17196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 46997.4us
I20260709 13:05:06.892755 17966 tablet_bootstrap.cc:492] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:06.865677 17967 raft_consensus.cc:2804] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:06.893988 17198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 63617us
I20260709 13:05:06.869628 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
W20260709 13:05:06.909199 18127 log.cc:927] Time spent T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:05:06.926754 17271 consensus_peers.cc:597] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:06.919324 18017 raft_consensus.cc:2468] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:06.897832 17967 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.932272 17967 raft_consensus.cc:3060] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:06.956691 17197 consensus_peers.cc:597] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:06.957238 17197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 114646us
I20260709 13:05:06.961186 18125 consensus_queue.cc:1048] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:06.988960 17198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 88992.6us
W20260709 13:05:06.997212 17197 consensus_peers.cc:597] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:06.998136 17197 consensus_peers.cc:597] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:06.999351 17197 consensus_peers.cc:597] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:06.999943 17197 consensus_peers.cc:597] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.030903 18012 raft_consensus.cc:3060] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.033310 18010 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.037230 18016 raft_consensus.cc:3060] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:07.038108 17345 consensus_peers.cc:597] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:07.038820 17345 consensus_peers.cc:597] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:07.039430 17345 consensus_peers.cc:597] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:07.041033 17345 consensus_peers.cc:597] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.041133 18010 raft_consensus.cc:1275] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:07.042137 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 57163.7us
W20260709 13:05:07.041915 17345 consensus_peers.cc:597] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.048223 17271 consensus_peers.cc:597] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.051213 18012 raft_consensus.cc:1275] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:07.059037 17197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 58642.4us
I20260709 13:05:07.068085 17227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:07.068982 17227 raft_consensus.cc:2393] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 2: Already voted for candidate 7e9eba24bc8842099fcba4a2024c2aed in this term.
I20260709 13:05:07.075088 17967 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:07.079370 18114 heartbeater.cc:344] Connected to a master server at 127.7.41.254:37309
I20260709 13:05:07.079797 18114 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:07.080927 17345 consensus_peers.cc:597] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:07.081821 17345 consensus_peers.cc:597] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.082371 17842 consensus_queue.cc:1048] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.094101 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:07.095681 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:07.097325 17306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85badce89ef744e995d4b4307b661464" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:07.097949 17307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacbd66665ce48a39ba07db89854bc1c" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:07.098528 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:07.099010 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:07.099306 17301 raft_consensus.cc:2393] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de7ec497603d42d0acaf22677ea7f1bd in current term 2: Already voted for candidate 79ae3773b2274d75b3f71364c0aa6d9c in this term.
I20260709 13:05:07.100055 18114 heartbeater.cc:507] Master 127.7.41.254:37309 requested a full tablet report, sending...
I20260709 13:05:07.112875 17227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b6348ed73e48b2a0efba1da6d17c66" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:07.116968 17962 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:05:07.118343 17962 leader_election.cc:304] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:07.119920 17976 raft_consensus.cc:2749] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:07.120673 17976 raft_consensus.cc:2749] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:07.121731 17226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:07.084959 17969 consensus_queue.cc:1048] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:05:07.143818 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b6348ed73e48b2a0efba1da6d17c66" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:07.148651 17374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:07.149822 17374 raft_consensus.cc:3060] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.156427 17962 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:07.157299 18082 raft_consensus.cc:2749] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:07.175148 17962 leader_election.cc:304] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:07.178344 18082 raft_consensus.cc:2749] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:07.191399 17967 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 3 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:07.207756 17962 leader_election.cc:304] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
W20260709 13:05:07.266697 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 63819.5us
I20260709 13:05:07.267585 17962 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:05:07.268858 17962 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:07.269273 18121 raft_consensus.cc:2749] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:07.270308 18121 raft_consensus.cc:2749] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:07.271085 18121 raft_consensus.cc:3060] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.285781 17966 tablet_bootstrap.cc:492] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.292209 17966 tablet_bootstrap.cc:492] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.292984 17966 ts_tablet_manager.cc:1403] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.401s	user 0.022s	sys 0.009s
I20260709 13:05:07.278139 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d30a413a6924c3ea6027b6d3b4adc86" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:05:07.274001 17374 raft_consensus.cc:2468] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 3.
I20260709 13:05:07.339150 18012 raft_consensus.cc:3060] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.375020 17196 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:07.376380 18055 raft_consensus.cc:2804] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:07.376955 18055 raft_consensus.cc:697] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:07.377961 18055 consensus_queue.cc:237] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:07.381443 17966 raft_consensus.cc:359] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.382288 17966 raft_consensus.cc:740] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.383060 17966 consensus_queue.cc:260] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.296480 17962 leader_election.cc:304] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de7ec497603d42d0acaf22677ea7f1bd; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:07.384228 17976 raft_consensus.cc:2749] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:07.384419 17962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 97427.1us
I20260709 13:05:07.395546 18121 raft_consensus.cc:2749] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:07.397639 17345 consensus_peers.cc:597] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:07.407445 17966 ts_tablet_manager.cc:1434] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.001s
I20260709 13:05:07.408396 17966 tablet_bootstrap.cc:492] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:07.410969 18059 raft_consensus.cc:493] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.411646 18059 raft_consensus.cc:515] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.414309 18059 leader_election.cc:290] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:07.411065 18124 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.415310 18124 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:07.418673 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:05:07.419377 18016 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:07.419806 18124 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:07.420517 17374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:07.421169 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:05:07.421808 17197 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:07.421142 17374 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:07.422825 18130 raft_consensus.cc:2804] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:07.423054 17345 leader_election.cc:343] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.423259 18130 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.423645 18130 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.430124 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:07.430851 17304 raft_consensus.cc:2468] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:07.432117 17346 leader_election.cc:304] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:07.433274 18059 raft_consensus.cc:2804] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:07.433693 18059 raft_consensus.cc:493] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.435787 18059 raft_consensus.cc:3060] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.454141 17966 tablet_bootstrap.cc:492] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.455287 17966 tablet_bootstrap.cc:492] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.456007 17966 ts_tablet_manager.cc:1403] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.000s
I20260709 13:05:07.456292 18012 raft_consensus.cc:2468] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 3.
I20260709 13:05:07.459106 17966 raft_consensus.cc:359] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.461796 17966 raft_consensus.cc:740] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.464862 18130 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:07.464967 17966 consensus_queue.cc:260] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.467485 17966 ts_tablet_manager.cc:1434] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:07.468015 17374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:07.468748 17374 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.468961 17966 tablet_bootstrap.cc:492] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:07.487075 17374 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 3.
I20260709 13:05:07.488659 17196 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:07.491539 18124 raft_consensus.cc:2804] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:07.492524 18124 raft_consensus.cc:697] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:07.493763 18124 consensus_queue.cc:237] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:07.501147 17055 ts_manager.cc:194] Re-registered known tserver with Master: de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:07.507561 17053 catalog_manager.cc:5697] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 1 to 3, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 3 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.513945 18130 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 3 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:07.505136 18059 raft_consensus.cc:515] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.514915 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:05:07.515650 18018 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.516393 18059 leader_election.cc:290] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:07.518397 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:07.519059 17304 raft_consensus.cc:3060] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.522683 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe458392d4741bf9e3b6893e219031e" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
W20260709 13:05:07.527031 17345 leader_election.cc:343] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.528411 17966 tablet_bootstrap.cc:492] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.530287 17304 raft_consensus.cc:2468] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 3.
I20260709 13:05:07.531692 17346 leader_election.cc:304] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:07.533316 18028 raft_consensus.cc:2804] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:07.533851 18028 raft_consensus.cc:697] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:07.534821 18028 consensus_queue.cc:237] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.544526 17966 tablet_bootstrap.cc:492] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.546154 17966 ts_tablet_manager.cc:1403] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.077s	user 0.030s	sys 0.009s
I20260709 13:05:07.546200 18018 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 3.
I20260709 13:05:07.551420 17966 raft_consensus.cc:359] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.552219 17966 raft_consensus.cc:740] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.552961 17966 consensus_queue.cc:260] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.555335 17966 ts_tablet_manager.cc:1434] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:07.556255 17966 tablet_bootstrap.cc:492] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:07.562366 18077 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.563251 18077 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.582124 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd" is_pre_election: true
I20260709 13:05:07.582315 17226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed" is_pre_election: true
I20260709 13:05:07.582952 18012 raft_consensus.cc:2468] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 2.
I20260709 13:05:07.582994 17226 raft_consensus.cc:2468] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 2.
I20260709 13:05:07.584306 17271 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:07.585186 17655 raft_consensus.cc:2804] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:07.585690 17655 raft_consensus.cc:493] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.586107 17655 raft_consensus.cc:3060] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.587478 18077 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:07.598654 17053 catalog_manager.cc:5697] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 1 to 3, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 3 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.609727 17655 raft_consensus.cc:515] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.612296 18012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
I20260709 13:05:07.612550 17655 leader_election.cc:290] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:07.613543 17226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fe91dffd9642e48367fdff703aa915" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:07.613449 18012 raft_consensus.cc:3060] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.612401 17052 catalog_manager.cc:5697] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 3, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 3 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.614327 17226 raft_consensus.cc:3060] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.624701 17966 tablet_bootstrap.cc:492] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.630934 17226 raft_consensus.cc:2468] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 3.
I20260709 13:05:07.632469 17272 leader_election.cc:304] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:07.633387 17655 raft_consensus.cc:2804] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:07.633848 17655 raft_consensus.cc:697] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:07.634680 17655 consensus_queue.cc:237] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.638505 18012 raft_consensus.cc:2468] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 3.
I20260709 13:05:07.625804 17966 tablet_bootstrap.cc:492] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.639902 17966 ts_tablet_manager.cc:1403] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.084s	user 0.030s	sys 0.015s
I20260709 13:05:07.642942 17966 raft_consensus.cc:359] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.645066 17966 raft_consensus.cc:740] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.645787 17966 consensus_queue.cc:260] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.648097 17966 ts_tablet_manager.cc:1434] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:07.648983 17966 tablet_bootstrap.cc:492] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:07.668952 18012 raft_consensus.cc:3060] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.670467 17056 catalog_manager.cc:5697] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 1 to 3, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 3 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.694121 17966 tablet_bootstrap.cc:492] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.695086 17966 tablet_bootstrap.cc:492] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.695747 17966 ts_tablet_manager.cc:1403] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.007s
I20260709 13:05:07.701632 17055 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46250
I20260709 13:05:07.702075 17966 raft_consensus.cc:359] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.702843 17966 raft_consensus.cc:740] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.703684 17966 consensus_queue.cc:260] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.705634 17966 ts_tablet_manager.cc:1434] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:07.706394 17966 tablet_bootstrap.cc:492] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:07.707722 18114 heartbeater.cc:499] Master 127.7.41.254:37309 was elected leader, sending a full tablet report...
I20260709 13:05:07.732643 17966 tablet_bootstrap.cc:492] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.733731 17966 tablet_bootstrap.cc:492] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.734498 17966 ts_tablet_manager.cc:1403] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.004s
I20260709 13:05:07.737283 17966 raft_consensus.cc:359] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.737996 17966 raft_consensus.cc:740] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.738714 17966 consensus_queue.cc:260] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.740896 17966 ts_tablet_manager.cc:1434] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:05:07.741695 17966 tablet_bootstrap.cc:492] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:07.767166 17966 tablet_bootstrap.cc:492] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.768226 17966 tablet_bootstrap.cc:492] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.769050 17966 ts_tablet_manager.cc:1403] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 13:05:07.774106 17966 raft_consensus.cc:359] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:07.777961 17966 raft_consensus.cc:740] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.778721 17966 consensus_queue.cc:260] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:07.782706 17966 ts_tablet_manager.cc:1434] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:05:07.783640 17966 tablet_bootstrap.cc:492] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:07.835896 17966 tablet_bootstrap.cc:492] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.836997 17966 tablet_bootstrap.cc:492] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.837698 17966 ts_tablet_manager.cc:1403] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.054s	user 0.029s	sys 0.011s
I20260709 13:05:07.840440 17966 raft_consensus.cc:359] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.841009 17966 raft_consensus.cc:740] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.841674 17966 consensus_queue.cc:260] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.843669 17966 ts_tablet_manager.cc:1434] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:07.847617 17966 tablet_bootstrap.cc:492] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:07.892191 18012 raft_consensus.cc:1275] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:07.893518 17966 tablet_bootstrap.cc:492] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.894562 17966 tablet_bootstrap.cc:492] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.895219 17966 ts_tablet_manager.cc:1403] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.020s
I20260709 13:05:07.895081 18130 consensus_queue.cc:1048] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:07.897987 17966 raft_consensus.cc:359] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.898680 17966 raft_consensus.cc:740] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.899313 17966 consensus_queue.cc:260] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.901197 17966 ts_tablet_manager.cc:1434] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:05:07.901950 17966 tablet_bootstrap.cc:492] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:07.921214 17966 tablet_bootstrap.cc:492] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.922453 17966 tablet_bootstrap.cc:492] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.923271 17966 ts_tablet_manager.cc:1403] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:05:07.929199 17966 raft_consensus.cc:359] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.931891 17966 raft_consensus.cc:740] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.933248 17966 consensus_queue.cc:260] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:07.937099 17966 ts_tablet_manager.cc:1434] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:05:07.938202 17966 tablet_bootstrap.cc:492] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:07.940989 18018 raft_consensus.cc:3060] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.948422 18018 raft_consensus.cc:1275] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:07.949962 18028 consensus_queue.cc:1048] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.960777 17376 raft_consensus.cc:1275] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:07.962159 18124 consensus_queue.cc:1048] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.969767 17374 raft_consensus.cc:1275] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:07.972357 18124 consensus_queue.cc:1048] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:07.983675 17966 tablet_bootstrap.cc:492] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:07.984999 17966 tablet_bootstrap.cc:492] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:07.985901 17966 ts_tablet_manager.cc:1403] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.008s
I20260709 13:05:07.989323 17966 raft_consensus.cc:359] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.990196 17966 raft_consensus.cc:740] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.991782 17966 consensus_queue.cc:260] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:07.998781 17966 ts_tablet_manager.cc:1434] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:05:08.003532 17304 raft_consensus.cc:1275] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:08.003686 17966 tablet_bootstrap.cc:492] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.009320 18012 raft_consensus.cc:1275] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:08.010047 18028 consensus_queue.cc:1048] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:08.010975 18124 consensus_queue.cc:1048] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.036577 17966 tablet_bootstrap.cc:492] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.037875 17966 tablet_bootstrap.cc:492] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.038590 17966 ts_tablet_manager.cc:1403] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.005s
I20260709 13:05:08.045502 17966 raft_consensus.cc:359] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:08.046277 17966 raft_consensus.cc:740] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.047158 17966 consensus_queue.cc:260] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:08.049319 17966 ts_tablet_manager.cc:1434] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:08.052707 17966 tablet_bootstrap.cc:492] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.112128 17966 tablet_bootstrap.cc:492] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.114174 17966 tablet_bootstrap.cc:492] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.114912 17966 ts_tablet_manager.cc:1403] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.062s	user 0.029s	sys 0.024s
I20260709 13:05:08.117197 17966 raft_consensus.cc:359] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:08.117763 17966 raft_consensus.cc:740] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.118531 17966 consensus_queue.cc:260] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:08.120101 17966 ts_tablet_manager.cc:1434] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:08.120895 17966 tablet_bootstrap.cc:492] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.124794 18016 raft_consensus.cc:3060] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.142863 17966 tablet_bootstrap.cc:492] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.143857 17966 tablet_bootstrap.cc:492] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.144511 17966 ts_tablet_manager.cc:1403] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:05:08.148049 17966 raft_consensus.cc:359] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:08.148742 17966 raft_consensus.cc:740] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.149477 17966 consensus_queue.cc:260] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:08.151134 17966 ts_tablet_manager.cc:1434] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:08.151911 17966 tablet_bootstrap.cc:492] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.180879 18018 raft_consensus.cc:1275] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:08.181245 17226 raft_consensus.cc:1275] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:08.184381 18184 consensus_queue.cc:1048] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.187175 18152 consensus_queue.cc:1048] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.194435 17966 tablet_bootstrap.cc:492] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.195549 17966 tablet_bootstrap.cc:492] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.196280 17966 ts_tablet_manager.cc:1403] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.000s
I20260709 13:05:08.198884 17966 raft_consensus.cc:359] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:08.199616 17966 raft_consensus.cc:740] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.200388 17966 consensus_queue.cc:260] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:08.203431 17966 ts_tablet_manager.cc:1434] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:08.205691 17966 tablet_bootstrap.cc:492] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.231688 17966 tablet_bootstrap.cc:492] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.232750 17966 tablet_bootstrap.cc:492] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.233410 17966 ts_tablet_manager.cc:1403] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.006s
I20260709 13:05:08.236505 17966 raft_consensus.cc:359] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.237036 17966 raft_consensus.cc:740] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.237699 17966 consensus_queue.cc:260] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.239580 17966 ts_tablet_manager.cc:1434] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:05:08.240288 17966 tablet_bootstrap.cc:492] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.253057 17966 tablet_bootstrap.cc:492] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.253849 17966 tablet_bootstrap.cc:492] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.254493 17966 ts_tablet_manager.cc:1403] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:05:08.256434 17966 raft_consensus.cc:359] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:08.256906 17966 raft_consensus.cc:740] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.257517 17966 consensus_queue.cc:260] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:08.259164 17966 ts_tablet_manager.cc:1434] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:08.260442 17966 tablet_bootstrap.cc:492] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.272217 17966 tablet_bootstrap.cc:492] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.273770 17966 tablet_bootstrap.cc:492] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.274415 17966 ts_tablet_manager.cc:1403] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:05:08.276376 17966 raft_consensus.cc:359] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.276875 17966 raft_consensus.cc:740] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.277387 17966 consensus_queue.cc:260] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.279042 17966 ts_tablet_manager.cc:1434] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:08.280090 17966 tablet_bootstrap.cc:492] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.301471 17966 tablet_bootstrap.cc:492] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.302381 17966 tablet_bootstrap.cc:492] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.303035 17966 ts_tablet_manager.cc:1403] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 13:05:08.305637 17966 raft_consensus.cc:359] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:08.306298 17966 raft_consensus.cc:740] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.306936 17966 consensus_queue.cc:260] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:08.308924 17966 ts_tablet_manager.cc:1434] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:05:08.309636 17966 tablet_bootstrap.cc:492] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.327153 17966 tablet_bootstrap.cc:492] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.327898 17966 tablet_bootstrap.cc:492] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.328394 17966 ts_tablet_manager.cc:1403] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:05:08.330353 17966 raft_consensus.cc:359] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:08.331010 17966 raft_consensus.cc:740] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.331677 17966 consensus_queue.cc:260] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:08.333636 17966 ts_tablet_manager.cc:1434] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:08.335047 17966 tablet_bootstrap.cc:492] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.338104 18016 raft_consensus.cc:3060] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.351287 17966 tablet_bootstrap.cc:492] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.352303 17966 tablet_bootstrap.cc:492] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.353134 17966 ts_tablet_manager.cc:1403] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:05:08.355592 17966 raft_consensus.cc:359] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.356285 17966 raft_consensus.cc:740] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.356906 17966 consensus_queue.cc:260] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.358897 17966 ts_tablet_manager.cc:1434] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:05:08.359673 17966 tablet_bootstrap.cc:492] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.390280 17966 tablet_bootstrap.cc:492] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.391222 17966 tablet_bootstrap.cc:492] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.391875 17966 ts_tablet_manager.cc:1403] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.005s
I20260709 13:05:08.395426 17966 raft_consensus.cc:359] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.396070 17966 raft_consensus.cc:740] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.396716 17966 consensus_queue.cc:260] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.398912 17966 ts_tablet_manager.cc:1434] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:05:08.400183 17966 tablet_bootstrap.cc:492] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.404348 18016 raft_consensus.cc:3060] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.437070 17966 tablet_bootstrap.cc:492] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.438109 17966 tablet_bootstrap.cc:492] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.438787 17966 ts_tablet_manager.cc:1403] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.039s	user 0.029s	sys 0.007s
I20260709 13:05:08.441524 17966 raft_consensus.cc:359] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:08.442258 17966 raft_consensus.cc:740] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.443045 17966 consensus_queue.cc:260] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:08.445315 17966 ts_tablet_manager.cc:1434] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:08.446554 17966 tablet_bootstrap.cc:492] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.462121 18016 raft_consensus.cc:3060] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.468283 18018 raft_consensus.cc:3060] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.476138 18010 raft_consensus.cc:3060] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.479732 17966 tablet_bootstrap.cc:492] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.484405 17966 tablet_bootstrap.cc:492] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.485266 17966 ts_tablet_manager.cc:1403] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.013s
I20260709 13:05:08.488098 17966 raft_consensus.cc:359] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.489830 17966 raft_consensus.cc:740] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.490504 17966 consensus_queue.cc:260] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.495661 17966 ts_tablet_manager.cc:1434] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:08.496732 17966 tablet_bootstrap.cc:492] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.516572 17966 tablet_bootstrap.cc:492] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.517473 17966 tablet_bootstrap.cc:492] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.518146 17966 ts_tablet_manager.cc:1403] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:05:08.520730 17966 raft_consensus.cc:359] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.521382 17966 raft_consensus.cc:740] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.522140 17966 consensus_queue.cc:260] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:08.523777 17966 ts_tablet_manager.cc:1434] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:08.524713 17966 tablet_bootstrap.cc:492] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap starting.
I20260709 13:05:08.537381 17966 tablet_bootstrap.cc:492] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:08.538367 17966 tablet_bootstrap.cc:492] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: Bootstrap complete.
I20260709 13:05:08.539008 17966 ts_tablet_manager.cc:1403] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:05:08.541436 17966 raft_consensus.cc:359] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:08.542119 17966 raft_consensus.cc:740] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.542783 17966 consensus_queue.cc:260] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:08.544692 17966 ts_tablet_manager.cc:1434] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:08.573959 18016 raft_consensus.cc:3060] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.898674 18018 raft_consensus.cc:3060] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.850005  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:16.900261 17302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a"
dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:43598
I20260709 13:05:16.901011 17302 raft_consensus.cc:606] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:16.913455 17374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16e21576805d4de796420b8d8190fd91"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:05:16.914001 17374 raft_consensus.cc:606] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:16.933391 17225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f"
dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
mode: GRACEFUL
new_leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
 from {username='slave'} at 127.0.0.1:41884
I20260709 13:05:16.933986 17225 raft_consensus.cc:606] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Received request to transfer leadership to TS 0e1f9e0cad0b4ecda332df1fd213ce1d
I20260709 13:05:16.937403 17376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86b2a5e865cd45b0a86c5a59f00e57a1"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:05:16.937969 17376 raft_consensus.cc:606] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:16.940392 17376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
mode: GRACEFUL
new_leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:05:16.940886 17376 raft_consensus.cc:606] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Received request to transfer leadership to TS 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:16.943246 17376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:05:16.943675 17376 raft_consensus.cc:606] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:16.946913 17376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
mode: GRACEFUL
new_leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:05:16.947383 17376 raft_consensus.cc:606] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Received request to transfer leadership to TS 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:16.949157  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:05:16.950618  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:17.068904 18228 raft_consensus.cc:993] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:17.069557 18218 raft_consensus.cc:1081] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:17.071228 18010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54776
I20260709 13:05:17.071765 18010 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.072103 18010 raft_consensus.cc:3060] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:17.078627 18010 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:17.080585 18010 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:17.081687 17225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:17.081614 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d94cad84c4419a7f21c6c0b35c7cb" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:17.082638 17225 raft_consensus.cc:3060] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:17.082722 17376 raft_consensus.cc:3055] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:17.083039 17376 raft_consensus.cc:740] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:17.083627 17376 consensus_queue.cc:260] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:17.084661 17376 raft_consensus.cc:3060] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:17.088723 17225 raft_consensus.cc:2468] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:17.090263 17962 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:17.091476 17376 raft_consensus.cc:2468] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:17.098757 18229 raft_consensus.cc:2804] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:17.099807 18229 raft_consensus.cc:697] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:17.100769 18229 consensus_queue.cc:237] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:17.112308 17052 catalog_manager.cc:5697] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 2 to 3, leader changed from 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 3 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.141868 18213 raft_consensus.cc:993] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:17.142377 18219 raft_consensus.cc:1081] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:17.143725 18010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:05:17.144176 18010 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.144505 18010 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:17.150722 18010 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:17.153270 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:17.153837 17304 raft_consensus.cc:3055] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:17.154002 18010 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:17.154143 17304 raft_consensus.cc:740] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:17.154803 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:17.155422 17376 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:17.155102 17304 consensus_queue.cc:260] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:17.156436 17304 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:17.162076 17376 raft_consensus.cc:2468] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:17.163411 17960 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:17.163528 17304 raft_consensus.cc:2468] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:17.164207 18229 raft_consensus.cc:2804] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:17.164716 18229 raft_consensus.cc:697] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:17.165534 18229 consensus_queue.cc:237] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:17.176563 17052 catalog_manager.cc:5697] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 2 to 3, leader changed from 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 3 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.210110 18222 raft_consensus.cc:993] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:17.210515 18222 raft_consensus.cc:1081] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:17.211773 18010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16e21576805d4de796420b8d8190fd91"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54776
I20260709 13:05:17.212289 18010 raft_consensus.cc:493] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.212848 18010 raft_consensus.cc:3060] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.217201 18010 raft_consensus.cc:515] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:17.218878 18010 leader_election.cc:290] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:17.219386 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:17.220024 17304 raft_consensus.cc:3060] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.220032 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:17.220760 17376 raft_consensus.cc:3055] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.221074 17376 raft_consensus.cc:740] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:17.221869 17376 consensus_queue.cc:260] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:17.223731 17376 raft_consensus.cc:3060] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.227473 18222 raft_consensus.cc:993] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:17.227977 18222 raft_consensus.cc:1081] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:17.228919 17304 raft_consensus.cc:2468] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:17.230862 17376 raft_consensus.cc:2468] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:17.231101 17962 leader_election.cc:304] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:17.232374 18229 raft_consensus.cc:2804] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.232895 18229 raft_consensus.cc:697] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:17.232909 18010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86b2a5e865cd45b0a86c5a59f00e57a1"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54776
I20260709 13:05:17.233754 18010 raft_consensus.cc:493] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.234261 18010 raft_consensus.cc:3060] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.233873 18229 consensus_queue.cc:237] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:17.243886 18010 raft_consensus.cc:515] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:17.246855 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2a5e865cd45b0a86c5a59f00e57a1" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:17.246912 18010 leader_election.cc:290] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:17.247941 17226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2a5e865cd45b0a86c5a59f00e57a1" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:17.247431 17376 raft_consensus.cc:3055] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.248512 17226 raft_consensus.cc:3060] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.248669 17376 raft_consensus.cc:740] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:17.248720 17052 catalog_manager.cc:5697] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 1 to 2, leader changed from 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 2 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.249703 17376 consensus_queue.cc:260] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:17.250965 17376 raft_consensus.cc:3060] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.255152 17226 raft_consensus.cc:2468] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:17.256127 17962 leader_election.cc:304] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:17.256979 18229 raft_consensus.cc:2804] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.257491 18229 raft_consensus.cc:697] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:17.258363 18229 consensus_queue.cc:237] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:17.261186 17376 raft_consensus.cc:2468] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:17.270107 17052 catalog_manager.cc:5697] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 1 to 2, leader changed from 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 2 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.298801 18222 raft_consensus.cc:993] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d: : Instructing follower 7e9eba24bc8842099fcba4a2024c2aed to start an election
I20260709 13:05:17.299276 18222 raft_consensus.cc:1081] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Signalling peer 7e9eba24bc8842099fcba4a2024c2aed to start an election
I20260709 13:05:17.301532 17226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768"
dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
 from {username='slave'} at 127.0.0.1:36332
I20260709 13:05:17.302053 17226 raft_consensus.cc:493] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.302390 17226 raft_consensus.cc:3060] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.309698 17226 raft_consensus.cc:515] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:17.310258 18222 raft_consensus.cc:993] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d: : Instructing follower 7e9eba24bc8842099fcba4a2024c2aed to start an election
I20260709 13:05:17.310793 18222 raft_consensus.cc:1081] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Signalling peer 7e9eba24bc8842099fcba4a2024c2aed to start an election
I20260709 13:05:17.312647 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:17.312995 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:17.312088 17226 leader_election.cc:290] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:17.313308 17304 raft_consensus.cc:3060] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.313550 17376 raft_consensus.cc:3055] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.313426 17225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532"
dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
 from {username='slave'} at 127.0.0.1:36332
I20260709 13:05:17.314061 17376 raft_consensus.cc:740] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:17.314283 17225 raft_consensus.cc:493] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.314704 17225 raft_consensus.cc:3060] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.314916 17376 consensus_queue.cc:260] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:17.316210 17376 raft_consensus.cc:3060] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.321062 17304 raft_consensus.cc:2468] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:17.321091 17225 raft_consensus.cc:515] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:17.322620 17198 leader_election.cc:304] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:17.323678 18212 raft_consensus.cc:2804] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.324163 18212 raft_consensus.cc:697] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:17.325169 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:17.324967 18212 consensus_queue.cc:237] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:17.325696 17302 raft_consensus.cc:3060] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.323071 17376 raft_consensus.cc:2468] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:17.327498 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:17.328164 17378 raft_consensus.cc:3055] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.328464 17378 raft_consensus.cc:740] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:17.329267 17378 consensus_queue.cc:260] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:17.330375 17378 raft_consensus.cc:3060] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.333806 17225 leader_election.cc:290] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:17.334247 17302 raft_consensus.cc:2468] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:17.337700 17378 raft_consensus.cc:2468] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 2.
I20260709 13:05:17.338976 17196 leader_election.cc:304] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:17.339998 18216 raft_consensus.cc:2804] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.350875 18216 raft_consensus.cc:697] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:17.351761 18216 consensus_queue.cc:237] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:17.353536 17052 catalog_manager.cc:5697] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 1 to 2, leader changed from 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196) to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 2 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.365370 18242 raft_consensus.cc:993] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed: : Instructing follower 0e1f9e0cad0b4ecda332df1fd213ce1d to start an election
I20260709 13:05:17.365873 18216 raft_consensus.cc:1081] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Signalling peer 0e1f9e0cad0b4ecda332df1fd213ce1d to start an election
I20260709 13:05:17.367410 17376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
 from {username='slave'} at 127.0.0.1:51580
I20260709 13:05:17.367967 17376 raft_consensus.cc:493] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.368376 17376 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.376787 17376 raft_consensus.cc:515] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:17.378943 17376 leader_election.cc:290] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:17.380411 17226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:17.380576 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:17.380298 17052 catalog_manager.cc:5697] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 1 to 2, leader changed from 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196) to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 2 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.381246 17302 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.381644 17226 raft_consensus.cc:3055] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.381946 17226 raft_consensus.cc:740] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:17.382582 17226 consensus_queue.cc:260] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:17.383505 17226 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.386631 17302 raft_consensus.cc:2468] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:17.388803 17346 leader_election.cc:304] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:17.389503 17226 raft_consensus.cc:2468] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:17.390198 18222 raft_consensus.cc:2804] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.390698 18222 raft_consensus.cc:697] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:17.391469 18222 consensus_queue.cc:237] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:17.403671 17052 catalog_manager.cc:5697] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 2, leader changed from 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.515600 17376 raft_consensus.cc:1275] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.516776 18229 consensus_queue.cc:1048] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:17.529095 17226 raft_consensus.cc:1275] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.530611 18230 consensus_queue.cc:1048] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:17.549351 17376 raft_consensus.cc:1275] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.550627 18229 consensus_queue.cc:1048] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:17.560218 17304 raft_consensus.cc:1275] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.561640 18229 consensus_queue.cc:1048] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:17.705314 17376 raft_consensus.cc:1275] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.706713 18229 consensus_queue.cc:1048] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.708011 17304 raft_consensus.cc:1275] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.709337 18216 consensus_queue.cc:1048] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.741307 17376 raft_consensus.cc:1275] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.745455 18212 consensus_queue.cc:1048] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:05:17.760033 17304 raft_consensus.cc:1275] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.760502 17376 raft_consensus.cc:1275] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.761724 18257 consensus_queue.cc:1048] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:17.766069 17226 raft_consensus.cc:1275] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.771370 18230 consensus_queue.cc:1048] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:17.778400 17304 raft_consensus.cc:1275] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.780732 18258 consensus_queue.cc:1048] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:17.803119 18257 consensus_queue.cc:1048] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.819216 17374 raft_consensus.cc:1275] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.821156 18242 consensus_queue.cc:1048] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:17.919888 17304 raft_consensus.cc:1275] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.920879 18228 consensus_queue.cc:1048] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.928776 17225 raft_consensus.cc:1275] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.931197 18228 consensus_queue.cc:1048] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.951601  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:17.997747  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:18.046551 17376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:05:18.047158 17376 raft_consensus.cc:606] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:18.049721 17376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
mode: GRACEFUL
new_leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:05:18.050266 17376 raft_consensus.cc:606] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Received request to transfer leadership to TS 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:18.052610 17376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:05:18.053190 17376 raft_consensus.cc:606] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:18.055670 17376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74ea231d707840749fc902bd3d111e34"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:05:18.056213 17376 raft_consensus.cc:606] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:18.058411 17302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571"
dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:43598
I20260709 13:05:18.058911 17302 raft_consensus.cc:606] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:18.061363 17225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5"
dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:41884
I20260709 13:05:18.061920 17225 raft_consensus.cc:606] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:18.063205  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:18.064358  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:18.218366 18218 raft_consensus.cc:993] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:18.218930 18218 raft_consensus.cc:1081] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:18.220602 18018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54776
I20260709 13:05:18.221196 18018 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.221458 18018 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.226421 18018 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:18.228638 18018 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:18.228875 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:18.229236 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:18.229523 17302 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.230219 17376 raft_consensus.cc:3055] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:18.230547 17376 raft_consensus.cc:740] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:18.231379 17376 consensus_queue.cc:260] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:18.233492 17376 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.236219 17302 raft_consensus.cc:2468] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:18.240106 17376 raft_consensus.cc:2468] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:18.241339 17960 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:18.242254 18257 raft_consensus.cc:2804] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:18.242698 18257 raft_consensus.cc:697] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:18.243546 18257 consensus_queue.cc:237] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:18.257505 17055 catalog_manager.cc:5697] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 2 to 3, leader changed from 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 3 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.312696 18237 raft_consensus.cc:993] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:18.313220 18237 raft_consensus.cc:1081] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:18.314924 18016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:05:18.315516 18016 raft_consensus.cc:493] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.315853 18016 raft_consensus.cc:3060] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.321666 18016 raft_consensus.cc:515] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:18.323195 18016 leader_election.cc:290] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:18.323827 17226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:18.324473 17226 raft_consensus.cc:3060] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.324941 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43cf64dce604011933dfed0af0fa571" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:18.325438 17302 raft_consensus.cc:3055] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:18.325683 17302 raft_consensus.cc:740] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:18.326333 17302 consensus_queue.cc:260] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:18.327292 17302 raft_consensus.cc:3060] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.329255 17226 raft_consensus.cc:2468] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:18.330310 17962 leader_election.cc:304] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:18.331100 18257 raft_consensus.cc:2804] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:18.331511 18257 raft_consensus.cc:697] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:18.332309 17302 raft_consensus.cc:2468] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:18.332230 18257 consensus_queue.cc:237] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:18.345148 17055 catalog_manager.cc:5697] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 1 to 2, leader changed from 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 2 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.357538 18222 raft_consensus.cc:993] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d: : Instructing follower 7e9eba24bc8842099fcba4a2024c2aed to start an election
I20260709 13:05:18.358004 18218 raft_consensus.cc:1081] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Signalling peer 7e9eba24bc8842099fcba4a2024c2aed to start an election
I20260709 13:05:18.359427 17226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f"
dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
 from {username='slave'} at 127.0.0.1:36332
I20260709 13:05:18.359947 17226 raft_consensus.cc:493] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.360280 17226 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.365916 17226 raft_consensus.cc:515] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:18.368010 17226 leader_election.cc:290] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 3 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:18.368314 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:18.368911 17302 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.369653 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "7e9eba24bc8842099fcba4a2024c2aed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:18.370225 17376 raft_consensus.cc:3055] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:18.370510 17376 raft_consensus.cc:740] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:18.371232 17376 consensus_queue.cc:260] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:18.372201 17376 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.377343 17302 raft_consensus.cc:2468] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 3.
I20260709 13:05:18.378583 17198 leader_election.cc:304] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:18.380937 17376 raft_consensus.cc:2468] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e9eba24bc8842099fcba4a2024c2aed in term 3.
I20260709 13:05:18.381124 18242 raft_consensus.cc:2804] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:18.382975 18222 raft_consensus.cc:993] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:18.383404 18222 raft_consensus.cc:1081] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:18.388060 18018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74ea231d707840749fc902bd3d111e34"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54776
I20260709 13:05:18.388597 18018 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.388928 18018 raft_consensus.cc:3060] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.390331 18259 raft_consensus.cc:993] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:18.390861 18259 raft_consensus.cc:1081] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:18.392095 18242 raft_consensus.cc:697] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 3 LEADER]: Becoming Leader. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:18.393018 18242 consensus_queue.cc:237] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:18.396483 18016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54780
I20260709 13:05:18.396938 18016 raft_consensus.cc:493] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.397253 18016 raft_consensus.cc:3060] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.398100 18018 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:18.399957 18018 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:18.400506 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:18.401103 17376 raft_consensus.cc:3055] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:18.401333 17376 raft_consensus.cc:740] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:18.402238 17226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74ea231d707840749fc902bd3d111e34" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:18.402752 17226 raft_consensus.cc:3060] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.404418 18016 raft_consensus.cc:515] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:18.405879 18016 leader_election.cc:290] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:18.406978 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:18.407135 17225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb81c4e8cd7b4230ac749fa80efc56c5" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:18.407580 17302 raft_consensus.cc:3060] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.407603 17226 raft_consensus.cc:2468] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:18.407727 17225 raft_consensus.cc:3055] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:18.408341 17225 raft_consensus.cc:740] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:18.402220 17376 consensus_queue.cc:260] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:18.409363 17962 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:18.409165 17225 consensus_queue.cc:260] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:18.409912 17376 raft_consensus.cc:3060] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.410218 18257 raft_consensus.cc:2804] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:18.410742 17225 raft_consensus.cc:3060] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.410758 18257 raft_consensus.cc:697] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:18.416488 18257 consensus_queue.cc:237] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:18.416898 17302 raft_consensus.cc:2468] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:18.417574 17376 raft_consensus.cc:2468] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:18.418068 17962 leader_election.cc:304] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:18.419194 18251 raft_consensus.cc:2804] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:18.419639 18251 raft_consensus.cc:697] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:18.420579 18251 consensus_queue.cc:237] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:18.433066 17225 raft_consensus.cc:2468] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:18.438258 17055 catalog_manager.cc:5697] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed reported cstate change: term changed from 2 to 3, leader changed from 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196) to 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194). New cstate: current_term: 3 leader_uuid: "7e9eba24bc8842099fcba4a2024c2aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.438820 17053 catalog_manager.cc:5697] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 2 to 3, leader changed from 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 3 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.444600 18218 raft_consensus.cc:993] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:18.445101 18218 raft_consensus.cc:1081] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:18.454308 18016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54776
I20260709 13:05:18.455224 18016 raft_consensus.cc:493] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:18.455608 18016 raft_consensus.cc:3060] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.459486 17055 catalog_manager.cc:5697] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 2 to 3, leader changed from 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 3 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.461635 18016 raft_consensus.cc:515] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:18.463593 18016 leader_election.cc:290] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:18.464162 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:18.464563 17374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:18.464896 17302 raft_consensus.cc:3060] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.465169 17374 raft_consensus.cc:3055] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:18.465535 17374 raft_consensus.cc:740] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:18.466266 17374 consensus_queue.cc:260] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:18.467386 17374 raft_consensus.cc:3060] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.470877 17302 raft_consensus.cc:2468] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:18.471925 17962 leader_election.cc:304] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:18.472371 17374 raft_consensus.cc:2468] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:18.472710 18251 raft_consensus.cc:2804] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:18.473242 18251 raft_consensus.cc:697] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:18.474082 18251 consensus_queue.cc:237] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:18.483382 17055 catalog_manager.cc:5697] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 1 to 2, leader changed from 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 2 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.667286 17302 raft_consensus.cc:1275] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:18.668983 18251 consensus_queue.cc:1048] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.677969 17376 raft_consensus.cc:1275] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:18.680110 18257 consensus_queue.cc:1048] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.743115 17304 raft_consensus.cc:1275] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.744316 18251 consensus_queue.cc:1048] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.759891 17225 raft_consensus.cc:1275] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.761413 18229 consensus_queue.cc:1048] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.813053 17225 raft_consensus.cc:1275] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:18.814268 18229 consensus_queue.cc:1048] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.823648 17376 raft_consensus.cc:1275] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:18.825245 18257 consensus_queue.cc:1048] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.850966 17376 raft_consensus.cc:1275] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:18.852221 18275 consensus_queue.cc:1048] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.858327 17226 raft_consensus.cc:1275] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:18.860586 17302 raft_consensus.cc:1275] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Refusing update from remote peer 7e9eba24bc8842099fcba4a2024c2aed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:18.862226 18242 consensus_queue.cc:1048] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.866328 18257 consensus_queue.cc:1048] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.886313 17302 raft_consensus.cc:1275] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:18.887534 18291 consensus_queue.cc:1048] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.949447 17376 raft_consensus.cc:1275] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.950726 18291 consensus_queue.cc:1048] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.959157 17302 raft_consensus.cc:1275] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.960917 18291 consensus_queue.cc:1048] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.065371  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:19.109862  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:19.148305 17225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43f244e037b7426793547977135a3e68"
dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:41884
I20260709 13:05:19.148878 17225 raft_consensus.cc:606] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:19.151118 17304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d"
dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:43598
I20260709 13:05:19.151512 17304 raft_consensus.cc:606] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:19.153498 17304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbdd6a649a514be4a7e5dd077219ffed"
dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:43598
I20260709 13:05:19.153867 17304 raft_consensus.cc:606] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:19.155846 17304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccf8ff673def486c94896905e592b78f"
dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
mode: GRACEFUL
new_leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
 from {username='slave'} at 127.0.0.1:43598
I20260709 13:05:19.156209 17304 raft_consensus.cc:606] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Received request to transfer leadership to TS 0e1f9e0cad0b4ecda332df1fd213ce1d
I20260709 13:05:19.158083 17225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768"
dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
mode: GRACEFUL
new_leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
 from {username='slave'} at 127.0.0.1:41884
I20260709 13:05:19.158449 17225 raft_consensus.cc:606] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Received request to transfer leadership to TS 79ae3773b2274d75b3f71364c0aa6d9c
I20260709 13:05:19.159339  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:19.160379  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:19.327270 18261 raft_consensus.cc:993] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:19.327808 18237 raft_consensus.cc:1081] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:19.329385 18018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:05:19.329953 18018 raft_consensus.cc:493] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.330341 18018 raft_consensus.cc:3060] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.334307 18261 raft_consensus.cc:993] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c: : Instructing follower 0e1f9e0cad0b4ecda332df1fd213ce1d to start an election
I20260709 13:05:19.334820 18237 raft_consensus.cc:1081] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Signalling peer 0e1f9e0cad0b4ecda332df1fd213ce1d to start an election
I20260709 13:05:19.336203 17376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccf8ff673def486c94896905e592b78f"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
 from {username='slave'} at 127.0.0.1:51558
I20260709 13:05:19.336738 17376 raft_consensus.cc:493] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.336500 18018 raft_consensus.cc:515] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:19.337071 17376 raft_consensus.cc:3060] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.339236 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:19.339429 17374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:19.339828 17302 raft_consensus.cc:3055] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.340032 17374 raft_consensus.cc:3060] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.340178 17302 raft_consensus.cc:740] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:19.341054 17302 consensus_queue.cc:260] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:19.341809 17302 raft_consensus.cc:3060] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.343537 17376 raft_consensus.cc:515] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:19.345402 17376 leader_election.cc:290] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:19.346484 17225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf8ff673def486c94896905e592b78f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:19.346728 17374 raft_consensus.cc:2468] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:19.347148 17225 raft_consensus.cc:3060] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.347328 17302 raft_consensus.cc:2468] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:19.347537 18018 leader_election.cc:290] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:19.347965 17960 leader_election.cc:304] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:19.349114 18257 raft_consensus.cc:2804] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.349576 18257 raft_consensus.cc:697] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:19.350397 18257 consensus_queue.cc:237] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:19.353614 17225 raft_consensus.cc:2468] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:19.354367 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf8ff673def486c94896905e592b78f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:19.354939 17346 leader_election.cc:304] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed; no voters: 
I20260709 13:05:19.354996 17302 raft_consensus.cc:3055] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.355829 18228 raft_consensus.cc:2804] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.356341 18228 raft_consensus.cc:697] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:19.355605 17302 raft_consensus.cc:740] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:19.357216 18228 consensus_queue.cc:237] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:19.358502 17302 consensus_queue.cc:260] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:19.360003 17302 raft_consensus.cc:3060] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.371765 17302 raft_consensus.cc:2468] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:19.377028 17052 catalog_manager.cc:5697] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 1 to 2, leader changed from 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 2 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.384049 17055 catalog_manager.cc:5697] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 2, leader changed from 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.448745 18237 raft_consensus.cc:993] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:19.449180 18261 raft_consensus.cc:1081] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:19.450470 18016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbdd6a649a514be4a7e5dd077219ffed"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:05:19.450898 18016 raft_consensus.cc:493] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.451205 18016 raft_consensus.cc:3060] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.457358 18016 raft_consensus.cc:515] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:19.458943 18016 leader_election.cc:290] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:19.459486 17225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdd6a649a514be4a7e5dd077219ffed" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:19.460084 17225 raft_consensus.cc:3060] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.459985 17302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdd6a649a514be4a7e5dd077219ffed" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:19.460708 17302 raft_consensus.cc:3055] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:19.461004 17302 raft_consensus.cc:740] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:19.461741 17302 consensus_queue.cc:260] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:19.462918 17302 raft_consensus.cc:3060] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.466686 17225 raft_consensus.cc:2468] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:19.467717 17962 leader_election.cc:304] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:19.468376 18291 raft_consensus.cc:2804] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.468825 18291 raft_consensus.cc:697] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:19.469280 17302 raft_consensus.cc:2468] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:19.469691 18291 consensus_queue.cc:237] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:19.480353 17055 catalog_manager.cc:5697] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 1 to 2, leader changed from 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 2 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.521520 18275 raft_consensus.cc:993] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:19.522051 18242 raft_consensus.cc:1081] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:19.523669 18016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43f244e037b7426793547977135a3e68"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54780
I20260709 13:05:19.524180 18016 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.524477 18016 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:19.529327 18016 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:19.530977 18016 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 4 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:19.531731 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:19.532166 17225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f244e037b7426793547977135a3e68" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:19.532379 17376 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:19.532698 17225 raft_consensus.cc:3055] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:19.533062 17225 raft_consensus.cc:740] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:19.533788 17225 consensus_queue.cc:260] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:19.534921 17225 raft_consensus.cc:3060] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:19.538149 17376 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 4.
I20260709 13:05:19.539160 17960 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:19.539862 18291 raft_consensus.cc:2804] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:19.540110 17225 raft_consensus.cc:2468] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 4.
I20260709 13:05:19.540565 18291 raft_consensus.cc:697] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 4 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:19.541663 18291 consensus_queue.cc:237] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:19.551867 17055 catalog_manager.cc:5697] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 3 to 4, leader changed from 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 4 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.605808 18242 raft_consensus.cc:993] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed: : Instructing follower 79ae3773b2274d75b3f71364c0aa6d9c to start an election
I20260709 13:05:19.606343 18275 raft_consensus.cc:1081] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Signalling peer 79ae3773b2274d75b3f71364c0aa6d9c to start an election
I20260709 13:05:19.607857 17304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768"
dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
 from {username='slave'} at 127.0.0.1:57902
I20260709 13:05:19.608385 17304 raft_consensus.cc:493] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.608724 17304 raft_consensus.cc:3060] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.613775 17304 raft_consensus.cc:515] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:19.615880 17304 leader_election.cc:290] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:19.616431 17225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:19.616700 17376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51f7c4d9c6e4ebb8b62960986f87768" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:19.617093 17225 raft_consensus.cc:3055] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:19.617427 17225 raft_consensus.cc:740] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e9eba24bc8842099fcba4a2024c2aed, State: Running, Role: LEADER
I20260709 13:05:19.617398 17376 raft_consensus.cc:3060] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.618291 17225 consensus_queue.cc:260] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:19.619169 17225 raft_consensus.cc:3060] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.624361 17376 raft_consensus.cc:2468] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 3.
I20260709 13:05:19.624779 17225 raft_consensus.cc:2468] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 3.
I20260709 13:05:19.625442 17270 leader_election.cc:304] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:19.626263 18261 raft_consensus.cc:2804] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.626747 18261 raft_consensus.cc:697] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:19.627426 18261 consensus_queue.cc:237] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:19.639087 17055 catalog_manager.cc:5697] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 2 to 3, leader changed from 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194) to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 3 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.756408 17304 raft_consensus.cc:1275] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.757553 18296 consensus_queue.cc:1048] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.771289 17225 raft_consensus.cc:1275] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.773751 18296 consensus_queue.cc:1048] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.782719 17376 raft_consensus.cc:1275] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.789405 18291 consensus_queue.cc:1048] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.818688 17302 raft_consensus.cc:1275] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.823661 18251 consensus_queue.cc:1048] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.854652 17225 raft_consensus.cc:1275] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.855948 18291 consensus_queue.cc:1048] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:19.868162 17302 raft_consensus.cc:1275] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.869951 18291 consensus_queue.cc:1048] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:20.037693 17374 raft_consensus.cc:1275] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:20.038775 18257 consensus_queue.cc:1048] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:20.051856 17225 raft_consensus.cc:1275] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 4 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:20.056689 17226 raft_consensus.cc:1275] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:20.070909 18261 consensus_queue.cc:1048] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:20.113858 18251 consensus_queue.cc:1048] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:20.183741 17374 raft_consensus.cc:1275] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:20.187413 18317 consensus_queue.cc:1048] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:20.304493  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:20.792296 17271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 50187.8us
W20260709 13:05:20.840672 17960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 46588.5us
W20260709 13:05:20.937160 17270 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.196:39887, user_credentials={real_user=slave}} blocked reactor thread for 116073us
I20260709 13:05:21.025514  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:21.062207 17306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a"
dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:43598
I20260709 13:05:21.062950 17306 raft_consensus.cc:606] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:21.069258 17374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a21af78b15714161898e0f709c8a5834"
dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
mode: GRACEFUL
new_leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:55640
I20260709 13:05:21.069859 17374 raft_consensus.cc:606] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Received request to transfer leadership to TS de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:21.072404  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:21.074237  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:21.312700 18296 raft_consensus.cc:993] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:21.313249 18296 raft_consensus.cc:1081] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:21.315058 18010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a21af78b15714161898e0f709c8a5834"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54776
I20260709 13:05:21.315781 18010 raft_consensus.cc:493] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.316301 18010 raft_consensus.cc:3060] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.344106 18328 raft_consensus.cc:993] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c: : Instructing follower de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:21.344770 18321 raft_consensus.cc:1081] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Signalling peer de7ec497603d42d0acaf22677ea7f1bd to start an election
I20260709 13:05:21.344558 18010 raft_consensus.cc:515] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:21.346660 18014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a"
dest_uuid: "de7ec497603d42d0acaf22677ea7f1bd"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:05:21.347258 18014 raft_consensus.cc:493] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.347652 18014 raft_consensus.cc:3060] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.349993 18010 leader_election.cc:290] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:21.351653 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21af78b15714161898e0f709c8a5834" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:21.352463 17379 raft_consensus.cc:3055] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:21.352731 17379 raft_consensus.cc:740] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:21.353667 17379 consensus_queue.cc:260] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:21.355453 17379 raft_consensus.cc:3060] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:21.356504 17254 debug-util.cc:398] Leaking SignalData structure 0x7b080029a8e0 after lost signal to thread 7338
W20260709 13:05:21.358071 17254 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3aa0 after lost signal to thread 17090
I20260709 13:05:21.369089 17379 raft_consensus.cc:2468] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:21.371060 17960 leader_election.cc:304] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:21.371949 18336 raft_consensus.cc:2804] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.372459 18336 raft_consensus.cc:697] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:21.373520 18336 consensus_queue.cc:237] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:21.396147 17254 debug-util.cc:398] Leaking SignalData structure 0x7b0800241960 after lost signal to thread 17257
W20260709 13:05:21.397621 17254 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3320 after lost signal to thread 17331
I20260709 13:05:21.421638 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21af78b15714161898e0f709c8a5834" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:21.422317 17230 raft_consensus.cc:3060] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:21.428998 17254 debug-util.cc:398] Leaking SignalData structure 0x7b08001efce0 after lost signal to thread 17405
W20260709 13:05:21.431267 17254 debug-util.cc:398] Leaking SignalData structure 0x7b080034ff00 after lost signal to thread 18106
I20260709 13:05:21.439544 17230 raft_consensus.cc:2468] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 2.
I20260709 13:05:21.492326 18014 raft_consensus.cc:515] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:21.499466 17052 catalog_manager.cc:5697] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 1 to 2, leader changed from 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 2 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.512459 17230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e9eba24bc8842099fcba4a2024c2aed"
I20260709 13:05:21.513237 17230 raft_consensus.cc:3060] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.514322 17304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245dcb50741d45dca44ea02ed447057a" candidate_uuid: "de7ec497603d42d0acaf22677ea7f1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:21.514936 17304 raft_consensus.cc:3055] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:21.515231 17304 raft_consensus.cc:740] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:21.516175 17304 consensus_queue.cc:260] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:21.528359 17304 raft_consensus.cc:3060] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.535962 17304 raft_consensus.cc:2468] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:21.537297 17962 leader_election.cc:304] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd; no voters: 
I20260709 13:05:21.527290 17230 raft_consensus.cc:2468] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de7ec497603d42d0acaf22677ea7f1bd in term 3.
I20260709 13:05:21.538425 18336 raft_consensus.cc:2804] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:21.538930 18336 raft_consensus.cc:697] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Becoming Leader. State: Replica: de7ec497603d42d0acaf22677ea7f1bd, State: Running, Role: LEADER
I20260709 13:05:21.539943 18336 consensus_queue.cc:237] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:21.511859 18014 leader_election.cc:290] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [CANDIDATE]: Term 3 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:21.566152 17052 catalog_manager.cc:5697] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd reported cstate change: term changed from 2 to 3, leader changed from 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195) to de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193). New cstate: current_term: 3 leader_uuid: "de7ec497603d42d0acaf22677ea7f1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.779162 17379 raft_consensus.cc:1275] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:21.780568 18340 consensus_queue.cc:1048] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:21.811417 17231 raft_consensus.cc:1275] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:21.813843 18340 consensus_queue.cc:1048] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:21.973349 17231 raft_consensus.cc:1275] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:21.975190 18340 consensus_queue.cc:1048] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:22.007174 17304 raft_consensus.cc:1275] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Refusing update from remote peer de7ec497603d42d0acaf22677ea7f1bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:22.008846 18340 consensus_queue.cc:1048] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:22.149631  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:22.195693  7335 tablet_server.cc:179] TabletServer@127.7.41.193:40565 shutting down...
W20260709 13:05:22.210647 17271 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 188 similar messages]
W20260709 13:05:22.218214 17271 consensus_peers.cc:597] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.242427 17345 consensus_peers.cc:597] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.246711  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:22.247879  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.248914  7335 raft_consensus.cc:2243] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.249769  7335 raft_consensus.cc:2272] T fb81c4e8cd7b4230ac749fa80efc56c5 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.253091  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.253959  7335 raft_consensus.cc:2243] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.254527  7335 raft_consensus.cc:2272] T 0f7a56b7669944ce91c6ad8b8f7c439c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.257841  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.258683  7335 raft_consensus.cc:2243] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.259804  7335 raft_consensus.cc:2272] T 6f853b6d09494a16a5ae6cc1110d7f3f P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.263248  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.264241  7335 raft_consensus.cc:2243] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.265360  7335 raft_consensus.cc:2272] T bbdd6a649a514be4a7e5dd077219ffed P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.268777  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.269646  7335 raft_consensus.cc:2243] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.270146  7335 raft_consensus.cc:2272] T 470d0807d3ce4a87bc3de4350bab91d9 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.273274  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.274281  7335 raft_consensus.cc:2243] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.274789  7335 raft_consensus.cc:2272] T 9c29266dacd348e593e9ece686e2e4e6 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.277885  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.278824  7335 raft_consensus.cc:2243] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:22.279425 17345 consensus_peers.cc:597] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.279485  7335 raft_consensus.cc:2272] T 968dc4dd3ad542808481bf0dad333ac7 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.282958  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.283627  7335 raft_consensus.cc:2243] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.284106  7335 raft_consensus.cc:2272] T 0650da7040f44f1ea1d37f44e9e5900a P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.287173  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.288048  7335 raft_consensus.cc:2243] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.288676  7335 raft_consensus.cc:2272] T 44c3a626d41640f2b0ca7233c56f8bbc P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.291656  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.292551  7335 raft_consensus.cc:2243] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.293149  7335 raft_consensus.cc:2272] T de6ec102dc0a48c0819f814102f27aa0 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.296299  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.297097  7335 raft_consensus.cc:2243] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.297609  7335 raft_consensus.cc:2272] T 6f1b381c59ed4f258e1b8e6e37096abc P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.301466  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.302309  7335 raft_consensus.cc:2243] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.302953  7335 raft_consensus.cc:2272] T f0ddeea989c64b70a533198455dc0b6c P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.305866  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.306746  7335 raft_consensus.cc:2243] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.307353  7335 raft_consensus.cc:2272] T b0f611e5491b4876b5239b70747dc109 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.310355  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.310984  7335 raft_consensus.cc:2243] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.311520  7335 raft_consensus.cc:2272] T c0b8248b5a4d4becb690235d23b259e4 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.314670  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.315410  7335 raft_consensus.cc:2243] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.316421  7335 raft_consensus.cc:2272] T c43cf64dce604011933dfed0af0fa571 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.319193  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.320051  7335 raft_consensus.cc:2243] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.320713  7335 raft_consensus.cc:2272] T bbe458392d4741bf9e3b6893e219031e P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.324059  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.324894  7335 raft_consensus.cc:2243] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.325587  7335 raft_consensus.cc:2272] T 7b39f71b242b42f986fa68287bf62ba8 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.328939  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.330875  7335 raft_consensus.cc:2243] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.331511  7335 raft_consensus.cc:2272] T 8b355c1a40d24e6387c364c6964fbb99 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:22.331961 17271 consensus_peers.cc:597] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.331867 17197 consensus_peers.cc:597] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.334491  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.335337  7335 raft_consensus.cc:2243] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.335850  7335 raft_consensus.cc:2272] T c38fd5f3f7224fde8c02ed2f1e9de777 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.338775  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.339529  7335 raft_consensus.cc:2243] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.340099  7335 raft_consensus.cc:2272] T b54b1ed764894db8bb28922faa095abf P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:22.342334 17345 consensus_peers.cc:597] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.343089  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.344118  7335 raft_consensus.cc:2243] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.345264  7335 raft_consensus.cc:2272] T 16e21576805d4de796420b8d8190fd91 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:22.346915 17271 consensus_peers.cc:597] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.348461  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.349402  7335 raft_consensus.cc:2243] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.350561  7335 raft_consensus.cc:2272] T 86b2a5e865cd45b0a86c5a59f00e57a1 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.353782  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.355031  7335 raft_consensus.cc:2243] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.355623  7335 raft_consensus.cc:2272] T 1a7341a74f344c90b6c0f9ff657621d5 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.359138  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.360235  7335 raft_consensus.cc:2243] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.361682  7335 raft_consensus.cc:2272] T 12cc194559d445f4859ac3e1c764ff4a P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.365839  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.366720  7335 raft_consensus.cc:2243] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.367276  7335 raft_consensus.cc:2272] T 69e81dc6421d4fdf8dcff43b8a449587 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.371300  7335 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:22.371892 17197 consensus_peers.cc:597] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.372179  7335 raft_consensus.cc:2243] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.372885  7335 raft_consensus.cc:2272] T 12c2736e41a64de2825d60818a0c19de P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:22.375607 17197 consensus_peers.cc:597] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.376245  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.377206  7335 raft_consensus.cc:2243] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.378402  7335 raft_consensus.cc:2272] T a8e23f2fe067471e9a52a8f835d7ca1d P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.381620  7335 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:22.382233 17271 consensus_peers.cc:597] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.382515  7335 raft_consensus.cc:2243] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.383131  7335 raft_consensus.cc:2272] T 4c83cdeb244b4fada6bff4050bdd4fcd P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.385953  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.386685  7335 raft_consensus.cc:2243] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.387180  7335 raft_consensus.cc:2272] T 1d30a413a6924c3ea6027b6d3b4adc86 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.389611  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.390491  7335 raft_consensus.cc:2243] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.393648  7335 raft_consensus.cc:2272] T 85badce89ef744e995d4b4307b661464 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.397776  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.398566  7335 raft_consensus.cc:2243] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.399077  7335 raft_consensus.cc:2272] T ddf498205a5942dd9c8ec8f97f6f8c67 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:22.405246 17345 consensus_peers.cc:597] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.407377  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.408253  7335 raft_consensus.cc:2243] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.408763  7335 raft_consensus.cc:2272] T dacbd66665ce48a39ba07db89854bc1c P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.411352  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.411983  7335 raft_consensus.cc:2243] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.412367  7335 raft_consensus.cc:2272] T a7b6348ed73e48b2a0efba1da6d17c66 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.414434  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.415006  7335 raft_consensus.cc:2243] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.415771  7335 raft_consensus.cc:2272] T 245dcb50741d45dca44ea02ed447057a P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.419059  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.419795  7335 raft_consensus.cc:2243] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.420692  7335 raft_consensus.cc:2272] T a21af78b15714161898e0f709c8a5834 P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:22.421605 17197 consensus_peers.cc:597] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.424114  7335 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:22.424832 17402 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa6e0 after lost signal to thread 7338
I20260709 13:05:22.425175  7335 raft_consensus.cc:2243] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.425825  7335 raft_consensus.cc:2272] T a9fe91dffd9642e48367fdff703aa915 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:22.425928 17402 debug-util.cc:398] Leaking SignalData structure 0x7b080014eb80 after lost signal to thread 17090
W20260709 13:05:22.427243 17402 debug-util.cc:398] Leaking SignalData structure 0x7b08002ccf60 after lost signal to thread 17257
W20260709 13:05:22.428313 17402 debug-util.cc:398] Leaking SignalData structure 0x7b080039f9a0 after lost signal to thread 17331
I20260709 13:05:22.429073  7335 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:22.429273 17402 debug-util.cc:398] Leaking SignalData structure 0x7b080041a8a0 after lost signal to thread 17405
I20260709 13:05:22.429939  7335 raft_consensus.cc:2243] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:22.430480 17402 debug-util.cc:398] Leaking SignalData structure 0x7b0800312fc0 after lost signal to thread 18106
I20260709 13:05:22.430574  7335 raft_consensus.cc:2272] T e66fd7f2e6494980b0c33606bc363fe8 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.433955  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.434882  7335 raft_consensus.cc:2243] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.435570  7335 raft_consensus.cc:2272] T b04afb5955d549318f7fe723b79f1d3b P de7ec497603d42d0acaf22677ea7f1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.438980  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.439729  7335 raft_consensus.cc:2243] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.440243  7335 raft_consensus.cc:2272] T e8692f804ad346579cc888efbc5c2bae P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:22.441028 17271 consensus_peers.cc:597] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.443338  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.444187  7335 raft_consensus.cc:2243] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.445338  7335 raft_consensus.cc:2272] T 74ea231d707840749fc902bd3d111e34 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.448441  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.449265  7335 raft_consensus.cc:2243] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.449869  7335 raft_consensus.cc:2272] T 079278fbd6474dea98fac1aaa536bb7c P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.452715  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.453450  7335 raft_consensus.cc:2243] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.454457  7335 raft_consensus.cc:2272] T 43f244e037b7426793547977135a3e68 P de7ec497603d42d0acaf22677ea7f1bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.457551  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.458253  7335 raft_consensus.cc:2243] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.459444  7335 raft_consensus.cc:2272] T 2d4c5c12c8844ad7877fca4c9d59dec6 P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.462779  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.463531  7335 raft_consensus.cc:2243] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.464071  7335 raft_consensus.cc:2272] T 573c9ef51ca24504be6b34051b2a0607 P de7ec497603d42d0acaf22677ea7f1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.467141  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:22.467753  7335 raft_consensus.cc:2243] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.468643  7335 raft_consensus.cc:2272] T f67d94cad84c4419a7f21c6c0b35c7cb P de7ec497603d42d0acaf22677ea7f1bd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:22.468789 17345 consensus_peers.cc:597] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.476126 17271 consensus_peers.cc:597] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.496325 17345 consensus_peers.cc:597] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.502031 17271 consensus_peers.cc:597] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.525179 17197 consensus_peers.cc:597] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.529583 17271 consensus_peers.cc:597] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.566428 17345 consensus_peers.cc:597] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.591761  7335 tablet_server.cc:196] TabletServer@127.7.41.193:40565 shutdown complete.
W20260709 13:05:22.633191 17271 consensus_peers.cc:597] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.641096 17345 consensus_peers.cc:597] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.661969 17345 consensus_peers.cc:597] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.668851 17345 consensus_peers.cc:597] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.675225 17197 consensus_peers.cc:597] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.675882 17197 consensus_peers.cc:597] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.676333 17197 consensus_peers.cc:597] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.676728 17197 consensus_peers.cc:597] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.722425 17197 consensus_peers.cc:597] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.747900 17197 consensus_peers.cc:597] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.764397 17271 consensus_peers.cc:597] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.800619  7335 tablet_server.cc:179] TabletServer@127.7.41.194:0 shutting down...
W20260709 13:05:22.863729 17272 consensus_peers.cc:597] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.874931 17272 consensus_peers.cc:597] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.898273 17346 consensus_peers.cc:597] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.901412 17346 consensus_peers.cc:597] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.902056 17346 consensus_peers.cc:597] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.927234 17272 consensus_peers.cc:597] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:22.931315 17272 consensus_peers.cc:597] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.960938  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:22.962069  7335 tablet_replica.cc:333] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:22.963135  7335 raft_consensus.cc:2243] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.964262  7335 raft_consensus.cc:2272] T ae1031f0c4bc4e48be05d8012957b6ac P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.967546  7335 tablet_replica.cc:333] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:22.968562  7335 raft_consensus.cc:2243] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.969203  7335 raft_consensus.cc:2272] T 43f244e037b7426793547977135a3e68 P 7e9eba24bc8842099fcba4a2024c2aed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.972325  7335 tablet_replica.cc:333] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:22.973237  7335 raft_consensus.cc:2243] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.974454  7335 raft_consensus.cc:2272] T 7b39f71b242b42f986fa68287bf62ba8 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.977317  7335 tablet_replica.cc:333] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:22.978215  7335 raft_consensus.cc:2243] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:22.979244  7335 raft_consensus.cc:2272] T fcfa6b6de693472bbeaab44d7af92532 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.982177  7335 tablet_replica.cc:333] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:22.990315  7335 raft_consensus.cc:2243] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:22.991050  7335 raft_consensus.cc:2272] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:22.994300  7335 tablet_replica.cc:333] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.006484  7335 raft_consensus.cc:2243] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.007213  7335 raft_consensus.cc:2272] T b7cac27834104ce3980fe87e7e6e00ec P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.010632  7335 tablet_replica.cc:333] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.011416  7335 raft_consensus.cc:2243] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.012032  7335 raft_consensus.cc:2272] T bbdd6a649a514be4a7e5dd077219ffed P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:23.012749 17346 consensus_peers.cc:597] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.028111 17272 consensus_peers.cc:597] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.030910  7335 tablet_replica.cc:333] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.032142  7335 raft_consensus.cc:2243] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:23.032135 17346 consensus_peers.cc:597] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.033304  7335 raft_consensus.cc:2272] T f0ddeea989c64b70a533198455dc0b6c P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.036430  7335 tablet_replica.cc:333] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.037334  7335 raft_consensus.cc:2243] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.037863  7335 raft_consensus.cc:2272] T 6f1b381c59ed4f258e1b8e6e37096abc P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:23.039762 17346 consensus_peers.cc:597] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.041038  7335 tablet_replica.cc:333] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.042131  7335 raft_consensus.cc:2243] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.042698  7335 raft_consensus.cc:2272] T ccf8ff673def486c94896905e592b78f P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.045825  7335 tablet_replica.cc:333] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.046753  7335 raft_consensus.cc:2243] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:23.050105 17272 consensus_peers.cc:597] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.051016  7335 raft_consensus.cc:2272] T 611590896f024a4a8f1ee24e522dbd0a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.054388  7335 tablet_replica.cc:333] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.055284  7335 raft_consensus.cc:2243] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.055869  7335 raft_consensus.cc:2272] T ddf498205a5942dd9c8ec8f97f6f8c67 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.058743  7335 tablet_replica.cc:333] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.059671  7335 raft_consensus.cc:2243] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.060312  7335 raft_consensus.cc:2272] T 85badce89ef744e995d4b4307b661464 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.063483  7335 tablet_replica.cc:333] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.065083  7335 raft_consensus.cc:2243] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.065663  7335 raft_consensus.cc:2272] T d51f7c4d9c6e4ebb8b62960986f87768 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.068730  7335 tablet_replica.cc:333] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.069491  7335 raft_consensus.cc:2243] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.070617  7335 raft_consensus.cc:2272] T 8b355c1a40d24e6387c364c6964fbb99 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.073573  7335 tablet_replica.cc:333] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.074440  7335 raft_consensus.cc:2243] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.075065  7335 raft_consensus.cc:2272] T 245dcb50741d45dca44ea02ed447057a P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.077801  7335 tablet_replica.cc:333] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.078738  7335 raft_consensus.cc:2243] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.079334  7335 raft_consensus.cc:2272] T f67d94cad84c4419a7f21c6c0b35c7cb P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.082304  7335 tablet_replica.cc:333] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.083576  7335 raft_consensus.cc:2243] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.084156  7335 raft_consensus.cc:2272] T 314a4e267fa44771932ef3f2482aa590 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.087083  7335 tablet_replica.cc:333] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.087885  7335 raft_consensus.cc:2243] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.088515  7335 raft_consensus.cc:2272] T 74ea231d707840749fc902bd3d111e34 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.091409  7335 tablet_replica.cc:333] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.092183  7335 raft_consensus.cc:2243] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.093236  7335 raft_consensus.cc:2272] T a7b6348ed73e48b2a0efba1da6d17c66 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:23.093783 17346 consensus_peers.cc:597] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.096212  7335 tablet_replica.cc:333] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.099464  7335 raft_consensus.cc:2243] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.100064  7335 raft_consensus.cc:2272] T 1de8dcf334364214b6b6115fe416ec2b P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.106643  7335 tablet_replica.cc:333] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.107573  7335 raft_consensus.cc:2243] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:23.108078 17346 consensus_peers.cc:597] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.108669  7335 raft_consensus.cc:2272] T dacbd66665ce48a39ba07db89854bc1c P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.111840  7335 tablet_replica.cc:333] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.112767  7335 raft_consensus.cc:2243] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.113335  7335 raft_consensus.cc:2272] T 0f7a56b7669944ce91c6ad8b8f7c439c P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.116426  7335 tablet_replica.cc:333] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.117283  7335 raft_consensus.cc:2243] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.117926  7335 raft_consensus.cc:2272] T 0650da7040f44f1ea1d37f44e9e5900a P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.120884  7335 tablet_replica.cc:333] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.121773  7335 raft_consensus.cc:2243] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.122578  7335 raft_consensus.cc:2272] T 7d21695723a94f56863565fdec1d8600 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.125861  7335 tablet_replica.cc:333] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.127501  7335 raft_consensus.cc:2243] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.129101  7335 raft_consensus.cc:2272] T 44c3a626d41640f2b0ca7233c56f8bbc P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:23.149763 17272 consensus_peers.cc:597] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.162640 17272 consensus_peers.cc:597] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.169328 17272 consensus_peers.cc:597] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.172575  7335 tablet_replica.cc:333] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.173547  7335 raft_consensus.cc:2243] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.174203  7335 raft_consensus.cc:2272] T 74084e0afb264747a12252fbdaf660a9 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:23.183012 17272 consensus_peers.cc:597] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.184809  7335 tablet_replica.cc:333] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.185710  7335 raft_consensus.cc:2243] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.186256  7335 raft_consensus.cc:2272] T e66fd7f2e6494980b0c33606bc363fe8 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.189502  7335 tablet_replica.cc:333] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.190344  7335 raft_consensus.cc:2243] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.190913  7335 raft_consensus.cc:2272] T 69e81dc6421d4fdf8dcff43b8a449587 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.194257  7335 tablet_replica.cc:333] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.195075  7335 raft_consensus.cc:2243] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.196131  7335 raft_consensus.cc:2272] T 1a7341a74f344c90b6c0f9ff657621d5 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.199105  7335 tablet_replica.cc:333] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.199950  7335 raft_consensus.cc:2243] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.200474  7335 raft_consensus.cc:2272] T 12c2736e41a64de2825d60818a0c19de P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.203147  7335 tablet_replica.cc:333] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.203931  7335 raft_consensus.cc:2243] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.205041  7335 raft_consensus.cc:2272] T 3dfa8e7c39704056b111af9fbc19e16f P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.207870  7335 tablet_replica.cc:333] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.208624  7335 raft_consensus.cc:2243] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.209241  7335 raft_consensus.cc:2272] T a9fe91dffd9642e48367fdff703aa915 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.211922  7335 tablet_replica.cc:333] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.212664  7335 raft_consensus.cc:2243] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.213171  7335 raft_consensus.cc:2272] T a21af78b15714161898e0f709c8a5834 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.215929  7335 tablet_replica.cc:333] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.216706  7335 raft_consensus.cc:2243] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.217268  7335 raft_consensus.cc:2272] T fb81c4e8cd7b4230ac749fa80efc56c5 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.220010  7335 tablet_replica.cc:333] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.220752  7335 raft_consensus.cc:2243] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.221307  7335 raft_consensus.cc:2272] T 9664e129106a424cb0418e3713b1e1fb P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.224323  7335 tablet_replica.cc:333] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.225040  7335 raft_consensus.cc:2243] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.226066  7335 raft_consensus.cc:2272] T c0b8248b5a4d4becb690235d23b259e4 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.228916  7335 tablet_replica.cc:333] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.229892  7335 raft_consensus.cc:2243] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.231068  7335 raft_consensus.cc:2272] T 96679e4b73a441eaa803ed3a16a1a35f P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.239641  7335 tablet_replica.cc:333] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.240407  7335 raft_consensus.cc:2243] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.241400  7335 raft_consensus.cc:2272] T 4c83cdeb244b4fada6bff4050bdd4fcd P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.244192  7335 tablet_replica.cc:333] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.244906  7335 raft_consensus.cc:2243] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.245936  7335 raft_consensus.cc:2272] T 1d30a413a6924c3ea6027b6d3b4adc86 P 7e9eba24bc8842099fcba4a2024c2aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.249116  7335 tablet_replica.cc:333] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.249930  7335 raft_consensus.cc:2243] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.251114  7335 raft_consensus.cc:2272] T 385f3dec424f482bbb969fb08e7d5509 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.255415  7335 tablet_replica.cc:333] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.256155  7335 raft_consensus.cc:2243] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.256767  7335 raft_consensus.cc:2272] T c43cf64dce604011933dfed0af0fa571 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.260075  7335 tablet_replica.cc:333] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.260766  7335 raft_consensus.cc:2243] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.261335  7335 raft_consensus.cc:2272] T de6ec102dc0a48c0819f814102f27aa0 P 7e9eba24bc8842099fcba4a2024c2aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.264092  7335 tablet_replica.cc:333] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed: stopping tablet replica
I20260709 13:05:23.264703  7335 raft_consensus.cc:2243] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.265769  7335 raft_consensus.cc:2272] T 573c9ef51ca24504be6b34051b2a0607 P 7e9eba24bc8842099fcba4a2024c2aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.316226 18358 raft_consensus.cc:493] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.316854 18358 raft_consensus.cc:515] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:23.327061 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
W20260709 13:05:23.327771 17271 leader_election.cc:336] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.328639 18358 leader_election.cc:290] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.329015 17270 leader_election.cc:304] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.330976 18358 raft_consensus.cc:2749] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.340088 18318 raft_consensus.cc:493] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.340708 18318 raft_consensus.cc:515] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:23.352739 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:23.355540 18318 leader_election.cc:290] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.375840 18317 raft_consensus.cc:493] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.384626 18317 raft_consensus.cc:515] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
W20260709 13:05:23.396600 17271 leader_election.cc:336] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.400751 18317 leader_election.cc:290] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:23.421703 18317 raft_consensus.cc:493] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.422330 18317 raft_consensus.cc:515] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:23.450631 18358 raft_consensus.cc:493] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.451270 18358 raft_consensus.cc:515] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:23.453521 18358 leader_election.cc:290] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:23.455000 18317 leader_election.cc:290] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:23.459510 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
W20260709 13:05:23.460631 17346 consensus_peers.cc:597] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.457780 17272 leader_election.cc:336] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:23.462522 17272 leader_election.cc:304] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.464672 18317 raft_consensus.cc:2749] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:23.480533 17271 leader_election.cc:336] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.481082 17271 leader_election.cc:304] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.481817 18358 raft_consensus.cc:2749] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:23.484664 17345 leader_election.cc:336] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.485235 17345 leader_election.cc:304] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.486092 18318 raft_consensus.cc:2749] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:23.488049 17272 consensus_peers.cc:597] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.496958 17271 leader_election.cc:336] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.497925 18318 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.498668 18318 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:23.500707 18318 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:23.504388 18318 raft_consensus.cc:493] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.504938 18318 raft_consensus.cc:515] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:23.513485 17346 leader_election.cc:336] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:23.514261 17346 leader_election.cc:336] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:23.507490 18318 leader_election.cc:290] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:23.524073 18358 raft_consensus.cc:493] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.525039 18358 raft_consensus.cc:515] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:23.527124 18358 leader_election.cc:290] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:23.532915 17272 leader_election.cc:336] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:23.533463 17272 leader_election.cc:304] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.534188 18317 raft_consensus.cc:2749] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:23.534945 17345 leader_election.cc:336] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.535465 17345 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:23.535643 17271 leader_election.cc:336] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.539167 18318 raft_consensus.cc:2749] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:23.540246 17345 leader_election.cc:336] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.540692 17345 leader_election.cc:304] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.541342 18318 raft_consensus.cc:2749] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:23.547266 17272 leader_election.cc:336] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:23.547889 17272 leader_election.cc:304] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.548693 18358 raft_consensus.cc:2749] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:23.607975 18318 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.608485 18318 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:23.610898 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:23.610536 18318 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.612803 18318 raft_consensus.cc:493] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.613325 18318 raft_consensus.cc:515] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:23.615346 18318 leader_election.cc:290] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:23.616784 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:23.617520 17301 raft_consensus.cc:2468] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
W20260709 13:05:23.618101 17345 leader_election.cc:336] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.618568 17345 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.619114 17346 leader_election.cc:304] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:23.619899 18296 raft_consensus.cc:2749] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:23.620563 18296 raft_consensus.cc:2804] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:23.620882 18296 raft_consensus.cc:493] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.621225 18296 raft_consensus.cc:3060] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:23.621415 17345 leader_election.cc:336] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.629902 18296 raft_consensus.cc:515] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:23.633754 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e23f2fe067471e9a52a8f835d7ca1d" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:23.634469 17301 raft_consensus.cc:3060] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:23.637243 17345 leader_election.cc:336] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.637697 18358 raft_consensus.cc:493] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.638317 18358 raft_consensus.cc:515] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:23.640275 18358 leader_election.cc:290] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:23.645166 17271 leader_election.cc:336] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.646100 18296 leader_election.cc:290] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: Requested vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:23.648609 17301 raft_consensus.cc:2468] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 3.
I20260709 13:05:23.650655 17346 leader_election.cc:304] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.651906 18318 raft_consensus.cc:2804] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:23.652438 18318 raft_consensus.cc:697] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:23.653319 18318 consensus_queue.cc:237] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:23.659806 18358 raft_consensus.cc:493] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.660373 18358 raft_consensus.cc:515] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:23.663540 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:23.664292 17379 raft_consensus.cc:2468] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 2.
I20260709 13:05:23.665949 17270 leader_election.cc:304] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:23.666987 18317 raft_consensus.cc:2804] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:23.667471 18317 raft_consensus.cc:493] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.667930 18317 raft_consensus.cc:3060] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:23.677187 18334 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.677872 18334 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:23.686627 17345 leader_election.cc:336] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.680625 18334 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:23.692713 18334 raft_consensus.cc:493] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.693182 18334 raft_consensus.cc:515] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:05:23.674899 17272 leader_election.cc:336] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:23.702718 17271 leader_election.cc:336] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.703131 17272 leader_election.cc:304] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.718761 18358 leader_election.cc:290] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.725657 18364 raft_consensus.cc:2749] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:23.731899 17272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 57047us
W20260709 13:05:23.756969 17345 leader_election.cc:336] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:23.759294 17346 leader_election.cc:336] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:23.759936 17346 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.762277 18369 raft_consensus.cc:2749] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:23.763475 18334 leader_election.cc:290] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.770272 18261 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.771003 18261 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:23.773454 18261 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.782742 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:23.783394 17301 raft_consensus.cc:2468] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
W20260709 13:05:23.786289 17271 leader_election.cc:336] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.786963 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:23.787686 17379 raft_consensus.cc:2468] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 3.
I20260709 13:05:23.790832 17270 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.791822 18261 raft_consensus.cc:2804] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:23.792153 18261 raft_consensus.cc:493] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.792474 18261 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:23.806907 18358 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.812671 18358 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:23.823072 18358 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.827709 18368 raft_consensus.cc:493] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.828329 18368 raft_consensus.cc:515] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:23.834828 17346 leader_election.cc:304] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.836478 18317 raft_consensus.cc:515] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:23.838618 18317 leader_election.cc:290] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.839779 18261 raft_consensus.cc:515] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:05:23.842396 17271 leader_election.cc:336] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:23.846061 17271 leader_election.cc:336] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.847225 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:23.848997 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16e21576805d4de796420b8d8190fd91" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:23.849550 17379 raft_consensus.cc:3060] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:23.850265 17271 leader_election.cc:336] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.855126 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cc194559d445f4859ac3e1c764ff4a" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:23.855998 17378 raft_consensus.cc:3060] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:23.867805 17270 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.870568 18370 raft_consensus.cc:2749] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:23.877162 17378 raft_consensus.cc:2468] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 4.
I20260709 13:05:23.878562 17270 leader_election.cc:304] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.880259 18334 raft_consensus.cc:2804] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:23.880695 18370 raft_consensus.cc:2804] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:23.880789 18334 raft_consensus.cc:493] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.881361 18370 raft_consensus.cc:697] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:23.881419 18334 raft_consensus.cc:3060] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:23.882301 18370 consensus_queue.cc:237] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:05:23.886323 17346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:38531, user_credentials={real_user=slave}} blocked reactor thread for 51588.4us
W20260709 13:05:23.894474 17345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:40565, user_credentials={real_user=slave}} blocked reactor thread for 51954.9us
I20260709 13:05:23.900261 18369 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.900898 18369 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:23.903544 18369 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.905056 18368 leader_election.cc:290] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:23.918236 17055 catalog_manager.cc:5697] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 3 to 4, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 4 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.841862 18261 leader_election.cc:290] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 election: Requested vote from peers 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.935734 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:23.936518 17301 raft_consensus.cc:2468] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 3.
I20260709 13:05:23.937924 17379 raft_consensus.cc:2468] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 3.
I20260709 13:05:23.939123 17270 leader_election.cc:304] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.940205 18261 raft_consensus.cc:2804] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:23.940574 18334 raft_consensus.cc:515] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:23.940675 18261 raft_consensus.cc:697] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:23.942310 18261 consensus_queue.cc:237] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:23.942739 18334 leader_election.cc:290] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.948096 17346 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:23.949391 18296 raft_consensus.cc:2804] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:23.949786 18296 raft_consensus.cc:493] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting leader election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.950179 18296 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:23.958280 18296 raft_consensus.cc:515] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:05:23.959609 17345 leader_election.cc:336] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.960429 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f853b6d09494a16a5ae6cc1110d7f3f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:23.961113 17301 raft_consensus.cc:3060] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:23.961237 17345 leader_election.cc:336] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:23.961958 17345 leader_election.cc:336] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.969014 17301 raft_consensus.cc:2468] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 3.
I20260709 13:05:23.970297 18368 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:23.970897 18368 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:23.973374 18368 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:23.973765 18296 leader_election.cc:290] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 election: Requested vote from peers 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531), de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565)
I20260709 13:05:23.980814 17346 leader_election.cc:304] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.981652 18318 raft_consensus.cc:2804] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:23.982151 18318 raft_consensus.cc:697] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:23.983069 18318 consensus_queue.cc:237] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
W20260709 13:05:23.984386 17345 leader_election.cc:336] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:23.984886 17345 leader_election.cc:336] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:23.985615 17053 catalog_manager.cc:5697] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 2 to 3, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 3 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:23.992756 17346 leader_election.cc:336] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:23.993273 17346 leader_election.cc:304] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:23.993937 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d4c5c12c8844ad7877fca4c9d59dec6" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:23.994652 17301 raft_consensus.cc:3060] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:23.998471 18369 raft_consensus.cc:2749] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:24.015136 18371 raft_consensus.cc:493] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.015803 18371 raft_consensus.cc:515] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
W20260709 13:05:24.021648 17346 leader_election.cc:336] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.022325 17346 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:24.023016 18334 raft_consensus.cc:2749] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:24.024348 17301 raft_consensus.cc:2468] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 4.
I20260709 13:05:24.029076 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:24.030987 17346 leader_election.cc:304] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:24.031975 18318 raft_consensus.cc:2804] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:24.032764 17272 leader_election.cc:336] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.033238 17272 leader_election.cc:304] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:24.032652 18318 raft_consensus.cc:697] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:24.034483 18261 raft_consensus.cc:2749] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:24.035176 18371 leader_election.cc:290] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:24.035583 18261 raft_consensus.cc:493] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.036139 18261 raft_consensus.cc:515] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.039424 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:24.034888 18318 consensus_queue.cc:237] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } }
I20260709 13:05:24.042703 18261 leader_election.cc:290] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
W20260709 13:05:24.048575 17272 leader_election.cc:336] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.049085 17272 leader_election.cc:304] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:24.050163 18370 raft_consensus.cc:2749] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:24.066908 17053 catalog_manager.cc:5697] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 2 to 3, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 3 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.070619 17055 catalog_manager.cc:5697] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 2 to 3, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 3 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.072125 17055 catalog_manager.cc:5697] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 3 to 4, leader changed from de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 4 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:24.121862 17345 consensus_peers.cc:597] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.125650 17301 raft_consensus.cc:1275] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:24.126984 18318 consensus_queue.cc:1048] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.158007 18370 raft_consensus.cc:493] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.158582 18370 raft_consensus.cc:515] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:24.160717 18370 leader_election.cc:290] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:24.166880 17271 leader_election.cc:336] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:24.167459 17272 leader_election.cc:336] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.167876 17272 leader_election.cc:304] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:24.169062 18370 raft_consensus.cc:2749] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:24.201035 18370 raft_consensus.cc:493] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.201637 18370 raft_consensus.cc:515] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:24.206094 18370 leader_election.cc:290] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:24.210492 17271 leader_election.cc:336] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:24.211349 17272 leader_election.cc:336] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.211756 17272 leader_election.cc:304] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:24.213397 18370 raft_consensus.cc:2749] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:24.274415 18334 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.274976 18334 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:24.276954 18334 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:24.278479 18334 raft_consensus.cc:493] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.279018 18334 raft_consensus.cc:515] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:24.285050 17346 leader_election.cc:336] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:24.286387 17346 leader_election.cc:336] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.285800 18334 leader_election.cc:290] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:24.289263 18334 raft_consensus.cc:493] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.289772 18334 raft_consensus.cc:515] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:24.292909 17345 leader_election.cc:336] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:24.297009 17346 leader_election.cc:336] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.294092 18334 leader_election.cc:290] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:24.293331 17345 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:24.299443 17345 leader_election.cc:336] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:24.299855 17345 leader_election.cc:304] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:24.300462 18370 raft_consensus.cc:493] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.301023 18370 raft_consensus.cc:515] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:24.302264 18296 raft_consensus.cc:2749] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:24.302985 18296 raft_consensus.cc:2749] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:24.307016 18370 leader_election.cc:290] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:24.309223 17271 leader_election.cc:336] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:24.311596 17272 leader_election.cc:336] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.312043 17272 leader_election.cc:304] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:24.312332 17345 leader_election.cc:336] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:24.312875 17345 leader_election.cc:304] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:24.313347 18370 raft_consensus.cc:2749] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:24.314082 18334 raft_consensus.cc:2749] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:24.339300 18371 raft_consensus.cc:493] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.339956 18371 raft_consensus.cc:515] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.342489 18371 leader_election.cc:290] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:24.344017 17379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:24.367430 18261 raft_consensus.cc:493] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.367966 18261 raft_consensus.cc:515] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:24.370376 18261 leader_election.cc:290] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:24.373891 18296 raft_consensus.cc:493] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.374574 18296 raft_consensus.cc:515] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:24.376757 18296 leader_election.cc:290] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:24.385682 17345 leader_election.cc:336] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:24.392808 18317 raft_consensus.cc:493] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.393460 18317 raft_consensus.cc:515] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:24.398448 18317 leader_election.cc:290] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:24.401556 17272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38067, user_credentials={real_user=slave}} blocked reactor thread for 50814.5us
W20260709 13:05:24.402251 17271 leader_election.cc:336] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:24.405292 18296 raft_consensus.cc:493] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.409597 18296 raft_consensus.cc:515] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
W20260709 13:05:24.416079 17346 leader_election.cc:336] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.418354 18296 leader_election.cc:290] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:24.418546 17346 leader_election.cc:304] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:24.416541  7335 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17254)
I20260709 13:05:24.417524 17379 raft_consensus.cc:1275] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:24.420409 18318 raft_consensus.cc:2749] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:24.420526 18371 consensus_queue.cc:1048] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:24.422039 18318 raft_consensus.cc:493] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.422559 18318 raft_consensus.cc:515] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.424634 18318 leader_election.cc:290] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
W20260709 13:05:24.429476 17272 leader_election.cc:336] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:24.429064 17271 leader_election.cc:336] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:24.429968 17272 leader_election.cc:304] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:24.432027 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:24.432684 17301 raft_consensus.cc:2468] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:24.434904 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
W20260709 13:05:24.435544 17272 leader_election.cc:336] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.436021 17272 leader_election.cc:304] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:24.437362 17346 leader_election.cc:304] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:24.437882 18370 raft_consensus.cc:2749] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:24.446808 18296 raft_consensus.cc:2804] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:24.447229 18296 raft_consensus.cc:493] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.447572 18296 raft_consensus.cc:3060] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:24.451581 17346 leader_election.cc:336] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:24.456575 17346 leader_election.cc:336] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.456980 17346 leader_election.cc:304] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 79ae3773b2274d75b3f71364c0aa6d9c, 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:24.457695 18334 raft_consensus.cc:2749] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:24.459865 18371 raft_consensus.cc:2749] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:24.460894 18371 raft_consensus.cc:493] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.461382 18371 raft_consensus.cc:515] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.462203 18334 raft_consensus.cc:493] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.464054 18334 raft_consensus.cc:515] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.464398 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" is_pre_election: true
I20260709 13:05:24.464856 18296 raft_consensus.cc:515] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.464898 18371 leader_election.cc:290] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:24.465307 17378 raft_consensus.cc:2468] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 3.
I20260709 13:05:24.467453 17270 leader_election.cc:304] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:24.467864 18296 leader_election.cc:290] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:24.468604 18370 raft_consensus.cc:2804] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:24.469094 18370 raft_consensus.cc:493] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.469509 18370 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.471123 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcfa6b6de693472bbeaab44d7af92532" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
W20260709 13:05:24.465284 17272 leader_election.cc:336] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.471760 17301 raft_consensus.cc:3060] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:24.471807 17272 leader_election.cc:304] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:24.472803 18261 raft_consensus.cc:2749] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:24.480713 17378 raft_consensus.cc:1275] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:24.482245 18371 consensus_queue.cc:1048] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:24.484143 17301 raft_consensus.cc:2468] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 3.
I20260709 13:05:24.487350 18334 leader_election.cc:290] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
W20260709 13:05:24.486603 17271 consensus_peers.cc:597] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.488619 17272 leader_election.cc:336] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:24.491897 17271 consensus_peers.cc:597] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.493163 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
I20260709 13:05:24.493957 17301 raft_consensus.cc:2468] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
W20260709 13:05:24.495198 17346 leader_election.cc:336] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.481688 18370 raft_consensus.cc:515] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.499604 17346 leader_election.cc:304] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:24.502269 17346 leader_election.cc:304] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:24.503108 18369 raft_consensus.cc:2804] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:24.503582 18369 raft_consensus.cc:697] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:24.504408 18369 consensus_queue.cc:237] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.505107 18318 raft_consensus.cc:2804] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:24.505326 17346 leader_election.cc:336] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.505577 18318 raft_consensus.cc:493] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.506034 18318 raft_consensus.cc:3060] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:24.520042 17345 consensus_peers.cc:597] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.521059 17271 consensus_peers.cc:597] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:24.526827 17272 leader_election.cc:336] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.533941 17378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfa8e7c39704056b111af9fbc19e16f" candidate_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d"
I20260709 13:05:24.534600 17378 raft_consensus.cc:3060] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.532984 18370 leader_election.cc:290] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196:39887)
I20260709 13:05:24.541046 18318 raft_consensus.cc:515] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.541566 17378 raft_consensus.cc:2468] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ae3773b2274d75b3f71364c0aa6d9c in term 4.
I20260709 13:05:24.542809 17270 leader_election.cc:304] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:24.543370 18318 leader_election.cc:290] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:24.544044 18370 raft_consensus.cc:2804] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:24.545733 18370 raft_consensus.cc:697] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 LEADER]: Becoming Leader. State: Replica: 79ae3773b2274d75b3f71364c0aa6d9c, State: Running, Role: LEADER
I20260709 13:05:24.546653 18370 consensus_queue.cc:237] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.547955 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1031f0c4bc4e48be05d8012957b6ac" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:24.548560 17301 raft_consensus.cc:3060] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.548976 17055 catalog_manager.cc:5697] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 2 to 3, leader changed from 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 3 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:24.556036 17301 raft_consensus.cc:2468] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
I20260709 13:05:24.563329 17301 raft_consensus.cc:1275] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:24.564545 17346 leader_election.cc:336] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.565927 17346 leader_election.cc:304] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed
I20260709 13:05:24.566790 18318 raft_consensus.cc:2804] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:24.567492 18318 raft_consensus.cc:697] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
I20260709 13:05:24.568377 18318 consensus_queue.cc:237] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.572278 18369 consensus_queue.cc:1048] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:24.573827 17055 catalog_manager.cc:5697] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c reported cstate change: term changed from 3 to 4, leader changed from 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194) to 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195). New cstate: current_term: 4 leader_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.588301 17306 raft_consensus.cc:1275] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:24.604387 18369 raft_consensus.cc:493] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.604996 18369 raft_consensus.cc:515] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.604923 17053 catalog_manager.cc:5697] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 2, leader changed from 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:24.607275 18369 leader_election.cc:290] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:24.609140 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" is_pre_election: true
W20260709 13:05:24.610746 17345 consensus_peers.cc:597] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.612315 17301 raft_consensus.cc:2468] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 1.
I20260709 13:05:24.613826 17346 leader_election.cc:304] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:24.614673 18369 raft_consensus.cc:2804] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:24.615031 18369 raft_consensus.cc:493] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.615569 18369 raft_consensus.cc:3060] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:24.620748 17346 leader_election.cc:336] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.621061 18334 raft_consensus.cc:493] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.621567 18334 raft_consensus.cc:515] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:24.627686 18334 leader_election.cc:290] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:24.629561 17345 leader_election.cc:336] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:24.624671 18369 raft_consensus.cc:515] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.633970 18369 leader_election.cc:290] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Requested vote from peers 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067), 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531)
I20260709 13:05:24.594112 18318 consensus_queue.cc:1048] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:05:24.636015 17301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96679e4b73a441eaa803ed3a16a1a35f" candidate_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79ae3773b2274d75b3f71364c0aa6d9c"
I20260709 13:05:24.636632 17301 raft_consensus.cc:3060] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.643888 17301 raft_consensus.cc:2468] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1f9e0cad0b4ecda332df1fd213ce1d in term 2.
W20260709 13:05:24.644042 17346 leader_election.cc:336] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.644685 17346 leader_election.cc:304] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:24.645372 18318 raft_consensus.cc:2749] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:24.651191 17346 leader_election.cc:304] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d, 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 
I20260709 13:05:24.651856 18318 raft_consensus.cc:2804] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:05:24.651889 17346 leader_election.cc:336] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.652566 18318 raft_consensus.cc:697] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Becoming Leader. State: Replica: 0e1f9e0cad0b4ecda332df1fd213ce1d, State: Running, Role: LEADER
W20260709 13:05:24.665208 17345 consensus_peers.cc:597] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:24.666755 18318 consensus_queue.cc:237] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } }
I20260709 13:05:24.682149 18369 raft_consensus.cc:493] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:24.683009 18369 raft_consensus.cc:515] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:24.691776 17345 leader_election.cc:336] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:24.695436 17346 leader_election.cc:336] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:24.695873 17346 leader_election.cc:304] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:24.698449 18334 raft_consensus.cc:2749] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:24.703903 17345 consensus_peers.cc:597] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:24.705513 18369 leader_election.cc:290] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:24.708325 17055 catalog_manager.cc:5697] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d reported cstate change: term changed from 1 to 2, leader changed from 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194) to 0e1f9e0cad0b4ecda332df1fd213ce1d (127.7.41.196). New cstate: current_term: 2 leader_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:24.750085 17345 consensus_peers.cc:597] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:24.785982 17271 consensus_peers.cc:597] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:24.791224 17271 consensus_peers.cc:597] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:24.796205 17345 consensus_peers.cc:597] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:24.838505 17271 consensus_peers.cc:597] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:24.871716 17345 consensus_peers.cc:597] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:24.892158 17345 consensus_peers.cc:597] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:24.922978 17271 consensus_peers.cc:597] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:24.925469 17306 raft_consensus.cc:1275] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:24.927363 18390 consensus_queue.cc:1048] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:24.935731 17346 consensus_peers.cc:597] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.961963 17272 consensus_peers.cc:597] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:24.982860 17346 consensus_peers.cc:597] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:25.057579 17306 raft_consensus.cc:1275] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:25.062489 18296 consensus_queue.cc:1048] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:25.133814 18261 raft_consensus.cc:493] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:25.134454 18261 raft_consensus.cc:515] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:25.136511 18261 leader_election.cc:290] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:25.141521 17272 leader_election.cc:336] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:25.142671 17271 consensus_peers.cc:597] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.143225 17271 leader_election.cc:336] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:25.143620 17271 leader_election.cc:304] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:25.147123 17378 raft_consensus.cc:1275] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Refusing update from remote peer 79ae3773b2274d75b3f71364c0aa6d9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:25.148916 18370 consensus_queue.cc:1048] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:25.152590 18261 raft_consensus.cc:2749] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:25.162176 17271 consensus_peers.cc:597] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:25.166723 17306 raft_consensus.cc:1275] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Refusing update from remote peer 0e1f9e0cad0b4ecda332df1fd213ce1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:25.171700 18296 consensus_queue.cc:1048] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:25.173254 17271 consensus_peers.cc:597] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.182822 17272 consensus_peers.cc:597] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.208103 17346 consensus_peers.cc:597] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:25.234272 17345 consensus_peers.cc:597] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.239270 17271 consensus_peers.cc:597] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.258808 17345 consensus_peers.cc:597] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:25.273542 18390 raft_consensus.cc:493] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:25.274190 18390 raft_consensus.cc:515] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:25.285346 17346 leader_election.cc:336] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:25.293782 17345 consensus_peers.cc:597] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:25.294247 18390 leader_election.cc:290] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:25.300029 17345 leader_election.cc:336] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:25.300498 17345 leader_election.cc:304] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:25.301653 18390 raft_consensus.cc:2749] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:25.310956 17345 consensus_peers.cc:597] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.329113 17271 consensus_peers.cc:597] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:25.334470 18390 raft_consensus.cc:493] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:25.335093 18390 raft_consensus.cc:515] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:25.341687 18370 raft_consensus.cc:493] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
W20260709 13:05:25.342561 17346 leader_election.cc:336] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:25.342343 18370 raft_consensus.cc:515] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
W20260709 13:05:25.347275 17345 leader_election.cc:336] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:25.347774 17345 leader_election.cc:304] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:25.348475 18390 leader_election.cc:290] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:25.349128 18318 raft_consensus.cc:2749] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:25.350595 18370 leader_election.cc:290] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:25.351177 17272 leader_election.cc:336] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:25.355553 17271 leader_election.cc:336] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:25.356058 17271 leader_election.cc:304] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:25.356807 18370 raft_consensus.cc:2749] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:25.362526 17346 consensus_peers.cc:597] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.366369 17346 consensus_peers.cc:597] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.370286 17272 consensus_peers.cc:597] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.377379 17272 consensus_peers.cc:597] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.396265 17346 consensus_peers.cc:597] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:25.408790 18318 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:25.409317 18318 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:25.411285 18318 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:25.416249 17346 leader_election.cc:336] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:25.417057 17345 leader_election.cc:336] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:25.417487 17345 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:25.418557 18318 raft_consensus.cc:2749] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:25.419305  7335 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 17254)
W20260709 13:05:25.435647 17272 consensus_peers.cc:597] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.436228 17272 consensus_peers.cc:597] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.489918 17272 consensus_peers.cc:597] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.490860 17346 consensus_peers.cc:597] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.522826 17346 consensus_peers.cc:597] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:25.526356 18370 raft_consensus.cc:493] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:25.527076 18370 raft_consensus.cc:515] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
W20260709 13:05:25.535181 17272 leader_election.cc:336] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:25.539109 17271 leader_election.cc:336] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:25.539619 17271 leader_election.cc:304] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:25.540796 18317 raft_consensus.cc:2749] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:25.540369 18370 leader_election.cc:290] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:25.573541 17346 consensus_peers.cc:597] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.586871 17346 consensus_peers.cc:597] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.640164 17346 consensus_peers.cc:597] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.665150 17272 consensus_peers.cc:597] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:25.730414 18370 raft_consensus.cc:493] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:25.730965 18370 raft_consensus.cc:515] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:25.733851 18370 leader_election.cc:290] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:25.738276 17272 leader_election.cc:336] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:25.743676 17271 leader_election.cc:336] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:25.744174 17271 leader_election.cc:304] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:25.744935 18370 raft_consensus.cc:2749] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:25.753433 17272 consensus_peers.cc:597] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.758579 17272 consensus_peers.cc:597] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.827219 17272 consensus_peers.cc:597] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:25.854414 17272 consensus_peers.cc:597] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:25.869283 18390 raft_consensus.cc:493] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:25.870043 18390 raft_consensus.cc:515] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:25.877766 17345 leader_election.cc:336] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:25.879542 18390 leader_election.cc:290] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:25.882553 18390 raft_consensus.cc:493] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:25.883157 18390 raft_consensus.cc:515] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:25.884231 17346 leader_election.cc:336] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:25.884739 17346 leader_election.cc:304] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:25.885432 18318 raft_consensus.cc:2749] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:25.886596 18390 leader_election.cc:290] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:25.899984 17346 leader_election.cc:336] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:25.901746 17345 leader_election.cc:336] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:25.902273 17345 leader_election.cc:304] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:25.903465 18390 raft_consensus.cc:2749] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:25.932787 18390 raft_consensus.cc:493] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:25.933334 18390 raft_consensus.cc:515] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:25.939991 17345 leader_election.cc:336] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:25.941128 18390 leader_election.cc:290] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:25.946466 17346 leader_election.cc:336] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:25.946924 17346 leader_election.cc:304] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:25.947769 18390 raft_consensus.cc:2749] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:25.979761 17346 consensus_peers.cc:597] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:26.043322 18390 raft_consensus.cc:493] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:26.043926 18390 raft_consensus.cc:515] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:26.046203 18390 leader_election.cc:290] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.050832 17345 leader_election.cc:336] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:26.051709 17346 leader_election.cc:336] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:26.052166 17346 leader_election.cc:304] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:26.052915 18390 raft_consensus.cc:2749] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:26.082064 18318 raft_consensus.cc:493] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:26.082588 18318 raft_consensus.cc:515] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:26.084489 18318 leader_election.cc:290] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
I20260709 13:05:26.087791 18318 raft_consensus.cc:493] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:26.088326 18318 raft_consensus.cc:515] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:26.090528 18318 leader_election.cc:290] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.095417 17346 leader_election.cc:336] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:26.105913 17345 leader_election.cc:336] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:26.107368 17345 leader_election.cc:304] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
W20260709 13:05:26.106719 17346 leader_election.cc:336] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:26.108665 18318 raft_consensus.cc:2749] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:26.117359 17345 leader_election.cc:336] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:26.117834 17345 leader_election.cc:304] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:26.119558 18390 raft_consensus.cc:2749] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:26.156611 18317 raft_consensus.cc:493] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:26.157222 18317 raft_consensus.cc:515] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:26.161921 18317 leader_election.cc:290] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.165532 17272 leader_election.cc:336] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:26.170989 17271 leader_election.cc:336] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:26.171506 17271 leader_election.cc:304] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:26.172326 18317 raft_consensus.cc:2749] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:26.200186 18317 raft_consensus.cc:493] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:26.200754 18317 raft_consensus.cc:515] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:26.202981 18317 leader_election.cc:290] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.207302 17272 leader_election.cc:336] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:26.212437 17271 leader_election.cc:336] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:26.212898 17271 leader_election.cc:304] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:26.213637 18317 raft_consensus.cc:2749] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:26.292421 18370 raft_consensus.cc:493] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:26.292973 18370 raft_consensus.cc:515] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:26.295190 18370 leader_election.cc:290] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.300949 17272 leader_election.cc:336] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:26.303339 17271 leader_election.cc:336] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:26.305365 17271 leader_election.cc:304] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:26.306135 18370 raft_consensus.cc:2749] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:26.401947 18317 raft_consensus.cc:493] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:26.402685 18317 raft_consensus.cc:515] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:26.405850 18317 leader_election.cc:290] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.410888 17271 leader_election.cc:336] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:26.413554 17272 leader_election.cc:336] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:26.414009 17272 leader_election.cc:304] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:26.414758 18317 raft_consensus.cc:2749] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:26.419746  7335 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 17254)
I20260709 13:05:26.457485 18317 raft_consensus.cc:493] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:26.458142 18317 raft_consensus.cc:515] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:26.462392 18317 leader_election.cc:290] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.466764 17271 leader_election.cc:336] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:26.469732 17272 leader_election.cc:336] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:26.470206 17272 leader_election.cc:304] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:26.470911 18317 raft_consensus.cc:2749] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:26.590101 17345 consensus_peers.cc:597] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:26.707930 18396 raft_consensus.cc:493] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:26.708483 18396 raft_consensus.cc:515] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:26.710626 18396 leader_election.cc:290] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.731328 17346 leader_election.cc:336] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:26.731854 17345 leader_election.cc:336] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:26.732308 17345 leader_election.cc:304] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:26.733075 18396 raft_consensus.cc:2749] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:26.869599 18396 raft_consensus.cc:493] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e9eba24bc8842099fcba4a2024c2aed)
I20260709 13:05:26.870203 18396 raft_consensus.cc:515] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:26.874948 18396 leader_election.cc:290] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.879632 17346 leader_election.cc:336] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:26.881443 17345 leader_election.cc:336] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:26.882016 17345 leader_election.cc:304] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:26.883975 18318 raft_consensus.cc:2749] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:26.895931 18370 raft_consensus.cc:493] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:26.896520 18370 raft_consensus.cc:515] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } } peers { permanent_uuid: "79ae3773b2274d75b3f71364c0aa6d9c" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 38531 } }
I20260709 13:05:26.898417 18370 leader_election.cc:290] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.910241 17272 leader_election.cc:336] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
W20260709 13:05:26.912741 17271 leader_election.cc:336] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
I20260709 13:05:26.913201 17271 leader_election.cc:304] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ae3773b2274d75b3f71364c0aa6d9c; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:26.914366 18370 raft_consensus.cc:2749] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:26.948575 17345 consensus_peers.cc:597] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:26.975024 18318 raft_consensus.cc:493] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:26.975622 18318 raft_consensus.cc:515] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
W20260709 13:05:26.976403 17271 consensus_peers.cc:597] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:26.977885 18318 leader_election.cc:290] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:26.989840 17345 leader_election.cc:336] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:26.992956 17345 consensus_peers.cc:597] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:26.999526 17271 consensus_peers.cc:597] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:27.006822 17346 leader_election.cc:336] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:27.007396 17346 leader_election.cc:304] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:27.013232 18318 raft_consensus.cc:2749] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:27.017184 17271 consensus_peers.cc:597] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:27.045799 17345 consensus_peers.cc:597] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:27.051203 17271 consensus_peers.cc:597] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:27.074255  7335 tablet_server.cc:196] TabletServer@127.7.41.194:0 shutdown complete.
W20260709 13:05:27.110368 17345 consensus_peers.cc:597] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:27.126628 17271 consensus_peers.cc:597] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:27.140825 17345 consensus_peers.cc:597] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:27.160580  7335 tablet_server.cc:179] TabletServer@127.7.41.195:0 shutting down...
W20260709 13:05:27.162245 17271 consensus_peers.cc:597] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:27.202421 17346 consensus_peers.cc:597] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.211534 17346 consensus_peers.cc:597] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.215791  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:05:27.216034 17345 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111) [suppressed 560 similar messages]
I20260709 13:05:27.217610  7335 tablet_replica.cc:333] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.218840  7335 raft_consensus.cc:2243] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.219452  7335 raft_consensus.cc:2272] T ae1031f0c4bc4e48be05d8012957b6ac P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.222301  7335 tablet_replica.cc:333] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
W20260709 13:05:27.222290 17345 consensus_peers.cc:597] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:27.223410  7335 raft_consensus.cc:2243] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.223956  7335 raft_consensus.cc:2272] T fcfa6b6de693472bbeaab44d7af92532 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.226293  7335 tablet_replica.cc:333] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.227006  7335 raft_consensus.cc:2243] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.227494  7335 raft_consensus.cc:2272] T 7b39f71b242b42f986fa68287bf62ba8 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.229985  7335 tablet_replica.cc:333] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.230962  7335 raft_consensus.cc:2243] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.231967  7335 raft_consensus.cc:2272] T b7cac27834104ce3980fe87e7e6e00ec P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.234387  7335 tablet_replica.cc:333] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.235030  7335 raft_consensus.cc:2243] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.235517  7335 raft_consensus.cc:2272] T b54b1ed764894db8bb28922faa095abf P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.237736  7335 tablet_replica.cc:333] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.238413  7335 raft_consensus.cc:2243] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.239255  7335 raft_consensus.cc:2272] T 6f1b381c59ed4f258e1b8e6e37096abc P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.241396  7335 tablet_replica.cc:333] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.242274  7335 raft_consensus.cc:2243] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.242738  7335 raft_consensus.cc:2272] T bbdd6a649a514be4a7e5dd077219ffed P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.245242  7335 tablet_replica.cc:333] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.245935  7335 raft_consensus.cc:2243] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.247015  7335 raft_consensus.cc:2272] T 611590896f024a4a8f1ee24e522dbd0a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.249305  7335 tablet_replica.cc:333] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.249894  7335 raft_consensus.cc:2243] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.250886  7335 raft_consensus.cc:2272] T 85badce89ef744e995d4b4307b661464 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.253618  7335 tablet_replica.cc:333] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.254659  7335 raft_consensus.cc:2243] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.255321  7335 raft_consensus.cc:2272] T c38fd5f3f7224fde8c02ed2f1e9de777 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.258397  7335 tablet_replica.cc:333] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.259320  7335 raft_consensus.cc:2243] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.260025  7335 raft_consensus.cc:2272] T 245dcb50741d45dca44ea02ed447057a P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.262563  7335 tablet_replica.cc:333] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.263448  7335 raft_consensus.cc:2243] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.264475  7335 raft_consensus.cc:2272] T e8692f804ad346579cc888efbc5c2bae P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:27.265578 17345 consensus_peers.cc:597] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:27.267104  7335 tablet_replica.cc:333] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.268042  7335 raft_consensus.cc:2243] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.268618  7335 raft_consensus.cc:2272] T b04afb5955d549318f7fe723b79f1d3b P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.271459  7335 tablet_replica.cc:333] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.272194  7335 raft_consensus.cc:2243] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.272644  7335 raft_consensus.cc:2272] T c43cf64dce604011933dfed0af0fa571 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:27.272924 17346 consensus_peers.cc:597] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.273579 17346 consensus_peers.cc:597] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.275102  7335 tablet_replica.cc:333] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.275856  7335 raft_consensus.cc:2243] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.276333  7335 raft_consensus.cc:2272] T 968dc4dd3ad542808481bf0dad333ac7 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.278800  7335 tablet_replica.cc:333] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.279404  7335 raft_consensus.cc:2243] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.280216  7335 raft_consensus.cc:2272] T 314a4e267fa44771932ef3f2482aa590 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.282526  7335 tablet_replica.cc:333] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.283116  7335 raft_consensus.cc:2243] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.283977  7335 raft_consensus.cc:2272] T 0f7a56b7669944ce91c6ad8b8f7c439c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.286432  7335 tablet_replica.cc:333] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.287253  7335 raft_consensus.cc:2243] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.288353  7335 raft_consensus.cc:2272] T 0650da7040f44f1ea1d37f44e9e5900a P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.291330  7335 tablet_replica.cc:333] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.292158  7335 raft_consensus.cc:2243] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.292748  7335 raft_consensus.cc:2272] T 7d21695723a94f56863565fdec1d8600 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.295099  7335 tablet_replica.cc:333] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.295711  7335 raft_consensus.cc:2243] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.296185  7335 raft_consensus.cc:2272] T 74084e0afb264747a12252fbdaf660a9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.298312  7335 tablet_replica.cc:333] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.298985  7335 raft_consensus.cc:2243] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.299515  7335 raft_consensus.cc:2272] T 6f853b6d09494a16a5ae6cc1110d7f3f P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.301539  7335 tablet_replica.cc:333] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.302168  7335 raft_consensus.cc:2243] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.302932  7335 raft_consensus.cc:2272] T d51f7c4d9c6e4ebb8b62960986f87768 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.304934  7335 tablet_replica.cc:333] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.305506  7335 raft_consensus.cc:2243] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.306428  7335 raft_consensus.cc:2272] T 3dfa8e7c39704056b111af9fbc19e16f P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.308370  7335 tablet_replica.cc:333] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.308949  7335 raft_consensus.cc:2243] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.309744  7335 raft_consensus.cc:2272] T 12cc194559d445f4859ac3e1c764ff4a P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.311707  7335 tablet_replica.cc:333] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.312258  7335 raft_consensus.cc:2243] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.312712  7335 raft_consensus.cc:2272] T 1a7341a74f344c90b6c0f9ff657621d5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.315061  7335 tablet_replica.cc:333] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.315635  7335 raft_consensus.cc:2243] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.316437  7335 raft_consensus.cc:2272] T 12c2736e41a64de2825d60818a0c19de P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.318558  7335 tablet_replica.cc:333] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.319190  7335 raft_consensus.cc:2243] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.320040  7335 raft_consensus.cc:2272] T 9c29266dacd348e593e9ece686e2e4e6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.322188  7335 tablet_replica.cc:333] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.322779  7335 raft_consensus.cc:2243] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.323266  7335 raft_consensus.cc:2272] T 470d0807d3ce4a87bc3de4350bab91d9 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.325700  7335 tablet_replica.cc:333] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.326388  7335 raft_consensus.cc:2243] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.326961  7335 raft_consensus.cc:2272] T dacbd66665ce48a39ba07db89854bc1c P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:27.328644 17346 consensus_peers.cc:597] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.329632  7335 tablet_replica.cc:333] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.330379  7335 raft_consensus.cc:2243] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.330978  7335 raft_consensus.cc:2272] T 1de8dcf334364214b6b6115fe416ec2b P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.333534  7335 tablet_replica.cc:333] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.334340  7335 raft_consensus.cc:2243] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.334854  7335 raft_consensus.cc:2272] T a7b6348ed73e48b2a0efba1da6d17c66 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.337127  7335 tablet_replica.cc:333] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.337770  7335 raft_consensus.cc:2243] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.338279  7335 raft_consensus.cc:2272] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 79ae3773b2274d75b3f71364c0aa6d9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.340255  7335 tablet_replica.cc:333] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.340817  7335 raft_consensus.cc:2243] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.341279  7335 raft_consensus.cc:2272] T a8e23f2fe067471e9a52a8f835d7ca1d P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.343321  7335 tablet_replica.cc:333] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.343866  7335 raft_consensus.cc:2243] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.344305  7335 raft_consensus.cc:2272] T 96679e4b73a441eaa803ed3a16a1a35f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.346251  7335 tablet_replica.cc:333] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.346788  7335 raft_consensus.cc:2243] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.347568  7335 raft_consensus.cc:2272] T a9fe91dffd9642e48367fdff703aa915 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.349838  7335 tablet_replica.cc:333] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.350530  7335 raft_consensus.cc:2243] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.351522  7335 raft_consensus.cc:2272] T 16e21576805d4de796420b8d8190fd91 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.354079  7335 tablet_replica.cc:333] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.354700  7335 raft_consensus.cc:2243] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.355188  7335 raft_consensus.cc:2272] T fb81c4e8cd7b4230ac749fa80efc56c5 P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.357182  7335 tablet_replica.cc:333] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.357813  7335 raft_consensus.cc:2243] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.358745  7335 raft_consensus.cc:2272] T 9664e129106a424cb0418e3713b1e1fb P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.361737  7335 tablet_replica.cc:333] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
W20260709 13:05:27.362392 17346 consensus_peers.cc:597] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.362504  7335 raft_consensus.cc:2243] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.363957  7335 raft_consensus.cc:2272] T b0f611e5491b4876b5239b70747dc109 P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:27.365211 17346 consensus_peers.cc:597] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.366916  7335 tablet_replica.cc:333] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.367762  7335 raft_consensus.cc:2243] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.368238  7335 raft_consensus.cc:2272] T c0b8248b5a4d4becb690235d23b259e4 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.371107  7335 tablet_replica.cc:333] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.371846  7335 raft_consensus.cc:2243] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.372881  7335 raft_consensus.cc:2272] T 079278fbd6474dea98fac1aaa536bb7c P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:27.372942 17346 consensus_peers.cc:597] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.375039  7335 tablet_replica.cc:333] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.375600  7335 raft_consensus.cc:2243] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.376057  7335 raft_consensus.cc:2272] T 385f3dec424f482bbb969fb08e7d5509 P 79ae3773b2274d75b3f71364c0aa6d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.378312  7335 tablet_replica.cc:333] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.378862  7335 raft_consensus.cc:2243] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.379339  7335 raft_consensus.cc:2272] T ccf8ff673def486c94896905e592b78f P 79ae3773b2274d75b3f71364c0aa6d9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.381487  7335 tablet_replica.cc:333] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c: stopping tablet replica
I20260709 13:05:27.382095  7335 raft_consensus.cc:2243] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.382542  7335 raft_consensus.cc:2272] T bbe458392d4741bf9e3b6893e219031e P 79ae3773b2274d75b3f71364c0aa6d9c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:27.402383 17346 consensus_peers.cc:597] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.422653 17346 consensus_peers.cc:597] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.423943 18399 raft_consensus.cc:493] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de7ec497603d42d0acaf22677ea7f1bd)
I20260709 13:05:27.424559 18399 raft_consensus.cc:515] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e1f9e0cad0b4ecda332df1fd213ce1d" member_type: VOTER last_known_addr { host: "127.7.41.196" port: 39887 } } peers { permanent_uuid: "de7ec497603d42d0acaf22677ea7f1bd" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40565 } } peers { permanent_uuid: "7e9eba24bc8842099fcba4a2024c2aed" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38067 } }
I20260709 13:05:27.426888 18399 leader_election.cc:290] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565), 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067)
W20260709 13:05:27.430987 17345 leader_election.cc:336] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111)
W20260709 13:05:27.434669 17346 leader_election.cc:336] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111)
I20260709 13:05:27.435117 17346 leader_election.cc:304] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e1f9e0cad0b4ecda332df1fd213ce1d; no voters: 7e9eba24bc8842099fcba4a2024c2aed, de7ec497603d42d0acaf22677ea7f1bd
I20260709 13:05:27.436431 18396 raft_consensus.cc:2749] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:27.439731 17345 consensus_peers.cc:597] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:27.443364 17346 consensus_peers.cc:597] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:27.455222 17346 consensus_peers.cc:597] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.469581 17346 consensus_peers.cc:597] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:38531: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.480217  7335 tablet_server.cc:196] TabletServer@127.7.41.195:0 shutdown complete.
W20260709 13:05:27.502113 17346 consensus_peers.cc:597] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:38531: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.520233 17346 consensus_peers.cc:597] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:38531: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.562624 17346 consensus_peers.cc:597] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:27.579344 17346 consensus_peers.cc:597] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:27.589165  7335 tablet_server.cc:179] TabletServer@127.7.41.196:0 shutting down...
W20260709 13:05:27.590070 17346 consensus_peers.cc:597] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:38531: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:27.609342 17346 consensus_peers.cc:597] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 79ae3773b2274d75b3f71364c0aa6d9c (127.7.41.195:38531): Couldn't send request to peer 79ae3773b2274d75b3f71364c0aa6d9c. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.195:38531: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.654639  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:27.655722  7335 tablet_replica.cc:333] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.656704  7335 raft_consensus.cc:2243] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.657943  7335 raft_consensus.cc:2272] T fcfa6b6de693472bbeaab44d7af92532 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.661021  7335 tablet_replica.cc:333] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.661994  7335 raft_consensus.cc:2243] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.663090  7335 raft_consensus.cc:2272] T ae1031f0c4bc4e48be05d8012957b6ac P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.666085  7335 tablet_replica.cc:333] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.666982  7335 raft_consensus.cc:2243] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.667557  7335 raft_consensus.cc:2272] T f0ddeea989c64b70a533198455dc0b6c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.670697  7335 tablet_replica.cc:333] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.671587  7335 raft_consensus.cc:2243] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.672191  7335 raft_consensus.cc:2272] T 43f244e037b7426793547977135a3e68 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.675040  7335 tablet_replica.cc:333] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.675951  7335 raft_consensus.cc:2243] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.676523  7335 raft_consensus.cc:2272] T b0f611e5491b4876b5239b70747dc109 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.679425  7335 tablet_replica.cc:333] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.680429  7335 raft_consensus.cc:2243] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.680963  7335 raft_consensus.cc:2272] T b7cac27834104ce3980fe87e7e6e00ec P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.683948  7335 tablet_replica.cc:333] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.684819  7335 raft_consensus.cc:2243] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.685701  7335 raft_consensus.cc:2272] T b54b1ed764894db8bb28922faa095abf P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.688660  7335 tablet_replica.cc:333] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.689551  7335 raft_consensus.cc:2243] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.690111  7335 raft_consensus.cc:2272] T 611590896f024a4a8f1ee24e522dbd0a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.692960  7335 tablet_replica.cc:333] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.693775  7335 raft_consensus.cc:2243] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.694818  7335 raft_consensus.cc:2272] T ddf498205a5942dd9c8ec8f97f6f8c67 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.697710  7335 tablet_replica.cc:333] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.698576  7335 raft_consensus.cc:2243] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.699640  7335 raft_consensus.cc:2272] T 6f853b6d09494a16a5ae6cc1110d7f3f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.702443  7335 tablet_replica.cc:333] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.703277  7335 raft_consensus.cc:2243] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.703922  7335 raft_consensus.cc:2272] T d51f7c4d9c6e4ebb8b62960986f87768 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.706914  7335 tablet_replica.cc:333] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.707743  7335 raft_consensus.cc:2243] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.708770  7335 raft_consensus.cc:2272] T c38fd5f3f7224fde8c02ed2f1e9de777 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.711797  7335 tablet_replica.cc:333] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.712634  7335 raft_consensus.cc:2243] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.713188  7335 raft_consensus.cc:2272] T 8b355c1a40d24e6387c364c6964fbb99 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.715948  7335 tablet_replica.cc:333] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.716740  7335 raft_consensus.cc:2243] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.717286  7335 raft_consensus.cc:2272] T e8692f804ad346579cc888efbc5c2bae P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.720072  7335 tablet_replica.cc:333] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.720885  7335 raft_consensus.cc:2243] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.721879  7335 raft_consensus.cc:2272] T b04afb5955d549318f7fe723b79f1d3b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.724570  7335 tablet_replica.cc:333] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.725329  7335 raft_consensus.cc:2243] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.725908  7335 raft_consensus.cc:2272] T 74ea231d707840749fc902bd3d111e34 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.728724  7335 tablet_replica.cc:333] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.729533  7335 raft_consensus.cc:2243] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.730614  7335 raft_consensus.cc:2272] T 968dc4dd3ad542808481bf0dad333ac7 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.733381  7335 tablet_replica.cc:333] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.734195  7335 raft_consensus.cc:2243] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.734800  7335 raft_consensus.cc:2272] T f67d94cad84c4419a7f21c6c0b35c7cb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.737731  7335 tablet_replica.cc:333] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.738554  7335 raft_consensus.cc:2243] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.739094  7335 raft_consensus.cc:2272] T 314a4e267fa44771932ef3f2482aa590 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.741719  7335 tablet_replica.cc:333] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.742605  7335 raft_consensus.cc:2243] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.743662  7335 raft_consensus.cc:2272] T 7d21695723a94f56863565fdec1d8600 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.746371  7335 tablet_replica.cc:333] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.747138  7335 raft_consensus.cc:2243] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.747660  7335 raft_consensus.cc:2272] T 44c3a626d41640f2b0ca7233c56f8bbc P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.750541  7335 tablet_replica.cc:333] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.751304  7335 raft_consensus.cc:2243] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.752291  7335 raft_consensus.cc:2272] T 74084e0afb264747a12252fbdaf660a9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.755118  7335 tablet_replica.cc:333] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.755898  7335 raft_consensus.cc:2243] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.756873  7335 raft_consensus.cc:2272] T e66fd7f2e6494980b0c33606bc363fe8 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.759684  7335 tablet_replica.cc:333] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.760469  7335 raft_consensus.cc:2243] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.761030  7335 raft_consensus.cc:2272] T 9c29266dacd348e593e9ece686e2e4e6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:27.762151 17345 consensus_peers.cc:597] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer de7ec497603d42d0acaf22677ea7f1bd (127.7.41.193:40565): Couldn't send request to peer de7ec497603d42d0acaf22677ea7f1bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:40565: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:27.763840  7335 tablet_replica.cc:333] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.764721  7335 raft_consensus.cc:2243] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.765669  7335 raft_consensus.cc:2272] T 470d0807d3ce4a87bc3de4350bab91d9 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.768307  7335 tablet_replica.cc:333] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.769115  7335 raft_consensus.cc:2243] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.769694  7335 raft_consensus.cc:2272] T 3dfa8e7c39704056b111af9fbc19e16f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.772552  7335 tablet_replica.cc:333] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.773396  7335 raft_consensus.cc:2243] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.773975  7335 raft_consensus.cc:2272] T 1d30a413a6924c3ea6027b6d3b4adc86 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.776804  7335 tablet_replica.cc:333] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.777664  7335 raft_consensus.cc:2243] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.778661  7335 raft_consensus.cc:2272] T 385f3dec424f482bbb969fb08e7d5509 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:27.779786 17346 consensus_peers.cc:597] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d -> Peer 7e9eba24bc8842099fcba4a2024c2aed (127.7.41.194:38067): Couldn't send request to peer 7e9eba24bc8842099fcba4a2024c2aed. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38067: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:27.781399  7335 tablet_replica.cc:333] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.782290  7335 raft_consensus.cc:2243] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.783368  7335 raft_consensus.cc:2272] T 96679e4b73a441eaa803ed3a16a1a35f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.786051  7335 tablet_replica.cc:333] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.786825  7335 raft_consensus.cc:2243] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.787892  7335 raft_consensus.cc:2272] T a8e23f2fe067471e9a52a8f835d7ca1d P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.790584  7335 tablet_replica.cc:333] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.791323  7335 raft_consensus.cc:2243] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.791813  7335 raft_consensus.cc:2272] T 4c83cdeb244b4fada6bff4050bdd4fcd P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.794377  7335 tablet_replica.cc:333] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.795115  7335 raft_consensus.cc:2243] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.795653  7335 raft_consensus.cc:2272] T 86b2a5e865cd45b0a86c5a59f00e57a1 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.798446  7335 tablet_replica.cc:333] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.799254  7335 raft_consensus.cc:2243] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.799826  7335 raft_consensus.cc:2272] T 16e21576805d4de796420b8d8190fd91 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.802441  7335 tablet_replica.cc:333] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.803175  7335 raft_consensus.cc:2243] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.803694  7335 raft_consensus.cc:2272] T 9664e129106a424cb0418e3713b1e1fb P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.806209  7335 tablet_replica.cc:333] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.806941  7335 raft_consensus.cc:2243] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.807935  7335 raft_consensus.cc:2272] T 1de8dcf334364214b6b6115fe416ec2b P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.810519  7335 tablet_replica.cc:333] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.811236  7335 raft_consensus.cc:2243] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.812259  7335 raft_consensus.cc:2272] T ccf8ff673def486c94896905e592b78f P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.815089  7335 tablet_replica.cc:333] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.815825  7335 raft_consensus.cc:2243] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.816792  7335 raft_consensus.cc:2272] T bbe458392d4741bf9e3b6893e219031e P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.819535  7335 tablet_replica.cc:333] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.820290  7335 raft_consensus.cc:2243] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.821280  7335 raft_consensus.cc:2272] T 69e81dc6421d4fdf8dcff43b8a449587 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.824281  7335 tablet_replica.cc:333] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.825088  7335 raft_consensus.cc:2243] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.825654  7335 raft_consensus.cc:2272] T 12cc194559d445f4859ac3e1c764ff4a P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.828274  7335 tablet_replica.cc:333] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.829012  7335 raft_consensus.cc:2243] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.829511  7335 raft_consensus.cc:2272] T 079278fbd6474dea98fac1aaa536bb7c P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.832193  7335 tablet_replica.cc:333] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.832895  7335 raft_consensus.cc:2243] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.833396  7335 raft_consensus.cc:2272] T a21af78b15714161898e0f709c8a5834 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.836107  7335 tablet_replica.cc:333] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.836792  7335 raft_consensus.cc:2243] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.837765  7335 raft_consensus.cc:2272] T de6ec102dc0a48c0819f814102f27aa0 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.840400  7335 tablet_replica.cc:333] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.841032  7335 raft_consensus.cc:2243] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:27.842097  7335 raft_consensus.cc:2272] T 2d4c5c12c8844ad7877fca4c9d59dec6 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:27.844720  7335 tablet_replica.cc:333] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d: stopping tablet replica
I20260709 13:05:27.845367  7335 raft_consensus.cc:2243] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:27.845878  7335 raft_consensus.cc:2272] T 573c9ef51ca24504be6b34051b2a0607 P 0e1f9e0cad0b4ecda332df1fd213ce1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.195559  7335 tablet_server.cc:196] TabletServer@127.7.41.196:0 shutdown complete.
I20260709 13:05:28.258285  7335 master.cc:562] Master@127.7.41.254:37309 shutting down...
I20260709 13:05:28.284701  7335 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:28.285229  7335 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:28.285529  7335 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0a1bc03204a547bfb078faa7ac2d3d89: stopping tablet replica
I20260709 13:05:28.306972  7335 master.cc:584] Master@127.7.41.254:37309 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (37986 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:05:28.396628  7335 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.41.254:38505
I20260709 13:05:28.397780  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.404090 18402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.404119 18403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.404978 18405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.405504  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:28.406836  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.407014  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.407227  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602328407193 us; error 0 us; skew 500 ppm
I20260709 13:05:28.407778  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.410379  7335 webserver.cc:533] Webserver started at http://127.7.41.254:36355/ using document root <none> and password file <none>
I20260709 13:05:28.411005  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.411234  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.411582  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.413189  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/master-0-root/instance:
uuid: "0fa99111c128473b9df1828d477cec92"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-fh5z"
I20260709 13:05:28.417665  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:05:28.421360 18410 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.422161  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:28.422463  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/master-0-root
uuid: "0fa99111c128473b9df1828d477cec92"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-fh5z"
I20260709 13:05:28.422740  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.436885  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.438211  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.475410  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.254:38505
I20260709 13:05:28.475533 18461 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.254:38505 every 8 connection(s)
I20260709 13:05:28.479223 18462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.489566 18462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92: Bootstrap starting.
I20260709 13:05:28.494371 18462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.498533 18462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92: No bootstrap required, opened a new log
I20260709 13:05:28.500797 18462 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa99111c128473b9df1828d477cec92" member_type: VOTER }
I20260709 13:05:28.501207 18462 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.501446 18462 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa99111c128473b9df1828d477cec92, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.502046 18462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa99111c128473b9df1828d477cec92" member_type: VOTER }
I20260709 13:05:28.502481 18462 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:28.502707 18462 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:28.502972 18462 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:28.507405 18462 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa99111c128473b9df1828d477cec92" member_type: VOTER }
I20260709 13:05:28.507900 18462 leader_election.cc:304] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fa99111c128473b9df1828d477cec92; no voters: 
I20260709 13:05:28.509070 18462 leader_election.cc:290] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:28.509443 18465 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:28.510844 18465 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 1 LEADER]: Becoming Leader. State: Replica: 0fa99111c128473b9df1828d477cec92, State: Running, Role: LEADER
I20260709 13:05:28.511504 18465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa99111c128473b9df1828d477cec92" member_type: VOTER }
I20260709 13:05:28.511958 18462 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:28.515893 18466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fa99111c128473b9df1828d477cec92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa99111c128473b9df1828d477cec92" member_type: VOTER } }
I20260709 13:05:28.516260 18467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fa99111c128473b9df1828d477cec92. Latest consensus state: current_term: 1 leader_uuid: "0fa99111c128473b9df1828d477cec92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa99111c128473b9df1828d477cec92" member_type: VOTER } }
I20260709 13:05:28.516542 18466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:28.516762 18467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:28.519441 18472 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:28.527134 18472 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:28.528137  7335 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:28.535766 18472 catalog_manager.cc:1383] Generated new cluster ID: 8214ea78c9ed45d7903ecf8cf8ffd695
I20260709 13:05:28.536056 18472 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:28.558624 18472 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:28.559864 18472 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:28.577194 18472 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92: Generated new TSK 0
I20260709 13:05:28.577816 18472 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:28.594868  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.600575 18483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.601773 18484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.603439 18486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.603847  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:28.604833  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.605053  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.605221  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602328605204 us; error 0 us; skew 500 ppm
I20260709 13:05:28.605741  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.607995  7335 webserver.cc:533] Webserver started at http://127.7.41.193:35011/ using document root <none> and password file <none>
I20260709 13:05:28.608489  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.608693  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.608984  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.610097  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-0-root/instance:
uuid: "81b99e130b0a4dd9a160ed19edfb1729"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-fh5z"
I20260709 13:05:28.614656  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:28.617822 18491 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.618572  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:28.618865  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-0-root
uuid: "81b99e130b0a4dd9a160ed19edfb1729"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-fh5z"
I20260709 13:05:28.619153  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.629365  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.630613  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.632009  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.634234  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.634455  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.634683  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.634867  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.675185  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.193:43055
I20260709 13:05:28.675280 18553 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.193:43055 every 8 connection(s)
I20260709 13:05:28.680490  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.689134 18559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.689913 18558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.692893  7335 server_base.cc:1061] running on GCE node
W20260709 13:05:28.692859 18561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.694686  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.694911  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.695123  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602328695103 us; error 0 us; skew 500 ppm
I20260709 13:05:28.695808  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.696709 18554 heartbeater.cc:344] Connected to a master server at 127.7.41.254:38505
I20260709 13:05:28.697089 18554 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.697837 18554 heartbeater.cc:507] Master 127.7.41.254:38505 requested a full tablet report, sending...
I20260709 13:05:28.698815  7335 webserver.cc:533] Webserver started at http://127.7.41.194:46385/ using document root <none> and password file <none>
I20260709 13:05:28.699525  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.699765  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.700071  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.700189 18427 ts_manager.cc:194] Registered new tserver with Master: 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055)
I20260709 13:05:28.701282  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-1-root/instance:
uuid: "16fae10ebb5640df8793296f7235a80b"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-fh5z"
I20260709 13:05:28.702114 18427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41872
I20260709 13:05:28.706298  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:05:28.709754 18566 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.710515  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:05:28.710824  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-1-root
uuid: "16fae10ebb5640df8793296f7235a80b"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-fh5z"
I20260709 13:05:28.711169  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.731489  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.732682  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.734153  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.736295  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.736524  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.736761  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.736936  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.776073  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.194:39821
I20260709 13:05:28.776185 18628 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.194:39821 every 8 connection(s)
I20260709 13:05:28.780870  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.787245 18632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.788235 18633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.791868  7335 server_base.cc:1061] running on GCE node
W20260709 13:05:28.791805 18635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.793357  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.793591  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.793802  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602328793782 us; error 0 us; skew 500 ppm
I20260709 13:05:28.793998 18629 heartbeater.cc:344] Connected to a master server at 127.7.41.254:38505
I20260709 13:05:28.794456 18629 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.794512  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.795419 18629 heartbeater.cc:507] Master 127.7.41.254:38505 requested a full tablet report, sending...
I20260709 13:05:28.797453  7335 webserver.cc:533] Webserver started at http://127.7.41.195:43575/ using document root <none> and password file <none>
I20260709 13:05:28.797789 18427 ts_manager.cc:194] Registered new tserver with Master: 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:28.798002  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.798411  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.798688  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.799446 18427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41888
I20260709 13:05:28.799851  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-2-root/instance:
uuid: "43ce3221884c4c00942a25c11309e465"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-fh5z"
I20260709 13:05:28.804478  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:28.807659 18640 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.808462  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:28.808770  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-2-root
uuid: "43ce3221884c4c00942a25c11309e465"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-fh5z"
I20260709 13:05:28.809077  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.827283  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.828616  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.830420  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.832952  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.833199  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.833482  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.833681  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.878434  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.195:39769
I20260709 13:05:28.878531 18702 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.195:39769 every 8 connection(s)
I20260709 13:05:28.892508 18703 heartbeater.cc:344] Connected to a master server at 127.7.41.254:38505
I20260709 13:05:28.892911 18703 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.893648 18703 heartbeater.cc:507] Master 127.7.41.254:38505 requested a full tablet report, sending...
I20260709 13:05:28.895608 18427 ts_manager.cc:194] Registered new tserver with Master: 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:28.896720  7335 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014701298s
I20260709 13:05:28.897039 18427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41894
I20260709 13:05:28.922220 18427 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41902:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:28.925074 18427 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:28.995054 18668 tablet_service.cc:1511] Processing CreateTablet for tablet ec82672ebf6d4d64b07f23962f86b343 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:28.996755 18668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82672ebf6d4d64b07f23962f86b343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.998586 18667 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae42f07ab964f43a2745d1ce1d8162c (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:29.000141 18667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae42f07ab964f43a2745d1ce1d8162c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.011770 18594 tablet_service.cc:1511] Processing CreateTablet for tablet ec82672ebf6d4d64b07f23962f86b343 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:29.012553 18592 tablet_service.cc:1511] Processing CreateTablet for tablet e6eab95ea4804591bb76f3e2cfb66a4d (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:29.013327 18594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82672ebf6d4d64b07f23962f86b343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.013959 18592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6eab95ea4804591bb76f3e2cfb66a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.015093 18593 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae42f07ab964f43a2745d1ce1d8162c (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:29.016443 18519 tablet_service.cc:1511] Processing CreateTablet for tablet ec82672ebf6d4d64b07f23962f86b343 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:29.017148 18517 tablet_service.cc:1511] Processing CreateTablet for tablet e6eab95ea4804591bb76f3e2cfb66a4d (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:29.017856 18519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82672ebf6d4d64b07f23962f86b343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.017609 18666 tablet_service.cc:1511] Processing CreateTablet for tablet e6eab95ea4804591bb76f3e2cfb66a4d (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:29.018539 18517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6eab95ea4804591bb76f3e2cfb66a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.019023 18666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6eab95ea4804591bb76f3e2cfb66a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.019960 18516 tablet_service.cc:1511] Processing CreateTablet for tablet c53fe657df6340a9955712c8731e389b (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:29.021324 18516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53fe657df6340a9955712c8731e389b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.022450 18665 tablet_service.cc:1511] Processing CreateTablet for tablet c53fe657df6340a9955712c8731e389b (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:29.023729 18665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53fe657df6340a9955712c8731e389b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.023631 18518 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae42f07ab964f43a2745d1ce1d8162c (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:29.024951 18515 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6c50cc36ba4ce999a28152a30f2c8a (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:29.027385 18593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae42f07ab964f43a2745d1ce1d8162c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.028195 18518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae42f07ab964f43a2745d1ce1d8162c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.032234 18591 tablet_service.cc:1511] Processing CreateTablet for tablet c53fe657df6340a9955712c8731e389b (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:29.033602 18515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6c50cc36ba4ce999a28152a30f2c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.042426 18591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53fe657df6340a9955712c8731e389b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.076360 18719 tablet_bootstrap.cc:492] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b: Bootstrap starting.
I20260709 13:05:29.079969 18590 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6c50cc36ba4ce999a28152a30f2c8a (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:29.082466 18590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6c50cc36ba4ce999a28152a30f2c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.089708 18668 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6c50cc36ba4ce999a28152a30f2c8a (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:29.091100 18668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6c50cc36ba4ce999a28152a30f2c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.096588 18514 tablet_service.cc:1511] Processing CreateTablet for tablet d1e152db3ede4bdcb0825dfee8950c10 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:29.097674 18593 tablet_service.cc:1511] Processing CreateTablet for tablet d1e152db3ede4bdcb0825dfee8950c10 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:29.098379 18514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e152db3ede4bdcb0825dfee8950c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.099004 18593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e152db3ede4bdcb0825dfee8950c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.103032 18718 tablet_bootstrap.cc:492] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465: Bootstrap starting.
I20260709 13:05:29.120102 18719 tablet_bootstrap.cc:654] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.126312 18665 tablet_service.cc:1511] Processing CreateTablet for tablet d1e152db3ede4bdcb0825dfee8950c10 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:29.126961 18718 tablet_bootstrap.cc:654] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.127707 18665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e152db3ede4bdcb0825dfee8950c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.132682 18591 tablet_service.cc:1511] Processing CreateTablet for tablet 76d5f24146c14596a7ca9287cd99f6b2 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:29.134001 18591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d5f24146c14596a7ca9287cd99f6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.134182 18664 tablet_service.cc:1511] Processing CreateTablet for tablet 76d5f24146c14596a7ca9287cd99f6b2 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:29.135561 18664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d5f24146c14596a7ca9287cd99f6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.139201 18518 tablet_service.cc:1511] Processing CreateTablet for tablet 76d5f24146c14596a7ca9287cd99f6b2 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:29.140532 18518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d5f24146c14596a7ca9287cd99f6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.148622 18720 tablet_bootstrap.cc:492] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:29.145799 18519 tablet_service.cc:1511] Processing CreateTablet for tablet e9c82f4244fe497482983f0808315da6 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:29.151183 18519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c82f4244fe497482983f0808315da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.157362 18594 tablet_service.cc:1511] Processing CreateTablet for tablet e9c82f4244fe497482983f0808315da6 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:29.158715 18594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c82f4244fe497482983f0808315da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.159889 18663 tablet_service.cc:1511] Processing CreateTablet for tablet e9c82f4244fe497482983f0808315da6 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:29.161244 18663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c82f4244fe497482983f0808315da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.178684 18718 tablet_bootstrap.cc:492] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465: No bootstrap required, opened a new log
I20260709 13:05:29.179253 18718 ts_tablet_manager.cc:1403] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465: Time spent bootstrapping tablet: real 0.077s	user 0.003s	sys 0.017s
I20260709 13:05:29.184684 18589 tablet_service.cc:1511] Processing CreateTablet for tablet 374d1ace655045148344cedc5cf8b497 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:29.182303 18718 raft_consensus.cc:359] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.186113 18718 raft_consensus.cc:385] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.186435 18718 raft_consensus.cc:740] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.187155 18720 tablet_bootstrap.cc:654] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.187326 18718 consensus_queue.cc:260] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.188359 18517 tablet_service.cc:1511] Processing CreateTablet for tablet 4e2ab41c55154d2391b80266f3a586b2 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:29.191332 18517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e2ab41c55154d2391b80266f3a586b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.189313 18664 tablet_service.cc:1511] Processing CreateTablet for tablet 374d1ace655045148344cedc5cf8b497 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:29.192301 18664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374d1ace655045148344cedc5cf8b497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.196682 18589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374d1ace655045148344cedc5cf8b497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.201495 18718 ts_tablet_manager.cc:1434] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.008s
I20260709 13:05:29.202277 18703 heartbeater.cc:499] Master 127.7.41.254:38505 was elected leader, sending a full tablet report...
I20260709 13:05:29.203281 18718 tablet_bootstrap.cc:492] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465: Bootstrap starting.
I20260709 13:05:29.206240 18667 tablet_service.cc:1511] Processing CreateTablet for tablet 4e2ab41c55154d2391b80266f3a586b2 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:29.207518 18667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e2ab41c55154d2391b80266f3a586b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.197682 18719 tablet_bootstrap.cc:492] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b: No bootstrap required, opened a new log
I20260709 13:05:29.197355 18590 tablet_service.cc:1511] Processing CreateTablet for tablet 4e2ab41c55154d2391b80266f3a586b2 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:29.211740 18590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e2ab41c55154d2391b80266f3a586b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.218176 18719 ts_tablet_manager.cc:1403] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b: Time spent bootstrapping tablet: real 0.142s	user 0.008s	sys 0.007s
I20260709 13:05:29.191325 18518 tablet_service.cc:1511] Processing CreateTablet for tablet 374d1ace655045148344cedc5cf8b497 (DEFAULT_TABLE table=test-workload [id=dc859fa41faf46b3a951097a234983f7]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:29.232543 18518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374d1ace655045148344cedc5cf8b497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.247148 18719 raft_consensus.cc:359] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.256242 18720 tablet_bootstrap.cc:492] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: No bootstrap required, opened a new log
I20260709 13:05:29.259938 18719 raft_consensus.cc:385] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.260123 18720 ts_tablet_manager.cc:1403] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.015s
I20260709 13:05:29.260370 18719 raft_consensus.cc:740] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.261301 18719 consensus_queue.cc:260] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.262094 18718 tablet_bootstrap.cc:654] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.262833 18720 raft_consensus.cc:359] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.263728 18720 raft_consensus.cc:385] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.263967 18629 heartbeater.cc:499] Master 127.7.41.254:38505 was elected leader, sending a full tablet report...
I20260709 13:05:29.264020 18720 raft_consensus.cc:740] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.265101 18720 consensus_queue.cc:260] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.266937 18719 ts_tablet_manager.cc:1434] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.004s
I20260709 13:05:29.267987 18719 tablet_bootstrap.cc:492] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b: Bootstrap starting.
I20260709 13:05:29.274282 18719 tablet_bootstrap.cc:654] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.274574 18720 ts_tablet_manager.cc:1434] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:05:29.279631 18720 tablet_bootstrap.cc:492] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
W20260709 13:05:29.280179 18630 tablet.cc:2406] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:29.275157 18554 heartbeater.cc:499] Master 127.7.41.254:38505 was elected leader, sending a full tablet report...
I20260709 13:05:29.275980 18723 raft_consensus.cc:493] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.282299 18723 raft_consensus.cc:515] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.284996 18723 leader_election.cc:290] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:29.304698 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53fe657df6340a9955712c8731e389b" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729" is_pre_election: true
I20260709 13:05:29.305747 18529 raft_consensus.cc:2468] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 0.
I20260709 13:05:29.307366 18641 leader_election.cc:304] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:29.308306 18723 raft_consensus.cc:2804] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.308679 18723 raft_consensus.cc:493] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.309110 18723 raft_consensus.cc:3060] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.317718 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53fe657df6340a9955712c8731e389b" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b" is_pre_election: true
W20260709 13:05:29.319626 18642 leader_election.cc:343] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.321126 18719 tablet_bootstrap.cc:492] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b: No bootstrap required, opened a new log
I20260709 13:05:29.321682 18719 ts_tablet_manager.cc:1403] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.006s
I20260709 13:05:29.323988 18720 tablet_bootstrap.cc:654] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.324680 18719 raft_consensus.cc:359] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:29.325443 18719 raft_consensus.cc:385] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.325696 18719 raft_consensus.cc:740] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.325827 18718 tablet_bootstrap.cc:492] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465: No bootstrap required, opened a new log
I20260709 13:05:29.325860 18723 raft_consensus.cc:515] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.326592 18718 ts_tablet_manager.cc:1403] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.007s
I20260709 13:05:29.326521 18719 consensus_queue.cc:260] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:29.329092 18719 ts_tablet_manager.cc:1434] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:05:29.330475 18719 tablet_bootstrap.cc:492] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b: Bootstrap starting.
I20260709 13:05:29.330763 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53fe657df6340a9955712c8731e389b" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:29.331386 18529 raft_consensus.cc:3060] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.332113 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53fe657df6340a9955712c8731e389b" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b"
W20260709 13:05:29.333557 18642 leader_election.cc:343] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.334134 18723 leader_election.cc:290] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:29.329833 18718 raft_consensus.cc:359] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:29.335309 18718 raft_consensus.cc:385] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.335636 18718 raft_consensus.cc:740] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.336405 18718 consensus_queue.cc:260] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:29.338721 18718 ts_tablet_manager.cc:1434] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:05:29.338855 18719 tablet_bootstrap.cc:654] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.339469 18529 raft_consensus.cc:2468] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 1.
I20260709 13:05:29.342567 18641 leader_election.cc:304] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 16fae10ebb5640df8793296f7235a80b
I20260709 13:05:29.339926 18718 tablet_bootstrap.cc:492] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465: Bootstrap starting.
I20260709 13:05:29.345058 18723 raft_consensus.cc:2804] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.341434 18720 tablet_bootstrap.cc:492] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: No bootstrap required, opened a new log
I20260709 13:05:29.345907 18720 ts_tablet_manager.cc:1403] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.011s
I20260709 13:05:29.353092 18723 raft_consensus.cc:697] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Becoming Leader. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:29.351876 18718 tablet_bootstrap.cc:654] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.354110 18723 consensus_queue.cc:237] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.355296 18720 raft_consensus.cc:359] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:29.356127 18720 raft_consensus.cc:385] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.356468 18720 raft_consensus.cc:740] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.357349 18720 consensus_queue.cc:260] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:29.361115 18719 tablet_bootstrap.cc:492] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b: No bootstrap required, opened a new log
I20260709 13:05:29.361826 18719 ts_tablet_manager.cc:1403] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.007s
I20260709 13:05:29.365687 18719 raft_consensus.cc:359] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.366678 18719 raft_consensus.cc:385] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.367044 18719 raft_consensus.cc:740] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.368105 18719 consensus_queue.cc:260] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.369052 18720 ts_tablet_manager.cc:1434] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:29.371495 18719 ts_tablet_manager.cc:1434] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:05:29.372905 18719 tablet_bootstrap.cc:492] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b: Bootstrap starting.
I20260709 13:05:29.380055 18720 tablet_bootstrap.cc:492] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:29.381430 18719 tablet_bootstrap.cc:654] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.391583 18718 tablet_bootstrap.cc:492] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465: No bootstrap required, opened a new log
I20260709 13:05:29.392344 18718 ts_tablet_manager.cc:1403] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.027s
I20260709 13:05:29.393167 18720 tablet_bootstrap.cc:654] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.396116 18718 raft_consensus.cc:359] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.397279 18718 raft_consensus.cc:385] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.397764 18718 raft_consensus.cc:740] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.399996 18718 consensus_queue.cc:260] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.401019 18719 tablet_bootstrap.cc:492] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b: No bootstrap required, opened a new log
I20260709 13:05:29.401599 18719 ts_tablet_manager.cc:1403] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.001s
I20260709 13:05:29.402738 18718 ts_tablet_manager.cc:1434] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:05:29.403012 18720 tablet_bootstrap.cc:492] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: No bootstrap required, opened a new log
I20260709 13:05:29.403570 18720 ts_tablet_manager.cc:1403] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 13:05:29.403623 18727 raft_consensus.cc:493] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.404232 18727 raft_consensus.cc:515] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:29.404572 18719 raft_consensus.cc:359] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.405365 18719 raft_consensus.cc:385] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.404799 18426 catalog_manager.cc:5697] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43ce3221884c4c00942a25c11309e465 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "43ce3221884c4c00942a25c11309e465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.405678 18719 raft_consensus.cc:740] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.406586 18720 raft_consensus.cc:359] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.407356 18720 raft_consensus.cc:385] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.407796 18720 raft_consensus.cc:740] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.406764 18719 consensus_queue.cc:260] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.408771 18720 consensus_queue.cc:260] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.410895 18727 leader_election.cc:290] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:29.418753 18719 ts_tablet_manager.cc:1434] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 13:05:29.422569 18719 tablet_bootstrap.cc:492] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b: Bootstrap starting.
I20260709 13:05:29.425325 18718 tablet_bootstrap.cc:492] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465: Bootstrap starting.
I20260709 13:05:29.429286 18719 tablet_bootstrap.cc:654] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.429649 18720 ts_tablet_manager.cc:1434] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.006s
I20260709 13:05:29.431824 18725 raft_consensus.cc:493] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.432344 18725 raft_consensus.cc:515] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.432301 18718 tablet_bootstrap.cc:654] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.438679 18725 leader_election.cc:290] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.442458 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "81b99e130b0a4dd9a160ed19edfb1729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b" is_pre_election: true
I20260709 13:05:29.443192 18604 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b99e130b0a4dd9a160ed19edfb1729 in term 0.
I20260709 13:05:29.444607 18493 leader_election.cc:304] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:29.446291 18739 raft_consensus.cc:2804] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.446836 18739 raft_consensus.cc:493] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.446594 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "81b99e130b0a4dd9a160ed19edfb1729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465" is_pre_election: true
I20260709 13:05:29.447429 18739 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.447813 18678 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b99e130b0a4dd9a160ed19edfb1729 in term 0.
I20260709 13:05:29.432237 18720 tablet_bootstrap.cc:492] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:29.457201 18718 tablet_bootstrap.cc:492] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465: No bootstrap required, opened a new log
I20260709 13:05:29.457845 18718 ts_tablet_manager.cc:1403] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.011s
I20260709 13:05:29.461037 18719 tablet_bootstrap.cc:492] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b: No bootstrap required, opened a new log
I20260709 13:05:29.466746 18719 ts_tablet_manager.cc:1403] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.000s
I20260709 13:05:29.461464 18718 raft_consensus.cc:359] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.467163 18718 raft_consensus.cc:385] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.467473 18718 raft_consensus.cc:740] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.468216 18720 tablet_bootstrap.cc:654] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.468341 18718 consensus_queue.cc:260] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.469902 18719 raft_consensus.cc:359] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.470685 18719 raft_consensus.cc:385] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.471472 18719 raft_consensus.cc:740] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.471498 18739 raft_consensus.cc:515] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:29.472484 18719 consensus_queue.cc:260] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.473101 18718 ts_tablet_manager.cc:1434] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:05:29.474152 18718 tablet_bootstrap.cc:492] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465: Bootstrap starting.
I20260709 13:05:29.474920 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "81b99e130b0a4dd9a160ed19edfb1729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:29.475505 18678 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.477572 18719 ts_tablet_manager.cc:1434] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:29.478657 18719 tablet_bootstrap.cc:492] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b: Bootstrap starting.
I20260709 13:05:29.480706 18718 tablet_bootstrap.cc:654] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.482100 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "81b99e130b0a4dd9a160ed19edfb1729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:29.482735 18604 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.485037 18719 tablet_bootstrap.cc:654] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.491619 18604 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b99e130b0a4dd9a160ed19edfb1729 in term 1.
I20260709 13:05:29.493324 18493 leader_election.cc:304] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:29.494381 18727 raft_consensus.cc:2804] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.497443 18718 tablet_bootstrap.cc:492] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465: No bootstrap required, opened a new log
I20260709 13:05:29.497974 18718 ts_tablet_manager.cc:1403] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.004s
I20260709 13:05:29.498365 18719 tablet_bootstrap.cc:492] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b: No bootstrap required, opened a new log
I20260709 13:05:29.499037 18719 ts_tablet_manager.cc:1403] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 13:05:29.500345 18739 leader_election.cc:290] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [CANDIDATE]: Term 1 election: Requested vote from peers 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:29.501042 18718 raft_consensus.cc:359] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.501771 18718 raft_consensus.cc:385] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.502099 18718 raft_consensus.cc:740] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.502426 18719 raft_consensus.cc:359] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.503189 18719 raft_consensus.cc:385] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.502878 18718 consensus_queue.cc:260] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.503525 18719 raft_consensus.cc:740] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.504509 18719 consensus_queue.cc:260] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.507933 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c50cc36ba4ce999a28152a30f2c8a" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465" is_pre_election: true
I20260709 13:05:29.508898 18677 raft_consensus.cc:2468] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 0.
I20260709 13:05:29.519194 18719 ts_tablet_manager.cc:1434] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.005s
I20260709 13:05:29.521414 18678 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b99e130b0a4dd9a160ed19edfb1729 in term 1.
W20260709 13:05:29.521673 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:29.523293 18719 tablet_bootstrap.cc:492] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b: Bootstrap starting.
I20260709 13:05:29.517733 18567 leader_election.cc:304] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 
I20260709 13:05:29.527421 18725 raft_consensus.cc:2804] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.526080 18727 raft_consensus.cc:697] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 LEADER]: Becoming Leader. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Running, Role: LEADER
I20260709 13:05:29.527966 18725 raft_consensus.cc:493] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.528330 18725 raft_consensus.cc:3060] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.528533 18727 consensus_queue.cc:237] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:29.532328 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c50cc36ba4ce999a28152a30f2c8a" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729" is_pre_election: true
W20260709 13:05:29.534317 18567 leader_election.cc:343] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.525830 18718 ts_tablet_manager.cc:1434] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:05:29.542574 18725 raft_consensus.cc:515] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.544700 18719 tablet_bootstrap.cc:654] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.545373 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c50cc36ba4ce999a28152a30f2c8a" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
W20260709 13:05:29.547024 18567 leader_election.cc:343] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.548609 18725 leader_election.cc:290] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.549326 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6c50cc36ba4ce999a28152a30f2c8a" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:29.549578 18720 tablet_bootstrap.cc:492] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: No bootstrap required, opened a new log
I20260709 13:05:29.549932 18678 raft_consensus.cc:3060] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.550369 18720 ts_tablet_manager.cc:1403] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.118s	user 0.030s	sys 0.036s
I20260709 13:05:29.554627 18720 raft_consensus.cc:359] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.555449 18720 raft_consensus.cc:385] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.555763 18720 raft_consensus.cc:740] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.556564 18720 consensus_queue.cc:260] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.557462 18718 tablet_bootstrap.cc:492] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465: Bootstrap starting.
I20260709 13:05:29.556668 18426 catalog_manager.cc:5697] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "81b99e130b0a4dd9a160ed19edfb1729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.557520 18719 tablet_bootstrap.cc:492] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b: No bootstrap required, opened a new log
I20260709 13:05:29.558421 18719 ts_tablet_manager.cc:1403] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.002s
I20260709 13:05:29.558452 18678 raft_consensus.cc:2468] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 1.
I20260709 13:05:29.559841 18567 leader_election.cc:304] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 81b99e130b0a4dd9a160ed19edfb1729
I20260709 13:05:29.560994 18725 raft_consensus.cc:2804] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.561571 18719 raft_consensus.cc:359] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.562376 18719 raft_consensus.cc:385] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.562668 18719 raft_consensus.cc:740] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.563529 18719 consensus_queue.cc:260] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.564679 18718 tablet_bootstrap.cc:654] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.570808 18720 ts_tablet_manager.cc:1434] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 13:05:29.571453 18725 raft_consensus.cc:697] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Becoming Leader. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:29.572299 18720 tablet_bootstrap.cc:492] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:29.572393 18725 consensus_queue.cc:237] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.579581 18750 raft_consensus.cc:493] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.580054 18750 raft_consensus.cc:515] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.582912 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729" is_pre_election: true
I20260709 13:05:29.583561 18529 raft_consensus.cc:2468] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 0.
I20260709 13:05:29.584712 18567 leader_election.cc:304] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:29.585870 18720 tablet_bootstrap.cc:654] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.586565 18751 raft_consensus.cc:2804] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.587076 18751 raft_consensus.cc:493] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.587018 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465" is_pre_election: true
I20260709 13:05:29.587638 18750 leader_election.cc:290] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.587841 18678 raft_consensus.cc:2468] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 0.
I20260709 13:05:29.588905 18751 raft_consensus.cc:3060] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.590844 18719 ts_tablet_manager.cc:1434] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b: Time spent starting tablet: real 0.032s	user 0.021s	sys 0.008s
I20260709 13:05:29.590945 18718 tablet_bootstrap.cc:492] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465: No bootstrap required, opened a new log
I20260709 13:05:29.591605 18718 ts_tablet_manager.cc:1403] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.006s
I20260709 13:05:29.592092 18719 tablet_bootstrap.cc:492] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b: Bootstrap starting.
I20260709 13:05:29.594671 18718 raft_consensus.cc:359] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.595389 18718 raft_consensus.cc:385] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.596923 18718 raft_consensus.cc:740] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.597770 18718 consensus_queue.cc:260] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.598399 18751 raft_consensus.cc:515] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.599079 18719 tablet_bootstrap.cc:654] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.598829 18732 raft_consensus.cc:493] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.599556 18732 raft_consensus.cc:515] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.600492 18718 ts_tablet_manager.cc:1434] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:29.599920 18426 catalog_manager.cc:5697] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b reported cstate change: term changed from 0 to 1, leader changed from <none> to 16fae10ebb5640df8793296f7235a80b (127.7.41.194). New cstate: current_term: 1 leader_uuid: "16fae10ebb5640df8793296f7235a80b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.601727 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:29.602357 18529 raft_consensus.cc:3060] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.602524 18751 leader_election.cc:290] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.603475 18718 tablet_bootstrap.cc:492] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465: Bootstrap starting.
I20260709 13:05:29.603511 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:29.604097 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d5f24146c14596a7ca9287cd99f6b2" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729" is_pre_election: true
I20260709 13:05:29.604344 18678 raft_consensus.cc:3060] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:29.606001 18641 leader_election.cc:343] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.601874 18732 leader_election.cc:290] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:29.610361 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d5f24146c14596a7ca9287cd99f6b2" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b" is_pre_election: true
I20260709 13:05:29.610996 18718 tablet_bootstrap.cc:654] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.611008 18604 raft_consensus.cc:2468] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 0.
I20260709 13:05:29.612562 18642 leader_election.cc:304] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 81b99e130b0a4dd9a160ed19edfb1729
I20260709 13:05:29.614244 18732 raft_consensus.cc:2804] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.614315 18678 raft_consensus.cc:2468] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 1.
I20260709 13:05:29.614708 18732 raft_consensus.cc:493] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.615094 18732 raft_consensus.cc:3060] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.615679 18567 leader_election.cc:304] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 
I20260709 13:05:29.616633 18751 raft_consensus.cc:2804] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.617302 18751 raft_consensus.cc:697] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Becoming Leader. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:29.618211 18751 consensus_queue.cc:237] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.632892 18732 raft_consensus.cc:515] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.638576 18528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d5f24146c14596a7ca9287cd99f6b2" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:29.639281 18529 raft_consensus.cc:2468] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 1.
W20260709 13:05:29.639983 18641 leader_election.cc:343] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.643280 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d5f24146c14596a7ca9287cd99f6b2" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:29.644037 18604 raft_consensus.cc:3060] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.650233 18732 leader_election.cc:290] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:29.654656 18718 tablet_bootstrap.cc:492] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465: No bootstrap required, opened a new log
I20260709 13:05:29.655189 18718 ts_tablet_manager.cc:1403] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.033s
I20260709 13:05:29.655666 18604 raft_consensus.cc:2468] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 1.
I20260709 13:05:29.656638 18720 tablet_bootstrap.cc:492] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: No bootstrap required, opened a new log
I20260709 13:05:29.656926 18642 leader_election.cc:304] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 81b99e130b0a4dd9a160ed19edfb1729
I20260709 13:05:29.657227 18720 ts_tablet_manager.cc:1403] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.021s
I20260709 13:05:29.658162 18732 raft_consensus.cc:2804] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.658341 18718 raft_consensus.cc:359] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.659229 18718 raft_consensus.cc:385] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.658533 18426 catalog_manager.cc:5697] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b reported cstate change: term changed from 0 to 1, leader changed from <none> to 16fae10ebb5640df8793296f7235a80b (127.7.41.194). New cstate: current_term: 1 leader_uuid: "16fae10ebb5640df8793296f7235a80b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.659597 18732 raft_consensus.cc:697] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Becoming Leader. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:29.659691 18718 raft_consensus.cc:740] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.660667 18718 consensus_queue.cc:260] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.660740 18732 consensus_queue.cc:237] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.660862 18720 raft_consensus.cc:359] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.662199 18720 raft_consensus.cc:385] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.662568 18720 raft_consensus.cc:740] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.663100 18718 ts_tablet_manager.cc:1434] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:05:29.663228 18751 raft_consensus.cc:493] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.663846 18751 raft_consensus.cc:515] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.664101 18720 consensus_queue.cc:260] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.665992 18751 leader_election.cc:290] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.666613 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e152db3ede4bdcb0825dfee8950c10" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729" is_pre_election: true
I20260709 13:05:29.667073 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e152db3ede4bdcb0825dfee8950c10" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465" is_pre_election: true
I20260709 13:05:29.667215 18718 tablet_bootstrap.cc:492] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465: Bootstrap starting.
I20260709 13:05:29.667254 18529 raft_consensus.cc:2468] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 0.
W20260709 13:05:29.668668 18567 leader_election.cc:343] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.669471 18567 leader_election.cc:304] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 43ce3221884c4c00942a25c11309e465
I20260709 13:05:29.670585 18751 raft_consensus.cc:2804] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.670979 18751 raft_consensus.cc:493] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.671325 18751 raft_consensus.cc:3060] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.673785 18718 tablet_bootstrap.cc:654] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.680058 18751 raft_consensus.cc:515] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.680722 18719 tablet_bootstrap.cc:492] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b: No bootstrap required, opened a new log
I20260709 13:05:29.684173 18718 tablet_bootstrap.cc:492] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465: No bootstrap required, opened a new log
I20260709 13:05:29.684551 18719 ts_tablet_manager.cc:1403] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b: Time spent bootstrapping tablet: real 0.093s	user 0.028s	sys 0.003s
I20260709 13:05:29.684703 18718 ts_tablet_manager.cc:1403] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:05:29.685655 18751 leader_election.cc:290] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.680615 18427 catalog_manager.cc:5697] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43ce3221884c4c00942a25c11309e465 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "43ce3221884c4c00942a25c11309e465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.683925 18720 ts_tablet_manager.cc:1434] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:05:29.686802 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e152db3ede4bdcb0825dfee8950c10" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:29.687494 18718 raft_consensus.cc:359] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.688162 18718 raft_consensus.cc:385] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.688429 18718 raft_consensus.cc:740] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.688477 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e152db3ede4bdcb0825dfee8950c10" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:29.687354 18529 raft_consensus.cc:3060] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.689211 18718 consensus_queue.cc:260] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.690268 18720 tablet_bootstrap.cc:492] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:29.691556 18718 ts_tablet_manager.cc:1434] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:05:29.692512 18718 tablet_bootstrap.cc:492] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465: Bootstrap starting.
I20260709 13:05:29.696226 18529 raft_consensus.cc:2468] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 1.
I20260709 13:05:29.697377 18678 raft_consensus.cc:3060] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.697696 18718 tablet_bootstrap.cc:654] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.700371 18567 leader_election.cc:304] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:29.700490 18719 raft_consensus.cc:359] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.703045 18719 raft_consensus.cc:385] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.703241 18751 raft_consensus.cc:2804] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.703361 18719 raft_consensus.cc:740] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.703848 18751 raft_consensus.cc:697] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Becoming Leader. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:29.704162 18719 consensus_queue.cc:260] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.704696 18751 consensus_queue.cc:237] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.704974 18718 tablet_bootstrap.cc:492] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465: No bootstrap required, opened a new log
I20260709 13:05:29.697372 18720 tablet_bootstrap.cc:654] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.706943 18678 raft_consensus.cc:2468] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 1.
I20260709 13:05:29.701541 18732 raft_consensus.cc:493] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.708204 18719 ts_tablet_manager.cc:1434] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:05:29.708204 18732 raft_consensus.cc:515] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.709553 18719 tablet_bootstrap.cc:492] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b: Bootstrap starting.
I20260709 13:05:29.710453 18732 leader_election.cc:290] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:29.712001 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c82f4244fe497482983f0808315da6" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729" is_pre_election: true
I20260709 13:05:29.712347 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c82f4244fe497482983f0808315da6" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b" is_pre_election: true
I20260709 13:05:29.712994 18604 raft_consensus.cc:2468] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 0.
I20260709 13:05:29.705905 18718 ts_tablet_manager.cc:1403] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
W20260709 13:05:29.713572 18641 leader_election.cc:343] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.714341 18642 leader_election.cc:304] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 81b99e130b0a4dd9a160ed19edfb1729
I20260709 13:05:29.715435 18732 raft_consensus.cc:2804] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.715816 18732 raft_consensus.cc:493] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.716180 18732 raft_consensus.cc:3060] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.716950 18718 raft_consensus.cc:359] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.717483 18718 raft_consensus.cc:385] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.717700 18718 raft_consensus.cc:740] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.718763 18719 tablet_bootstrap.cc:654] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.718617 18718 consensus_queue.cc:260] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.721697 18718 ts_tablet_manager.cc:1434] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:29.724236 18720 tablet_bootstrap.cc:492] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: No bootstrap required, opened a new log
I20260709 13:05:29.724828 18720 ts_tablet_manager.cc:1403] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.005s
I20260709 13:05:29.727911 18720 raft_consensus.cc:359] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.728670 18720 raft_consensus.cc:385] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.729156 18720 raft_consensus.cc:740] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.728714 18427 catalog_manager.cc:5697] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b reported cstate change: term changed from 0 to 1, leader changed from <none> to 16fae10ebb5640df8793296f7235a80b (127.7.41.194). New cstate: current_term: 1 leader_uuid: "16fae10ebb5640df8793296f7235a80b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.730172 18720 consensus_queue.cc:260] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.732841 18720 ts_tablet_manager.cc:1434] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:05:29.733909 18720 tablet_bootstrap.cc:492] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:29.735472 18718 tablet_bootstrap.cc:492] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465: Bootstrap starting.
I20260709 13:05:29.740203 18720 tablet_bootstrap.cc:654] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.741516 18718 tablet_bootstrap.cc:654] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.747745 18719 tablet_bootstrap.cc:492] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b: No bootstrap required, opened a new log
I20260709 13:05:29.748329 18719 ts_tablet_manager.cc:1403] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.013s
I20260709 13:05:29.749924 18732 raft_consensus.cc:515] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.751798 18719 raft_consensus.cc:359] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.752753 18719 raft_consensus.cc:385] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.752821 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c82f4244fe497482983f0808315da6" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:29.753197 18719 raft_consensus.cc:740] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Initialized, Role: FOLLOWER
W20260709 13:05:29.754298 18641 leader_election.cc:343] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.755555 18719 consensus_queue.cc:260] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.758159 18719 ts_tablet_manager.cc:1434] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:05:29.758886 18732 leader_election.cc:290] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:29.759545 18719 tablet_bootstrap.cc:492] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b: Bootstrap starting.
I20260709 13:05:29.762741 18604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c82f4244fe497482983f0808315da6" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:29.763343 18604 raft_consensus.cc:3060] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.768193 18718 tablet_bootstrap.cc:492] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465: No bootstrap required, opened a new log
I20260709 13:05:29.768698 18718 ts_tablet_manager.cc:1403] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:05:29.769248 18720 tablet_bootstrap.cc:492] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: No bootstrap required, opened a new log
I20260709 13:05:29.769807 18720 ts_tablet_manager.cc:1403] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.019s
I20260709 13:05:29.771422 18604 raft_consensus.cc:2468] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 1.
I20260709 13:05:29.771468 18718 raft_consensus.cc:359] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.772315 18718 raft_consensus.cc:385] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.772627 18718 raft_consensus.cc:740] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.772730 18642 leader_election.cc:304] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 81b99e130b0a4dd9a160ed19edfb1729
I20260709 13:05:29.772871 18720 raft_consensus.cc:359] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.773790 18720 raft_consensus.cc:385] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.774174 18720 raft_consensus.cc:740] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.774323 18732 raft_consensus.cc:2804] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.774946 18719 tablet_bootstrap.cc:654] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.775211 18720 consensus_queue.cc:260] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.775581 18732 raft_consensus.cc:697] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Becoming Leader. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:29.773452 18718 consensus_queue.cc:260] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.778106 18720 ts_tablet_manager.cc:1434] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:05:29.778810 18718 ts_tablet_manager.cc:1434] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:29.779079 18720 tablet_bootstrap.cc:492] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:29.778966 18732 consensus_queue.cc:237] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.786980 18720 tablet_bootstrap.cc:654] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.787101 18719 tablet_bootstrap.cc:492] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b: No bootstrap required, opened a new log
I20260709 13:05:29.787637 18719 ts_tablet_manager.cc:1403] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.003s
I20260709 13:05:29.789839 18719 raft_consensus.cc:359] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.790585 18719 raft_consensus.cc:385] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.791076 18719 raft_consensus.cc:740] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.791957 18719 consensus_queue.cc:260] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.793177 18720 tablet_bootstrap.cc:492] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: No bootstrap required, opened a new log
I20260709 13:05:29.793648 18720 ts_tablet_manager.cc:1403] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:05:29.793823 18751 raft_consensus.cc:493] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.794423 18751 raft_consensus.cc:515] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.796518 18751 leader_election.cc:290] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.793959 18719 ts_tablet_manager.cc:1434] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:29.797915 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53fe657df6340a9955712c8731e389b" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465" is_pre_election: true
I20260709 13:05:29.798079 18720 raft_consensus.cc:359] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.797472 18424 catalog_manager.cc:5697] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43ce3221884c4c00942a25c11309e465 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "43ce3221884c4c00942a25c11309e465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.798743 18720 raft_consensus.cc:385] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.799621 18720 raft_consensus.cc:740] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.800258 18720 consensus_queue.cc:260] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.801847 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53fe657df6340a9955712c8731e389b" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729" is_pre_election: true
I20260709 13:05:29.802210 18720 ts_tablet_manager.cc:1434] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:29.802620 18529 raft_consensus.cc:2393] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16fae10ebb5640df8793296f7235a80b in current term 1: Already voted for candidate 43ce3221884c4c00942a25c11309e465 in this term.
I20260709 13:05:29.803438 18720 tablet_bootstrap.cc:492] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:29.803840 18567 leader_election.cc:304] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b; no voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729
I20260709 13:05:29.804993 18751 raft_consensus.cc:3060] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.809597 18720 tablet_bootstrap.cc:654] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.812706 18751 raft_consensus.cc:2749] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.817786 18720 tablet_bootstrap.cc:492] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: No bootstrap required, opened a new log
I20260709 13:05:29.818351 18720 ts_tablet_manager.cc:1403] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:05:29.820904 18720 raft_consensus.cc:359] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.821677 18720 raft_consensus.cc:385] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.821904 18720 raft_consensus.cc:740] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.822580 18720 consensus_queue.cc:260] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.823910 18720 ts_tablet_manager.cc:1434] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:05:29.824920 18720 tablet_bootstrap.cc:492] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:29.828838 18720 tablet_bootstrap.cc:654] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.832890 18720 tablet_bootstrap.cc:492] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: No bootstrap required, opened a new log
I20260709 13:05:29.832895 18751 raft_consensus.cc:493] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.833374 18720 ts_tablet_manager.cc:1403] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:05:29.833570 18751 raft_consensus.cc:515] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.835253 18751 leader_election.cc:290] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.836082 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6eab95ea4804591bb76f3e2cfb66a4d" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729" is_pre_election: true
I20260709 13:05:29.836370 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6eab95ea4804591bb76f3e2cfb66a4d" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465" is_pre_election: true
I20260709 13:05:29.836236 18720 raft_consensus.cc:359] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.836891 18529 raft_consensus.cc:2468] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 0.
I20260709 13:05:29.837030 18720 raft_consensus.cc:385] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.837095 18678 raft_consensus.cc:2468] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 0.
I20260709 13:05:29.837412 18720 raft_consensus.cc:740] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.837992 18567 leader_election.cc:304] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:29.838332 18720 consensus_queue.cc:260] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.838797 18751 raft_consensus.cc:2804] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.839221 18751 raft_consensus.cc:493] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.839514 18751 raft_consensus.cc:3060] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.840696 18720 ts_tablet_manager.cc:1434] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:05:29.846093 18751 raft_consensus.cc:515] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.847872 18751 leader_election.cc:290] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.848616 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6eab95ea4804591bb76f3e2cfb66a4d" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:29.848877 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6eab95ea4804591bb76f3e2cfb66a4d" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:29.849259 18529 raft_consensus.cc:3060] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.849413 18678 raft_consensus.cc:3060] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.852375 18732 consensus_queue.cc:1048] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.856041 18678 raft_consensus.cc:2468] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 1.
I20260709 13:05:29.856951 18529 raft_consensus.cc:2468] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 1.
I20260709 13:05:29.857262 18567 leader_election.cc:304] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 
I20260709 13:05:29.858150 18751 raft_consensus.cc:2804] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.858667 18751 raft_consensus.cc:697] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Becoming Leader. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:29.859525 18751 consensus_queue.cc:237] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.863998 18727 raft_consensus.cc:493] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.864722 18727 raft_consensus.cc:515] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.869508 18727 leader_election.cc:290] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.870338 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2ab41c55154d2391b80266f3a586b2" candidate_uuid: "81b99e130b0a4dd9a160ed19edfb1729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b" is_pre_election: true
I20260709 13:05:29.871152 18732 raft_consensus.cc:493] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.871711 18732 raft_consensus.cc:515] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.870635 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2ab41c55154d2391b80266f3a586b2" candidate_uuid: "81b99e130b0a4dd9a160ed19edfb1729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465" is_pre_election: true
I20260709 13:05:29.872726 18678 raft_consensus.cc:2468] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b99e130b0a4dd9a160ed19edfb1729 in term 0.
I20260709 13:05:29.874529 18492 leader_election.cc:304] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:29.875844 18727 raft_consensus.cc:2804] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.876144 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374d1ace655045148344cedc5cf8b497" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b" is_pre_election: true
I20260709 13:05:29.876411 18727 raft_consensus.cc:493] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.873831 18732 leader_election.cc:290] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:29.871186 18603 raft_consensus.cc:2468] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b99e130b0a4dd9a160ed19edfb1729 in term 0.
I20260709 13:05:29.876909 18727 raft_consensus.cc:3060] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.876919 18602 raft_consensus.cc:2468] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 0.
I20260709 13:05:29.880245 18642 leader_election.cc:304] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 
I20260709 13:05:29.881006 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374d1ace655045148344cedc5cf8b497" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729" is_pre_election: true
I20260709 13:05:29.881829 18723 raft_consensus.cc:2804] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.882400 18723 raft_consensus.cc:493] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.882174 18732 consensus_queue.cc:1048] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.882956 18723 raft_consensus.cc:3060] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.881750 18529 raft_consensus.cc:2468] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 0.
I20260709 13:05:29.889375 18426 catalog_manager.cc:5697] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b reported cstate change: term changed from 0 to 1, leader changed from <none> to 16fae10ebb5640df8793296f7235a80b (127.7.41.194). New cstate: current_term: 1 leader_uuid: "16fae10ebb5640df8793296f7235a80b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.895159 18727 raft_consensus.cc:515] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.895426 18723 raft_consensus.cc:515] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.898458 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2ab41c55154d2391b80266f3a586b2" candidate_uuid: "81b99e130b0a4dd9a160ed19edfb1729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:29.899092 18602 raft_consensus.cc:3060] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.899192 18723 leader_election.cc:290] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:29.902462 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374d1ace655045148344cedc5cf8b497" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:29.903203 18603 raft_consensus.cc:3060] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.903935 18727 leader_election.cc:290] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [CANDIDATE]: Term 1 election: Requested vote from peers 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.905021 18529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374d1ace655045148344cedc5cf8b497" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:29.905623 18529 raft_consensus.cc:3060] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.911650 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2ab41c55154d2391b80266f3a586b2" candidate_uuid: "81b99e130b0a4dd9a160ed19edfb1729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:29.912523 18678 raft_consensus.cc:3060] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.918594 18529 raft_consensus.cc:2468] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 1.
I20260709 13:05:29.919719 18641 leader_election.cc:304] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:29.920663 18678 raft_consensus.cc:2468] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b99e130b0a4dd9a160ed19edfb1729 in term 1.
I20260709 13:05:29.922106 18492 leader_election.cc:304] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:29.923244 18747 raft_consensus.cc:493] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.923220 18602 raft_consensus.cc:2468] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b99e130b0a4dd9a160ed19edfb1729 in term 1.
I20260709 13:05:29.924126 18775 raft_consensus.cc:2804] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.924005 18747 raft_consensus.cc:515] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.924043 18603 raft_consensus.cc:2468] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 1.
I20260709 13:05:29.925570 18775 raft_consensus.cc:697] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Becoming Leader. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:29.926721 18747 leader_election.cc:290] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:29.926563 18775 consensus_queue.cc:237] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.924005 18727 raft_consensus.cc:2804] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.928117 18727 raft_consensus.cc:697] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 LEADER]: Becoming Leader. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Running, Role: LEADER
I20260709 13:05:29.928700 18678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c82f4244fe497482983f0808315da6" candidate_uuid: "81b99e130b0a4dd9a160ed19edfb1729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465" is_pre_election: true
I20260709 13:05:29.929121 18727 consensus_queue.cc:237] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:29.930583 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c82f4244fe497482983f0808315da6" candidate_uuid: "81b99e130b0a4dd9a160ed19edfb1729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b" is_pre_election: true
I20260709 13:05:29.931440 18602 raft_consensus.cc:2393] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81b99e130b0a4dd9a160ed19edfb1729 in current term 1: Already voted for candidate 43ce3221884c4c00942a25c11309e465 in this term.
I20260709 13:05:29.932574 18493 leader_election.cc:304] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b99e130b0a4dd9a160ed19edfb1729; no voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465
I20260709 13:05:29.933341 18747 raft_consensus.cc:3060] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.938820 18424 catalog_manager.cc:5697] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43ce3221884c4c00942a25c11309e465 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "43ce3221884c4c00942a25c11309e465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.940024 18747 raft_consensus.cc:2749] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.942119 18426 catalog_manager.cc:5697] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "81b99e130b0a4dd9a160ed19edfb1729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.001595 18529 raft_consensus.cc:3060] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.003002 18747 consensus_queue.cc:1048] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.009827 18751 consensus_queue.cc:1048] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.010795 18725 consensus_queue.cc:1048] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.031921 18751 consensus_queue.cc:1048] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.049873 18783 consensus_queue.cc:1048] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.054976 18775 consensus_queue.cc:1048] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.060303 18751 consensus_queue.cc:1048] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.063126 18528 raft_consensus.cc:3060] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.079134 18775 consensus_queue.cc:1048] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.088107 18725 consensus_queue.cc:1048] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.105233 18751 consensus_queue.cc:1048] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.122627  7335 ts_manager.cc:295] Set tserver state for 81b99e130b0a4dd9a160ed19edfb1729 to MAINTENANCE_MODE
I20260709 13:05:30.123442  7335 tablet_server.cc:179] TabletServer@127.7.41.193:0 shutting down...
I20260709 13:05:30.142688  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:30.144192  7335 tablet_replica.cc:333] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: stopping tablet replica
I20260709 13:05:30.145017  7335 raft_consensus.cc:2243] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.145810  7335 pending_rounds.cc:70] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Trying to abort 1 pending ops.
I20260709 13:05:30.146096  7335 pending_rounds.cc:77] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635143401668608 op_type: NO_OP noop_request { }
I20260709 13:05:30.146497  7335 raft_consensus.cc:2889] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:30.146797  7335 raft_consensus.cc:2272] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.149233  7335 tablet_replica.cc:333] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: stopping tablet replica
I20260709 13:05:30.149808  7335 raft_consensus.cc:2243] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.150276  7335 raft_consensus.cc:2272] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.152701  7335 tablet_replica.cc:333] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: stopping tablet replica
I20260709 13:05:30.153263  7335 raft_consensus.cc:2243] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.153666  7335 raft_consensus.cc:2272] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.155577  7335 tablet_replica.cc:333] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: stopping tablet replica
I20260709 13:05:30.156138  7335 raft_consensus.cc:2243] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.156517  7335 raft_consensus.cc:2272] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.158506  7335 tablet_replica.cc:333] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: stopping tablet replica
I20260709 13:05:30.159044  7335 raft_consensus.cc:2243] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.159452  7335 raft_consensus.cc:2272] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.161840  7335 tablet_replica.cc:333] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: stopping tablet replica
I20260709 13:05:30.162443  7335 raft_consensus.cc:2243] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.162849  7335 raft_consensus.cc:2272] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.164858  7335 tablet_replica.cc:333] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: stopping tablet replica
I20260709 13:05:30.165373  7335 raft_consensus.cc:2243] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.165742  7335 raft_consensus.cc:2272] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.167616  7335 tablet_replica.cc:333] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: stopping tablet replica
I20260709 13:05:30.168125  7335 raft_consensus.cc:2243] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:30.168927  7335 raft_consensus.cc:2272] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.170902  7335 tablet_replica.cc:333] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: stopping tablet replica
I20260709 13:05:30.171396  7335 raft_consensus.cc:2243] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.171790  7335 raft_consensus.cc:2272] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.174304  7335 tablet_replica.cc:333] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: stopping tablet replica
I20260709 13:05:30.174772  7335 raft_consensus.cc:2243] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.175163  7335 raft_consensus.cc:2272] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.204094  7335 tablet_server.cc:196] TabletServer@127.7.41.193:0 shutdown complete.
W20260709 13:05:30.283289 18641 consensus_peers.cc:597] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.363543 18641 consensus_peers.cc:597] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.391624 18775 consensus_queue.cc:1048] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.405483 18751 consensus_queue.cc:1048] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:30.423509 18567 consensus_peers.cc:597] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:30.466536 18776 consensus_queue.cc:1048] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:30.471526 18641 consensus_peers.cc:597] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.513770 18567 consensus_peers.cc:597] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.522606 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:30.551144 18641 consensus_peers.cc:597] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.649546 18567 consensus_peers.cc:597] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:30.664814 18567 consensus_peers.cc:597] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:31.515425 18751 raft_consensus.cc:493] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81b99e130b0a4dd9a160ed19edfb1729)
I20260709 13:05:31.516259 18751 raft_consensus.cc:515] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:31.518503 18751 leader_election.cc:290] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769), 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055)
I20260709 13:05:31.519328 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "43ce3221884c4c00942a25c11309e465" is_pre_election: true
W20260709 13:05:31.523782 18567 leader_election.cc:336] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111)
W20260709 13:05:31.523988 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:31.524353 18567 leader_election.cc:304] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b; no voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729
I20260709 13:05:31.525067 18751 raft_consensus.cc:2749] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.555056 18776 raft_consensus.cc:493] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81b99e130b0a4dd9a160ed19edfb1729)
I20260709 13:05:31.555749 18776 raft_consensus.cc:515] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:31.557618 18776 leader_election.cc:290] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:31.558943 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b" is_pre_election: true
I20260709 13:05:31.559676 18602 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 1.
I20260709 13:05:31.561297 18642 leader_election.cc:304] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 
I20260709 13:05:31.562011 18776 raft_consensus.cc:2804] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:31.562137 18641 leader_election.cc:336] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111)
I20260709 13:05:31.562417 18776 raft_consensus.cc:493] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 81b99e130b0a4dd9a160ed19edfb1729)
I20260709 13:05:31.562796 18776 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.570346 18776 raft_consensus.cc:515] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:31.571941 18776 leader_election.cc:290] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:31.572965 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:31.573508 18602 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:31.575700 18641 leader_election.cc:336] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111)
I20260709 13:05:31.580247 18602 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 2.
I20260709 13:05:31.581386 18642 leader_election.cc:304] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 81b99e130b0a4dd9a160ed19edfb1729
I20260709 13:05:31.582276 18776 raft_consensus.cc:2804] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:31.583366 18776 raft_consensus.cc:697] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Becoming Leader. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:31.584693 18776 consensus_queue.cc:237] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:31.593504 18426 catalog_manager.cc:5697] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 reported cstate change: term changed from 1 to 2, leader changed from 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193) to 43ce3221884c4c00942a25c11309e465 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "43ce3221884c4c00942a25c11309e465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.658439 18776 raft_consensus.cc:493] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.659034 18776 raft_consensus.cc:515] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:31.660812 18776 leader_election.cc:290] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:31.661981 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2ab41c55154d2391b80266f3a586b2" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b" is_pre_election: true
I20260709 13:05:31.662858 18602 raft_consensus.cc:2468] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 1.
I20260709 13:05:31.663872 18642 leader_election.cc:304] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 
W20260709 13:05:31.664338 18641 leader_election.cc:336] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111)
I20260709 13:05:31.664554 18776 raft_consensus.cc:2804] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:31.665019 18776 raft_consensus.cc:493] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.665316 18776 raft_consensus.cc:3060] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.671790 18776 raft_consensus.cc:515] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:31.673413 18776 leader_election.cc:290] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:31.674626 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2ab41c55154d2391b80266f3a586b2" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:31.675215 18602 raft_consensus.cc:3060] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:31.677024 18641 leader_election.cc:336] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111)
I20260709 13:05:31.680678 18602 raft_consensus.cc:2468] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 2.
I20260709 13:05:31.681782 18642 leader_election.cc:304] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 43ce3221884c4c00942a25c11309e465; no voters: 81b99e130b0a4dd9a160ed19edfb1729
I20260709 13:05:31.682528 18776 raft_consensus.cc:2804] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:31.682933 18776 raft_consensus.cc:697] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Becoming Leader. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:31.683966 18776 consensus_queue.cc:237] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:31.690811 18426 catalog_manager.cc:5697] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 reported cstate change: term changed from 1 to 2, leader changed from 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193) to 43ce3221884c4c00942a25c11309e465 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "43ce3221884c4c00942a25c11309e465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:32.015202 18641 consensus_peers.cc:597] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:32.091992 18602 raft_consensus.cc:1275] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Refusing update from remote peer 43ce3221884c4c00942a25c11309e465: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:32.093351 18776 consensus_queue.cc:1048] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:32.231323 18641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111) [suppressed 85 similar messages]
I20260709 13:05:32.238121 18602 raft_consensus.cc:1275] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Refusing update from remote peer 43ce3221884c4c00942a25c11309e465: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:32.239472 18776 consensus_queue.cc:1048] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:32.253217 18641 consensus_peers.cc:597] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:32.525159 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:32.683314 18641 consensus_peers.cc:597] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:32.782723 18567 consensus_peers.cc:597] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:32.801227 18641 consensus_peers.cc:597] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:32.869845 18567 consensus_peers.cc:597] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:32.964283 18567 consensus_peers.cc:597] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:33.038367 18641 consensus_peers.cc:597] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:33.060467 18567 consensus_peers.cc:597] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:33.355541 18641 consensus_peers.cc:597] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:33.526188 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:34.527290 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:34.591251 18641 consensus_peers.cc:597] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:34.741748 18641 consensus_peers.cc:597] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:34.933888 18641 consensus_peers.cc:597] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:35.032248 18641 consensus_peers.cc:597] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:05:35.141085 18567 consensus_peers.cc:597] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:35.223436  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:35.231451 18818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:35.232177 18819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:35.233762 18821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:35.235280  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:35.236624  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:35.237026  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:35.237301  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602335237282 us; error 0 us; skew 500 ppm
I20260709 13:05:35.237951  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:35.241751  7335 webserver.cc:533] Webserver started at http://127.7.41.193:35011/ using document root <none> and password file <none>
I20260709 13:05:35.242293  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:35.242451  7335 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:05:35.246632  7335 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:35.250624 18826 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:35.251441  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:05:35.251782  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-0-root
uuid: "81b99e130b0a4dd9a160ed19edfb1729"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-fh5z"
I20260709 13:05:35.252183  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601985998407-7335-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:35.266146  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:35.267468  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:35.269045  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:35.272926 18833 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:05:35.327559  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:05:35.327889  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.056s	user 0.001s	sys 0.002s
I20260709 13:05:35.328197  7335 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:05:35.333271 18833 tablet_bootstrap.cc:492] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:35.347476 18833 tablet_bootstrap.cc:492] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.348543 18833 tablet_bootstrap.cc:492] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap complete.
I20260709 13:05:35.349236 18833 ts_tablet_manager.cc:1403] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:05:35.351388 18833 raft_consensus.cc:359] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.351859 18833 raft_consensus.cc:740] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.352506 18833 consensus_queue.cc:260] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.355197 18833 ts_tablet_manager.cc:1434] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:35.355888 18833 tablet_bootstrap.cc:492] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:35.368649 18833 tablet_bootstrap.cc:492] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.369091  7335 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:05:35.369477 18833 tablet_bootstrap.cc:492] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap complete.
I20260709 13:05:35.369491  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.041s	user 0.035s	sys 0.004s
I20260709 13:05:35.370271 18833 ts_tablet_manager.cc:1403] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:05:35.373027 18833 raft_consensus.cc:359] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.373773 18833 raft_consensus.cc:740] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.374756 18833 consensus_queue.cc:260] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.376996 18833 ts_tablet_manager.cc:1434] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
W20260709 13:05:35.377097 18567 consensus_peers.cc:597] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:35.377794 18833 tablet_bootstrap.cc:492] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:35.394747 18833 tablet_bootstrap.cc:492] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.395982 18833 tablet_bootstrap.cc:492] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap complete.
I20260709 13:05:35.396819 18833 ts_tablet_manager.cc:1403] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:05:35.400367 18833 raft_consensus.cc:359] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.401273 18833 raft_consensus.cc:740] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.402199 18833 consensus_queue.cc:260] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.404631 18833 ts_tablet_manager.cc:1434] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:35.405578 18833 tablet_bootstrap.cc:492] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:35.423213 18833 tablet_bootstrap.cc:492] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.424058 18833 tablet_bootstrap.cc:492] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap complete.
I20260709 13:05:35.424635 18833 ts_tablet_manager.cc:1403] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:05:35.427277 18833 raft_consensus.cc:359] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:35.428015 18833 raft_consensus.cc:740] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.428872 18833 consensus_queue.cc:260] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:35.431133 18833 ts_tablet_manager.cc:1434] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:35.431867 18833 tablet_bootstrap.cc:492] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:35.433277  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.193:43055
I20260709 13:05:35.433449 18894 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.193:43055 every 8 connection(s)
I20260709 13:05:35.446956  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:35.519253 18833 tablet_bootstrap.cc:492] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.520174 18833 tablet_bootstrap.cc:492] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap complete.
I20260709 13:05:35.521024 18833 ts_tablet_manager.cc:1403] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.089s	user 0.037s	sys 0.043s
I20260709 13:05:35.523764 18833 raft_consensus.cc:359] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.524361 18833 raft_consensus.cc:740] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.525034 18833 consensus_queue.cc:260] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.527586 18833 ts_tablet_manager.cc:1434] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
W20260709 13:05:35.528218 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:35.528831 18833 tablet_bootstrap.cc:492] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:35.530722 18677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76d5f24146c14596a7ca9287cd99f6b2"
dest_uuid: "43ce3221884c4c00942a25c11309e465"
mode: GRACEFUL
new_leader_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:50142
I20260709 13:05:35.531543 18677 raft_consensus.cc:606] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Received request to transfer leadership to TS 16fae10ebb5640df8793296f7235a80b
I20260709 13:05:35.532246 18895 heartbeater.cc:344] Connected to a master server at 127.7.41.254:38505
I20260709 13:05:35.532709 18895 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:35.533473 18895 heartbeater.cc:507] Master 127.7.41.254:38505 requested a full tablet report, sending...
I20260709 13:05:35.534534 18677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343"
dest_uuid: "43ce3221884c4c00942a25c11309e465"
mode: GRACEFUL
new_leader_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:50142
I20260709 13:05:35.535192 18677 raft_consensus.cc:606] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Received request to transfer leadership to TS 16fae10ebb5640df8793296f7235a80b
I20260709 13:05:35.536408  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:35.537086  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:35.537940  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:35.540727 18427 ts_manager.cc:194] Re-registered known tserver with Master: 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055)
I20260709 13:05:35.544095 18833 tablet_bootstrap.cc:492] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:05:35.545156 18833 tablet_bootstrap.cc:492] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap complete.
I20260709 13:05:35.545868 18833 ts_tablet_manager.cc:1403] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:05:35.548679 18833 raft_consensus.cc:359] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.549571 18833 raft_consensus.cc:740] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.550312 18833 consensus_queue.cc:260] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.552322 18833 ts_tablet_manager.cc:1434] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:35.552780 18427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42008
I20260709 13:05:35.553179 18833 tablet_bootstrap.cc:492] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:35.556291 18895 heartbeater.cc:499] Master 127.7.41.254:38505 was elected leader, sending a full tablet report...
I20260709 13:05:35.565222 18833 tablet_bootstrap.cc:492] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.566113 18833 tablet_bootstrap.cc:492] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap complete.
I20260709 13:05:35.566769 18833 ts_tablet_manager.cc:1403] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 13:05:35.569289 18833 raft_consensus.cc:359] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.570091 18833 raft_consensus.cc:740] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.570969 18833 consensus_queue.cc:260] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.572808 18833 ts_tablet_manager.cc:1434] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:35.573518 18833 tablet_bootstrap.cc:492] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:35.580525 18869 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:35.586930 18641 consensus_peers.cc:597] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:35.594895 18833 tablet_bootstrap.cc:492] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.595817 18833 tablet_bootstrap.cc:492] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap complete.
I20260709 13:05:35.596341 18833 ts_tablet_manager.cc:1403] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:05:35.598225 18833 raft_consensus.cc:359] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.598716 18833 raft_consensus.cc:740] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.599226 18833 consensus_queue.cc:260] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.600589 18833 ts_tablet_manager.cc:1434] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:35.601488 18833 tablet_bootstrap.cc:492] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:35.612216 18833 tablet_bootstrap.cc:492] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.612851 18833 tablet_bootstrap.cc:492] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap complete.
I20260709 13:05:35.613502 18833 ts_tablet_manager.cc:1403] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.012s	user 0.004s	sys 0.008s
I20260709 13:05:35.615291 18833 raft_consensus.cc:359] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.615900 18833 raft_consensus.cc:740] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.616461 18833 consensus_queue.cc:260] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.618139 18833 ts_tablet_manager.cc:1434] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:35.618808 18833 tablet_bootstrap.cc:492] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap starting.
I20260709 13:05:35.630793 18833 tablet_bootstrap.cc:492] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.631520 18833 tablet_bootstrap.cc:492] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: Bootstrap complete.
I20260709 13:05:35.632026 18833 ts_tablet_manager.cc:1403] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:05:35.633942 18833 raft_consensus.cc:359] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.634513 18833 raft_consensus.cc:740] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b99e130b0a4dd9a160ed19edfb1729, State: Initialized, Role: FOLLOWER
I20260709 13:05:35.635046 18833 consensus_queue.cc:260] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.636576 18833 ts_tablet_manager.cc:1434] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:35.661207 18912 raft_consensus.cc:993] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465: : Instructing follower 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:35.661861 18817 raft_consensus.cc:1081] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Signalling peer 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:35.663152 18869 raft_consensus.cc:3060] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.663520 18602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343"
dest_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:37062
I20260709 13:05:35.664160 18602 raft_consensus.cc:493] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:35.664443 18602 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.668969 18869 pending_rounds.cc:85] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Aborting all ops after (but not including) 0
I20260709 13:05:35.669346 18869 pending_rounds.cc:107] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:05:35.669636 18869 raft_consensus.cc:2889] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:35.669952 18602 raft_consensus.cc:515] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:35.672093 18602 leader_election.cc:290] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 3 election: Requested vote from peers 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769), 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055)
I20260709 13:05:35.673485 18868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:35.674683 18868 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.674844 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:35.675498 18677 raft_consensus.cc:3055] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:35.675818 18677 raft_consensus.cc:740] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:35.676657 18677 consensus_queue.cc:260] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:35.677879 18677 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.682484 18868 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 3.
I20260709 13:05:35.683812 18567 leader_election.cc:304] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:35.684594 18751 raft_consensus.cc:2804] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:35.685065 18751 raft_consensus.cc:697] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 3 LEADER]: Becoming Leader. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:35.685529 18677 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 3.
I20260709 13:05:35.685876 18751 consensus_queue.cc:237] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:35.692626 18427 catalog_manager.cc:5697] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b reported cstate change: term changed from 2 to 3, leader changed from 43ce3221884c4c00942a25c11309e465 (127.7.41.195) to 16fae10ebb5640df8793296f7235a80b (127.7.41.194). New cstate: current_term: 3 leader_uuid: "16fae10ebb5640df8793296f7235a80b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.775918 18911 raft_consensus.cc:993] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465: : Instructing follower 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:35.776419 18911 raft_consensus.cc:1081] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Signalling peer 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:35.777774 18602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76d5f24146c14596a7ca9287cd99f6b2"
dest_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:37062
I20260709 13:05:35.778343 18602 raft_consensus.cc:493] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:35.778647 18602 raft_consensus.cc:3060] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.784947 18602 raft_consensus.cc:515] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.786839 18602 leader_election.cc:290] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 2 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:35.787431 18868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d5f24146c14596a7ca9287cd99f6b2" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:35.787774 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d5f24146c14596a7ca9287cd99f6b2" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:35.788132 18868 raft_consensus.cc:3060] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.788390 18677 raft_consensus.cc:3055] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:35.788727 18677 raft_consensus.cc:740] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:35.789597 18677 consensus_queue.cc:260] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.791031 18677 raft_consensus.cc:3060] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.795631 18868 raft_consensus.cc:2468] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 2.
I20260709 13:05:35.796834 18567 leader_election.cc:304] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:35.797482 18751 raft_consensus.cc:2804] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:35.797930 18751 raft_consensus.cc:697] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 2 LEADER]: Becoming Leader. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:35.798235 18677 raft_consensus.cc:2468] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 2.
I20260709 13:05:35.798805 18751 consensus_queue.cc:237] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:35.805749 18427 catalog_manager.cc:5697] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b reported cstate change: term changed from 1 to 2, leader changed from 43ce3221884c4c00942a25c11309e465 (127.7.41.195) to 16fae10ebb5640df8793296f7235a80b (127.7.41.194). New cstate: current_term: 2 leader_uuid: "16fae10ebb5640df8793296f7235a80b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.180971 18677 raft_consensus.cc:1275] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:36.182269 18751 consensus_queue.cc:1048] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.191258 18868 raft_consensus.cc:1275] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:36.192821 18923 consensus_queue.cc:1048] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.378850 18677 raft_consensus.cc:1275] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:36.380250 18923 consensus_queue.cc:1048] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:36.389325 18869 raft_consensus.cc:1275] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:36.391782 18923 consensus_queue.cc:1048] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:36.529246 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:36.546047  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:36.563485 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e152db3ede4bdcb0825dfee8950c10"
dest_uuid: "16fae10ebb5640df8793296f7235a80b"
mode: GRACEFUL
new_leader_uuid: "43ce3221884c4c00942a25c11309e465"
 from {username='slave'} at 127.0.0.1:35076
I20260709 13:05:36.564024 18602 raft_consensus.cc:606] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Received request to transfer leadership to TS 43ce3221884c4c00942a25c11309e465
I20260709 13:05:36.566495 18602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343"
dest_uuid: "16fae10ebb5640df8793296f7235a80b"
mode: GRACEFUL
new_leader_uuid: "43ce3221884c4c00942a25c11309e465"
 from {username='slave'} at 127.0.0.1:35076
I20260709 13:05:36.567009 18602 raft_consensus.cc:606] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 3 LEADER]: Received request to transfer leadership to TS 43ce3221884c4c00942a25c11309e465
I20260709 13:05:36.568367  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:36.569020  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:36.569715  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:36.664978 18751 raft_consensus.cc:993] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b: : Instructing follower 43ce3221884c4c00942a25c11309e465 to start an election
I20260709 13:05:36.665413 18923 raft_consensus.cc:1081] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 3 LEADER]: Signalling peer 43ce3221884c4c00942a25c11309e465 to start an election
I20260709 13:05:36.666834 18677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343"
dest_uuid: "43ce3221884c4c00942a25c11309e465"
 from {username='slave'} at 127.0.0.1:37428
I20260709 13:05:36.667299 18677 raft_consensus.cc:493] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:36.667552 18677 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.672683 18677 raft_consensus.cc:515] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:36.674413 18677 leader_election.cc:290] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 4 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:36.675420 18869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:36.675669 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:36.676229 18869 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.676319 18602 raft_consensus.cc:3055] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:36.676859 18602 raft_consensus.cc:740] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:36.677745 18602 consensus_queue.cc:260] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:36.678858 18602 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.681852 18869 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 4.
I20260709 13:05:36.682931 18641 leader_election.cc:304] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:36.683601 18817 raft_consensus.cc:2804] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:36.684046 18817 raft_consensus.cc:697] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 4 LEADER]: Becoming Leader. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:36.684490 18602 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 4.
I20260709 13:05:36.684791 18817 consensus_queue.cc:237] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:36.690734 18427 catalog_manager.cc:5697] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 reported cstate change: term changed from 3 to 4, leader changed from 16fae10ebb5640df8793296f7235a80b (127.7.41.194) to 43ce3221884c4c00942a25c11309e465 (127.7.41.195). New cstate: current_term: 4 leader_uuid: "43ce3221884c4c00942a25c11309e465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.078657 18751 raft_consensus.cc:993] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b: : Instructing follower 43ce3221884c4c00942a25c11309e465 to start an election
I20260709 13:05:37.079250 18923 raft_consensus.cc:1081] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Signalling peer 43ce3221884c4c00942a25c11309e465 to start an election
I20260709 13:05:37.080786 18677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e152db3ede4bdcb0825dfee8950c10"
dest_uuid: "43ce3221884c4c00942a25c11309e465"
 from {username='slave'} at 127.0.0.1:37428
I20260709 13:05:37.081243 18677 raft_consensus.cc:493] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.081521 18677 raft_consensus.cc:3060] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.087047 18677 raft_consensus.cc:515] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:37.088711 18677 leader_election.cc:290] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:37.089514 18869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e152db3ede4bdcb0825dfee8950c10" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:37.089766 18602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e152db3ede4bdcb0825dfee8950c10" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:37.090164 18869 raft_consensus.cc:3060] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.090461 18602 raft_consensus.cc:3055] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.090786 18602 raft_consensus.cc:740] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:37.091576 18602 consensus_queue.cc:260] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:37.092586 18602 raft_consensus.cc:3060] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.095619 18869 raft_consensus.cc:2468] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 2.
I20260709 13:05:37.096861 18641 leader_election.cc:304] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:37.097609 18817 raft_consensus.cc:2804] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:37.097826 18602 raft_consensus.cc:2468] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 2.
I20260709 13:05:37.098059 18817 raft_consensus.cc:697] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Becoming Leader. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:37.099102 18817 consensus_queue.cc:237] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:37.105481 18427 catalog_manager.cc:5697] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 reported cstate change: term changed from 1 to 2, leader changed from 16fae10ebb5640df8793296f7235a80b (127.7.41.194) to 43ce3221884c4c00942a25c11309e465 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "43ce3221884c4c00942a25c11309e465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.198365 18603 raft_consensus.cc:1275] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 4 FOLLOWER]: Refusing update from remote peer 43ce3221884c4c00942a25c11309e465: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:37.199755 18817 consensus_queue.cc:1048] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:37.209585 18869 raft_consensus.cc:1275] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 4 FOLLOWER]: Refusing update from remote peer 43ce3221884c4c00942a25c11309e465: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:37.211301 18817 consensus_queue.cc:1048] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:37.505546 18603 raft_consensus.cc:1275] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Refusing update from remote peer 43ce3221884c4c00942a25c11309e465: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:37.506978 18817 consensus_queue.cc:1048] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:37.515974 18869 raft_consensus.cc:1275] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Refusing update from remote peer 43ce3221884c4c00942a25c11309e465: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:37.517738 18924 consensus_queue.cc:1048] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:37.530230 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:37.577204  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:37.584527 18677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374d1ace655045148344cedc5cf8b497"
dest_uuid: "43ce3221884c4c00942a25c11309e465"
mode: GRACEFUL
new_leader_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:50142
I20260709 13:05:37.585115 18677 raft_consensus.cc:606] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Received request to transfer leadership to TS 16fae10ebb5640df8793296f7235a80b
I20260709 13:05:37.587601 18677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343"
dest_uuid: "43ce3221884c4c00942a25c11309e465"
mode: GRACEFUL
new_leader_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:50142
I20260709 13:05:37.588078 18677 raft_consensus.cc:606] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 4 LEADER]: Received request to transfer leadership to TS 16fae10ebb5640df8793296f7235a80b
I20260709 13:05:37.589112  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:37.589584  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:37.590162  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:37.708806 18817 raft_consensus.cc:993] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465: : Instructing follower 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:37.709424 18817 raft_consensus.cc:1081] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Signalling peer 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:37.711155 18603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374d1ace655045148344cedc5cf8b497"
dest_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:37062
I20260709 13:05:37.711676 18603 raft_consensus.cc:493] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.712021 18603 raft_consensus.cc:3060] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.718335 18603 raft_consensus.cc:515] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:37.720075 18603 leader_election.cc:290] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 2 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:37.720870 18869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374d1ace655045148344cedc5cf8b497" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:37.721019 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374d1ace655045148344cedc5cf8b497" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:37.721618 18869 raft_consensus.cc:3060] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.721742 18677 raft_consensus.cc:3055] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.722261 18677 raft_consensus.cc:740] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:37.723223 18677 consensus_queue.cc:260] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:37.724900 18677 raft_consensus.cc:3060] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.727352 18869 raft_consensus.cc:2468] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 2.
I20260709 13:05:37.728390 18567 leader_election.cc:304] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:37.729091 18923 raft_consensus.cc:2804] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:37.730195 18923 raft_consensus.cc:697] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 2 LEADER]: Becoming Leader. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:37.731338 18923 consensus_queue.cc:237] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:37.732502 18677 raft_consensus.cc:2468] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 2.
I20260709 13:05:37.738905 18427 catalog_manager.cc:5697] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b reported cstate change: term changed from 1 to 2, leader changed from 43ce3221884c4c00942a25c11309e465 (127.7.41.195) to 16fae10ebb5640df8793296f7235a80b (127.7.41.194). New cstate: current_term: 2 leader_uuid: "16fae10ebb5640df8793296f7235a80b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.792148 18938 raft_consensus.cc:993] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465: : Instructing follower 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:37.792652 18817 raft_consensus.cc:1081] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 4 LEADER]: Signalling peer 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:37.794170 18603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343"
dest_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:37062
I20260709 13:05:37.794708 18603 raft_consensus.cc:493] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.795049 18603 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.800773 18603 raft_consensus.cc:515] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:37.802440 18603 leader_election.cc:290] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 5 election: Requested vote from peers 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769), 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055)
I20260709 13:05:37.803570 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:37.803892 18868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82672ebf6d4d64b07f23962f86b343" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:37.804282 18677 raft_consensus.cc:3055] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:37.804569 18868 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.804720 18677 raft_consensus.cc:740] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:37.805536 18677 consensus_queue.cc:260] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:37.806527 18677 raft_consensus.cc:3060] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.809706 18868 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 5.
I20260709 13:05:37.810789 18567 leader_election.cc:304] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:37.811522 18923 raft_consensus.cc:2804] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:37.811659 18677 raft_consensus.cc:2468] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 5.
I20260709 13:05:37.811981 18923 raft_consensus.cc:697] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 5 LEADER]: Becoming Leader. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:37.812940 18923 consensus_queue.cc:237] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } }
I20260709 13:05:37.818996 18427 catalog_manager.cc:5697] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b reported cstate change: term changed from 4 to 5, leader changed from 43ce3221884c4c00942a25c11309e465 (127.7.41.195) to 16fae10ebb5640df8793296f7235a80b (127.7.41.194). New cstate: current_term: 5 leader_uuid: "16fae10ebb5640df8793296f7235a80b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:38.199201 18677 raft_consensus.cc:1275] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 5 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:38.200400 18923 consensus_queue.cc:1048] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.212209 18868 raft_consensus.cc:1275] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 5 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:38.214301 18945 consensus_queue.cc:1048] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.215682 18677 raft_consensus.cc:1275] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.217257 18945 consensus_queue.cc:1048] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.236856 18869 raft_consensus.cc:1275] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.240206 18923 consensus_queue.cc:1048] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:38.531164 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:38.596534  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:38.604925 18603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374d1ace655045148344cedc5cf8b497"
dest_uuid: "16fae10ebb5640df8793296f7235a80b"
mode: GRACEFUL
new_leader_uuid: "43ce3221884c4c00942a25c11309e465"
 from {username='slave'} at 127.0.0.1:35076
I20260709 13:05:38.605396 18603 raft_consensus.cc:606] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 2 LEADER]: Received request to transfer leadership to TS 43ce3221884c4c00942a25c11309e465
I20260709 13:05:38.607792 18603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c"
dest_uuid: "16fae10ebb5640df8793296f7235a80b"
mode: GRACEFUL
new_leader_uuid: "43ce3221884c4c00942a25c11309e465"
 from {username='slave'} at 127.0.0.1:35076
I20260709 13:05:38.608218 18603 raft_consensus.cc:606] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Received request to transfer leadership to TS 43ce3221884c4c00942a25c11309e465
I20260709 13:05:38.609212  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:38.609638  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:38.610169  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:38.786787 18952 raft_consensus.cc:993] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b: : Instructing follower 43ce3221884c4c00942a25c11309e465 to start an election
I20260709 13:05:38.787261 18945 raft_consensus.cc:1081] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 2 LEADER]: Signalling peer 43ce3221884c4c00942a25c11309e465 to start an election
I20260709 13:05:38.788558 18677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374d1ace655045148344cedc5cf8b497"
dest_uuid: "43ce3221884c4c00942a25c11309e465"
 from {username='slave'} at 127.0.0.1:37428
I20260709 13:05:38.788975 18677 raft_consensus.cc:493] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:38.789201 18677 raft_consensus.cc:3060] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.793722 18677 raft_consensus.cc:515] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:38.795151 18677 leader_election.cc:290] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 3 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:38.796047 18868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374d1ace655045148344cedc5cf8b497" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:38.796155 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374d1ace655045148344cedc5cf8b497" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:38.796816 18868 raft_consensus.cc:3060] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.796921 18603 raft_consensus.cc:3055] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:38.797345 18603 raft_consensus.cc:740] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:38.798064 18603 consensus_queue.cc:260] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:38.799258 18603 raft_consensus.cc:3060] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.802421 18868 raft_consensus.cc:2468] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 3.
I20260709 13:05:38.803572 18641 leader_election.cc:304] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:38.804407 18817 raft_consensus.cc:2804] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:38.804579 18603 raft_consensus.cc:2468] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 3.
I20260709 13:05:38.805442 18817 raft_consensus.cc:697] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 3 LEADER]: Becoming Leader. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:38.806457 18817 consensus_queue.cc:237] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:38.812352 18426 catalog_manager.cc:5697] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 reported cstate change: term changed from 2 to 3, leader changed from 16fae10ebb5640df8793296f7235a80b (127.7.41.194) to 43ce3221884c4c00942a25c11309e465 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "43ce3221884c4c00942a25c11309e465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:38.976483 18952 raft_consensus.cc:993] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b: : Instructing follower 43ce3221884c4c00942a25c11309e465 to start an election
I20260709 13:05:38.976936 18945 raft_consensus.cc:1081] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Signalling peer 43ce3221884c4c00942a25c11309e465 to start an election
I20260709 13:05:38.978614 18677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c"
dest_uuid: "43ce3221884c4c00942a25c11309e465"
 from {username='slave'} at 127.0.0.1:37428
I20260709 13:05:38.979125 18677 raft_consensus.cc:493] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:38.979423 18677 raft_consensus.cc:3060] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.983966 18677 raft_consensus.cc:515] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:38.985345 18677 leader_election.cc:290] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 16fae10ebb5640df8793296f7235a80b (127.7.41.194:39821)
I20260709 13:05:38.986281 18868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:38.986447 18603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c" candidate_uuid: "43ce3221884c4c00942a25c11309e465" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16fae10ebb5640df8793296f7235a80b"
I20260709 13:05:38.987004 18868 raft_consensus.cc:3060] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.987063 18603 raft_consensus.cc:3055] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:38.987499 18603 raft_consensus.cc:740] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:38.988209 18603 consensus_queue.cc:260] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:38.989236 18603 raft_consensus.cc:3060] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:38.992342 18868 raft_consensus.cc:2468] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 2.
I20260709 13:05:38.993445 18641 leader_election.cc:304] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43ce3221884c4c00942a25c11309e465, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:38.994207 18817 raft_consensus.cc:2804] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:38.994678 18817 raft_consensus.cc:697] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Becoming Leader. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:38.995558 18817 consensus_queue.cc:237] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:38.995784 18603 raft_consensus.cc:2468] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43ce3221884c4c00942a25c11309e465 in term 2.
I20260709 13:05:39.004084 18426 catalog_manager.cc:5697] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 reported cstate change: term changed from 1 to 2, leader changed from 16fae10ebb5640df8793296f7235a80b (127.7.41.194) to 43ce3221884c4c00942a25c11309e465 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "43ce3221884c4c00942a25c11309e465" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.261459 18868 raft_consensus.cc:1275] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Refusing update from remote peer 43ce3221884c4c00942a25c11309e465: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:39.262801 18817 consensus_queue.cc:1048] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.272641 18603 raft_consensus.cc:1275] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Refusing update from remote peer 43ce3221884c4c00942a25c11309e465: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:39.274768 18958 consensus_queue.cc:1048] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.427515 18868 raft_consensus.cc:1275] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Refusing update from remote peer 43ce3221884c4c00942a25c11309e465: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.428674 18817 consensus_queue.cc:1048] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.437642 18603 raft_consensus.cc:1275] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Refusing update from remote peer 43ce3221884c4c00942a25c11309e465: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:39.439417 18970 consensus_queue.cc:1048] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:39.532058 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:39.616492  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:39.624264 18677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e2ab41c55154d2391b80266f3a586b2"
dest_uuid: "43ce3221884c4c00942a25c11309e465"
mode: GRACEFUL
new_leader_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:50142
I20260709 13:05:39.624802 18677 raft_consensus.cc:606] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Received request to transfer leadership to TS 16fae10ebb5640df8793296f7235a80b
I20260709 13:05:39.627127 18677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c"
dest_uuid: "43ce3221884c4c00942a25c11309e465"
mode: GRACEFUL
new_leader_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:50142
I20260709 13:05:39.627573 18677 raft_consensus.cc:606] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Received request to transfer leadership to TS 16fae10ebb5640df8793296f7235a80b
I20260709 13:05:39.628548  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:39.628999  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:39.629498  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:39.931174 18958 raft_consensus.cc:993] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465: : Instructing follower 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:39.931681 18817 raft_consensus.cc:1081] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Signalling peer 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:39.933099 18602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e2ab41c55154d2391b80266f3a586b2"
dest_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:37062
I20260709 13:05:39.933558 18602 raft_consensus.cc:493] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:39.933815 18602 raft_consensus.cc:3060] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.939929 18602 raft_consensus.cc:515] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:39.941352 18602 leader_election.cc:290] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 3 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:39.942178 18868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2ab41c55154d2391b80266f3a586b2" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:39.942488 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e2ab41c55154d2391b80266f3a586b2" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:39.942781 18868 raft_consensus.cc:3060] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.943138 18677 raft_consensus.cc:3055] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:39.943437 18677 raft_consensus.cc:740] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:39.944119 18677 consensus_queue.cc:260] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:39.945044 18677 raft_consensus.cc:3060] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:39.948213 18868 raft_consensus.cc:2468] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 3.
I20260709 13:05:39.949331 18567 leader_election.cc:304] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:39.949753 18677 raft_consensus.cc:2468] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 3.
I20260709 13:05:39.949993 18952 raft_consensus.cc:2804] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:39.951165 18952 raft_consensus.cc:697] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 3 LEADER]: Becoming Leader. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:39.952071 18952 consensus_queue.cc:237] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:39.958477 18426 catalog_manager.cc:5697] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b reported cstate change: term changed from 2 to 3, leader changed from 43ce3221884c4c00942a25c11309e465 (127.7.41.195) to 16fae10ebb5640df8793296f7235a80b (127.7.41.194). New cstate: current_term: 3 leader_uuid: "16fae10ebb5640df8793296f7235a80b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.005023 18958 raft_consensus.cc:993] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465: : Instructing follower 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:40.005559 18970 raft_consensus.cc:1081] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Signalling peer 16fae10ebb5640df8793296f7235a80b to start an election
I20260709 13:05:40.007174 18602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c"
dest_uuid: "16fae10ebb5640df8793296f7235a80b"
 from {username='slave'} at 127.0.0.1:37062
I20260709 13:05:40.007688 18602 raft_consensus.cc:493] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:40.008033 18602 raft_consensus.cc:3060] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.013211 18602 raft_consensus.cc:515] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:40.014628 18602 leader_election.cc:290] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 3 election: Requested vote from peers 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055), 43ce3221884c4c00942a25c11309e465 (127.7.41.195:39769)
I20260709 13:05:40.015514 18868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81b99e130b0a4dd9a160ed19edfb1729"
I20260709 13:05:40.015698 18677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae42f07ab964f43a2745d1ce1d8162c" candidate_uuid: "16fae10ebb5640df8793296f7235a80b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43ce3221884c4c00942a25c11309e465"
I20260709 13:05:40.016095 18868 raft_consensus.cc:3060] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.016252 18677 raft_consensus.cc:3055] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:40.016634 18677 raft_consensus.cc:740] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43ce3221884c4c00942a25c11309e465, State: Running, Role: LEADER
I20260709 13:05:40.017201 18677 consensus_queue.cc:260] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:40.018080 18677 raft_consensus.cc:3060] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:40.022413 18868 raft_consensus.cc:2468] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 3.
I20260709 13:05:40.023559 18567 leader_election.cc:304] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16fae10ebb5640df8793296f7235a80b, 81b99e130b0a4dd9a160ed19edfb1729; no voters: 
I20260709 13:05:40.024178 18677 raft_consensus.cc:2468] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16fae10ebb5640df8793296f7235a80b in term 3.
I20260709 13:05:40.024258 18952 raft_consensus.cc:2804] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:40.025015 18952 raft_consensus.cc:697] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 3 LEADER]: Becoming Leader. State: Replica: 16fae10ebb5640df8793296f7235a80b, State: Running, Role: LEADER
I20260709 13:05:40.025787 18952 consensus_queue.cc:237] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } }
I20260709 13:05:40.031477 18426 catalog_manager.cc:5697] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b reported cstate change: term changed from 2 to 3, leader changed from 43ce3221884c4c00942a25c11309e465 (127.7.41.195) to 16fae10ebb5640df8793296f7235a80b (127.7.41.194). New cstate: current_term: 3 leader_uuid: "16fae10ebb5640df8793296f7235a80b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16fae10ebb5640df8793296f7235a80b" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 39821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.456103 18868 raft_consensus.cc:1275] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:40.457634 18972 consensus_queue.cc:1048] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:40.459612 18677 raft_consensus.cc:1275] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:40.461026 18972 consensus_queue.cc:1048] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:40.532992 18475 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:40.545089 18868 raft_consensus.cc:1275] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:40.546929 18952 consensus_queue.cc:1048] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b99e130b0a4dd9a160ed19edfb1729" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.556254 18677 raft_consensus.cc:1275] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Refusing update from remote peer 16fae10ebb5640df8793296f7235a80b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:40.558435 18952 consensus_queue.cc:1048] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ce3221884c4c00942a25c11309e465" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 39769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.635327  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:40.663156  7335 tablet_server.cc:179] TabletServer@127.7.41.193:43055 shutting down...
I20260709 13:05:40.683234  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:40.683878  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:40.684474  7335 raft_consensus.cc:2243] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.684891  7335 raft_consensus.cc:2272] T c53fe657df6340a9955712c8731e389b P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.686880  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:40.687422  7335 raft_consensus.cc:2243] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.687840  7335 raft_consensus.cc:2272] T 76d5f24146c14596a7ca9287cd99f6b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.689601  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:40.690178  7335 raft_consensus.cc:2243] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.690601  7335 raft_consensus.cc:2272] T 374d1ace655045148344cedc5cf8b497 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.692337  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:40.692866  7335 raft_consensus.cc:2243] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.693265  7335 raft_consensus.cc:2272] T e6eab95ea4804591bb76f3e2cfb66a4d P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.694998  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:40.695510  7335 raft_consensus.cc:2243] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.695907  7335 raft_consensus.cc:2272] T 4e2ab41c55154d2391b80266f3a586b2 P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.698099  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:40.698662  7335 raft_consensus.cc:2243] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.699074  7335 raft_consensus.cc:2272] T ec82672ebf6d4d64b07f23962f86b343 P 81b99e130b0a4dd9a160ed19edfb1729 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.700858  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:40.701347  7335 raft_consensus.cc:2243] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.701742  7335 raft_consensus.cc:2272] T e9c82f4244fe497482983f0808315da6 P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.703545  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:40.704145  7335 raft_consensus.cc:2243] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.704558  7335 raft_consensus.cc:2272] T d1e152db3ede4bdcb0825dfee8950c10 P 81b99e130b0a4dd9a160ed19edfb1729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.706305  7335 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:40.706804  7335 raft_consensus.cc:2243] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.707228  7335 raft_consensus.cc:2272] T 8ae42f07ab964f43a2745d1ce1d8162c P 81b99e130b0a4dd9a160ed19edfb1729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.710245  7335 tablet_replica.cc:333] stopping tablet replica
W20260709 13:05:40.710641 18641 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 66 similar messages]
I20260709 13:05:40.710937  7335 raft_consensus.cc:2243] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.711458  7335 raft_consensus.cc:2272] T 5f6c50cc36ba4ce999a28152a30f2c8a P 81b99e130b0a4dd9a160ed19edfb1729 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:40.713604 18641 consensus_peers.cc:597] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:40.739778  7335 tablet_server.cc:196] TabletServer@127.7.41.193:43055 shutdown complete.
I20260709 13:05:40.758468  7335 tablet_server.cc:179] TabletServer@127.7.41.194:0 shutting down...
I20260709 13:05:40.785790  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:40.786633  7335 tablet_replica.cc:333] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b: stopping tablet replica
I20260709 13:05:40.787706  7335 raft_consensus.cc:2243] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.788748  7335 raft_consensus.cc:2272] T 4e2ab41c55154d2391b80266f3a586b2 P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.791860  7335 tablet_replica.cc:333] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b: stopping tablet replica
I20260709 13:05:40.792505  7335 raft_consensus.cc:2243] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.792936  7335 raft_consensus.cc:2272] T d1e152db3ede4bdcb0825dfee8950c10 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.794895  7335 tablet_replica.cc:333] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b: stopping tablet replica
I20260709 13:05:40.795411  7335 raft_consensus.cc:2243] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.796123  7335 raft_consensus.cc:2272] T 76d5f24146c14596a7ca9287cd99f6b2 P 16fae10ebb5640df8793296f7235a80b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.798221  7335 tablet_replica.cc:333] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b: stopping tablet replica
I20260709 13:05:40.798730  7335 raft_consensus.cc:2243] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.799088  7335 raft_consensus.cc:2272] T 374d1ace655045148344cedc5cf8b497 P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.801091  7335 tablet_replica.cc:333] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b: stopping tablet replica
I20260709 13:05:40.801600  7335 raft_consensus.cc:2243] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.802433  7335 raft_consensus.cc:2272] T e6eab95ea4804591bb76f3e2cfb66a4d P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.804601  7335 tablet_replica.cc:333] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b: stopping tablet replica
I20260709 13:05:40.805084  7335 raft_consensus.cc:2243] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.805785  7335 raft_consensus.cc:2272] T 5f6c50cc36ba4ce999a28152a30f2c8a P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.807860  7335 tablet_replica.cc:333] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b: stopping tablet replica
I20260709 13:05:40.808314  7335 raft_consensus.cc:2243] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.808678  7335 raft_consensus.cc:2272] T c53fe657df6340a9955712c8731e389b P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.810966  7335 tablet_replica.cc:333] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b: stopping tablet replica
I20260709 13:05:40.811482  7335 raft_consensus.cc:2243] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.811899  7335 raft_consensus.cc:2272] T e9c82f4244fe497482983f0808315da6 P 16fae10ebb5640df8793296f7235a80b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.814137  7335 tablet_replica.cc:333] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b: stopping tablet replica
I20260709 13:05:40.814623  7335 raft_consensus.cc:2243] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.815317  7335 raft_consensus.cc:2272] T ec82672ebf6d4d64b07f23962f86b343 P 16fae10ebb5640df8793296f7235a80b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.817269  7335 tablet_replica.cc:333] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b: stopping tablet replica
I20260709 13:05:40.817760  7335 raft_consensus.cc:2243] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.818573  7335 raft_consensus.cc:2272] T 8ae42f07ab964f43a2745d1ce1d8162c P 16fae10ebb5640df8793296f7235a80b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.849663  7335 tablet_server.cc:196] TabletServer@127.7.41.194:0 shutdown complete.
I20260709 13:05:40.906378  7335 tablet_server.cc:179] TabletServer@127.7.41.195:0 shutting down...
W20260709 13:05:40.924898 18641 consensus_peers.cc:597] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 -> Peer 81b99e130b0a4dd9a160ed19edfb1729 (127.7.41.193:43055): Couldn't send request to peer 81b99e130b0a4dd9a160ed19edfb1729. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43055: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:40.935328  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:40.936419  7335 tablet_replica.cc:333] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465: stopping tablet replica
I20260709 13:05:40.937913  7335 raft_consensus.cc:2243] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.938827  7335 raft_consensus.cc:2272] T 4e2ab41c55154d2391b80266f3a586b2 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.942844  7335 tablet_replica.cc:333] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465: stopping tablet replica
I20260709 13:05:40.943701  7335 raft_consensus.cc:2243] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.945235  7335 raft_consensus.cc:2272] T d1e152db3ede4bdcb0825dfee8950c10 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.947922  7335 tablet_replica.cc:333] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465: stopping tablet replica
I20260709 13:05:40.948661  7335 raft_consensus.cc:2243] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.950582  7335 raft_consensus.cc:2272] T 374d1ace655045148344cedc5cf8b497 P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.953188  7335 tablet_replica.cc:333] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465: stopping tablet replica
I20260709 13:05:40.953785  7335 raft_consensus.cc:2243] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.954412  7335 raft_consensus.cc:2272] T e6eab95ea4804591bb76f3e2cfb66a4d P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.956964  7335 tablet_replica.cc:333] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465: stopping tablet replica
I20260709 13:05:40.957710  7335 raft_consensus.cc:2243] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.958392  7335 raft_consensus.cc:2272] T 8ae42f07ab964f43a2745d1ce1d8162c P 43ce3221884c4c00942a25c11309e465 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.961768  7335 tablet_replica.cc:333] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465: stopping tablet replica
I20260709 13:05:40.962438  7335 raft_consensus.cc:2243] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.963063  7335 raft_consensus.cc:2272] T 76d5f24146c14596a7ca9287cd99f6b2 P 43ce3221884c4c00942a25c11309e465 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.965610  7335 tablet_replica.cc:333] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465: stopping tablet replica
I20260709 13:05:40.966212  7335 raft_consensus.cc:2243] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.967427  7335 raft_consensus.cc:2272] T e9c82f4244fe497482983f0808315da6 P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.970078  7335 tablet_replica.cc:333] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465: stopping tablet replica
I20260709 13:05:40.970686  7335 raft_consensus.cc:2243] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.971273  7335 raft_consensus.cc:2272] T ec82672ebf6d4d64b07f23962f86b343 P 43ce3221884c4c00942a25c11309e465 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.973874  7335 tablet_replica.cc:333] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465: stopping tablet replica
I20260709 13:05:40.974462  7335 raft_consensus.cc:2243] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.975069  7335 raft_consensus.cc:2272] T 5f6c50cc36ba4ce999a28152a30f2c8a P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.977456  7335 tablet_replica.cc:333] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465: stopping tablet replica
I20260709 13:05:40.977996  7335 raft_consensus.cc:2243] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:40.979473  7335 raft_consensus.cc:2272] T c53fe657df6340a9955712c8731e389b P 43ce3221884c4c00942a25c11309e465 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.014183  7335 tablet_server.cc:196] TabletServer@127.7.41.195:0 shutdown complete.
I20260709 13:05:41.047840  7335 master.cc:562] Master@127.7.41.254:38505 shutting down...
I20260709 13:05:41.072685  7335 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:41.073438  7335 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:41.073808  7335 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0fa99111c128473b9df1828d477cec92: stopping tablet replica
I20260709 13:05:41.093986  7335 master.cc:584] Master@127.7.41.254:38505 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12746 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:05:41.144070  7335 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.41.254:39277
I20260709 13:05:41.145159  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:41.150813 18991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.150820 18992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.153977 18994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.153944  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:41.155320  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:41.155539  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:41.155701  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602341155683 us; error 0 us; skew 500 ppm
I20260709 13:05:41.156239  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:41.159127  7335 webserver.cc:533] Webserver started at http://127.7.41.254:45501/ using document root <none> and password file <none>
I20260709 13:05:41.159639  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:41.159842  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:41.160131  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:41.161439  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/master-0-root/instance:
uuid: "586c1106b5aa4aa7bd53a34938ac3fa8"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-fh5z"
I20260709 13:05:41.165987  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:05:41.169405 18999 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.170197  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:41.170487  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/master-0-root
uuid: "586c1106b5aa4aa7bd53a34938ac3fa8"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-fh5z"
I20260709 13:05:41.170761  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:41.187786  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:41.189010  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:41.228616  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.254:39277
I20260709 13:05:41.228721 19050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.254:39277 every 8 connection(s)
I20260709 13:05:41.232663 19051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.245620 19051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8: Bootstrap starting.
I20260709 13:05:41.250679 19051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.255174 19051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8: No bootstrap required, opened a new log
I20260709 13:05:41.257508 19051 raft_consensus.cc:359] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586c1106b5aa4aa7bd53a34938ac3fa8" member_type: VOTER }
I20260709 13:05:41.258005 19051 raft_consensus.cc:385] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.258271 19051 raft_consensus.cc:740] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 586c1106b5aa4aa7bd53a34938ac3fa8, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.258915 19051 consensus_queue.cc:260] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586c1106b5aa4aa7bd53a34938ac3fa8" member_type: VOTER }
I20260709 13:05:41.259419 19051 raft_consensus.cc:399] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:41.259675 19051 raft_consensus.cc:493] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:41.259982 19051 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.265106 19051 raft_consensus.cc:515] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586c1106b5aa4aa7bd53a34938ac3fa8" member_type: VOTER }
I20260709 13:05:41.265638 19051 leader_election.cc:304] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 586c1106b5aa4aa7bd53a34938ac3fa8; no voters: 
I20260709 13:05:41.266768 19051 leader_election.cc:290] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:41.267185 19054 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.268579 19054 raft_consensus.cc:697] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 1 LEADER]: Becoming Leader. State: Replica: 586c1106b5aa4aa7bd53a34938ac3fa8, State: Running, Role: LEADER
I20260709 13:05:41.269340 19054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586c1106b5aa4aa7bd53a34938ac3fa8" member_type: VOTER }
I20260709 13:05:41.269888 19051 sys_catalog.cc:565] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:41.272460 19056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 586c1106b5aa4aa7bd53a34938ac3fa8. Latest consensus state: current_term: 1 leader_uuid: "586c1106b5aa4aa7bd53a34938ac3fa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586c1106b5aa4aa7bd53a34938ac3fa8" member_type: VOTER } }
I20260709 13:05:41.272433 19055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "586c1106b5aa4aa7bd53a34938ac3fa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586c1106b5aa4aa7bd53a34938ac3fa8" member_type: VOTER } }
I20260709 13:05:41.273254 19056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:41.273324 19055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:41.277570 19061 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:41.285724 19061 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:41.286687  7335 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:41.294981 19061 catalog_manager.cc:1383] Generated new cluster ID: aa4e6f48a051404c88ca790c457f5f33
I20260709 13:05:41.295234 19061 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:41.307627 19061 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:41.308990 19061 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:41.325492 19061 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8: Generated new TSK 0
I20260709 13:05:41.326184 19061 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:41.353405  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:41.360918 19072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.361210 19073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.362277 19075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.363736  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:41.364861  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:41.365088  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:41.365321  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602341365279 us; error 0 us; skew 500 ppm
I20260709 13:05:41.365957  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:41.368643  7335 webserver.cc:533] Webserver started at http://127.7.41.193:41643/ using document root <none> and password file <none>
I20260709 13:05:41.369290  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:41.369503  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:41.369829  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:41.371236  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-0-root/instance:
uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-fh5z"
I20260709 13:05:41.376513  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:41.380214 19080 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.381091  7335 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:05:41.381386  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-0-root
uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-fh5z"
I20260709 13:05:41.381675  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:41.404678  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:41.405987  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:41.407483  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:41.409744  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:41.409924  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.410291  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:41.410477  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.452530  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.193:40373
I20260709 13:05:41.452628 19142 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.193:40373 every 8 connection(s)
I20260709 13:05:41.458503  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:41.466979 19147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.467782 19148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.473290 19150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.473735  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:41.473989 19143 heartbeater.cc:344] Connected to a master server at 127.7.41.254:39277
I20260709 13:05:41.474539 19143 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:41.474995  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:41.475243  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:41.475353 19143 heartbeater.cc:507] Master 127.7.41.254:39277 requested a full tablet report, sending...
I20260709 13:05:41.475525  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602341475501 us; error 0 us; skew 500 ppm
I20260709 13:05:41.476275  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:41.477980 19016 ts_manager.cc:194] Registered new tserver with Master: cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193:40373)
I20260709 13:05:41.479321  7335 webserver.cc:533] Webserver started at http://127.7.41.194:35145/ using document root <none> and password file <none>
I20260709 13:05:41.479934  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:41.480182  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:41.480232 19016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52228
I20260709 13:05:41.480535  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:41.482237  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-1-root/instance:
uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-fh5z"
I20260709 13:05:41.487288  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:41.490757 19155 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.491643  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:41.491990  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-1-root
uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-fh5z"
I20260709 13:05:41.492323  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:41.524437  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:41.525674  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:41.527220  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:41.529386  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:41.529616  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.529853  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:41.530027  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.570520  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.194:36635
I20260709 13:05:41.570627 19217 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.194:36635 every 8 connection(s)
I20260709 13:05:41.575591  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:41.583122 19221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:41.584514 19222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.587883  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:41.588482 19218 heartbeater.cc:344] Connected to a master server at 127.7.41.254:39277
I20260709 13:05:41.588972 19218 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:41.589682 19218 heartbeater.cc:507] Master 127.7.41.254:39277 requested a full tablet report, sending...
W20260709 13:05:41.587772 19224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:41.590909  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:41.591157  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:41.591344  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602341591321 us; error 0 us; skew 500 ppm
I20260709 13:05:41.592056  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:41.592083 19016 ts_manager.cc:194] Registered new tserver with Master: 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194:36635)
I20260709 13:05:41.594156 19016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52242
I20260709 13:05:41.595098  7335 webserver.cc:533] Webserver started at http://127.7.41.195:39131/ using document root <none> and password file <none>
I20260709 13:05:41.595804  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:41.596064  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:41.596401  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:41.597713  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-2-root/instance:
uuid: "7402c031ca6d4119b24cb3930ac9abaf"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-fh5z"
I20260709 13:05:41.602233  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:05:41.605464 19229 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.606383  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:41.606632  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-2-root
uuid: "7402c031ca6d4119b24cb3930ac9abaf"
format_stamp: "Formatted at 2026-07-09 13:05:41 on dist-test-slave-fh5z"
I20260709 13:05:41.606863  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601985998407-7335-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:41.637063  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:41.638257  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:41.639678  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:41.641898  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:41.642151  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.642459  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:41.642602  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:41.685341  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.195:37457
I20260709 13:05:41.685456 19291 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.195:37457 every 8 connection(s)
I20260709 13:05:41.699791 19292 heartbeater.cc:344] Connected to a master server at 127.7.41.254:39277
I20260709 13:05:41.700217 19292 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:41.700977 19292 heartbeater.cc:507] Master 127.7.41.254:39277 requested a full tablet report, sending...
I20260709 13:05:41.703136 19016 ts_manager.cc:194] Registered new tserver with Master: 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195:37457)
I20260709 13:05:41.703400  7335 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014819197s
I20260709 13:05:41.704674 19016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44682
I20260709 13:05:41.729661 19016 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44690:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:41.731877 19016 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:41.775182 19257 tablet_service.cc:1511] Processing CreateTablet for tablet 655ee07b56034f1f86a7d3c485702280 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f224ecc4d1a24f4c9d91a691bf51f614]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:41.776257 19256 tablet_service.cc:1511] Processing CreateTablet for tablet e519f671f2b640e7846de0e642eaed42 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f224ecc4d1a24f4c9d91a691bf51f614]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:41.776727 19257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 655ee07b56034f1f86a7d3c485702280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.777611 19256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e519f671f2b640e7846de0e642eaed42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.787830 19183 tablet_service.cc:1511] Processing CreateTablet for tablet 655ee07b56034f1f86a7d3c485702280 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f224ecc4d1a24f4c9d91a691bf51f614]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:41.788635 19182 tablet_service.cc:1511] Processing CreateTablet for tablet e519f671f2b640e7846de0e642eaed42 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f224ecc4d1a24f4c9d91a691bf51f614]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:41.789366 19183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 655ee07b56034f1f86a7d3c485702280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.790537 19107 tablet_service.cc:1511] Processing CreateTablet for tablet e519f671f2b640e7846de0e642eaed42 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f224ecc4d1a24f4c9d91a691bf51f614]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:41.791715 19107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e519f671f2b640e7846de0e642eaed42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.794641 19108 tablet_service.cc:1511] Processing CreateTablet for tablet 655ee07b56034f1f86a7d3c485702280 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f224ecc4d1a24f4c9d91a691bf51f614]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:41.795696 19108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 655ee07b56034f1f86a7d3c485702280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.798408 19182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e519f671f2b640e7846de0e642eaed42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.810505 19306 tablet_bootstrap.cc:492] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf: Bootstrap starting.
I20260709 13:05:41.814581 19307 tablet_bootstrap.cc:492] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a: Bootstrap starting.
I20260709 13:05:41.818888 19306 tablet_bootstrap.cc:654] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.821455 19307 tablet_bootstrap.cc:654] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.829991 19308 tablet_bootstrap.cc:492] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56: Bootstrap starting.
I20260709 13:05:41.835572 19306 tablet_bootstrap.cc:492] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf: No bootstrap required, opened a new log
I20260709 13:05:41.836376 19306 ts_tablet_manager.cc:1403] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.000s
I20260709 13:05:41.838011 19308 tablet_bootstrap.cc:654] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.838537 19307 tablet_bootstrap.cc:492] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a: No bootstrap required, opened a new log
I20260709 13:05:41.839046 19307 ts_tablet_manager.cc:1403] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.016s
I20260709 13:05:41.839540 19306 raft_consensus.cc:359] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:41.840353 19306 raft_consensus.cc:385] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.840660 19306 raft_consensus.cc:740] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7402c031ca6d4119b24cb3930ac9abaf, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.841521 19306 consensus_queue.cc:260] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:41.842090 19307 raft_consensus.cc:359] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:41.842815 19308 tablet_bootstrap.cc:492] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56: No bootstrap required, opened a new log
I20260709 13:05:41.842939 19307 raft_consensus.cc:385] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.843465 19308 ts_tablet_manager.cc:1403] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:05:41.844213 19292 heartbeater.cc:499] Master 127.7.41.254:39277 was elected leader, sending a full tablet report...
I20260709 13:05:41.844645 19306 ts_tablet_manager.cc:1434] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:41.845618 19306 tablet_bootstrap.cc:492] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf: Bootstrap starting.
I20260709 13:05:41.843488 19307 raft_consensus.cc:740] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01d88baf00b54ee8acd67bbafaf99c7a, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.846073 19308 raft_consensus.cc:359] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:41.846817 19308 raft_consensus.cc:385] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.847307 19308 raft_consensus.cc:740] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd74deeb8e1a4f4a856f34f5f63f9a56, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.846762 19307 consensus_queue.cc:260] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:41.848219 19308 consensus_queue.cc:260] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:41.854826 19306 tablet_bootstrap.cc:654] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.859586 19307 ts_tablet_manager.cc:1434] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.015s
I20260709 13:05:41.859740 19218 heartbeater.cc:499] Master 127.7.41.254:39277 was elected leader, sending a full tablet report...
I20260709 13:05:41.860122 19308 ts_tablet_manager.cc:1434] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.007s
I20260709 13:05:41.859799 19143 heartbeater.cc:499] Master 127.7.41.254:39277 was elected leader, sending a full tablet report...
I20260709 13:05:41.860821 19307 tablet_bootstrap.cc:492] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a: Bootstrap starting.
I20260709 13:05:41.861161 19308 tablet_bootstrap.cc:492] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56: Bootstrap starting.
I20260709 13:05:41.867719 19307 tablet_bootstrap.cc:654] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.869369 19306 tablet_bootstrap.cc:492] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf: No bootstrap required, opened a new log
I20260709 13:05:41.869997 19306 ts_tablet_manager.cc:1403] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.009s
I20260709 13:05:41.867717 19308 tablet_bootstrap.cc:654] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:41.876881 19306 raft_consensus.cc:359] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:41.877710 19306 raft_consensus.cc:385] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.878085 19306 raft_consensus.cc:740] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7402c031ca6d4119b24cb3930ac9abaf, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.878958 19306 consensus_queue.cc:260] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:41.881496 19307 tablet_bootstrap.cc:492] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a: No bootstrap required, opened a new log
I20260709 13:05:41.881910 19306 ts_tablet_manager.cc:1434] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:41.882158 19307 ts_tablet_manager.cc:1403] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.002s
I20260709 13:05:41.882225 19308 tablet_bootstrap.cc:492] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56: No bootstrap required, opened a new log
I20260709 13:05:41.882900 19308 ts_tablet_manager.cc:1403] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 13:05:41.885674 19308 raft_consensus.cc:359] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:41.885545 19307 raft_consensus.cc:359] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:41.886547 19308 raft_consensus.cc:385] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.886627 19307 raft_consensus.cc:385] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:41.887066 19307 raft_consensus.cc:740] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01d88baf00b54ee8acd67bbafaf99c7a, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.886977 19308 raft_consensus.cc:740] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd74deeb8e1a4f4a856f34f5f63f9a56, State: Initialized, Role: FOLLOWER
I20260709 13:05:41.888052 19307 consensus_queue.cc:260] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:41.888226 19308 consensus_queue.cc:260] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:41.890161 19307 ts_tablet_manager.cc:1434] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:41.891038 19308 ts_tablet_manager.cc:1434] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:41.895371 19312 raft_consensus.cc:493] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.895927 19312 raft_consensus.cc:515] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:41.898707 19312 leader_election.cc:290] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194:36635), cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193:40373)
I20260709 13:05:41.911887 19193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655ee07b56034f1f86a7d3c485702280" candidate_uuid: "7402c031ca6d4119b24cb3930ac9abaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" is_pre_election: true
I20260709 13:05:41.912657 19193 raft_consensus.cc:2468] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7402c031ca6d4119b24cb3930ac9abaf in term 0.
I20260709 13:05:41.913982 19232 leader_election.cc:304] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, 7402c031ca6d4119b24cb3930ac9abaf; no voters: 
I20260709 13:05:41.914921 19312 raft_consensus.cc:2804] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.915247 19312 raft_consensus.cc:493] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.915576 19312 raft_consensus.cc:3060] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.916458 19118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655ee07b56034f1f86a7d3c485702280" candidate_uuid: "7402c031ca6d4119b24cb3930ac9abaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" is_pre_election: true
I20260709 13:05:41.917084 19118 raft_consensus.cc:2468] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7402c031ca6d4119b24cb3930ac9abaf in term 0.
I20260709 13:05:41.921466 19312 raft_consensus.cc:515] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:41.921859 19319 raft_consensus.cc:493] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.922452 19319 raft_consensus.cc:515] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:41.923455 19312 leader_election.cc:290] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [CANDIDATE]: Term 1 election: Requested vote from peers 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194:36635), cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193:40373)
I20260709 13:05:41.924139 19193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655ee07b56034f1f86a7d3c485702280" candidate_uuid: "7402c031ca6d4119b24cb3930ac9abaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
I20260709 13:05:41.924319 19319 leader_election.cc:290] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193:40373), 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194:36635)
I20260709 13:05:41.924427 19118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655ee07b56034f1f86a7d3c485702280" candidate_uuid: "7402c031ca6d4119b24cb3930ac9abaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
I20260709 13:05:41.924753 19193 raft_consensus.cc:3060] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.925110 19118 raft_consensus.cc:3060] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.925406 19117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519f671f2b640e7846de0e642eaed42" candidate_uuid: "7402c031ca6d4119b24cb3930ac9abaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" is_pre_election: true
I20260709 13:05:41.926148 19117 raft_consensus.cc:2468] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7402c031ca6d4119b24cb3930ac9abaf in term 0.
I20260709 13:05:41.926295 19192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519f671f2b640e7846de0e642eaed42" candidate_uuid: "7402c031ca6d4119b24cb3930ac9abaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" is_pre_election: true
I20260709 13:05:41.927057 19192 raft_consensus.cc:2468] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7402c031ca6d4119b24cb3930ac9abaf in term 0.
I20260709 13:05:41.928514 19232 leader_election.cc:304] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, 7402c031ca6d4119b24cb3930ac9abaf; no voters: 
I20260709 13:05:41.929311 19319 raft_consensus.cc:2804] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:41.929706 19319 raft_consensus.cc:493] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.930055 19319 raft_consensus.cc:3060] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.932123 19118 raft_consensus.cc:2468] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7402c031ca6d4119b24cb3930ac9abaf in term 1.
I20260709 13:05:41.932303 19193 raft_consensus.cc:2468] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7402c031ca6d4119b24cb3930ac9abaf in term 1.
I20260709 13:05:41.933135 19232 leader_election.cc:304] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7402c031ca6d4119b24cb3930ac9abaf, cd74deeb8e1a4f4a856f34f5f63f9a56; no voters: 
I20260709 13:05:41.933795 19312 raft_consensus.cc:2804] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.935070 19312 raft_consensus.cc:697] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 LEADER]: Becoming Leader. State: Replica: 7402c031ca6d4119b24cb3930ac9abaf, State: Running, Role: LEADER
I20260709 13:05:41.935930 19312 consensus_queue.cc:237] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:41.937821 19319 raft_consensus.cc:515] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:41.940142 19319 leader_election.cc:290] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [CANDIDATE]: Term 1 election: Requested vote from peers cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193:40373), 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194:36635)
I20260709 13:05:41.941809 19118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519f671f2b640e7846de0e642eaed42" candidate_uuid: "7402c031ca6d4119b24cb3930ac9abaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
I20260709 13:05:41.941996 19193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519f671f2b640e7846de0e642eaed42" candidate_uuid: "7402c031ca6d4119b24cb3930ac9abaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
I20260709 13:05:41.942530 19118 raft_consensus.cc:3060] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.942659 19193 raft_consensus.cc:3060] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:41.944520 19016 catalog_manager.cc:5697] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195). New cstate: current_term: 1 leader_uuid: "7402c031ca6d4119b24cb3930ac9abaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.948364 19193 raft_consensus.cc:2468] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7402c031ca6d4119b24cb3930ac9abaf in term 1.
I20260709 13:05:41.948959 19118 raft_consensus.cc:2468] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7402c031ca6d4119b24cb3930ac9abaf in term 1.
I20260709 13:05:41.949539 19232 leader_election.cc:304] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, 7402c031ca6d4119b24cb3930ac9abaf; no voters: 
I20260709 13:05:41.950435 19312 raft_consensus.cc:2804] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:41.950930 19312 raft_consensus.cc:697] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 LEADER]: Becoming Leader. State: Replica: 7402c031ca6d4119b24cb3930ac9abaf, State: Running, Role: LEADER
I20260709 13:05:41.951718 19312 consensus_queue.cc:237] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:41.959018 19016 catalog_manager.cc:5697] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195). New cstate: current_term: 1 leader_uuid: "7402c031ca6d4119b24cb3930ac9abaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.000541 19016 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44706:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:42.002866 19016 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:42.025818 19108 tablet_service.cc:1511] Processing CreateTablet for tablet 55e86bc769fa42d984698f3416388d11 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=dcf3c001ac86415bb4de6f50bbbf7faa]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:42.026782 19182 tablet_service.cc:1511] Processing CreateTablet for tablet 55e86bc769fa42d984698f3416388d11 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=dcf3c001ac86415bb4de6f50bbbf7faa]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:42.027163 19108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e86bc769fa42d984698f3416388d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.028100 19182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e86bc769fa42d984698f3416388d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.028301 19257 tablet_service.cc:1511] Processing CreateTablet for tablet 55e86bc769fa42d984698f3416388d11 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=dcf3c001ac86415bb4de6f50bbbf7faa]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:42.029534 19257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e86bc769fa42d984698f3416388d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.031232 19107 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4112621fe54956aafb3691fe5e17e6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=dcf3c001ac86415bb4de6f50bbbf7faa]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:42.032442 19107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4112621fe54956aafb3691fe5e17e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.035933 19183 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4112621fe54956aafb3691fe5e17e6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=dcf3c001ac86415bb4de6f50bbbf7faa]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:42.037199 19183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4112621fe54956aafb3691fe5e17e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.041247 19256 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4112621fe54956aafb3691fe5e17e6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=dcf3c001ac86415bb4de6f50bbbf7faa]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:42.042559 19256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4112621fe54956aafb3691fe5e17e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.046584 19306 tablet_bootstrap.cc:492] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf: Bootstrap starting.
I20260709 13:05:42.049755 19308 tablet_bootstrap.cc:492] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56: Bootstrap starting.
I20260709 13:05:42.052191 19306 tablet_bootstrap.cc:654] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.057404 19307 tablet_bootstrap.cc:492] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a: Bootstrap starting.
I20260709 13:05:42.057894 19308 tablet_bootstrap.cc:654] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.063918 19307 tablet_bootstrap.cc:654] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.064796 19306 tablet_bootstrap.cc:492] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf: No bootstrap required, opened a new log
I20260709 13:05:42.065675 19306 ts_tablet_manager.cc:1403] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.014s
I20260709 13:05:42.070930 19306 raft_consensus.cc:359] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.071982 19306 raft_consensus.cc:385] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.072448 19306 raft_consensus.cc:740] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7402c031ca6d4119b24cb3930ac9abaf, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.073459 19306 consensus_queue.cc:260] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.078593 19308 tablet_bootstrap.cc:492] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56: No bootstrap required, opened a new log
I20260709 13:05:42.079058 19306 ts_tablet_manager.cc:1434] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:05:42.080389 19308 ts_tablet_manager.cc:1403] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.003s
I20260709 13:05:42.083671 19308 raft_consensus.cc:359] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.084406 19308 raft_consensus.cc:385] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.084690 19308 raft_consensus.cc:740] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd74deeb8e1a4f4a856f34f5f63f9a56, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.085417 19308 consensus_queue.cc:260] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.088001 19308 ts_tablet_manager.cc:1434] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:42.089184 19308 tablet_bootstrap.cc:492] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56: Bootstrap starting.
I20260709 13:05:42.090602 19306 tablet_bootstrap.cc:492] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf: Bootstrap starting.
I20260709 13:05:42.094719 19307 tablet_bootstrap.cc:492] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a: No bootstrap required, opened a new log
I20260709 13:05:42.095309 19307 ts_tablet_manager.cc:1403] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.000s
I20260709 13:05:42.095970 19308 tablet_bootstrap.cc:654] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.098354 19306 tablet_bootstrap.cc:654] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.098510 19307 raft_consensus.cc:359] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.099426 19307 raft_consensus.cc:385] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.099740 19307 raft_consensus.cc:740] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01d88baf00b54ee8acd67bbafaf99c7a, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.100713 19307 consensus_queue.cc:260] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.103077 19307 ts_tablet_manager.cc:1434] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:42.104218 19307 tablet_bootstrap.cc:492] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a: Bootstrap starting.
I20260709 13:05:42.111889 19307 tablet_bootstrap.cc:654] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:42.115935 19306 tablet_bootstrap.cc:492] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf: No bootstrap required, opened a new log
I20260709 13:05:42.116535 19306 ts_tablet_manager.cc:1403] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.004s
I20260709 13:05:42.117079 19308 tablet_bootstrap.cc:492] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56: No bootstrap required, opened a new log
I20260709 13:05:42.117702 19308 ts_tablet_manager.cc:1403] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260709 13:05:42.119729 19306 raft_consensus.cc:359] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.120566 19306 raft_consensus.cc:385] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.121699 19306 raft_consensus.cc:740] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7402c031ca6d4119b24cb3930ac9abaf, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.120568 19308 raft_consensus.cc:359] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.122282 19308 raft_consensus.cc:385] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.122648 19308 raft_consensus.cc:740] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd74deeb8e1a4f4a856f34f5f63f9a56, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.122573 19306 consensus_queue.cc:260] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.123701 19307 tablet_bootstrap.cc:492] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a: No bootstrap required, opened a new log
I20260709 13:05:42.123633 19308 consensus_queue.cc:260] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.124390 19307 ts_tablet_manager.cc:1403] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.008s
I20260709 13:05:42.126050 19308 ts_tablet_manager.cc:1434] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:05:42.127899 19306 ts_tablet_manager.cc:1434] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:42.127907 19307 raft_consensus.cc:359] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.129043 19307 raft_consensus.cc:385] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:42.129413 19307 raft_consensus.cc:740] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01d88baf00b54ee8acd67bbafaf99c7a, State: Initialized, Role: FOLLOWER
I20260709 13:05:42.130332 19307 consensus_queue.cc:260] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.132851 19307 ts_tablet_manager.cc:1434] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:05:42.134330 19314 raft_consensus.cc:493] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.134910 19314 raft_consensus.cc:515] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.137413 19314 leader_election.cc:290] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194:36635), 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195:37457)
I20260709 13:05:42.151595 19313 raft_consensus.cc:493] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.152068 19193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4112621fe54956aafb3691fe5e17e6" candidate_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" is_pre_election: true
I20260709 13:05:42.152271 19313 raft_consensus.cc:515] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.152881 19193 raft_consensus.cc:2468] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd74deeb8e1a4f4a856f34f5f63f9a56 in term 0.
I20260709 13:05:42.154177 19083 leader_election.cc:304] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, cd74deeb8e1a4f4a856f34f5f63f9a56; no voters: 
I20260709 13:05:42.155149 19314 raft_consensus.cc:2804] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.155550 19314 raft_consensus.cc:493] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.155937 19314 raft_consensus.cc:3060] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.158144 19267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4112621fe54956aafb3691fe5e17e6" candidate_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7402c031ca6d4119b24cb3930ac9abaf" is_pre_election: true
I20260709 13:05:42.159013 19267 raft_consensus.cc:2468] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd74deeb8e1a4f4a856f34f5f63f9a56 in term 0.
I20260709 13:05:42.156760 19313 leader_election.cc:290] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193:40373), 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195:37457)
I20260709 13:05:42.164402 19314 raft_consensus.cc:515] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.167615 19193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4112621fe54956aafb3691fe5e17e6" candidate_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
I20260709 13:05:42.168238 19193 raft_consensus.cc:3060] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.168715 19267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4112621fe54956aafb3691fe5e17e6" candidate_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7402c031ca6d4119b24cb3930ac9abaf"
I20260709 13:05:42.169430 19267 raft_consensus.cc:3060] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.171676 19314 leader_election.cc:290] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [CANDIDATE]: Term 1 election: Requested vote from peers 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194:36635), 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195:37457)
I20260709 13:05:42.171826 19266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e86bc769fa42d984698f3416388d11" candidate_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7402c031ca6d4119b24cb3930ac9abaf" is_pre_election: true
I20260709 13:05:42.172710 19266 raft_consensus.cc:2468] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01d88baf00b54ee8acd67bbafaf99c7a in term 0.
I20260709 13:05:42.174485 19156 leader_election.cc:304] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, 7402c031ca6d4119b24cb3930ac9abaf; no voters: 
I20260709 13:05:42.175468 19313 raft_consensus.cc:2804] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:42.175853 19313 raft_consensus.cc:493] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.175994 19193 raft_consensus.cc:2468] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd74deeb8e1a4f4a856f34f5f63f9a56 in term 1.
I20260709 13:05:42.176229 19313 raft_consensus.cc:3060] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.177250 19083 leader_election.cc:304] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, cd74deeb8e1a4f4a856f34f5f63f9a56; no voters: 
I20260709 13:05:42.178231 19314 raft_consensus.cc:2804] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.178625 19118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e86bc769fa42d984698f3416388d11" candidate_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" is_pre_election: true
I20260709 13:05:42.179102 19267 raft_consensus.cc:2468] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd74deeb8e1a4f4a856f34f5f63f9a56 in term 1.
I20260709 13:05:42.179399 19118 raft_consensus.cc:2468] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01d88baf00b54ee8acd67bbafaf99c7a in term 0.
I20260709 13:05:42.181437 19314 raft_consensus.cc:697] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 LEADER]: Becoming Leader. State: Replica: cd74deeb8e1a4f4a856f34f5f63f9a56, State: Running, Role: LEADER
I20260709 13:05:42.182394 19314 consensus_queue.cc:237] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.183983 19313 raft_consensus.cc:515] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.188340 19313 leader_election.cc:290] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [CANDIDATE]: Term 1 election: Requested vote from peers cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193:40373), 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195:37457)
I20260709 13:05:42.188931 19118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e86bc769fa42d984698f3416388d11" candidate_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
I20260709 13:05:42.189476 19118 raft_consensus.cc:3060] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.189462 19267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e86bc769fa42d984698f3416388d11" candidate_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7402c031ca6d4119b24cb3930ac9abaf"
I20260709 13:05:42.190371 19267 raft_consensus.cc:3060] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:42.191514 19015 catalog_manager.cc:5697] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.195879 19118 raft_consensus.cc:2468] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01d88baf00b54ee8acd67bbafaf99c7a in term 1.
I20260709 13:05:42.196975 19158 leader_election.cc:304] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, cd74deeb8e1a4f4a856f34f5f63f9a56; no voters: 
I20260709 13:05:42.197913 19313 raft_consensus.cc:2804] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:42.198225 19267 raft_consensus.cc:2468] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01d88baf00b54ee8acd67bbafaf99c7a in term 1.
I20260709 13:05:42.205660 19313 raft_consensus.cc:697] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 LEADER]: Becoming Leader. State: Replica: 01d88baf00b54ee8acd67bbafaf99c7a, State: Running, Role: LEADER
I20260709 13:05:42.206584 19313 consensus_queue.cc:237] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.214586 19015 catalog_manager.cc:5697] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194). New cstate: current_term: 1 leader_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.256592 19267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "655ee07b56034f1f86a7d3c485702280"
dest_uuid: "7402c031ca6d4119b24cb3930ac9abaf"
mode: GRACEFUL
new_leader_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
 from {username='slave'} at 127.0.0.1:34360
I20260709 13:05:42.257200 19267 raft_consensus.cc:606] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 LEADER]: Received request to transfer leadership to TS cd74deeb8e1a4f4a856f34f5f63f9a56
I20260709 13:05:42.262512 19267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e519f671f2b640e7846de0e642eaed42"
dest_uuid: "7402c031ca6d4119b24cb3930ac9abaf"
mode: GRACEFUL
new_leader_uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
 from {username='slave'} at 127.0.0.1:34360
I20260709 13:05:42.263001 19267 raft_consensus.cc:606] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 LEADER]: Received request to transfer leadership to TS 01d88baf00b54ee8acd67bbafaf99c7a
I20260709 13:05:42.275267 19193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55e86bc769fa42d984698f3416388d11"
dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
mode: GRACEFUL
new_leader_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
 from {username='slave'} at 127.0.0.1:57764
I20260709 13:05:42.275784 19193 raft_consensus.cc:606] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 LEADER]: Received request to transfer leadership to TS cd74deeb8e1a4f4a856f34f5f63f9a56
I20260709 13:05:42.332599 19312 consensus_queue.cc:1048] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.346004 19312 consensus_queue.cc:1048] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.358408 19320 raft_consensus.cc:993] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf: : Instructing follower 01d88baf00b54ee8acd67bbafaf99c7a to start an election
I20260709 13:05:42.358901 19320 raft_consensus.cc:1081] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 LEADER]: Signalling peer 01d88baf00b54ee8acd67bbafaf99c7a to start an election
I20260709 13:05:42.360324 19193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e519f671f2b640e7846de0e642eaed42"
dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
 from {username='slave'} at 127.0.0.1:57750
I20260709 13:05:42.360970 19193 raft_consensus.cc:493] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.361413 19193 raft_consensus.cc:3060] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.367905 19193 raft_consensus.cc:515] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.369779 19193 leader_election.cc:290] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [CANDIDATE]: Term 2 election: Requested vote from peers cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193:40373), 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195:37457)
I20260709 13:05:42.370659 19118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519f671f2b640e7846de0e642eaed42" candidate_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
I20260709 13:05:42.371023 19267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e519f671f2b640e7846de0e642eaed42" candidate_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7402c031ca6d4119b24cb3930ac9abaf"
I20260709 13:05:42.371353 19118 raft_consensus.cc:3060] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.371716 19267 raft_consensus.cc:3055] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:42.372089 19267 raft_consensus.cc:740] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7402c031ca6d4119b24cb3930ac9abaf, State: Running, Role: LEADER
I20260709 13:05:42.372815 19267 consensus_queue.cc:260] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.374218 19267 raft_consensus.cc:3060] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.378772 19118 raft_consensus.cc:2468] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01d88baf00b54ee8acd67bbafaf99c7a in term 2.
I20260709 13:05:42.380028 19158 leader_election.cc:304] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, cd74deeb8e1a4f4a856f34f5f63f9a56; no voters: 
I20260709 13:05:42.380951 19313 raft_consensus.cc:2804] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:42.381423 19267 raft_consensus.cc:2468] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01d88baf00b54ee8acd67bbafaf99c7a in term 2.
I20260709 13:05:42.381451 19313 raft_consensus.cc:697] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 LEADER]: Becoming Leader. State: Replica: 01d88baf00b54ee8acd67bbafaf99c7a, State: Running, Role: LEADER
I20260709 13:05:42.382654 19313 consensus_queue.cc:237] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.389225 19013 catalog_manager.cc:5697] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a reported cstate change: term changed from 1 to 2, leader changed from 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195) to 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194). New cstate: current_term: 2 leader_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.412601 19312 consensus_queue.cc:1048] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.413323 19320 consensus_queue.cc:1048] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.427198 19319 raft_consensus.cc:993] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf: : Instructing follower cd74deeb8e1a4f4a856f34f5f63f9a56 to start an election
I20260709 13:05:42.427680 19319 raft_consensus.cc:1081] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 LEADER]: Signalling peer cd74deeb8e1a4f4a856f34f5f63f9a56 to start an election
I20260709 13:05:42.429687 19118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "655ee07b56034f1f86a7d3c485702280"
dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
 from {username='slave'} at 127.0.0.1:36092
I20260709 13:05:42.430265 19118 raft_consensus.cc:493] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.430706 19118 raft_consensus.cc:3060] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.438190 19118 raft_consensus.cc:515] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:42.441030 19267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655ee07b56034f1f86a7d3c485702280" candidate_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7402c031ca6d4119b24cb3930ac9abaf"
I20260709 13:05:42.441177 19118 leader_election.cc:290] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [CANDIDATE]: Term 2 election: Requested vote from peers 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195:37457), 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194:36635)
I20260709 13:05:42.441701 19193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655ee07b56034f1f86a7d3c485702280" candidate_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
I20260709 13:05:42.442399 19193 raft_consensus.cc:3060] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.448074 19193 raft_consensus.cc:2468] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd74deeb8e1a4f4a856f34f5f63f9a56 in term 2.
I20260709 13:05:42.441748 19267 raft_consensus.cc:3055] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:42.448818 19267 raft_consensus.cc:740] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7402c031ca6d4119b24cb3930ac9abaf, State: Running, Role: LEADER
I20260709 13:05:42.449133 19083 leader_election.cc:304] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, cd74deeb8e1a4f4a856f34f5f63f9a56; no voters: 
I20260709 13:05:42.450006 19314 raft_consensus.cc:2804] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:42.449723 19267 consensus_queue.cc:260] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:42.450553 19314 raft_consensus.cc:697] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 LEADER]: Becoming Leader. State: Replica: cd74deeb8e1a4f4a856f34f5f63f9a56, State: Running, Role: LEADER
I20260709 13:05:42.451119 19267 raft_consensus.cc:3060] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.451351 19314 consensus_queue.cc:237] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } }
I20260709 13:05:42.458094 19267 raft_consensus.cc:2468] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd74deeb8e1a4f4a856f34f5f63f9a56 in term 2.
I20260709 13:05:42.458624 19015 catalog_manager.cc:5697] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 reported cstate change: term changed from 1 to 2, leader changed from 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195) to cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193). New cstate: current_term: 2 leader_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.670639 19314 consensus_queue.cc:1048] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.683187 19314 consensus_queue.cc:1048] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.685431 19313 consensus_queue.cc:1048] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:42.700304 19340 raft_consensus.cc:993] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a: : Instructing follower cd74deeb8e1a4f4a856f34f5f63f9a56 to start an election
I20260709 13:05:42.700770 19340 raft_consensus.cc:1081] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 LEADER]: Signalling peer cd74deeb8e1a4f4a856f34f5f63f9a56 to start an election
I20260709 13:05:42.706995 19118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55e86bc769fa42d984698f3416388d11"
dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
 from {username='slave'} at 127.0.0.1:36096
I20260709 13:05:42.707579 19118 raft_consensus.cc:493] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.707480 19340 consensus_queue.cc:1048] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:42.708153 19118 raft_consensus.cc:3060] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.717729 19118 raft_consensus.cc:515] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.720947 19193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e86bc769fa42d984698f3416388d11" candidate_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
I20260709 13:05:42.721700 19118 leader_election.cc:290] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [CANDIDATE]: Term 2 election: Requested vote from peers 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194:36635), 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195:37457)
I20260709 13:05:42.721621 19193 raft_consensus.cc:3055] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:42.722506 19193 raft_consensus.cc:740] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01d88baf00b54ee8acd67bbafaf99c7a, State: Running, Role: LEADER
I20260709 13:05:42.723316 19193 consensus_queue.cc:260] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.724584 19193 raft_consensus.cc:3060] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.725622 19266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e86bc769fa42d984698f3416388d11" candidate_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7402c031ca6d4119b24cb3930ac9abaf"
I20260709 13:05:42.726281 19266 raft_consensus.cc:3060] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:42.731877 19193 raft_consensus.cc:2468] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd74deeb8e1a4f4a856f34f5f63f9a56 in term 2.
I20260709 13:05:42.732674 19266 raft_consensus.cc:2468] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd74deeb8e1a4f4a856f34f5f63f9a56 in term 2.
I20260709 13:05:42.733337 19083 leader_election.cc:304] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, cd74deeb8e1a4f4a856f34f5f63f9a56; no voters: 
I20260709 13:05:42.734266 19352 raft_consensus.cc:2804] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:42.734678 19352 raft_consensus.cc:697] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 LEADER]: Becoming Leader. State: Replica: cd74deeb8e1a4f4a856f34f5f63f9a56, State: Running, Role: LEADER
I20260709 13:05:42.735535 19352 consensus_queue.cc:237] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:42.743093 19016 catalog_manager.cc:5697] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 reported cstate change: term changed from 1 to 2, leader changed from 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194) to cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193). New cstate: current_term: 2 leader_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:42.945796 19118 raft_consensus.cc:1275] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Refusing update from remote peer 01d88baf00b54ee8acd67bbafaf99c7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.947242 19340 consensus_queue.cc:1048] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:42.952571 19266 raft_consensus.cc:1275] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Refusing update from remote peer 01d88baf00b54ee8acd67bbafaf99c7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:42.954984 19340 consensus_queue.cc:1048] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.020285 19266 raft_consensus.cc:1275] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Refusing update from remote peer cd74deeb8e1a4f4a856f34f5f63f9a56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.021631 19352 consensus_queue.cc:1048] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.022179  7335 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:05:43.023663  7335 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:05:43.024153  7335 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:05:43.029836 19193 raft_consensus.cc:1275] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Refusing update from remote peer cd74deeb8e1a4f4a856f34f5f63f9a56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.031651 19351 consensus_queue.cc:1048] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.044775 19118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b4112621fe54956aafb3691fe5e17e6"
dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
mode: GRACEFUL
new_leader_uuid: "7402c031ca6d4119b24cb3930ac9abaf"
 from {username='slave'} at 127.0.0.1:36098
I20260709 13:05:43.045351 19118 raft_consensus.cc:606] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 LEADER]: Received request to transfer leadership to TS 7402c031ca6d4119b24cb3930ac9abaf
I20260709 13:05:43.046597  7335 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:05:43.079466 19314 raft_consensus.cc:993] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56: : Instructing follower 7402c031ca6d4119b24cb3930ac9abaf to start an election
I20260709 13:05:43.079998 19352 raft_consensus.cc:1081] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 LEADER]: Signalling peer 7402c031ca6d4119b24cb3930ac9abaf to start an election
I20260709 13:05:43.081594 19266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b4112621fe54956aafb3691fe5e17e6"
dest_uuid: "7402c031ca6d4119b24cb3930ac9abaf"
 from {username='slave'} at 127.0.0.1:34344
I20260709 13:05:43.082156 19266 raft_consensus.cc:493] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.082523 19266 raft_consensus.cc:3060] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.087739 19266 raft_consensus.cc:515] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:43.089685 19266 leader_election.cc:290] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [CANDIDATE]: Term 2 election: Requested vote from peers cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193:40373), 01d88baf00b54ee8acd67bbafaf99c7a (127.7.41.194:36635)
I20260709 13:05:43.090577 19118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4112621fe54956aafb3691fe5e17e6" candidate_uuid: "7402c031ca6d4119b24cb3930ac9abaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56"
I20260709 13:05:43.090895 19193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4112621fe54956aafb3691fe5e17e6" candidate_uuid: "7402c031ca6d4119b24cb3930ac9abaf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01d88baf00b54ee8acd67bbafaf99c7a"
I20260709 13:05:43.091313 19118 raft_consensus.cc:3055] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.091531 19193 raft_consensus.cc:3060] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.091807 19118 raft_consensus.cc:740] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd74deeb8e1a4f4a856f34f5f63f9a56, State: Running, Role: LEADER
I20260709 13:05:43.092742 19118 consensus_queue.cc:260] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:43.093888 19118 raft_consensus.cc:3060] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.096853 19193 raft_consensus.cc:2468] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7402c031ca6d4119b24cb3930ac9abaf in term 2.
I20260709 13:05:43.098096 19232 leader_election.cc:304] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01d88baf00b54ee8acd67bbafaf99c7a, 7402c031ca6d4119b24cb3930ac9abaf; no voters: 
I20260709 13:05:43.098897 19312 raft_consensus.cc:2804] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.099625 19118 raft_consensus.cc:2468] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7402c031ca6d4119b24cb3930ac9abaf in term 2.
I20260709 13:05:43.100024 19312 raft_consensus.cc:697] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 LEADER]: Becoming Leader. State: Replica: 7402c031ca6d4119b24cb3930ac9abaf, State: Running, Role: LEADER
I20260709 13:05:43.101075 19312 consensus_queue.cc:237] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } }
I20260709 13:05:43.108242 19016 catalog_manager.cc:5697] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf reported cstate change: term changed from 1 to 2, leader changed from cd74deeb8e1a4f4a856f34f5f63f9a56 (127.7.41.193) to 7402c031ca6d4119b24cb3930ac9abaf (127.7.41.195). New cstate: current_term: 2 leader_uuid: "7402c031ca6d4119b24cb3930ac9abaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd74deeb8e1a4f4a856f34f5f63f9a56" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 40373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01d88baf00b54ee8acd67bbafaf99c7a" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:43.137419  7335 tablet_server.cc:179] TabletServer@127.7.41.193:0 shutting down...
I20260709 13:05:43.156256  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:43.156886  7335 tablet_replica.cc:333] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56: stopping tablet replica
I20260709 13:05:43.157457  7335 raft_consensus.cc:2243] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.157879  7335 raft_consensus.cc:2272] T 3b4112621fe54956aafb3691fe5e17e6 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.160234  7335 tablet_replica.cc:333] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56: stopping tablet replica
I20260709 13:05:43.160784  7335 raft_consensus.cc:2243] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.160991 19266 raft_consensus.cc:1275] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Refusing update from remote peer cd74deeb8e1a4f4a856f34f5f63f9a56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:43.161232  7335 raft_consensus.cc:2272] T e519f671f2b640e7846de0e642eaed42 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.162429 19352 consensus_queue.cc:1048] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7402c031ca6d4119b24cb3930ac9abaf" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 37457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.164086  7335 tablet_replica.cc:333] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56: stopping tablet replica
I20260709 13:05:43.164722  7335 raft_consensus.cc:2243] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.165421  7335 pending_rounds.cc:70] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56: Trying to abort 1 pending ops.
I20260709 13:05:43.165695  7335 pending_rounds.cc:77] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635195853467648 op_type: NO_OP noop_request { }
I20260709 13:05:43.166127  7335 raft_consensus.cc:2889] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:43.166496  7335 raft_consensus.cc:2272] T 55e86bc769fa42d984698f3416388d11 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.169071  7335 tablet_replica.cc:333] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56: stopping tablet replica
I20260709 13:05:43.169677  7335 raft_consensus.cc:2243] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.170575  7335 raft_consensus.cc:2272] T 655ee07b56034f1f86a7d3c485702280 P cd74deeb8e1a4f4a856f34f5f63f9a56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.194737  7335 tablet_server.cc:196] TabletServer@127.7.41.193:0 shutdown complete.
I20260709 13:05:43.207001  7335 tablet_server.cc:179] TabletServer@127.7.41.194:0 shutting down...
I20260709 13:05:43.224428  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:43.225045  7335 tablet_replica.cc:333] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a: stopping tablet replica
I20260709 13:05:43.225544  7335 raft_consensus.cc:2243] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.225942  7335 raft_consensus.cc:2272] T 3b4112621fe54956aafb3691fe5e17e6 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.229543  7335 tablet_replica.cc:333] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a: stopping tablet replica
I20260709 13:05:43.230103  7335 raft_consensus.cc:2243] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.230861  7335 raft_consensus.cc:2272] T e519f671f2b640e7846de0e642eaed42 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.233176  7335 tablet_replica.cc:333] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a: stopping tablet replica
I20260709 13:05:43.233917  7335 raft_consensus.cc:2243] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.234349  7335 raft_consensus.cc:2272] T 55e86bc769fa42d984698f3416388d11 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.236435  7335 tablet_replica.cc:333] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a: stopping tablet replica
I20260709 13:05:43.236862  7335 raft_consensus.cc:2243] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.237218  7335 raft_consensus.cc:2272] T 655ee07b56034f1f86a7d3c485702280 P 01d88baf00b54ee8acd67bbafaf99c7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.260322  7335 tablet_server.cc:196] TabletServer@127.7.41.194:0 shutdown complete.
I20260709 13:05:43.272212  7335 tablet_server.cc:179] TabletServer@127.7.41.195:0 shutting down...
I20260709 13:05:43.289186  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:43.289929  7335 tablet_replica.cc:333] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf: stopping tablet replica
I20260709 13:05:43.290707  7335 raft_consensus.cc:2243] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.291205  7335 pending_rounds.cc:70] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf: Trying to abort 1 pending ops.
I20260709 13:05:43.291440  7335 pending_rounds.cc:77] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635195853467648 op_type: NO_OP noop_request { }
I20260709 13:05:43.291777  7335 raft_consensus.cc:2889] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:43.292137  7335 raft_consensus.cc:2272] T 55e86bc769fa42d984698f3416388d11 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.295092  7335 tablet_replica.cc:333] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf: stopping tablet replica
I20260709 13:05:43.295840  7335 raft_consensus.cc:2243] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.296387  7335 raft_consensus.cc:2272] T 655ee07b56034f1f86a7d3c485702280 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.299113  7335 tablet_replica.cc:333] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf: stopping tablet replica
I20260709 13:05:43.299571  7335 raft_consensus.cc:2243] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.300117  7335 pending_rounds.cc:70] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf: Trying to abort 1 pending ops.
I20260709 13:05:43.300264  7335 pending_rounds.cc:77] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635197352296448 op_type: NO_OP noop_request { }
I20260709 13:05:43.300479  7335 raft_consensus.cc:2889] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:43.300693  7335 raft_consensus.cc:2272] T 3b4112621fe54956aafb3691fe5e17e6 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.302795  7335 tablet_replica.cc:333] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf: stopping tablet replica
I20260709 13:05:43.303246  7335 raft_consensus.cc:2243] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.303617  7335 raft_consensus.cc:2272] T e519f671f2b640e7846de0e642eaed42 P 7402c031ca6d4119b24cb3930ac9abaf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.326293  7335 tablet_server.cc:196] TabletServer@127.7.41.195:0 shutdown complete.
I20260709 13:05:43.338090  7335 master.cc:562] Master@127.7.41.254:39277 shutting down...
I20260709 13:05:43.358228  7335 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:43.358835  7335 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.359216  7335 tablet_replica.cc:333] T 00000000000000000000000000000000 P 586c1106b5aa4aa7bd53a34938ac3fa8: stopping tablet replica
I20260709 13:05:43.378002  7335 master.cc:584] Master@127.7.41.254:39277 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2261 ms)
[----------] 6 tests from LeaderRebalancerTest (357240 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:05:43.404889  7335 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.41.254:39975
I20260709 13:05:43.406118  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:43.410964 19360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:43.411362 19361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:43.412446 19363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:43.413630  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:43.414528  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:43.414736  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:43.414915  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602343414880 us; error 0 us; skew 500 ppm
I20260709 13:05:43.415455  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:43.417606  7335 webserver.cc:533] Webserver started at http://127.7.41.254:42261/ using document root <none> and password file <none>
I20260709 13:05:43.418147  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:43.418336  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:43.418620  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:43.419688  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/master-0-root/instance:
uuid: "ac0d376da43d46c2b5da928a495d4239"
format_stamp: "Formatted at 2026-07-09 13:05:43 on dist-test-slave-fh5z"
I20260709 13:05:43.423967  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:05:43.427100 19368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:43.427983  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:43.428254  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/master-0-root
uuid: "ac0d376da43d46c2b5da928a495d4239"
format_stamp: "Formatted at 2026-07-09 13:05:43 on dist-test-slave-fh5z"
I20260709 13:05:43.428489  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:43.441115  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:43.442121  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:43.477705  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.254:39975
I20260709 13:05:43.477823 19419 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.254:39975 every 8 connection(s)
I20260709 13:05:43.481652 19420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:43.492414 19420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239: Bootstrap starting.
I20260709 13:05:43.496799 19420 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:43.500794 19420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239: No bootstrap required, opened a new log
I20260709 13:05:43.502874 19420 raft_consensus.cc:359] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0d376da43d46c2b5da928a495d4239" member_type: VOTER }
I20260709 13:05:43.503233 19420 raft_consensus.cc:385] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:43.503422 19420 raft_consensus.cc:740] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac0d376da43d46c2b5da928a495d4239, State: Initialized, Role: FOLLOWER
I20260709 13:05:43.503988 19420 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0d376da43d46c2b5da928a495d4239" member_type: VOTER }
I20260709 13:05:43.504421 19420 raft_consensus.cc:399] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:43.504607 19420 raft_consensus.cc:493] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:43.504810 19420 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:43.509418 19420 raft_consensus.cc:515] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0d376da43d46c2b5da928a495d4239" member_type: VOTER }
I20260709 13:05:43.509966 19420 leader_election.cc:304] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac0d376da43d46c2b5da928a495d4239; no voters: 
I20260709 13:05:43.511132 19420 leader_election.cc:290] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:43.511452 19423 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:43.512794 19423 raft_consensus.cc:697] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 1 LEADER]: Becoming Leader. State: Replica: ac0d376da43d46c2b5da928a495d4239, State: Running, Role: LEADER
I20260709 13:05:43.513505 19423 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0d376da43d46c2b5da928a495d4239" member_type: VOTER }
I20260709 13:05:43.514319 19420 sys_catalog.cc:565] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:43.518000 19424 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac0d376da43d46c2b5da928a495d4239" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0d376da43d46c2b5da928a495d4239" member_type: VOTER } }
I20260709 13:05:43.518330 19425 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac0d376da43d46c2b5da928a495d4239. Latest consensus state: current_term: 1 leader_uuid: "ac0d376da43d46c2b5da928a495d4239" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac0d376da43d46c2b5da928a495d4239" member_type: VOTER } }
I20260709 13:05:43.518872 19425 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:43.518829 19424 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:43.521581 19429 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:43.529748 19429 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:43.544451 19429 catalog_manager.cc:1383] Generated new cluster ID: 6a71b33d9bb54b7eb4888e11e62570ab
I20260709 13:05:43.544811 19429 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:43.550148  7335 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:43.571745 19429 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:43.573736 19429 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:43.594607 19429 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239: Generated new TSK 0
I20260709 13:05:43.595206 19429 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:43.616748  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:43.622519 19441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:43.624325 19442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:43.625144 19444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:43.625667  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:43.626729  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:43.626927  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:43.627121  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602343627102 us; error 0 us; skew 500 ppm
I20260709 13:05:43.627677  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:43.629904  7335 webserver.cc:533] Webserver started at http://127.7.41.193:35365/ using document root <none> and password file <none>
I20260709 13:05:43.630524  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:43.630720  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:43.631022  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:43.632090  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-0-root/instance:
uuid: "d0479c7f55b243b7b6093626504d266d"
format_stamp: "Formatted at 2026-07-09 13:05:43 on dist-test-slave-fh5z"
I20260709 13:05:43.636425  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:43.639693 19449 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:43.640455  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:43.640744  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-0-root
uuid: "d0479c7f55b243b7b6093626504d266d"
format_stamp: "Formatted at 2026-07-09 13:05:43 on dist-test-slave-fh5z"
I20260709 13:05:43.641016  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:43.658849  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:43.660023  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:43.661448  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:43.663628  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:43.663801  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:43.664112  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:43.664270  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:43.703018  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.193:43955
I20260709 13:05:43.703155 19511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.193:43955 every 8 connection(s)
I20260709 13:05:43.708319  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:43.716213 19516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:43.716328 19517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:43.721766  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:43.721820 19512 heartbeater.cc:344] Connected to a master server at 127.7.41.254:39975
W20260709 13:05:43.721835 19519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:43.722708 19512 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:43.723470 19512 heartbeater.cc:507] Master 127.7.41.254:39975 requested a full tablet report, sending...
I20260709 13:05:43.723799  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:43.724073  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:43.724269  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602343724252 us; error 0 us; skew 500 ppm
I20260709 13:05:43.725040  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:43.725708 19385 ts_manager.cc:194] Registered new tserver with Master: d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955)
I20260709 13:05:43.727774  7335 webserver.cc:533] Webserver started at http://127.7.41.194:36071/ using document root <none> and password file <none>
I20260709 13:05:43.727900 19385 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56580
I20260709 13:05:43.728416  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:43.728679  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:43.729013  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:43.730548  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-1-root/instance:
uuid: "29aef9a1cf614f47958c16d7a3d39f19"
format_stamp: "Formatted at 2026-07-09 13:05:43 on dist-test-slave-fh5z"
I20260709 13:05:43.735023  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:05:43.738302 19524 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:43.739144  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:43.739454  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-1-root
uuid: "29aef9a1cf614f47958c16d7a3d39f19"
format_stamp: "Formatted at 2026-07-09 13:05:43 on dist-test-slave-fh5z"
I20260709 13:05:43.739740  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:43.764827  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:43.765877  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:43.767321  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:43.769479  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:43.769649  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:43.769958  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:43.770134  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:43.808349  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.194:34193
I20260709 13:05:43.808465 19586 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.194:34193 every 8 connection(s)
I20260709 13:05:43.813483  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:43.821377 19590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:43.822427 19591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:43.824169 19593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:43.824771  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:43.825582 19587 heartbeater.cc:344] Connected to a master server at 127.7.41.254:39975
I20260709 13:05:43.825832  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:43.825987 19587 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:43.826232  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:43.826503  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602343826479 us; error 0 us; skew 500 ppm
I20260709 13:05:43.827104  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:43.827046 19587 heartbeater.cc:507] Master 127.7.41.254:39975 requested a full tablet report, sending...
I20260709 13:05:43.829421 19385 ts_manager.cc:194] Registered new tserver with Master: 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:43.829813  7335 webserver.cc:533] Webserver started at http://127.7.41.195:40999/ using document root <none> and password file <none>
I20260709 13:05:43.830408  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:43.830636  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:43.830926  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:43.831229 19385 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56588
I20260709 13:05:43.832052  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-2-root/instance:
uuid: "37776c8ae93f49588bd377ce7c8a1b75"
format_stamp: "Formatted at 2026-07-09 13:05:43 on dist-test-slave-fh5z"
I20260709 13:05:43.836676  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:43.839938 19598 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:43.840729  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:43.841046  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-2-root
uuid: "37776c8ae93f49588bd377ce7c8a1b75"
format_stamp: "Formatted at 2026-07-09 13:05:43 on dist-test-slave-fh5z"
I20260709 13:05:43.841292  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601985998407-7335-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:43.851327  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:43.852352  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:43.853732  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:43.855934  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:43.856156  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:43.856401  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:43.856581  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:43.895020  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.195:45561
I20260709 13:05:43.895136 19660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.195:45561 every 8 connection(s)
I20260709 13:05:43.908694 19661 heartbeater.cc:344] Connected to a master server at 127.7.41.254:39975
I20260709 13:05:43.909339 19661 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:43.910185 19661 heartbeater.cc:507] Master 127.7.41.254:39975 requested a full tablet report, sending...
I20260709 13:05:43.912181 19385 ts_manager.cc:194] Registered new tserver with Master: 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:43.912868  7335 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014600481s
I20260709 13:05:43.913578 19385 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56590
I20260709 13:05:43.936981 19385 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56594:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:43.939540 19385 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:44.007853 19477 tablet_service.cc:1511] Processing CreateTablet for tablet 4d1a9a7451e24c88a965530eb1aac51b (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:44.009395 19477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d1a9a7451e24c88a965530eb1aac51b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.009083 19476 tablet_service.cc:1511] Processing CreateTablet for tablet 93450d6918fe4d958c327c2f75516daf (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:44.013041 19474 tablet_service.cc:1511] Processing CreateTablet for tablet 5b415265a7fe45a1bd1296cfafdb1198 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:44.011078 19475 tablet_service.cc:1511] Processing CreateTablet for tablet f45e3c99c5e24c028f1ff3728c454967 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:44.016561 19476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93450d6918fe4d958c327c2f75516daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.016600 19472 tablet_service.cc:1511] Processing CreateTablet for tablet bad169a236f045d7ad9ad781a28fa8c5 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:44.018390 19472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad169a236f045d7ad9ad781a28fa8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.016600 19473 tablet_service.cc:1511] Processing CreateTablet for tablet d25ac713a1ea470e8d4d40d751446b7c (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:44.020964 19475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45e3c99c5e24c028f1ff3728c454967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.021708 19474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b415265a7fe45a1bd1296cfafdb1198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.026793 19471 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6ab9eea9d84a36bea7d114842c1fc9 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:44.029613 19470 tablet_service.cc:1511] Processing CreateTablet for tablet e87ed645b59244d8900748909544dfe2 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:44.034366 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25ac713a1ea470e8d4d40d751446b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.036787 19471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6ab9eea9d84a36bea7d114842c1fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.038579 19470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87ed645b59244d8900748909544dfe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.046893 19469 tablet_service.cc:1511] Processing CreateTablet for tablet 423d54e2d6c945bd952cf46755a0b0a1 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:44.048292 19469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d54e2d6c945bd952cf46755a0b0a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.078702 19675 tablet_bootstrap.cc:492] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:44.085000 19552 tablet_service.cc:1511] Processing CreateTablet for tablet 4d1a9a7451e24c88a965530eb1aac51b (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:44.086445 19552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d1a9a7451e24c88a965530eb1aac51b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.091693 19551 tablet_service.cc:1511] Processing CreateTablet for tablet 93450d6918fe4d958c327c2f75516daf (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:44.093194 19551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93450d6918fe4d958c327c2f75516daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.096294 19626 tablet_service.cc:1511] Processing CreateTablet for tablet 4d1a9a7451e24c88a965530eb1aac51b (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:44.097730 19626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d1a9a7451e24c88a965530eb1aac51b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.098994 19625 tablet_service.cc:1511] Processing CreateTablet for tablet 93450d6918fe4d958c327c2f75516daf (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:44.100833 19675 tablet_bootstrap.cc:654] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.100600 19618 tablet_service.cc:1511] Processing CreateTablet for tablet 423d54e2d6c945bd952cf46755a0b0a1 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:44.102820 19619 tablet_service.cc:1511] Processing CreateTablet for tablet e87ed645b59244d8900748909544dfe2 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:44.103006 19624 tablet_service.cc:1511] Processing CreateTablet for tablet f45e3c99c5e24c028f1ff3728c454967 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:44.105195 19620 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6ab9eea9d84a36bea7d114842c1fc9 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:44.105466 19623 tablet_service.cc:1511] Processing CreateTablet for tablet 5b415265a7fe45a1bd1296cfafdb1198 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:44.105975 19675 tablet_bootstrap.cc:492] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:44.106534 19675 ts_tablet_manager.cc:1403] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 13:05:44.105515 19621 tablet_service.cc:1511] Processing CreateTablet for tablet bad169a236f045d7ad9ad781a28fa8c5 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:44.106729 19622 tablet_service.cc:1511] Processing CreateTablet for tablet d25ac713a1ea470e8d4d40d751446b7c (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:44.107986 19625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93450d6918fe4d958c327c2f75516daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.108726 19622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25ac713a1ea470e8d4d40d751446b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.109508 19620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6ab9eea9d84a36bea7d114842c1fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.110131 19623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b415265a7fe45a1bd1296cfafdb1198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.109791 19675 raft_consensus.cc:359] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:44.110610 19675 raft_consensus.cc:385] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.110883 19619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87ed645b59244d8900748909544dfe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.110929 19675 raft_consensus.cc:740] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.111845 19618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d54e2d6c945bd952cf46755a0b0a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.112113 19675 consensus_queue.cc:260] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:44.114142 19621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad169a236f045d7ad9ad781a28fa8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.115833 19624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45e3c99c5e24c028f1ff3728c454967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.117853 19550 tablet_service.cc:1511] Processing CreateTablet for tablet f45e3c99c5e24c028f1ff3728c454967 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:44.119334 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45e3c99c5e24c028f1ff3728c454967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.119853 19549 tablet_service.cc:1511] Processing CreateTablet for tablet 5b415265a7fe45a1bd1296cfafdb1198 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:44.121232 19549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b415265a7fe45a1bd1296cfafdb1198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.129642 19548 tablet_service.cc:1511] Processing CreateTablet for tablet d25ac713a1ea470e8d4d40d751446b7c (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:44.131145 19548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25ac713a1ea470e8d4d40d751446b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.140743 19547 tablet_service.cc:1511] Processing CreateTablet for tablet bad169a236f045d7ad9ad781a28fa8c5 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:44.143136 19547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad169a236f045d7ad9ad781a28fa8c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.186900 19512 heartbeater.cc:499] Master 127.7.41.254:39975 was elected leader, sending a full tablet report...
I20260709 13:05:44.192641 19546 tablet_service.cc:1511] Processing CreateTablet for tablet 2e6ab9eea9d84a36bea7d114842c1fc9 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:44.194159 19546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e6ab9eea9d84a36bea7d114842c1fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.198215 19675 ts_tablet_manager.cc:1434] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.091s	user 0.017s	sys 0.017s
I20260709 13:05:44.198853 19678 tablet_bootstrap.cc:492] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:44.199406 19675 tablet_bootstrap.cc:492] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:44.216393 19675 tablet_bootstrap.cc:654] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.216145 19545 tablet_service.cc:1511] Processing CreateTablet for tablet 423d54e2d6c945bd952cf46755a0b0a1 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:44.219213 19545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d54e2d6c945bd952cf46755a0b0a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.217720 19551 tablet_service.cc:1511] Processing CreateTablet for tablet e87ed645b59244d8900748909544dfe2 (DEFAULT_TABLE table=test-workload [id=98bcbad00b2048558143832b9f10bd77]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:44.227003 19551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87ed645b59244d8900748909544dfe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:44.227403 19679 tablet_bootstrap.cc:492] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:44.236063 19678 tablet_bootstrap.cc:654] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.239578 19675 tablet_bootstrap.cc:492] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:44.240164 19675 ts_tablet_manager.cc:1403] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.010s
I20260709 13:05:44.241231 19679 tablet_bootstrap.cc:654] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.243323 19675 raft_consensus.cc:359] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.244077 19675 raft_consensus.cc:385] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.244422 19675 raft_consensus.cc:740] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.245236 19675 consensus_queue.cc:260] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.260169 19679 tablet_bootstrap.cc:492] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:44.260823 19679 ts_tablet_manager.cc:1403] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.012s
I20260709 13:05:44.263167 19679 raft_consensus.cc:359] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.263688 19679 raft_consensus.cc:385] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.263926 19679 raft_consensus.cc:740] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.264477 19679 consensus_queue.cc:260] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.266500 19675 ts_tablet_manager.cc:1434] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:05:44.267630 19675 tablet_bootstrap.cc:492] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:44.267655 19678 tablet_bootstrap.cc:492] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:44.268301 19678 ts_tablet_manager.cc:1403] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.005s
I20260709 13:05:44.271219 19678 raft_consensus.cc:359] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.271971 19678 raft_consensus.cc:385] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.272267 19678 raft_consensus.cc:740] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.272359 19587 heartbeater.cc:499] Master 127.7.41.254:39975 was elected leader, sending a full tablet report...
I20260709 13:05:44.273394 19679 ts_tablet_manager.cc:1434] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:05:44.273149 19678 consensus_queue.cc:260] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.274986 19679 tablet_bootstrap.cc:492] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:44.276616 19675 tablet_bootstrap.cc:654] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.278789 19677 raft_consensus.cc:493] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.279307 19677 raft_consensus.cc:515] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:44.280591 19661 heartbeater.cc:499] Master 127.7.41.254:39975 was elected leader, sending a full tablet report...
I20260709 13:05:44.281881 19677 leader_election.cc:290] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.283320 19678 ts_tablet_manager.cc:1434] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:05:44.284200 19678 tablet_bootstrap.cc:492] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:44.292843 19679 tablet_bootstrap.cc:654] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.295459 19678 tablet_bootstrap.cc:654] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.300220 19679 tablet_bootstrap.cc:492] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:44.301853 19679 ts_tablet_manager.cc:1403] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.004s
I20260709 13:05:44.303082 19678 tablet_bootstrap.cc:492] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:44.303637 19678 ts_tablet_manager.cc:1403] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.006s
I20260709 13:05:44.304935 19679 raft_consensus.cc:359] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.305751 19679 raft_consensus.cc:385] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.306133 19679 raft_consensus.cc:740] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.306574 19678 raft_consensus.cc:359] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.307346 19678 raft_consensus.cc:385] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.307686 19678 raft_consensus.cc:740] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.307103 19679 consensus_queue.cc:260] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.308461 19678 consensus_queue.cc:260] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.309707 19679 ts_tablet_manager.cc:1434] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:44.310779 19678 ts_tablet_manager.cc:1434] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:05:44.311987 19678 tablet_bootstrap.cc:492] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:44.313382 19675 tablet_bootstrap.cc:492] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:44.313985 19675 ts_tablet_manager.cc:1403] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.024s
I20260709 13:05:44.310890 19679 tablet_bootstrap.cc:492] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:44.316921 19675 raft_consensus.cc:359] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.317672 19675 raft_consensus.cc:385] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.318002 19675 raft_consensus.cc:740] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.319355 19678 tablet_bootstrap.cc:654] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.318961 19675 consensus_queue.cc:260] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.323235 19675 ts_tablet_manager.cc:1434] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:05:44.324570 19675 tablet_bootstrap.cc:492] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:44.323254 19679 tablet_bootstrap.cc:654] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.334103 19675 tablet_bootstrap.cc:654] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.368070 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1a9a7451e24c88a965530eb1aac51b" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
W20260709 13:05:44.369939 19451 leader_election.cc:343] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.372934 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1a9a7451e24c88a965530eb1aac51b" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:44.374516 19679 tablet_bootstrap.cc:492] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:44.375305 19679 ts_tablet_manager.cc:1403] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.029s
W20260709 13:05:44.375288 19451 leader_election.cc:343] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.376417 19451 leader_election.cc:304] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0479c7f55b243b7b6093626504d266d; no voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:44.378051 19677 raft_consensus.cc:2749] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:44.379387 19679 raft_consensus.cc:359] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.380264 19679 raft_consensus.cc:385] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.380577 19679 raft_consensus.cc:740] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.381729 19675 tablet_bootstrap.cc:492] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:44.381460 19679 consensus_queue.cc:260] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.382014 19678 tablet_bootstrap.cc:492] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:44.382416 19675 ts_tablet_manager.cc:1403] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.017s
I20260709 13:05:44.382577 19678 ts_tablet_manager.cc:1403] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.071s	user 0.033s	sys 0.031s
I20260709 13:05:44.384692 19675 raft_consensus.cc:359] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.385295 19675 raft_consensus.cc:385] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.385568 19675 raft_consensus.cc:740] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.385552 19678 raft_consensus.cc:359] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.386475 19678 raft_consensus.cc:385] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.386808 19678 raft_consensus.cc:740] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.387184 19679 ts_tablet_manager.cc:1434] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.007s
I20260709 13:05:44.386891 19675 consensus_queue.cc:260] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.387702 19678 consensus_queue.cc:260] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.388350 19679 tablet_bootstrap.cc:492] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:44.393843 19675 ts_tablet_manager.cc:1434] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:05:44.394326 19678 ts_tablet_manager.cc:1434] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:44.395020 19679 tablet_bootstrap.cc:654] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.395079 19675 tablet_bootstrap.cc:492] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:44.395354 19678 tablet_bootstrap.cc:492] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:44.403981 19678 tablet_bootstrap.cc:654] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.404050 19675 tablet_bootstrap.cc:654] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.410962 19684 raft_consensus.cc:493] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.411541 19684 raft_consensus.cc:515] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.417078 19684 leader_election.cc:290] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.418087 19684 raft_consensus.cc:493] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.418576 19684 raft_consensus.cc:515] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.421867 19684 leader_election.cc:290] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.422150 19677 raft_consensus.cc:493] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.422684 19677 raft_consensus.cc:515] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.424362 19679 tablet_bootstrap.cc:492] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:44.424837 19677 leader_election.cc:290] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.424907 19679 ts_tablet_manager.cc:1403] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.013s
I20260709 13:05:44.424983 19678 tablet_bootstrap.cc:492] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:44.426752 19678 ts_tablet_manager.cc:1403] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 13:05:44.427428 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87ed645b59244d8900748909544dfe2" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:44.427421 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87ed645b59244d8900748909544dfe2" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:44.428472 19679 raft_consensus.cc:359] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
W20260709 13:05:44.429502 19451 leader_election.cc:343] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.429236 19679 raft_consensus.cc:385] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.430195 19679 raft_consensus.cc:740] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.430604 19675 tablet_bootstrap.cc:492] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:44.431118 19679 consensus_queue.cc:260] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.431159 19675 ts_tablet_manager.cc:1403] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.015s
W20260709 13:05:44.433678 19451 leader_election.cc:343] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.434183 19451 leader_election.cc:304] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0479c7f55b243b7b6093626504d266d; no voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:44.434521 19678 raft_consensus.cc:359] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.435287 19678 raft_consensus.cc:385] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.435379 19677 raft_consensus.cc:2749] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:44.435621 19678 raft_consensus.cc:740] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.435751 19675 raft_consensus.cc:359] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.436682 19675 raft_consensus.cc:385] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.437039 19675 raft_consensus.cc:740] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.437955 19675 consensus_queue.cc:260] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.438391 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:44.439086 19561 raft_consensus.cc:2468] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:44.439848 19679 ts_tablet_manager.cc:1434] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:05:44.440924 19679 tablet_bootstrap.cc:492] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:44.440506 19678 consensus_queue.cc:260] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.441089 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad169a236f045d7ad9ad781a28fa8c5" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:44.442027 19487 raft_consensus.cc:2468] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:44.443658 19678 ts_tablet_manager.cc:1434] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:05:44.444741 19678 tablet_bootstrap.cc:492] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:44.447980 19679 tablet_bootstrap.cc:654] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.448145 19600 leader_election.cc:304] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:44.450764 19601 leader_election.cc:304] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:44.451216 19684 raft_consensus.cc:2804] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:44.451615 19684 raft_consensus.cc:493] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.451953 19684 raft_consensus.cc:3060] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.452574 19678 tablet_bootstrap.cc:654] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.455307 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad169a236f045d7ad9ad781a28fa8c5" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
W20260709 13:05:44.457480 19600 leader_election.cc:343] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.464493 19684 raft_consensus.cc:515] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.441282 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:44.440531 19675 ts_tablet_manager.cc:1434] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:05:44.470366 19675 tablet_bootstrap.cc:492] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:44.475207 19699 raft_consensus.cc:2804] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:44.475680 19699 raft_consensus.cc:493] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.476012 19699 raft_consensus.cc:3060] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:44.477036 19601 leader_election.cc:343] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.479010 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
W20260709 13:05:44.480571 19601 leader_election.cc:343] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.482844 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:44.483891 19562 raft_consensus.cc:3060] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.483680 19684 leader_election.cc:290] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.489181 19675 tablet_bootstrap.cc:654] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.490379 19699 raft_consensus.cc:515] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.492152 19679 tablet_bootstrap.cc:492] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:44.492689 19679 ts_tablet_manager.cc:1403] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.022s
I20260709 13:05:44.492621 19562 raft_consensus.cc:2468] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:44.493423 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad169a236f045d7ad9ad781a28fa8c5" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:44.494100 19486 raft_consensus.cc:3060] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.493978 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad169a236f045d7ad9ad781a28fa8c5" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:44.494252 19600 leader_election.cc:304] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: d0479c7f55b243b7b6093626504d266d
I20260709 13:05:44.495324 19684 raft_consensus.cc:2804] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:44.495632 19600 leader_election.cc:343] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.496245 19699 leader_election.cc:290] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.496119 19679 raft_consensus.cc:359] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.496917 19679 raft_consensus.cc:385] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.497207 19679 raft_consensus.cc:740] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.497965 19679 consensus_queue.cc:260] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.501408 19679 ts_tablet_manager.cc:1434] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:44.502542 19679 tablet_bootstrap.cc:492] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:44.504609 19678 tablet_bootstrap.cc:492] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:44.505195 19678 ts_tablet_manager.cc:1403] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.021s
I20260709 13:05:44.508438 19678 raft_consensus.cc:359] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.509248 19678 raft_consensus.cc:385] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.509586 19678 raft_consensus.cc:740] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.510391 19678 consensus_queue.cc:260] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.511406 19679 tablet_bootstrap.cc:654] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.513093 19486 raft_consensus.cc:2468] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:44.514266 19678 ts_tablet_manager.cc:1434] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:05:44.516394 19678 tablet_bootstrap.cc:492] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:44.521435 19678 tablet_bootstrap.cc:654] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.522114 19601 leader_election.cc:304] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 29aef9a1cf614f47958c16d7a3d39f19
I20260709 13:05:44.523341 19684 raft_consensus.cc:697] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:44.524396 19684 consensus_queue.cc:237] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.523662 19701 raft_consensus.cc:2804] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:44.526206 19701 raft_consensus.cc:697] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:44.526473 19679 tablet_bootstrap.cc:492] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:44.527673 19679 ts_tablet_manager.cc:1403] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.012s
W20260709 13:05:44.528223 19433 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:44.531337 19679 raft_consensus.cc:359] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.532327 19679 raft_consensus.cc:385] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.534730 19679 raft_consensus.cc:740] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.529160 19701 consensus_queue.cc:237] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.536669 19679 consensus_queue.cc:260] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.538403 19675 tablet_bootstrap.cc:492] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:44.539007 19675 ts_tablet_manager.cc:1403] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.011s
I20260709 13:05:44.543198 19678 tablet_bootstrap.cc:492] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:44.542707 19675 raft_consensus.cc:359] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.543726 19675 raft_consensus.cc:385] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.544149 19675 raft_consensus.cc:740] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.543793 19678 ts_tablet_manager.cc:1403] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.012s
I20260709 13:05:44.545014 19679 ts_tablet_manager.cc:1434] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:05:44.545212 19675 consensus_queue.cc:260] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.546177 19679 tablet_bootstrap.cc:492] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:44.549121 19678 raft_consensus.cc:359] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.549853 19678 raft_consensus.cc:385] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.550174 19678 raft_consensus.cc:740] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.552206 19699 raft_consensus.cc:493] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.552660 19699 raft_consensus.cc:515] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.553640 19679 tablet_bootstrap.cc:654] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.554860 19699 leader_election.cc:290] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.556057 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:44.556632 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:44.556798 19562 raft_consensus.cc:2468] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:44.557610 19678 consensus_queue.cc:260] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.558383 19600 leader_election.cc:304] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
W20260709 13:05:44.559054 19601 leader_election.cc:343] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.559227 19701 raft_consensus.cc:2804] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:44.559633 19701 raft_consensus.cc:493] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.559980 19701 raft_consensus.cc:3060] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.561586 19679 tablet_bootstrap.cc:492] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:44.562137 19679 ts_tablet_manager.cc:1403] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.008s
I20260709 13:05:44.564512 19679 raft_consensus.cc:359] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:44.564136 19385 catalog_manager.cc:5697] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.565129 19679 raft_consensus.cc:385] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.565515 19679 raft_consensus.cc:740] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.566732 19675 ts_tablet_manager.cc:1434] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:05:44.567528 19701 raft_consensus.cc:515] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.569078 19679 consensus_queue.cc:260] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:44.570678 19675 tablet_bootstrap.cc:492] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:44.571334 19678 ts_tablet_manager.cc:1434] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:05:44.571875 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:44.572428 19678 tablet_bootstrap.cc:492] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
W20260709 13:05:44.575333 19601 leader_election.cc:343] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.578296 19675 tablet_bootstrap.cc:654] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.578167 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:44.578830 19679 ts_tablet_manager.cc:1434] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:44.579105 19562 raft_consensus.cc:3060] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.581135 19678 tablet_bootstrap.cc:654] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.578136 19701 leader_election.cc:290] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.587913 19562 raft_consensus.cc:2468] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:44.588285 19679 tablet_bootstrap.cc:492] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:44.589347 19600 leader_election.cc:304] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: d0479c7f55b243b7b6093626504d266d
I20260709 13:05:44.590569 19701 raft_consensus.cc:2804] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:44.591053 19701 raft_consensus.cc:697] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:44.591693 19678 tablet_bootstrap.cc:492] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:44.591854 19701 consensus_queue.cc:237] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.592279 19678 ts_tablet_manager.cc:1403] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:05:44.595180 19675 tablet_bootstrap.cc:492] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:44.595954 19675 ts_tablet_manager.cc:1403] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.011s
I20260709 13:05:44.595685 19678 raft_consensus.cc:359] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.596886 19678 raft_consensus.cc:385] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.597337 19678 raft_consensus.cc:740] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.598554 19678 consensus_queue.cc:260] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.599959 19675 raft_consensus.cc:359] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.600770 19675 raft_consensus.cc:385] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.600944 19699 raft_consensus.cc:493] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.601116 19675 raft_consensus.cc:740] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.601468 19678 ts_tablet_manager.cc:1434] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:44.601675 19684 raft_consensus.cc:493] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.601917 19679 tablet_bootstrap.cc:654] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.602192 19684 raft_consensus.cc:515] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.602734 19678 tablet_bootstrap.cc:492] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:44.602301 19675 consensus_queue.cc:260] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.604418 19684 leader_election.cc:290] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.601545 19699 raft_consensus.cc:515] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.606153 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45e3c99c5e24c028f1ff3728c454967" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:44.606398 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45e3c99c5e24c028f1ff3728c454967" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:44.606861 19486 raft_consensus.cc:2468] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:44.607029 19562 raft_consensus.cc:2468] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:44.608011 19675 ts_tablet_manager.cc:1434] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:05:44.608153 19699 leader_election.cc:290] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.609453 19675 tablet_bootstrap.cc:492] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:44.610292 19678 tablet_bootstrap.cc:654] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.610708 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87ed645b59244d8900748909544dfe2" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:44.611419 19486 raft_consensus.cc:2468] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:44.608165 19600 leader_election.cc:304] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:44.617071 19601 leader_election.cc:304] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:44.618283 19684 raft_consensus.cc:2804] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:44.618752 19684 raft_consensus.cc:493] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.618901 19675 tablet_bootstrap.cc:654] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.619609 19699 raft_consensus.cc:2804] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:44.620067 19699 raft_consensus.cc:493] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.620476 19699 raft_consensus.cc:3060] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.622385 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87ed645b59244d8900748909544dfe2" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:44.622726 19678 tablet_bootstrap.cc:492] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:44.623274 19678 ts_tablet_manager.cc:1403] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
W20260709 13:05:44.623735 19600 leader_election.cc:343] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.623692 19679 tablet_bootstrap.cc:492] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:44.626151 19678 raft_consensus.cc:359] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.633962 19675 tablet_bootstrap.cc:492] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:44.626992 19683 raft_consensus.cc:493] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.640169 19678 raft_consensus.cc:385] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.619252 19684 raft_consensus.cc:3060] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.640931 19675 ts_tablet_manager.cc:1403] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.015s
I20260709 13:05:44.640879 19683 raft_consensus.cc:515] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:44.640934 19678 raft_consensus.cc:740] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.626603 19679 ts_tablet_manager.cc:1403] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 13:05:44.643812 19678 consensus_queue.cc:260] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.644840 19675 raft_consensus.cc:359] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.645639 19675 raft_consensus.cc:385] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.645968 19675 raft_consensus.cc:740] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.646736 19675 consensus_queue.cc:260] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.648921 19675 ts_tablet_manager.cc:1434] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:05:44.649859 19675 tablet_bootstrap.cc:492] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:44.649703 19679 raft_consensus.cc:359] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.650463 19679 raft_consensus.cc:385] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.650738 19679 raft_consensus.cc:740] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.637513 19699 raft_consensus.cc:515] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.654193 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87ed645b59244d8900748909544dfe2" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:44.654771 19486 raft_consensus.cc:3060] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.656699 19675 tablet_bootstrap.cc:654] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.657979 19684 raft_consensus.cc:515] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.661005 19679 consensus_queue.cc:260] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.664177 19678 ts_tablet_manager.cc:1434] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.041s	user 0.016s	sys 0.020s
I20260709 13:05:44.665233 19678 tablet_bootstrap.cc:492] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:44.665474 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45e3c99c5e24c028f1ff3728c454967" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:44.665830 19486 raft_consensus.cc:2468] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:44.666344 19487 raft_consensus.cc:3060] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.668187 19601 leader_election.cc:304] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:44.670926 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87ed645b59244d8900748909544dfe2" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:44.672381 19678 tablet_bootstrap.cc:654] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:44.672811 19600 leader_election.cc:343] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:44.676438 19699 leader_election.cc:290] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.677582 19699 raft_consensus.cc:2804] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:44.678233 19699 raft_consensus.cc:697] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:44.679363 19699 consensus_queue.cc:237] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.682380 19677 raft_consensus.cc:493] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.683089 19677 raft_consensus.cc:515] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.684621 19683 leader_election.cc:290] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.690438 19677 leader_election.cc:290] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.695755 19679 ts_tablet_manager.cc:1434] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.052s	user 0.012s	sys 0.008s
I20260709 13:05:44.699288 19679 tablet_bootstrap.cc:492] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:44.699824 19684 leader_election.cc:290] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:44.700860 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d54e2d6c945bd952cf46755a0b0a1" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:44.703701 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d54e2d6c945bd952cf46755a0b0a1" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:44.704443 19562 raft_consensus.cc:2468] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 0.
I20260709 13:05:44.705241 19675 tablet_bootstrap.cc:492] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:44.705732 19675 ts_tablet_manager.cc:1403] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.013s
I20260709 13:05:44.705704 19451 leader_election.cc:304] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:44.704062 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45e3c99c5e24c028f1ff3728c454967" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:44.707351 19636 raft_consensus.cc:2468] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 0.
I20260709 13:05:44.707696 19561 raft_consensus.cc:3060] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.710197 19679 tablet_bootstrap.cc:654] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:44.712793 19677 raft_consensus.cc:2804] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:44.713358 19677 raft_consensus.cc:493] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.713765 19677 raft_consensus.cc:3060] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.722358 19561 raft_consensus.cc:2468] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:44.723862 19600 leader_election.cc:304] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:44.724056 19683 raft_consensus.cc:493] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.724781 19684 raft_consensus.cc:2804] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:44.724561 19683 raft_consensus.cc:515] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.725296 19684 raft_consensus.cc:697] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:44.726315 19684 consensus_queue.cc:237] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.732029 19487 raft_consensus.cc:2468] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:44.748868 19678 tablet_bootstrap.cc:492] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:44.749513 19718 raft_consensus.cc:493] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.753082 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93450d6918fe4d958c327c2f75516daf" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:44.754971 19487 raft_consensus.cc:2468] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:44.754431 19718 raft_consensus.cc:515] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.756326 19527 leader_election.cc:304] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:44.754326 19678 ts_tablet_manager.cc:1403] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.021s
I20260709 13:05:44.757026 19718 leader_election.cc:290] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.759853 19718 raft_consensus.cc:2804] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:44.754583 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1a9a7451e24c88a965530eb1aac51b" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:44.760031 19675 raft_consensus.cc:359] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.761109 19486 raft_consensus.cc:2468] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:44.761139 19675 raft_consensus.cc:385] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.763017 19675 raft_consensus.cc:740] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.767179 19675 consensus_queue.cc:260] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.762108 19718 raft_consensus.cc:493] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.774886 19718 raft_consensus.cc:3060] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.753410 19677 raft_consensus.cc:515] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.790691 19678 raft_consensus.cc:359] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:44.791759 19678 raft_consensus.cc:385] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.792090 19678 raft_consensus.cc:740] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.794279 19678 consensus_queue.cc:260] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:44.797442 19678 ts_tablet_manager.cc:1434] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 13:05:44.799538 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1a9a7451e24c88a965530eb1aac51b" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:44.799579 19635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6ab9eea9d84a36bea7d114842c1fc9" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:44.800302 19635 raft_consensus.cc:2468] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:44.800302 19636 raft_consensus.cc:2468] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:44.792922 19683 leader_election.cc:290] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.806941 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93450d6918fe4d958c327c2f75516daf" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:44.807616 19727 raft_consensus.cc:493] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.807723 19634 raft_consensus.cc:2468] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:44.808266 19727 raft_consensus.cc:515] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.808820 19526 leader_election.cc:304] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:44.809911 19526 leader_election.cc:304] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:44.811568 19726 raft_consensus.cc:2804] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:44.811865 19679 tablet_bootstrap.cc:492] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:44.812479 19679 ts_tablet_manager.cc:1403] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.017s
I20260709 13:05:44.812264 19726 raft_consensus.cc:493] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.813155 19726 raft_consensus.cc:3060] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.815593 19679 raft_consensus.cc:359] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.816325 19679 raft_consensus.cc:385] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:44.816582 19679 raft_consensus.cc:740] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:44.817288 19679 consensus_queue.cc:260] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.818142 19683 raft_consensus.cc:2804] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:44.817653 19385 catalog_manager.cc:5697] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.818593 19683 raft_consensus.cc:493] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.819294 19683 raft_consensus.cc:3060] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.819998 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d54e2d6c945bd952cf46755a0b0a1" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:44.820650 19561 raft_consensus.cc:3060] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.819893 19385 catalog_manager.cc:5697] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:44.804150 19527 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:43955, user_credentials={real_user=slave}} blocked reactor thread for 48034us
I20260709 13:05:44.821980 19718 raft_consensus.cc:515] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.829195 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6ab9eea9d84a36bea7d114842c1fc9" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:44.829939 19487 raft_consensus.cc:2468] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:44.823277 19385 catalog_manager.cc:5697] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.830989 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:44.830014 19718 leader_election.cc:290] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.830289 19727 leader_election.cc:290] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.827010 19683 raft_consensus.cc:515] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:44.827447 19675 ts_tablet_manager.cc:1434] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.121s	user 0.004s	sys 0.006s
I20260709 13:05:44.832093 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93450d6918fe4d958c327c2f75516daf" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:44.832710 19487 raft_consensus.cc:3060] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.833262 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:44.831810 19562 raft_consensus.cc:2393] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0479c7f55b243b7b6093626504d266d in current term 1: Already voted for candidate 37776c8ae93f49588bd377ce7c8a1b75 in this term.
I20260709 13:05:44.834388 19683 leader_election.cc:290] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.833587 19385 catalog_manager.cc:5697] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.833214 19718 raft_consensus.cc:493] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.836071 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1a9a7451e24c88a965530eb1aac51b" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:44.836211 19451 leader_election.cc:304] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0479c7f55b243b7b6093626504d266d; no voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:44.836732 19486 raft_consensus.cc:3060] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.837672 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d54e2d6c945bd952cf46755a0b0a1" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:44.838308 19634 raft_consensus.cc:3060] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.840752 19487 raft_consensus.cc:2468] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 1.
I20260709 13:05:44.842470 19527 leader_election.cc:304] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:44.842618 19727 raft_consensus.cc:3060] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.843508 19683 raft_consensus.cc:2804] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:44.836231 19718 raft_consensus.cc:515] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.847477 19486 raft_consensus.cc:2468] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 1.
I20260709 13:05:44.844070 19683 raft_consensus.cc:697] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:44.850077 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93450d6918fe4d958c327c2f75516daf" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:44.850710 19636 raft_consensus.cc:3060] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.850958 19527 leader_election.cc:304] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:44.849956 19683 consensus_queue.cc:237] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.853802 19633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87ed645b59244d8900748909544dfe2" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:44.853833 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87ed645b59244d8900748909544dfe2" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:44.857159 19677 leader_election.cc:290] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.854823 19727 raft_consensus.cc:2749] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:44.858476 19635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1a9a7451e24c88a965530eb1aac51b" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:44.858668 19561 raft_consensus.cc:2468] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 1.
I20260709 13:05:44.859263 19635 raft_consensus.cc:3060] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.854803 19634 raft_consensus.cc:2468] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 1.
I20260709 13:05:44.854394 19718 leader_election.cc:290] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.860306 19451 leader_election.cc:304] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:44.861202 19727 raft_consensus.cc:2804] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:44.860394 19728 raft_consensus.cc:2804] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:44.861760 19727 raft_consensus.cc:697] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:44.863345 19727 consensus_queue.cc:237] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.861861 19728 raft_consensus.cc:697] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:44.868304 19728 consensus_queue.cc:237] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:44.856736 19726 raft_consensus.cc:515] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.869786 19636 raft_consensus.cc:2468] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 1.
I20260709 13:05:44.857479 19486 raft_consensus.cc:2393] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29aef9a1cf614f47958c16d7a3d39f19 in current term 1: Already voted for candidate 37776c8ae93f49588bd377ce7c8a1b75 in this term.
I20260709 13:05:44.872103 19726 leader_election.cc:290] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.872835 19679 ts_tablet_manager.cc:1434] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.007s
I20260709 13:05:44.868209 19635 raft_consensus.cc:2468] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 1.
I20260709 13:05:44.876037 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6ab9eea9d84a36bea7d114842c1fc9" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:44.877285 19486 raft_consensus.cc:3060] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.873813 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e6ab9eea9d84a36bea7d114842c1fc9" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:44.875629 19527 leader_election.cc:304] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19; no voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d
I20260709 13:05:44.880468 19636 raft_consensus.cc:3060] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.881300 19726 raft_consensus.cc:3060] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.888540 19486 raft_consensus.cc:2468] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 1.
I20260709 13:05:44.889588 19636 raft_consensus.cc:2468] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 1.
I20260709 13:05:44.889560 19384 catalog_manager.cc:5697] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:44.891152 19526 leader_election.cc:304] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:44.891979 19683 raft_consensus.cc:2804] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:44.892495 19683 raft_consensus.cc:697] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:44.893571 19726 raft_consensus.cc:2749] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:44.893343 19683 consensus_queue.cc:237] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.891729 19384 catalog_manager.cc:5697] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.899360 19385 catalog_manager.cc:5697] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 0 to 1, leader changed from <none> to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 1 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:44.910429 19382 catalog_manager.cc:5697] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:44.931849 19727 raft_consensus.cc:493] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.932374 19727 raft_consensus.cc:515] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:44.934435 19727 leader_election.cc:290] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:44.935003 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:44.935531 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:44.935775 19561 raft_consensus.cc:2393] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0479c7f55b243b7b6093626504d266d in current term 1: Already voted for candidate 37776c8ae93f49588bd377ce7c8a1b75 in this term.
I20260709 13:05:44.937438 19451 leader_election.cc:304] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0479c7f55b243b7b6093626504d266d; no voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:44.938297 19727 raft_consensus.cc:3060] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:44.944587 19727 raft_consensus.cc:2749] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:44.946362 19561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d1a9a7451e24c88a965530eb1aac51b"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
mode: GRACEFUL
new_leader_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:48456
I20260709 13:05:44.946867 19561 raft_consensus.cc:606] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Received request to transfer leadership to TS d0479c7f55b243b7b6093626504d266d
I20260709 13:05:44.951814 19561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93450d6918fe4d958c327c2f75516daf"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
mode: GRACEFUL
new_leader_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:48456
I20260709 13:05:44.952260 19561 raft_consensus.cc:606] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Received request to transfer leadership to TS d0479c7f55b243b7b6093626504d266d
I20260709 13:05:44.963843 19636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f45e3c99c5e24c028f1ff3728c454967"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
mode: GRACEFUL
new_leader_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:38512
I20260709 13:05:44.964371 19636 raft_consensus.cc:606] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Received request to transfer leadership to TS d0479c7f55b243b7b6093626504d266d
I20260709 13:05:44.969503 19636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
mode: GRACEFUL
new_leader_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:38512
I20260709 13:05:44.970077 19636 raft_consensus.cc:606] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Received request to transfer leadership to TS d0479c7f55b243b7b6093626504d266d
I20260709 13:05:44.975119 19636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
mode: GRACEFUL
new_leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:38512
I20260709 13:05:44.975674 19636 raft_consensus.cc:606] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Received request to transfer leadership to TS 29aef9a1cf614f47958c16d7a3d39f19
I20260709 13:05:44.975700 19684 consensus_queue.cc:1048] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:44.981799 19636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bad169a236f045d7ad9ad781a28fa8c5"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
mode: GRACEFUL
new_leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:38512
I20260709 13:05:44.982431 19636 raft_consensus.cc:606] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Received request to transfer leadership to TS 29aef9a1cf614f47958c16d7a3d39f19
I20260709 13:05:44.993238 19636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e87ed645b59244d8900748909544dfe2"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
mode: GRACEFUL
new_leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:38512
I20260709 13:05:44.997292 19636 raft_consensus.cc:606] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Received request to transfer leadership to TS 29aef9a1cf614f47958c16d7a3d39f19
I20260709 13:05:45.006199 19699 consensus_queue.cc:1048] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.016201 19684 raft_consensus.cc:993] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75: : Instructing follower d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:45.016661 19684 raft_consensus.cc:1081] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Signalling peer d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:45.018354 19487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:51656
I20260709 13:05:45.018930 19487 raft_consensus.cc:493] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.019316 19487 raft_consensus.cc:3060] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.022689 19699 consensus_queue.cc:1048] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:45.023092 19486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "423d54e2d6c945bd952cf46755a0b0a1"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
mode: GRACEFUL
new_leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:51674
I20260709 13:05:45.023707 19486 raft_consensus.cc:606] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Received request to transfer leadership to TS 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:45.025574 19487 raft_consensus.cc:515] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.027837 19683 raft_consensus.cc:493] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.028348 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:45.028435 19683 raft_consensus.cc:515] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.029007 19561 raft_consensus.cc:3060] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.033422 19683 leader_election.cc:290] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:45.034193 19562 raft_consensus.cc:3060] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:45.034497 19487 leader_election.cc:290] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:45.034500 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad169a236f045d7ad9ad781a28fa8c5" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:45.035583 19635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:45.036166 19635 raft_consensus.cc:3055] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.036486 19635 raft_consensus.cc:740] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:45.037285 19635 consensus_queue.cc:260] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.038727 19635 raft_consensus.cc:3060] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.039148 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad169a236f045d7ad9ad781a28fa8c5" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:45.039980 19561 raft_consensus.cc:2468] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:45.042286 19527 leader_election.cc:304] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19; no voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d
I20260709 13:05:45.043099 19451 leader_election.cc:304] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:45.044032 19727 raft_consensus.cc:2804] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.044507 19727 raft_consensus.cc:697] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:45.045322 19727 consensus_queue.cc:237] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.046756 19683 raft_consensus.cc:2749] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:45.048230 19635 raft_consensus.cc:2468] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:45.048794 19716 consensus_queue.cc:1048] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:45.050494 19699 consensus_queue.cc:1048] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.055572 19385 catalog_manager.cc:5697] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 1 to 2, leader changed from 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195) to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 2 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.073329 19701 raft_consensus.cc:993] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75: : Instructing follower 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:45.073832 19716 raft_consensus.cc:1081] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Signalling peer 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:45.076499 19561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bad169a236f045d7ad9ad781a28fa8c5"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:48448
I20260709 13:05:45.077093 19561 raft_consensus.cc:493] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.077984 19561 raft_consensus.cc:3060] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.081862 19701 consensus_queue.cc:1048] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.086790 19561 raft_consensus.cc:515] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.089167 19701 raft_consensus.cc:993] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75: : Instructing follower 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:45.089717 19701 raft_consensus.cc:1081] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Signalling peer 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:45.090380 19561 leader_election.cc:290] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:45.090564 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad169a236f045d7ad9ad781a28fa8c5" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:45.090607 19635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad169a236f045d7ad9ad781a28fa8c5" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:45.091429 19486 raft_consensus.cc:3060] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.091547 19635 raft_consensus.cc:3055] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.092013 19635 raft_consensus.cc:740] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:45.092823 19635 consensus_queue.cc:260] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.094064 19635 raft_consensus.cc:3060] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.092767 19561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:48448
I20260709 13:05:45.095077 19561 raft_consensus.cc:493] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.095510 19561 raft_consensus.cc:3060] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.099452 19486 raft_consensus.cc:2468] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:45.100737 19527 leader_election.cc:304] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:45.101603 19683 raft_consensus.cc:2804] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.102233 19683 raft_consensus.cc:697] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:45.102708 19561 raft_consensus.cc:515] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.101500 19635 raft_consensus.cc:2468] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:45.102993 19683 consensus_queue.cc:237] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.104872 19561 leader_election.cc:290] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:45.106274 19635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:45.106822 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:45.106890 19635 raft_consensus.cc:3055] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.107470 19635 raft_consensus.cc:740] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:45.107491 19486 raft_consensus.cc:3060] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.108409 19635 consensus_queue.cc:260] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.109571 19635 raft_consensus.cc:3060] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.111202 19382 catalog_manager.cc:5697] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 1 to 2, leader changed from 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195) to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.114761 19635 raft_consensus.cc:2468] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:45.114850 19486 raft_consensus.cc:2468] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:45.116258 19526 leader_election.cc:304] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:45.117937 19683 raft_consensus.cc:2804] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.118469 19683 raft_consensus.cc:697] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:45.119261 19683 consensus_queue.cc:237] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.125381 19382 catalog_manager.cc:5697] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 1 to 2, leader changed from 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195) to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.135917 19716 consensus_queue.cc:1048] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.142565 19701 raft_consensus.cc:993] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75: : Instructing follower 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:45.142659 19684 consensus_queue.cc:1048] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:45.143087 19699 raft_consensus.cc:1081] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Signalling peer 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:45.146476 19560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e87ed645b59244d8900748909544dfe2"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:48448
I20260709 13:05:45.147197 19560 raft_consensus.cc:493] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.147663 19560 raft_consensus.cc:3060] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.148980 19684 consensus_queue.cc:1048] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.160656 19560 raft_consensus.cc:515] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.163960 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87ed645b59244d8900748909544dfe2" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:45.165212 19635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87ed645b59244d8900748909544dfe2" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:45.165863 19635 raft_consensus.cc:3055] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.166200 19635 raft_consensus.cc:740] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:45.166987 19635 consensus_queue.cc:260] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.167903 19635 raft_consensus.cc:3060] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.169067 19684 consensus_queue.cc:1048] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:45.175698 19635 raft_consensus.cc:2468] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:45.176759 19560 leader_election.cc:290] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:45.177430 19684 raft_consensus.cc:993] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75: : Instructing follower d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:45.178074 19684 raft_consensus.cc:1081] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Signalling peer d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:45.178155 19526 leader_election.cc:304] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: d0479c7f55b243b7b6093626504d266d
I20260709 13:05:45.179062 19683 raft_consensus.cc:2804] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.179528 19683 raft_consensus.cc:697] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:45.180354 19683 consensus_queue.cc:237] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.182744 19485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f45e3c99c5e24c028f1ff3728c454967"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:51656
I20260709 13:05:45.183396 19485 raft_consensus.cc:493] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.183867 19485 raft_consensus.cc:3060] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.188052 19385 catalog_manager.cc:5697] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 1 to 2, leader changed from 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195) to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.191072 19485 raft_consensus.cc:515] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.193157 19485 leader_election.cc:290] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:45.194716 19635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45e3c99c5e24c028f1ff3728c454967" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:45.194880 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45e3c99c5e24c028f1ff3728c454967" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:45.195299 19635 raft_consensus.cc:3055] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.195523 19560 raft_consensus.cc:3060] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.195703 19635 raft_consensus.cc:740] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:45.196655 19635 consensus_queue.cc:260] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.198012 19635 raft_consensus.cc:3060] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.201381 19560 raft_consensus.cc:2468] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:45.202494 19451 leader_election.cc:304] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:45.203277 19727 raft_consensus.cc:2804] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.203689 19727 raft_consensus.cc:697] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:45.204484 19727 consensus_queue.cc:237] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.204859 19635 raft_consensus.cc:2468] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:45.210724 19382 catalog_manager.cc:5697] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 1 to 2, leader changed from 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195) to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 2 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.280109 19727 consensus_queue.cc:1048] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.286896 19683 consensus_queue.cc:1048] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.287120 19677 raft_consensus.cc:993] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d: : Instructing follower 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:45.287797 19677 raft_consensus.cc:1081] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Signalling peer 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:45.289834 19636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "423d54e2d6c945bd952cf46755a0b0a1"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:38492
I20260709 13:05:45.290433 19636 raft_consensus.cc:493] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.290809 19636 raft_consensus.cc:3060] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.296615 19729 consensus_queue.cc:1048] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:45.297035 19728 raft_consensus.cc:993] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19: : Instructing follower d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:45.297595 19728 raft_consensus.cc:1081] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Signalling peer d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:45.303620 19718 consensus_queue.cc:1048] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.304720 19636 raft_consensus.cc:515] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.306777 19635 raft_consensus.cc:1240] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Rejecting Update request from peer d0479c7f55b243b7b6093626504d266d for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:45.308916 19636 leader_election.cc:290] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 2 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:45.311363 19729 consensus_queue.cc:1059] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:45.312068 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d54e2d6c945bd952cf46755a0b0a1" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:45.312633 19729 raft_consensus.cc:3055] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.312716 19560 raft_consensus.cc:3060] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.313033 19729 raft_consensus.cc:740] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:45.314163 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423d54e2d6c945bd952cf46755a0b0a1" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:45.314517 19485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d1a9a7451e24c88a965530eb1aac51b"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:51658
I20260709 13:05:45.314749 19729 consensus_queue.cc:260] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.316254 19729 raft_consensus.cc:3060] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.315256 19485 raft_consensus.cc:493] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.319566 19485 raft_consensus.cc:3060] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.325773 19560 raft_consensus.cc:2468] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 2.
I20260709 13:05:45.326344 19485 raft_consensus.cc:515] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:45.327085 19600 leader_election.cc:304] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:45.327944 19684 raft_consensus.cc:2804] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.328423 19684 raft_consensus.cc:697] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:45.329567 19485 leader_election.cc:290] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Requested vote from peers 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:45.329268 19684 consensus_queue.cc:237] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.331038 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1a9a7451e24c88a965530eb1aac51b" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:45.331316 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1a9a7451e24c88a965530eb1aac51b" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:45.331655 19634 raft_consensus.cc:3060] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.331897 19560 raft_consensus.cc:3055] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.332234 19560 raft_consensus.cc:740] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:45.333051 19560 consensus_queue.cc:260] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:45.334201 19560 raft_consensus.cc:3060] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.334888 19487 raft_consensus.cc:2468] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 2.
I20260709 13:05:45.339242 19634 raft_consensus.cc:2468] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:45.339396 19385 catalog_manager.cc:5697] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 1 to 2, leader changed from d0479c7f55b243b7b6093626504d266d (127.7.41.193) to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:45.340421 19451 leader_election.cc:304] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:45.341231 19729 raft_consensus.cc:2804] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.341542 19560 raft_consensus.cc:2468] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:45.341683 19729 raft_consensus.cc:697] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:45.344146 19729 consensus_queue.cc:237] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } }
I20260709 13:05:45.351336 19382 catalog_manager.cc:5697] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 1 to 2, leader changed from 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194) to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 2 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.403759 19718 consensus_queue.cc:1048] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.407087 19718 consensus_queue.cc:1048] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.414417 19718 consensus_queue.cc:1048] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.421940 19730 raft_consensus.cc:993] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19: : Instructing follower d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:45.423141 19730 raft_consensus.cc:1081] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Signalling peer d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:45.426453 19487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93450d6918fe4d958c327c2f75516daf"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:51658
I20260709 13:05:45.427017 19487 raft_consensus.cc:493] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.427413 19487 raft_consensus.cc:3060] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.434814 19487 raft_consensus.cc:515] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.435288 19718 consensus_queue.cc:1048] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:45.436887 19487 leader_election.cc:290] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:45.437976 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93450d6918fe4d958c327c2f75516daf" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:45.438651 19560 raft_consensus.cc:3055] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.438953 19560 raft_consensus.cc:740] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:45.439702 19560 consensus_queue.cc:260] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.441790 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93450d6918fe4d958c327c2f75516daf" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:45.442447 19634 raft_consensus.cc:3060] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.444633 19560 raft_consensus.cc:3060] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.448576 19634 raft_consensus.cc:2468] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:45.449944 19451 leader_election.cc:304] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:45.450785 19729 raft_consensus.cc:2804] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.451131 19560 raft_consensus.cc:2468] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:45.451269 19729 raft_consensus.cc:697] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:45.452236 19729 consensus_queue.cc:237] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:45.458176 19382 catalog_manager.cc:5697] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 1 to 2, leader changed from 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194) to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 2 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.535315 19485 raft_consensus.cc:1275] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.536789 19718 consensus_queue.cc:1048] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.544730 19634 raft_consensus.cc:1275] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.547004 19730 consensus_queue.cc:1048] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.577628 19634 raft_consensus.cc:1275] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.578981 19729 consensus_queue.cc:1048] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.587847 19634 raft_consensus.cc:1275] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.589605 19730 consensus_queue.cc:1048] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.590243 19560 raft_consensus.cc:1275] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.593273 19757 consensus_queue.cc:1048] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.598506 19485 raft_consensus.cc:1275] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.599946 19718 consensus_queue.cc:1048] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.611433 19636 raft_consensus.cc:1275] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.613234 19677 consensus_queue.cc:1048] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.615651 19560 raft_consensus.cc:1275] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.617051 19677 consensus_queue.cc:1048] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.654341 19485 raft_consensus.cc:3060] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.659922 19485 raft_consensus.cc:1275] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.661198 19718 consensus_queue.cc:1048] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.668680 19636 raft_consensus.cc:1275] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.670733 19726 consensus_queue.cc:1048] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.764402 19562 raft_consensus.cc:1275] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.765702 19684 consensus_queue.cc:1048] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.777447 19485 raft_consensus.cc:1275] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.778970 19759 consensus_queue.cc:1048] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.840624 19636 raft_consensus.cc:1275] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.841952 19757 consensus_queue.cc:1048] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.849850 19562 raft_consensus.cc:1275] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.851722 19729 consensus_queue.cc:1048] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.966547 19562 raft_consensus.cc:1275] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.968212 19729 consensus_queue.cc:1048] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.976032 19636 raft_consensus.cc:1275] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.977643 19729 consensus_queue.cc:1048] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:48.056437 19382 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56600:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:48.058614 19382 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:48.104753 19473 tablet_service.cc:1511] Processing CreateTablet for tablet 2474c53e0e3d47f9b3c9237ac11a4045 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:48.106091 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2474c53e0e3d47f9b3c9237ac11a4045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.105754 19551 tablet_service.cc:1511] Processing CreateTablet for tablet 2474c53e0e3d47f9b3c9237ac11a4045 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:48.107081 19551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2474c53e0e3d47f9b3c9237ac11a4045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.107466 19626 tablet_service.cc:1511] Processing CreateTablet for tablet 2474c53e0e3d47f9b3c9237ac11a4045 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:48.108716 19626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2474c53e0e3d47f9b3c9237ac11a4045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.111395 19471 tablet_service.cc:1511] Processing CreateTablet for tablet f59c14d708e144d6b61dea112358952b (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:48.112658 19471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59c14d708e144d6b61dea112358952b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.114962 19618 tablet_service.cc:1511] Processing CreateTablet for tablet f59c14d708e144d6b61dea112358952b (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:48.116230 19618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59c14d708e144d6b61dea112358952b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.119043 19547 tablet_service.cc:1511] Processing CreateTablet for tablet f59c14d708e144d6b61dea112358952b (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:48.120317 19547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f59c14d708e144d6b61dea112358952b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.129781 19773 tablet_bootstrap.cc:492] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:48.130273 19774 tablet_bootstrap.cc:492] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:48.136168 19774 tablet_bootstrap.cc:654] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.137697 19773 tablet_bootstrap.cc:654] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.146072 19473 tablet_service.cc:1511] Processing CreateTablet for tablet c0532b1070b64cf496ba1708d67e6206 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:48.147934 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0532b1070b64cf496ba1708d67e6206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.152107 19551 tablet_service.cc:1511] Processing CreateTablet for tablet c0532b1070b64cf496ba1708d67e6206 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:48.153429 19551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0532b1070b64cf496ba1708d67e6206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.161900 19774 tablet_bootstrap.cc:492] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:48.162554 19774 ts_tablet_manager.cc:1403] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.004s
I20260709 13:05:48.166472 19625 tablet_service.cc:1511] Processing CreateTablet for tablet c0532b1070b64cf496ba1708d67e6206 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:48.167835 19625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0532b1070b64cf496ba1708d67e6206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.170343 19469 tablet_service.cc:1511] Processing CreateTablet for tablet 81ac3d8cb14941548d0c3baef77d029c (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:48.171685 19469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ac3d8cb14941548d0c3baef77d029c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.165665 19774 raft_consensus.cc:359] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.174751 19774 raft_consensus.cc:385] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.174623 19552 tablet_service.cc:1511] Processing CreateTablet for tablet 81ac3d8cb14941548d0c3baef77d029c (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:48.175150 19774 raft_consensus.cc:740] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.176013 19552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ac3d8cb14941548d0c3baef77d029c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.178231 19773 tablet_bootstrap.cc:492] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:48.178802 19773 ts_tablet_manager.cc:1403] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.012s
I20260709 13:05:48.180459 19620 tablet_service.cc:1511] Processing CreateTablet for tablet 81ac3d8cb14941548d0c3baef77d029c (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:48.181771 19620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ac3d8cb14941548d0c3baef77d029c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.182015 19773 raft_consensus.cc:359] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.182826 19773 raft_consensus.cc:385] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.183135 19773 raft_consensus.cc:740] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.183841 19773 consensus_queue.cc:260] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.184921 19550 tablet_service.cc:1511] Processing CreateTablet for tablet 794c2c688ff843229b3ca40d7668ba35 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:48.186260 19550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794c2c688ff843229b3ca40d7668ba35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.186544 19773 ts_tablet_manager.cc:1434] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:48.187572 19773 tablet_bootstrap.cc:492] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:48.188275 19624 tablet_service.cc:1511] Processing CreateTablet for tablet 794c2c688ff843229b3ca40d7668ba35 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:48.199692 19624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794c2c688ff843229b3ca40d7668ba35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.176030 19774 consensus_queue.cc:260] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.203433 19774 ts_tablet_manager.cc:1434] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:05:48.204401 19774 tablet_bootstrap.cc:492] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:48.187692 19473 tablet_service.cc:1511] Processing CreateTablet for tablet 794c2c688ff843229b3ca40d7668ba35 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:48.198289 19471 tablet_service.cc:1511] Processing CreateTablet for tablet 2088bde43a6b476eb51297cfda3ac214 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:48.213914 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 794c2c688ff843229b3ca40d7668ba35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.211443 19728 raft_consensus.cc:493] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.216791 19728 raft_consensus.cc:515] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.217402 19619 tablet_service.cc:1511] Processing CreateTablet for tablet 2088bde43a6b476eb51297cfda3ac214 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:48.218753 19619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2088bde43a6b476eb51297cfda3ac214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.218914 19728 leader_election.cc:290] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.220981 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:48.221666 19485 raft_consensus.cc:2468] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:48.222189 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:48.223148 19527 leader_election.cc:304] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
W20260709 13:05:48.223723 19526 leader_election.cc:343] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.224089 19728 raft_consensus.cc:2804] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.224498 19728 raft_consensus.cc:493] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.224824 19728 raft_consensus.cc:3060] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.194180 19773 tablet_bootstrap.cc:654] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.214442 19551 tablet_service.cc:1511] Processing CreateTablet for tablet 2088bde43a6b476eb51297cfda3ac214 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:48.234935 19551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2088bde43a6b476eb51297cfda3ac214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.233626 19728 raft_consensus.cc:515] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.241943 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:48.243489 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:48.242893 19728 leader_election.cc:290] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.246872 19774 tablet_bootstrap.cc:654] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:48.246280 19526 leader_election.cc:343] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.244123 19485 raft_consensus.cc:3060] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.243960 19775 tablet_bootstrap.cc:492] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:48.246642 19471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2088bde43a6b476eb51297cfda3ac214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.269549 19485 raft_consensus.cc:2468] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 1.
I20260709 13:05:48.246433 19469 tablet_service.cc:1511] Processing CreateTablet for tablet 86a592376cce4ee2b91ca76b9c5bb0fe (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:48.271190 19469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86a592376cce4ee2b91ca76b9c5bb0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.278399 19551 tablet_service.cc:1511] Processing CreateTablet for tablet 86a592376cce4ee2b91ca76b9c5bb0fe (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:48.279241 19619 tablet_service.cc:1511] Processing CreateTablet for tablet 86a592376cce4ee2b91ca76b9c5bb0fe (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:48.279945 19551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86a592376cce4ee2b91ca76b9c5bb0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.281368 19474 tablet_service.cc:1511] Processing CreateTablet for tablet dc6a6f295c29495bb96d4f9d8b1d79f3 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:48.282650 19474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc6a6f295c29495bb96d4f9d8b1d79f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.285524 19619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86a592376cce4ee2b91ca76b9c5bb0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.286803 19527 leader_election.cc:304] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:48.288241 19728 raft_consensus.cc:2804] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.288767 19728 raft_consensus.cc:697] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:48.289574 19728 consensus_queue.cc:237] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.301379 19625 tablet_service.cc:1511] Processing CreateTablet for tablet dc6a6f295c29495bb96d4f9d8b1d79f3 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:48.302960 19625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc6a6f295c29495bb96d4f9d8b1d79f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.309480 19773 tablet_bootstrap.cc:492] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:48.310098 19773 ts_tablet_manager.cc:1403] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.021s
I20260709 13:05:48.313222 19773 raft_consensus.cc:359] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.313966 19773 raft_consensus.cc:385] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.314280 19773 raft_consensus.cc:740] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.315016 19773 consensus_queue.cc:260] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.315176 19547 tablet_service.cc:1511] Processing CreateTablet for tablet dc6a6f295c29495bb96d4f9d8b1d79f3 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:48.318548 19547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc6a6f295c29495bb96d4f9d8b1d79f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.319414 19773 ts_tablet_manager.cc:1434] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:48.320999 19773 tablet_bootstrap.cc:492] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:48.333470 19473 tablet_service.cc:1511] Processing CreateTablet for tablet 44604e0e855f4279a2bb5edca42723e9 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:48.330039 19773 tablet_bootstrap.cc:654] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.335271 19473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44604e0e855f4279a2bb5edca42723e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.335958 19775 tablet_bootstrap.cc:654] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.344437 19382 catalog_manager.cc:5697] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.346599 19551 tablet_service.cc:1511] Processing CreateTablet for tablet 44604e0e855f4279a2bb5edca42723e9 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:48.355962 19774 tablet_bootstrap.cc:492] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:48.356742 19774 ts_tablet_manager.cc:1403] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.153s	user 0.030s	sys 0.012s
I20260709 13:05:48.362555 19774 raft_consensus.cc:359] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.356254 19551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44604e0e855f4279a2bb5edca42723e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.381456 19774 raft_consensus.cc:385] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.381829 19774 raft_consensus.cc:740] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.384488 19619 tablet_service.cc:1511] Processing CreateTablet for tablet 44604e0e855f4279a2bb5edca42723e9 (DEFAULT_TABLE table=soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:48.386981 19774 consensus_queue.cc:260] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.387722 19619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44604e0e855f4279a2bb5edca42723e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:48.389462 19774 ts_tablet_manager.cc:1434] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:05:48.393221 19774 tablet_bootstrap.cc:492] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:48.397146 19773 tablet_bootstrap.cc:492] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:48.397729 19773 ts_tablet_manager.cc:1403] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.025s
I20260709 13:05:48.398891 19775 tablet_bootstrap.cc:492] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:48.399511 19775 ts_tablet_manager.cc:1403] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.156s	user 0.013s	sys 0.028s
I20260709 13:05:48.401106 19773 raft_consensus.cc:359] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.401902 19773 raft_consensus.cc:385] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.402218 19773 raft_consensus.cc:740] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.402935 19773 consensus_queue.cc:260] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.405215 19773 ts_tablet_manager.cc:1434] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:48.406473 19773 tablet_bootstrap.cc:492] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:48.410581 19774 tablet_bootstrap.cc:654] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.412659 19773 tablet_bootstrap.cc:654] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.402611 19775 raft_consensus.cc:359] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.420527 19775 raft_consensus.cc:385] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.420872 19775 raft_consensus.cc:740] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.421671 19775 consensus_queue.cc:260] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.427050 19775 ts_tablet_manager.cc:1434] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:05:48.427227 19774 tablet_bootstrap.cc:492] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:48.427845 19774 ts_tablet_manager.cc:1403] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.003s
I20260709 13:05:48.427959 19773 tablet_bootstrap.cc:492] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:48.428498 19773 ts_tablet_manager.cc:1403] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:05:48.428499 19775 tablet_bootstrap.cc:492] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:48.430791 19774 raft_consensus.cc:359] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.431263 19774 raft_consensus.cc:385] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.431447 19774 raft_consensus.cc:740] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.431986 19774 consensus_queue.cc:260] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.432111 19773 raft_consensus.cc:359] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.433219 19773 raft_consensus.cc:385] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.433499 19773 raft_consensus.cc:740] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.434119 19774 ts_tablet_manager.cc:1434] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:48.434309 19773 consensus_queue.cc:260] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.435225 19774 tablet_bootstrap.cc:492] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:48.438917 19773 ts_tablet_manager.cc:1434] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:05:48.439967 19773 tablet_bootstrap.cc:492] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:48.442710 19774 tablet_bootstrap.cc:654] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.447388 19773 tablet_bootstrap.cc:654] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.455086 19775 tablet_bootstrap.cc:654] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.456404 19774 tablet_bootstrap.cc:492] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:48.456481 19773 tablet_bootstrap.cc:492] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:48.457145 19774 ts_tablet_manager.cc:1403] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:05:48.457196 19773 ts_tablet_manager.cc:1403] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.006s
I20260709 13:05:48.460289 19773 raft_consensus.cc:359] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.460856 19775 tablet_bootstrap.cc:492] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:48.460832 19773 raft_consensus.cc:385] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.461545 19773 raft_consensus.cc:740] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.460789 19774 raft_consensus.cc:359] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.461671 19775 ts_tablet_manager.cc:1403] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.004s
I20260709 13:05:48.461982 19774 raft_consensus.cc:385] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.462368 19774 raft_consensus.cc:740] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.462462 19773 consensus_queue.cc:260] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.463161 19774 consensus_queue.cc:260] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.464422 19775 raft_consensus.cc:359] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.465019 19775 raft_consensus.cc:385] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.465263 19775 raft_consensus.cc:740] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.465410 19774 ts_tablet_manager.cc:1434] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:48.465914 19775 consensus_queue.cc:260] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.466465 19774 tablet_bootstrap.cc:492] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:48.468127 19775 ts_tablet_manager.cc:1434] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:48.470445 19775 tablet_bootstrap.cc:492] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:48.472937 19773 ts_tablet_manager.cc:1434] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:05:48.475998 19774 tablet_bootstrap.cc:654] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.476953 19775 tablet_bootstrap.cc:654] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.482102 19773 tablet_bootstrap.cc:492] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:48.485452 19775 tablet_bootstrap.cc:492] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:48.489997 19775 ts_tablet_manager.cc:1403] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:05:48.491577 19774 tablet_bootstrap.cc:492] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:48.492183 19774 ts_tablet_manager.cc:1403] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.009s
I20260709 13:05:48.493067 19775 raft_consensus.cc:359] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.493875 19775 raft_consensus.cc:385] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.494208 19775 raft_consensus.cc:740] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.494997 19775 consensus_queue.cc:260] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.495256 19774 raft_consensus.cc:359] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.495914 19774 raft_consensus.cc:385] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.496219 19774 raft_consensus.cc:740] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.497349 19775 ts_tablet_manager.cc:1434] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:05:48.497001 19774 consensus_queue.cc:260] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.498359 19775 tablet_bootstrap.cc:492] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:48.499574 19774 ts_tablet_manager.cc:1434] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:05:48.500590 19774 tablet_bootstrap.cc:492] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:48.504354 19773 tablet_bootstrap.cc:654] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.505458 19775 tablet_bootstrap.cc:654] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.507050 19774 tablet_bootstrap.cc:654] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.517639 19773 tablet_bootstrap.cc:492] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:48.518087 19775 tablet_bootstrap.cc:492] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:48.518178 19773 ts_tablet_manager.cc:1403] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.007s
I20260709 13:05:48.518784 19775 ts_tablet_manager.cc:1403] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:05:48.518976 19774 tablet_bootstrap.cc:492] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:48.519510 19774 ts_tablet_manager.cc:1403] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:05:48.521509 19773 raft_consensus.cc:359] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.521723 19775 raft_consensus.cc:359] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.521991 19774 raft_consensus.cc:359] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.522433 19773 raft_consensus.cc:385] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.522500 19775 raft_consensus.cc:385] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.522729 19774 raft_consensus.cc:385] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.522843 19773 raft_consensus.cc:740] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.522941 19775 raft_consensus.cc:740] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.523298 19774 raft_consensus.cc:740] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.524137 19774 consensus_queue.cc:260] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.523957 19775 consensus_queue.cc:260] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.524008 19773 consensus_queue.cc:260] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.526575 19774 ts_tablet_manager.cc:1434] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:05:48.526594 19773 ts_tablet_manager.cc:1434] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:05:48.527740 19774 tablet_bootstrap.cc:492] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:48.527776 19773 tablet_bootstrap.cc:492] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:48.532438 19775 ts_tablet_manager.cc:1434] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:48.533456 19775 tablet_bootstrap.cc:492] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:48.538331 19774 tablet_bootstrap.cc:654] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.540702 19775 tablet_bootstrap.cc:654] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.542181 19773 tablet_bootstrap.cc:654] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.557663 19728 raft_consensus.cc:493] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.558295 19728 raft_consensus.cc:515] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.562309 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:48.563045 19636 raft_consensus.cc:2468] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:48.564066 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:48.564289 19526 leader_election.cc:304] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:48.564862 19728 leader_election.cc:290] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.565202 19778 raft_consensus.cc:2804] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.565647 19778 raft_consensus.cc:493] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.565940 19778 raft_consensus.cc:3060] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:48.569192 19433 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:48.562161 19761 raft_consensus.cc:493] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.569924 19761 raft_consensus.cc:515] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.571532 19773 tablet_bootstrap.cc:492] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:48.571844 19778 raft_consensus.cc:515] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.572074 19761 leader_election.cc:290] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:48.572083 19773 ts_tablet_manager.cc:1403] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.004s
I20260709 13:05:48.572472 19775 tablet_bootstrap.cc:492] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:48.572763 19761 raft_consensus.cc:493] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.573050 19775 ts_tablet_manager.cc:1403] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.015s
I20260709 13:05:48.573256 19761 raft_consensus.cc:515] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.574734 19757 raft_consensus.cc:493] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.575213 19757 raft_consensus.cc:515] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.575690 19773 raft_consensus.cc:359] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.576081 19775 raft_consensus.cc:359] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.576479 19773 raft_consensus.cc:385] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.576834 19775 raft_consensus.cc:385] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.576891 19773 raft_consensus.cc:740] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.577237 19775 raft_consensus.cc:740] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.578106 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0532b1070b64cf496ba1708d67e6206" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:48.578559 19761 leader_election.cc:290] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:48.578801 19562 raft_consensus.cc:2468] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 0.
I20260709 13:05:48.580751 19778 leader_election.cc:290] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.581413 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:48.581758 19485 raft_consensus.cc:2468] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:48.581548 19775 consensus_queue.cc:260] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.583047 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:48.583622 19636 raft_consensus.cc:3060] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.583774 19757 leader_election.cc:290] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.584262 19775 ts_tablet_manager.cc:1434] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:05:48.584244 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0532b1070b64cf496ba1708d67e6206" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:48.585517 19775 tablet_bootstrap.cc:492] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:48.588065 19451 leader_election.cc:304] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:48.585078 19634 raft_consensus.cc:2468] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 0.
I20260709 13:05:48.591548 19798 raft_consensus.cc:2804] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.592705 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c14d708e144d6b61dea112358952b" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:48.593094 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:48.593966 19487 raft_consensus.cc:2468] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:48.593966 19485 raft_consensus.cc:2468] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:48.595284 19601 leader_election.cc:304] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:48.596580 19601 leader_election.cc:304] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:48.596997 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c14d708e144d6b61dea112358952b" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:48.597378 19761 raft_consensus.cc:2804] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.597693 19562 raft_consensus.cc:2468] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:48.597816 19761 raft_consensus.cc:493] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.598515 19798 raft_consensus.cc:493] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.598838 19761 raft_consensus.cc:3060] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.599083 19798 raft_consensus.cc:3060] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.599838 19775 tablet_bootstrap.cc:654] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.606629 19798 raft_consensus.cc:515] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.608597 19800 raft_consensus.cc:493] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.610351 19800 raft_consensus.cc:515] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.611688 19774 tablet_bootstrap.cc:492] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:48.608723 19636 raft_consensus.cc:2468] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 1.
I20260709 13:05:48.612226 19774 ts_tablet_manager.cc:1403] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.000s
I20260709 13:05:48.612191 19797 raft_consensus.cc:2764] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:05:48.613983 19526 leader_election.cc:304] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: d0479c7f55b243b7b6093626504d266d
I20260709 13:05:48.614179 19761 raft_consensus.cc:515] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.615296 19728 raft_consensus.cc:2804] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.615608 19774 raft_consensus.cc:359] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.616379 19774 raft_consensus.cc:385] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.616611 19728 raft_consensus.cc:697] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:48.609468 19773 consensus_queue.cc:260] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.616727 19774 raft_consensus.cc:740] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.617503 19778 raft_consensus.cc:493] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.617676 19728 consensus_queue.cc:237] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.617961 19778 raft_consensus.cc:515] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.617960 19774 consensus_queue.cc:260] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.620700 19774 ts_tablet_manager.cc:1434] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:05:48.621658 19774 tablet_bootstrap.cc:492] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:48.622700 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a592376cce4ee2b91ca76b9c5bb0fe" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
W20260709 13:05:48.624060 19527 leader_election.cc:343] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.626096 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a592376cce4ee2b91ca76b9c5bb0fe" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
W20260709 13:05:48.627569 19526 leader_election.cc:343] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.628028 19526 leader_election.cc:304] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19; no voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d
I20260709 13:05:48.628425 19774 tablet_bootstrap.cc:654] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.628652 19778 leader_election.cc:290] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.629101 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:48.630196 19773 ts_tablet_manager.cc:1434] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:05:48.635030 19773 tablet_bootstrap.cc:492] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:48.636701 19800 leader_election.cc:290] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.637562 19798 leader_election.cc:290] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.640180 19560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794c2c688ff843229b3ca40d7668ba35" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:48.641016 19560 raft_consensus.cc:2468] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 0.
I20260709 13:05:48.642053 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0532b1070b64cf496ba1708d67e6206" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:48.642764 19561 raft_consensus.cc:3060] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.644455 19761 leader_election.cc:290] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:48.646613 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c14d708e144d6b61dea112358952b" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:48.646785 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c14d708e144d6b61dea112358952b" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:48.646998 19451 leader_election.cc:304] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:48.647267 19485 raft_consensus.cc:3060] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.647418 19562 raft_consensus.cc:3060] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.648360 19384 catalog_manager.cc:5697] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.650370 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0532b1070b64cf496ba1708d67e6206" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:48.650944 19634 raft_consensus.cc:3060] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.651414 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794c2c688ff843229b3ca40d7668ba35" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
W20260709 13:05:48.652937 19451 leader_election.cc:343] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.654469 19800 raft_consensus.cc:2804] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.654937 19800 raft_consensus.cc:493] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.657994 19485 raft_consensus.cc:2468] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:48.660980 19634 raft_consensus.cc:2468] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 1.
I20260709 13:05:48.661108 19800 raft_consensus.cc:3060] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.663122 19451 leader_election.cc:304] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:48.661917 19601 leader_election.cc:304] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:48.660373 19562 raft_consensus.cc:2468] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:48.664482 19761 raft_consensus.cc:2804] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.653837 19773 tablet_bootstrap.cc:654] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.665001 19761 raft_consensus.cc:697] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:48.664510 19775 tablet_bootstrap.cc:492] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:48.665733 19775 ts_tablet_manager.cc:1403] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.019s
I20260709 13:05:48.630162 19778 raft_consensus.cc:2749] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.660446 19561 raft_consensus.cc:2468] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 1.
I20260709 13:05:48.668319 19761 consensus_queue.cc:237] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.668891 19775 raft_consensus.cc:359] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.669631 19775 raft_consensus.cc:385] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.669922 19775 raft_consensus.cc:740] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.670688 19775 consensus_queue.cc:260] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.673394 19775 ts_tablet_manager.cc:1434] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:48.674583 19775 tablet_bootstrap.cc:492] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:48.664994 19798 raft_consensus.cc:2804] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.677654 19800 raft_consensus.cc:515] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.678882 19798 raft_consensus.cc:697] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:48.680742 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794c2c688ff843229b3ca40d7668ba35" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:48.681427 19775 tablet_bootstrap.cc:654] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.681021 19798 consensus_queue.cc:237] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.682230 19773 tablet_bootstrap.cc:492] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:48.682874 19773 ts_tablet_manager.cc:1403] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.000s
I20260709 13:05:48.682931 19774 tablet_bootstrap.cc:492] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:48.683478 19774 ts_tablet_manager.cc:1403] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.012s
I20260709 13:05:48.681448 19561 raft_consensus.cc:3060] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.685923 19773 raft_consensus.cc:359] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.686722 19773 raft_consensus.cc:385] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.687013 19773 raft_consensus.cc:740] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.687734 19773 consensus_queue.cc:260] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.695139 19773 ts_tablet_manager.cc:1434] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:48.696182 19773 tablet_bootstrap.cc:492] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19: Bootstrap starting.
I20260709 13:05:48.702178 19773 tablet_bootstrap.cc:654] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.706516 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794c2c688ff843229b3ca40d7668ba35" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:48.707186 19634 raft_consensus.cc:3060] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.708772 19385 catalog_manager.cc:5697] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 0 to 1, leader changed from <none> to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 1 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.710719 19384 catalog_manager.cc:5697] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.712857 19774 raft_consensus.cc:359] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.715219 19774 raft_consensus.cc:385] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.715471 19774 raft_consensus.cc:740] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.718441 19561 raft_consensus.cc:2468] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 1.
I20260709 13:05:48.719686 19451 leader_election.cc:304] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:48.720022 19634 raft_consensus.cc:2468] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 1.
I20260709 13:05:48.721112 19774 consensus_queue.cc:260] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.722327 19800 leader_election.cc:290] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.722456 19757 raft_consensus.cc:2804] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.723246 19757 raft_consensus.cc:697] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:48.724485 19757 consensus_queue.cc:237] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.725757 19774 ts_tablet_manager.cc:1434] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.004s
I20260709 13:05:48.725834 19634 raft_consensus.cc:3060] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.727007 19774 tablet_bootstrap.cc:492] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d: Bootstrap starting.
I20260709 13:05:48.727839 19800 raft_consensus.cc:493] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.728575 19800 raft_consensus.cc:515] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.732355 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6a6f295c29495bb96d4f9d8b1d79f3" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:48.732993 19800 leader_election.cc:290] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.733485 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6a6f295c29495bb96d4f9d8b1d79f3" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
W20260709 13:05:48.733608 19451 leader_election.cc:343] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:48.735240 19451 leader_election.cc:343] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.735661 19451 leader_election.cc:304] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0479c7f55b243b7b6093626504d266d; no voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:48.736112 19778 raft_consensus.cc:493] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.736639 19778 raft_consensus.cc:515] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.738569 19802 consensus_queue.cc:1048] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:48.739176 19761 raft_consensus.cc:493] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.739687 19761 raft_consensus.cc:515] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.740302 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44604e0e855f4279a2bb5edca42723e9" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:48.741747 19761 leader_election.cc:290] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
W20260709 13:05:48.742240 19527 leader_election.cc:343] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.743762 19773 tablet_bootstrap.cc:492] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19: No bootstrap required, opened a new log
I20260709 13:05:48.738592 19800 raft_consensus.cc:2749] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.742897 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44604e0e855f4279a2bb5edca42723e9" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:48.744267 19773 ts_tablet_manager.cc:1403] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.003s
W20260709 13:05:48.745396 19526 leader_election.cc:343] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:48.745724 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:48.745957 19526 leader_election.cc:304] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19; no voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d
I20260709 13:05:48.746901 19802 raft_consensus.cc:2749] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:48.738906 19778 leader_election.cc:290] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.745407 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:48.748179 19485 raft_consensus.cc:2468] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:48.748256 19773 raft_consensus.cc:359] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.749243 19773 raft_consensus.cc:385] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.749577 19773 raft_consensus.cc:740] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.749533 19601 leader_election.cc:304] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 29aef9a1cf614f47958c16d7a3d39f19
I20260709 13:05:48.736193 19774 tablet_bootstrap.cc:654] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.751313 19773 consensus_queue.cc:260] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.753314 19773 ts_tablet_manager.cc:1434] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:48.762180 19797 raft_consensus.cc:2804] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.763413 19797 raft_consensus.cc:493] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29aef9a1cf614f47958c16d7a3d39f19)
I20260709 13:05:48.763855 19797 raft_consensus.cc:3060] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.796236 19728 raft_consensus.cc:493] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.797130 19728 raft_consensus.cc:515] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.799867 19728 leader_election.cc:290] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.789722 19797 raft_consensus.cc:515] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.804335 19636 raft_consensus.cc:1240] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Rejecting Update request from peer 29aef9a1cf614f47958c16d7a3d39f19 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:48.804847 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088bde43a6b476eb51297cfda3ac214" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:48.805398 19774 tablet_bootstrap.cc:492] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d: No bootstrap required, opened a new log
I20260709 13:05:48.805526 19487 raft_consensus.cc:2468] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:48.805984 19774 ts_tablet_manager.cc:1403] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.041s
I20260709 13:05:48.802328 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088bde43a6b476eb51297cfda3ac214" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:48.806566 19634 raft_consensus.cc:2468] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 0.
I20260709 13:05:48.807121 19775 tablet_bootstrap.cc:492] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:48.808198 19526 leader_election.cc:304] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:48.808858 19774 raft_consensus.cc:359] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.809091 19802 consensus_queue.cc:1059] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:48.809576 19774 raft_consensus.cc:385] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.809865 19774 raft_consensus.cc:740] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.810009 19801 raft_consensus.cc:3055] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.810420 19801 raft_consensus.cc:740] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:48.809137 19775 ts_tablet_manager.cc:1403] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.133s	user 0.049s	sys 0.037s
I20260709 13:05:48.811065 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:48.810513 19385 catalog_manager.cc:5697] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 0 to 1, leader changed from <none> to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 1 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.811697 19487 raft_consensus.cc:3060] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.813707 19775 raft_consensus.cc:359] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.814548 19775 raft_consensus.cc:385] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.814814 19775 raft_consensus.cc:740] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.810587 19774 consensus_queue.cc:260] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.809877 19802 raft_consensus.cc:2804] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:48.816473 19802 raft_consensus.cc:493] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.816779 19802 raft_consensus.cc:3060] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.817142 19728 consensus_queue.cc:1048] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:48.817704 19774 ts_tablet_manager.cc:1434] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:05:48.809125 19797 leader_election.cc:290] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 2 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:48.819985 19801 consensus_queue.cc:260] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.822388 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:48.825726 19801 raft_consensus.cc:3060] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.827360 19487 raft_consensus.cc:2468] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 2.
I20260709 13:05:48.815524 19775 consensus_queue.cc:260] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.827384 19802 raft_consensus.cc:515] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.828681 19601 leader_election.cc:304] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:48.829746 19761 raft_consensus.cc:2804] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.829895 19775 ts_tablet_manager.cc:1434] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:05:48.830295 19761 raft_consensus.cc:697] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:48.830830 19802 leader_election.cc:290] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:48.831092 19775 tablet_bootstrap.cc:492] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:48.831169 19761 consensus_queue.cc:237] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.835237 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088bde43a6b476eb51297cfda3ac214" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:48.835829 19634 raft_consensus.cc:3060] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.839501 19775 tablet_bootstrap.cc:654] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.843168 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088bde43a6b476eb51297cfda3ac214" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:48.843508 19634 raft_consensus.cc:2468] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 1.
I20260709 13:05:48.843816 19487 raft_consensus.cc:3060] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:48.846891 19526 leader_election.cc:304] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:48.849013 19802 raft_consensus.cc:2804] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:48.849676 19802 raft_consensus.cc:697] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:48.851089 19775 tablet_bootstrap.cc:492] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:48.850513 19802 consensus_queue.cc:237] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.851744 19775 ts_tablet_manager.cc:1403] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
I20260709 13:05:48.854660 19775 raft_consensus.cc:359] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.855466 19775 raft_consensus.cc:385] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.854530 19383 catalog_manager.cc:5697] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 1 to 2, leader changed from 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194) to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.855846 19775 raft_consensus.cc:740] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.856722 19775 consensus_queue.cc:260] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.858729 19775 ts_tablet_manager.cc:1434] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:48.864573 19775 tablet_bootstrap.cc:492] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75: Bootstrap starting.
I20260709 13:05:48.868607 19561 raft_consensus.cc:2468] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 2.
I20260709 13:05:48.870991 19487 raft_consensus.cc:2468] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 1.
I20260709 13:05:48.871255 19775 tablet_bootstrap.cc:654] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:48.877859 19775 tablet_bootstrap.cc:492] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75: No bootstrap required, opened a new log
I20260709 13:05:48.878304 19775 ts_tablet_manager.cc:1403] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 13:05:48.880860 19775 raft_consensus.cc:359] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.881561 19775 raft_consensus.cc:385] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:48.881824 19775 raft_consensus.cc:740] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Initialized, Role: FOLLOWER
I20260709 13:05:48.881350 19385 catalog_manager.cc:5697] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.882531 19775 consensus_queue.cc:260] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.884619 19775 ts_tablet_manager.cc:1434] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:05:48.995209 19797 raft_consensus.cc:493] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.995702 19797 raft_consensus.cc:515] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:48.997593 19797 leader_election.cc:290] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:48.998446 19487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6a6f295c29495bb96d4f9d8b1d79f3" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d" is_pre_election: true
I20260709 13:05:48.998682 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6a6f295c29495bb96d4f9d8b1d79f3" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:48.999234 19487 raft_consensus.cc:2468] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:48.999394 19561 raft_consensus.cc:2468] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 0.
I20260709 13:05:49.000665 19600 leader_election.cc:304] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:49.001880 19797 raft_consensus.cc:2804] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.002316 19797 raft_consensus.cc:493] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.002678 19797 raft_consensus.cc:3060] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.009792 19797 raft_consensus.cc:515] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.011405 19797 leader_election.cc:290] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:49.012192 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6a6f295c29495bb96d4f9d8b1d79f3" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:49.012339 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6a6f295c29495bb96d4f9d8b1d79f3" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:49.012799 19485 raft_consensus.cc:3060] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.012976 19561 raft_consensus.cc:3060] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.015187 19487 raft_consensus.cc:3060] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.019238 19485 raft_consensus.cc:2468] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:49.020231 19561 raft_consensus.cc:2468] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 1.
I20260709 13:05:49.020305 19601 leader_election.cc:304] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:49.021241 19797 raft_consensus.cc:2804] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.021713 19797 raft_consensus.cc:697] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:49.022559 19797 consensus_queue.cc:237] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.023643 19801 consensus_queue.cc:1048] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.036449 19728 consensus_queue.cc:1048] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.038054 19385 catalog_manager.cc:5697] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.081728 19797 consensus_queue.cc:1048] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.092099 19824 consensus_queue.cc:1048] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.101102 19798 consensus_queue.cc:1048] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.114625 19757 consensus_queue.cc:1048] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.147915 19757 consensus_queue.cc:1048] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.159879 19757 consensus_queue.cc:1048] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.187281 19757 raft_consensus.cc:493] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.187711 19757 raft_consensus.cc:515] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.189555 19757 leader_election.cc:290] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:49.190193 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44604e0e855f4279a2bb5edca42723e9" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:49.190426 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44604e0e855f4279a2bb5edca42723e9" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:49.190824 19561 raft_consensus.cc:2468] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 0.
I20260709 13:05:49.191056 19634 raft_consensus.cc:2468] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 0.
I20260709 13:05:49.191803 19451 leader_election.cc:304] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:49.192569 19757 raft_consensus.cc:2804] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.192873 19757 raft_consensus.cc:493] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.193148 19757 raft_consensus.cc:3060] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.196705 19829 raft_consensus.cc:493] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.197178 19829 raft_consensus.cc:515] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.198734 19757 raft_consensus.cc:515] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.199216 19829 leader_election.cc:290] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:49.199990 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a592376cce4ee2b91ca76b9c5bb0fe" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19" is_pre_election: true
I20260709 13:05:49.200634 19561 raft_consensus.cc:2468] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 0.
I20260709 13:05:49.200904 19757 leader_election.cc:290] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:49.201578 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44604e0e855f4279a2bb5edca42723e9" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:49.201733 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a592376cce4ee2b91ca76b9c5bb0fe" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75" is_pre_election: true
I20260709 13:05:49.202216 19562 raft_consensus.cc:3060] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.202317 19634 raft_consensus.cc:2468] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 0.
I20260709 13:05:49.202258 19451 leader_election.cc:304] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:49.202740 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44604e0e855f4279a2bb5edca42723e9" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:49.203334 19636 raft_consensus.cc:3060] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.204365 19757 raft_consensus.cc:2804] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:49.204783 19757 raft_consensus.cc:493] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.205114 19757 raft_consensus.cc:3060] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.209947 19562 raft_consensus.cc:2468] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 1.
I20260709 13:05:49.211229 19451 leader_election.cc:304] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:49.211910 19829 raft_consensus.cc:2804] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.211905 19636 raft_consensus.cc:2468] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 1.
I20260709 13:05:49.212488 19829 raft_consensus.cc:697] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:49.213322 19829 consensus_queue.cc:237] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.213415 19757 raft_consensus.cc:515] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.215471 19757 leader_election.cc:290] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:49.216027 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a592376cce4ee2b91ca76b9c5bb0fe" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:49.216305 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a592376cce4ee2b91ca76b9c5bb0fe" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:49.216902 19636 raft_consensus.cc:3060] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.216809 19562 raft_consensus.cc:3060] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:49.221661 19636 raft_consensus.cc:2468] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 1.
I20260709 13:05:49.223924 19451 leader_election.cc:304] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:49.224709 19829 raft_consensus.cc:2804] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:49.225245 19829 raft_consensus.cc:697] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:49.226060 19829 consensus_queue.cc:237] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.228418 19385 catalog_manager.cc:5697] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 0 to 1, leader changed from <none> to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 1 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.228459 19562 raft_consensus.cc:2468] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 1.
I20260709 13:05:49.241822 19385 catalog_manager.cc:5697] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 0 to 1, leader changed from <none> to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 1 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.258760 19636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
mode: GRACEFUL
new_leader_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:38512
I20260709 13:05:49.259270 19636 raft_consensus.cc:606] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Received request to transfer leadership to TS d0479c7f55b243b7b6093626504d266d
I20260709 13:05:49.263998 19636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f59c14d708e144d6b61dea112358952b"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
mode: GRACEFUL
new_leader_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:38512
I20260709 13:05:49.264485 19636 raft_consensus.cc:606] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Received request to transfer leadership to TS d0479c7f55b243b7b6093626504d266d
I20260709 13:05:49.271732 19562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
mode: GRACEFUL
new_leader_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:48456
I20260709 13:05:49.272241 19562 raft_consensus.cc:606] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Received request to transfer leadership to TS d0479c7f55b243b7b6093626504d266d
I20260709 13:05:49.276769 19487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "794c2c688ff843229b3ca40d7668ba35"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
mode: GRACEFUL
new_leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:51674
I20260709 13:05:49.277262 19487 raft_consensus.cc:606] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Received request to transfer leadership to TS 29aef9a1cf614f47958c16d7a3d39f19
I20260709 13:05:49.284782 19487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86a592376cce4ee2b91ca76b9c5bb0fe"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
mode: GRACEFUL
new_leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:51674
I20260709 13:05:49.285274 19487 raft_consensus.cc:606] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Received request to transfer leadership to TS 29aef9a1cf614f47958c16d7a3d39f19
I20260709 13:05:49.289646 19636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc6a6f295c29495bb96d4f9d8b1d79f3"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
mode: GRACEFUL
new_leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:38512
I20260709 13:05:49.290117 19636 raft_consensus.cc:606] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Received request to transfer leadership to TS 29aef9a1cf614f47958c16d7a3d39f19
I20260709 13:05:49.294373 19487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44604e0e855f4279a2bb5edca42723e9"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
mode: GRACEFUL
new_leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:51674
I20260709 13:05:49.294852 19487 raft_consensus.cc:606] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Received request to transfer leadership to TS 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:49.367002 19728 consensus_queue.cc:1048] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.378532 19802 consensus_queue.cc:1048] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.402570 19562 raft_consensus.cc:1275] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.403939 19824 consensus_queue.cc:1048] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.414755 19487 raft_consensus.cc:1275] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.416121 19835 consensus_queue.cc:1048] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.423969 19835 raft_consensus.cc:993] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75: : Instructing follower d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:49.424366 19824 raft_consensus.cc:1081] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Signalling peer d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:49.425827 19487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:51656
I20260709 13:05:49.426427 19487 raft_consensus.cc:493] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.426857 19487 raft_consensus.cc:3060] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.432250 19487 raft_consensus.cc:515] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.434147 19487 leader_election.cc:290] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 3 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:49.435592 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:49.435942 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2474c53e0e3d47f9b3c9237ac11a4045" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:49.436146 19636 raft_consensus.cc:3055] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:49.436563 19636 raft_consensus.cc:740] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:49.436582 19562 raft_consensus.cc:3060] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.437388 19636 consensus_queue.cc:260] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.438634 19636 raft_consensus.cc:3060] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.442384 19562 raft_consensus.cc:2468] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 3.
I20260709 13:05:49.443290 19636 raft_consensus.cc:2468] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 3.
I20260709 13:05:49.443476 19451 leader_election.cc:304] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:49.444296 19829 raft_consensus.cc:2804] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:49.444715 19829 raft_consensus.cc:697] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 3 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:49.445338 19829 consensus_queue.cc:237] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.451223 19382 catalog_manager.cc:5697] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 2 to 3, leader changed from 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195) to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 3 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.492760 19778 raft_consensus.cc:993] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19: : Instructing follower d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:49.493192 19802 raft_consensus.cc:1081] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Signalling peer d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:49.494663 19485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:51658
I20260709 13:05:49.495144 19485 raft_consensus.cc:493] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.495445 19485 raft_consensus.cc:3060] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.500293 19485 raft_consensus.cc:515] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.501940 19485 leader_election.cc:290] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:49.502727 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:49.502936 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:49.503433 19562 raft_consensus.cc:3055] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.503460 19636 raft_consensus.cc:3060] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.503948 19562 raft_consensus.cc:740] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:49.504756 19562 consensus_queue.cc:260] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.505992 19562 raft_consensus.cc:3060] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.510329 19636 raft_consensus.cc:2468] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:49.511435 19451 leader_election.cc:304] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:49.512111 19829 raft_consensus.cc:2804] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.512615 19829 raft_consensus.cc:697] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:49.512590 19562 raft_consensus.cc:2468] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:49.513723 19829 consensus_queue.cc:237] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.520514 19382 catalog_manager.cc:5697] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 1 to 2, leader changed from 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194) to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 2 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.540762 19824 raft_consensus.cc:993] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75: : Instructing follower d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:49.541392 19835 raft_consensus.cc:1081] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Signalling peer d0479c7f55b243b7b6093626504d266d to start an election
I20260709 13:05:49.543174 19485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f59c14d708e144d6b61dea112358952b"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
 from {username='slave'} at 127.0.0.1:51656
I20260709 13:05:49.543702 19485 raft_consensus.cc:493] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.544035 19485 raft_consensus.cc:3060] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.549851 19485 raft_consensus.cc:515] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.550709 19835 consensus_queue.cc:1048] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.551841 19485 leader_election.cc:290] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Requested vote from peers 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:49.552501 19562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c14d708e144d6b61dea112358952b" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:49.553103 19562 raft_consensus.cc:3060] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.553290 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f59c14d708e144d6b61dea112358952b" candidate_uuid: "d0479c7f55b243b7b6093626504d266d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:49.553982 19636 raft_consensus.cc:3055] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.554282 19636 raft_consensus.cc:740] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:49.555110 19636 consensus_queue.cc:260] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.556265 19636 raft_consensus.cc:3060] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.559711 19562 raft_consensus.cc:2468] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:49.559811 19797 raft_consensus.cc:993] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75: : Instructing follower 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:49.560371 19797 raft_consensus.cc:1081] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Signalling peer 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:49.564707 19824 consensus_queue.cc:1048] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.565457 19562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc6a6f295c29495bb96d4f9d8b1d79f3"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:48448
I20260709 13:05:49.566115 19562 raft_consensus.cc:493] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.565960 19451 leader_election.cc:304] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:49.566582 19562 raft_consensus.cc:3060] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.567051 19829 raft_consensus.cc:2804] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.567523 19829 raft_consensus.cc:697] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Becoming Leader. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:49.568325 19829 consensus_queue.cc:237] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.573514 19562 raft_consensus.cc:515] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.575764 19562 leader_election.cc:290] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:49.577287 19636 raft_consensus.cc:2468] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0479c7f55b243b7b6093626504d266d in term 2.
I20260709 13:05:49.579160 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6a6f295c29495bb96d4f9d8b1d79f3" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:49.579526 19636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc6a6f295c29495bb96d4f9d8b1d79f3" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:49.579739 19485 raft_consensus.cc:3060] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.580130 19636 raft_consensus.cc:3055] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.580439 19636 raft_consensus.cc:740] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:49.581243 19636 consensus_queue.cc:260] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.581902 19385 catalog_manager.cc:5697] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d reported cstate change: term changed from 1 to 2, leader changed from 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195) to d0479c7f55b243b7b6093626504d266d (127.7.41.193). New cstate: current_term: 2 leader_uuid: "d0479c7f55b243b7b6093626504d266d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.583390 19636 raft_consensus.cc:3060] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.592089 19485 raft_consensus.cc:2468] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:49.593398 19527 leader_election.cc:304] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:49.594230 19802 raft_consensus.cc:2804] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.594692 19802 raft_consensus.cc:697] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:49.595490 19802 consensus_queue.cc:237] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.596289 19636 raft_consensus.cc:2468] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:49.604931 19385 catalog_manager.cc:5697] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 1 to 2, leader changed from 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195) to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.720116 19757 consensus_queue.cc:1048] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.726979 19829 raft_consensus.cc:993] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d: : Instructing follower 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:49.727483 19829 raft_consensus.cc:1081] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Signalling peer 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:49.730916 19636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44604e0e855f4279a2bb5edca42723e9"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:38492
I20260709 13:05:49.731465 19636 raft_consensus.cc:493] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.731828 19636 raft_consensus.cc:3060] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.735956 19798 consensus_queue.cc:1048] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.738451 19636 raft_consensus.cc:515] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.741120 19636 leader_election.cc:290] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 2 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:49.742318 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44604e0e855f4279a2bb5edca42723e9" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:49.744155 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44604e0e855f4279a2bb5edca42723e9" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:49.744755 19485 raft_consensus.cc:3055] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.745023 19485 raft_consensus.cc:740] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:49.745713 19485 consensus_queue.cc:260] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.746757 19485 raft_consensus.cc:3060] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.755277 19485 raft_consensus.cc:2468] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 2.
I20260709 13:05:49.756122 19601 leader_election.cc:304] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 29aef9a1cf614f47958c16d7a3d39f19
I20260709 13:05:49.756855 19824 raft_consensus.cc:2804] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.757331 19824 raft_consensus.cc:697] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:49.758116 19824 consensus_queue.cc:237] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.764119 19382 catalog_manager.cc:5697] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 1 to 2, leader changed from d0479c7f55b243b7b6093626504d266d (127.7.41.193) to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.772969 19757 raft_consensus.cc:993] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d: : Instructing follower 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:49.773487 19798 raft_consensus.cc:1081] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Signalling peer 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:49.774991 19562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "794c2c688ff843229b3ca40d7668ba35"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:48438
I20260709 13:05:49.775457 19562 raft_consensus.cc:493] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.775864 19562 raft_consensus.cc:3060] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.780381 19562 raft_consensus.cc:515] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.781860 19562 leader_election.cc:290] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:49.782480 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794c2c688ff843229b3ca40d7668ba35" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:49.783085 19485 raft_consensus.cc:3055] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.783165 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "794c2c688ff843229b3ca40d7668ba35" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:49.783437 19485 raft_consensus.cc:740] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:49.783790 19634 raft_consensus.cc:3060] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.784309 19485 consensus_queue.cc:260] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.785544 19485 raft_consensus.cc:3060] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.790946 19634 raft_consensus.cc:2468] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:49.792191 19526 leader_election.cc:304] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:49.792856 19802 raft_consensus.cc:2804] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.793313 19802 raft_consensus.cc:697] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:49.793723 19485 raft_consensus.cc:2468] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:49.794157 19802 consensus_queue.cc:237] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.800563 19382 catalog_manager.cc:5697] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 1 to 2, leader changed from d0479c7f55b243b7b6093626504d266d (127.7.41.193) to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.839138 19562 raft_consensus.cc:1275] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.840261 19757 consensus_queue.cc:1048] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.840626 19798 consensus_queue.cc:1048] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.856714 19757 consensus_queue.cc:1048] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:49.859251 19634 raft_consensus.cc:1275] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.860749 19757 consensus_queue.cc:1048] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:49.866719 19757 raft_consensus.cc:993] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d: : Instructing follower 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:49.867184 19757 raft_consensus.cc:1081] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Signalling peer 29aef9a1cf614f47958c16d7a3d39f19 to start an election
I20260709 13:05:49.868795 19562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86a592376cce4ee2b91ca76b9c5bb0fe"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
 from {username='slave'} at 127.0.0.1:48438
I20260709 13:05:49.869303 19562 raft_consensus.cc:493] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:49.869628 19562 raft_consensus.cc:3060] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.876368 19562 raft_consensus.cc:515] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.878343 19562 leader_election.cc:290] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195:45561)
I20260709 13:05:49.878926 19485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a592376cce4ee2b91ca76b9c5bb0fe" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:49.879544 19485 raft_consensus.cc:3055] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.879818 19485 raft_consensus.cc:740] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:49.879842 19634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86a592376cce4ee2b91ca76b9c5bb0fe" candidate_uuid: "29aef9a1cf614f47958c16d7a3d39f19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
I20260709 13:05:49.880487 19634 raft_consensus.cc:3060] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.880609 19485 consensus_queue.cc:260] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.881959 19485 raft_consensus.cc:3060] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.886186 19634 raft_consensus.cc:2468] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:49.887195 19526 leader_election.cc:304] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:49.887880 19485 raft_consensus.cc:2468] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29aef9a1cf614f47958c16d7a3d39f19 in term 2.
I20260709 13:05:49.888062 19802 raft_consensus.cc:2804] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.888697 19802 raft_consensus.cc:697] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Becoming Leader. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:49.889520 19802 consensus_queue.cc:237] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:49.896876 19383 catalog_manager.cc:5697] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 reported cstate change: term changed from 1 to 2, leader changed from d0479c7f55b243b7b6093626504d266d (127.7.41.193) to 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "29aef9a1cf614f47958c16d7a3d39f19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.933545 19634 raft_consensus.cc:1275] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.934824 19842 consensus_queue.cc:1048] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:49.942603 19562 raft_consensus.cc:1275] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.944330 19843 consensus_queue.cc:1048] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.062247 19485 raft_consensus.cc:1275] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.063606 19802 consensus_queue.cc:1048] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.072048 19635 raft_consensus.cc:1275] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.073401 19801 consensus_queue.cc:1048] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.098771 19635 raft_consensus.cc:1275] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.099973 19842 consensus_queue.cc:1048] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.108335 19562 raft_consensus.cc:1275] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Refusing update from remote peer d0479c7f55b243b7b6093626504d266d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.110646 19842 consensus_queue.cc:1048] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.205358 19562 raft_consensus.cc:3060] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.210582 19562 raft_consensus.cc:1275] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.211752 19824 consensus_queue.cc:1048] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.218899 19485 raft_consensus.cc:1275] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.220649 19835 consensus_queue.cc:1048] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.304193 19485 raft_consensus.cc:1275] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.305397 19778 consensus_queue.cc:1048] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.312487 19635 raft_consensus.cc:1275] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.314286 19802 consensus_queue.cc:1048] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.384831 19635 raft_consensus.cc:1275] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.385977 19802 consensus_queue.cc:1048] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.394508 19485 raft_consensus.cc:1275] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Refusing update from remote peer 29aef9a1cf614f47958c16d7a3d39f19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.396476 19802 consensus_queue.cc:1048] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.298506 19382 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56600:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:52.324271 19382 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56600:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:52.424554  7335 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:05:52.597291 19889 log.cc:927] Time spent T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:05:52.599104 19893 tablet.cc:1724] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:52.608717 19887 log.cc:927] Time spent T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:05:52.651798 19601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:43955, user_credentials={real_user=slave}} blocked reactor thread for 125431us
I20260709 13:05:52.654953 19901 tablet.cc:1724] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.667578 19897 tablet.cc:1724] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:52.670120 19885 log.cc:927] Time spent T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75: Append to log took a long time: real 0.096s	user 0.006s	sys 0.000s
W20260709 13:05:52.691589 19513 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:2474c53e0e3d47f9b3c9237ac11a4045)
W20260709 13:05:52.698558 19513 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:2474c53e0e3d47f9b3c9237ac11a4045)
W20260709 13:05:52.704116 19513 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:2474c53e0e3d47f9b3c9237ac11a4045)
I20260709 13:05:52.756785 19905 tablet.cc:1724] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.782173 19910 tablet.cc:1724] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.809580 19916 tablet.cc:1724] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.852612 19918 tablet.cc:1724] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:52.854811 19451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:45561, user_credentials={real_user=slave}} blocked reactor thread for 74797.3us
I20260709 13:05:52.871060 19562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2088bde43a6b476eb51297cfda3ac214"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
mode: GRACEFUL
new_leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:45350
I20260709 13:05:52.871959 19562 raft_consensus.cc:606] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Received request to transfer leadership to TS 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:52.874449 19921 tablet.cc:1724] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.886417 19920 tablet.cc:1724] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.904227 19901 tablet.cc:1724] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.910521 19899 raft_consensus.cc:993] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19: : Instructing follower 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:52.911155 19899 raft_consensus.cc:1081] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Signalling peer 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:52.922263 19893 tablet.cc:1724] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.927788 19635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2088bde43a6b476eb51297cfda3ac214"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:38500
I20260709 13:05:52.928601 19635 raft_consensus.cc:493] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:52.929093 19635 raft_consensus.cc:3060] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.937640 19897 tablet.cc:1724] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.944416 19922 tablet.cc:1724] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.941967 19910 tablet.cc:1724] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.954840 19901 tablet.cc:1724] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.955358 19924 tablet.cc:1724] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.955403 19635 raft_consensus.cc:515] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:52.972195 19635 leader_election.cc:290] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 2 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:52.898370 19923 tablet.cc:1724] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.973683 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088bde43a6b476eb51297cfda3ac214" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:52.974535 19561 raft_consensus.cc:3055] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.974956 19561 raft_consensus.cc:740] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:52.974375 19901 tablet.cc:1724] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.975925 19561 consensus_queue.cc:260] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:52.976930 19561 raft_consensus.cc:3060] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.977351 19916 tablet.cc:1724] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.981032 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2088bde43a6b476eb51297cfda3ac214" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:52.986863 19901 tablet.cc:1724] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.994490 19905 tablet.cc:1724] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:52.961588 19920 tablet.cc:1724] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:53.004329 19561 raft_consensus.cc:2468] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 2.
I20260709 13:05:53.004803 19921 tablet.cc:1724] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:53.013814 19600 leader_election.cc:304] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: d0479c7f55b243b7b6093626504d266d
I20260709 13:05:53.015671 19894 raft_consensus.cc:2804] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:53.016178 19894 raft_consensus.cc:697] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:53.017206 19894 consensus_queue.cc:237] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:53.025449 19922 tablet.cc:1724] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:53.031176 19918 tablet.cc:1724] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:53.032914 19382 catalog_manager.cc:5697] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 1 to 2, leader changed from 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194) to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.066480 19922 tablet.cc:1724] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:53.068277 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
mode: GRACEFUL
new_leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:60462
I20260709 13:05:53.068990 19484 raft_consensus.cc:606] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Received request to transfer leadership to TS 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:53.070698  7335 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:05:53.071480  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:53.083191 19484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198"
dest_uuid: "d0479c7f55b243b7b6093626504d266d"
mode: GRACEFUL
new_leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:60462
I20260709 13:05:53.083817 19484 raft_consensus.cc:606] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Received request to transfer leadership to TS 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:53.085127 19382 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239: soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee] alter complete (version 1)
I20260709 13:05:53.090581 19561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c"
dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
mode: GRACEFUL
new_leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:45350
I20260709 13:05:53.091135 19561 raft_consensus.cc:606] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Received request to transfer leadership to TS 37776c8ae93f49588bd377ce7c8a1b75
I20260709 13:05:53.092841  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:53.093434  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:53.258046 19892 raft_consensus.cc:993] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19: : Instructing follower 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:53.258577 19899 raft_consensus.cc:1081] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Signalling peer 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:53.260263 19633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:38500
I20260709 13:05:53.260798 19633 raft_consensus.cc:493] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.261092 19633 raft_consensus.cc:3060] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.267462 19633 raft_consensus.cc:515] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:53.269106 19633 leader_election.cc:290] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 3 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:53.269809 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:53.270471 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25ac713a1ea470e8d4d40d751446b7c" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:53.270768 19484 raft_consensus.cc:3060] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.271348 19561 raft_consensus.cc:3055] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:53.271782 19561 raft_consensus.cc:740] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29aef9a1cf614f47958c16d7a3d39f19, State: Running, Role: LEADER
I20260709 13:05:53.272737 19561 consensus_queue.cc:260] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:53.274144 19561 raft_consensus.cc:3060] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.279258 19484 raft_consensus.cc:2468] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 3.
I20260709 13:05:53.280602 19601 leader_election.cc:304] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37776c8ae93f49588bd377ce7c8a1b75, d0479c7f55b243b7b6093626504d266d; no voters: 
I20260709 13:05:53.281028 19561 raft_consensus.cc:2468] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 3.
I20260709 13:05:53.281507 19894 raft_consensus.cc:2804] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:53.282073 19894 raft_consensus.cc:697] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:53.282945 19894 consensus_queue.cc:237] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:53.291352 19382 catalog_manager.cc:5697] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 2 to 3, leader changed from 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194) to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.352301 19919 raft_consensus.cc:993] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d: : Instructing follower 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:53.352923 19878 raft_consensus.cc:1081] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Signalling peer 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:53.354651 19633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:38492
I20260709 13:05:53.355238 19633 raft_consensus.cc:493] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.355623 19633 raft_consensus.cc:3060] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.361517 19633 raft_consensus.cc:515] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:53.363351 19633 leader_election.cc:290] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 3 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:53.364320 19484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:53.364471 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81ac3d8cb14941548d0c3baef77d029c" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:53.365114 19484 raft_consensus.cc:3055] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:53.365192 19561 raft_consensus.cc:3060] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.365479 19484 raft_consensus.cc:740] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:53.366381 19484 consensus_queue.cc:260] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:53.367460 19484 raft_consensus.cc:3060] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.370476 19561 raft_consensus.cc:2468] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 3.
I20260709 13:05:53.371711 19600 leader_election.cc:304] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:53.372483 19894 raft_consensus.cc:2804] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:53.373620 19894 raft_consensus.cc:697] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:53.373687 19484 raft_consensus.cc:2468] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 3.
I20260709 13:05:53.374770 19894 consensus_queue.cc:237] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:53.382370 19382 catalog_manager.cc:5697] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 2 to 3, leader changed from d0479c7f55b243b7b6093626504d266d (127.7.41.193) to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.482570 19486 raft_consensus.cc:3060] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.489514 19486 raft_consensus.cc:1275] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:53.490871 19894 consensus_queue.cc:1048] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.494278 19893 tablet.cc:1724] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:53.502483 19382 catalog_manager.cc:5789] TS d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955) does not have the latest schema for tablet 2088bde43a6b476eb51297cfda3ac214 (table soft_deleted_table [id=473886555ff5485d9838bd6a97a8a3ee]). Expected version 1 got 0
I20260709 13:05:53.502933 19561 raft_consensus.cc:1275] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:53.507803 19851 consensus_queue.cc:1048] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.548604 19878 raft_consensus.cc:993] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d: : Instructing follower 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:53.549190 19878 raft_consensus.cc:1081] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Signalling peer 37776c8ae93f49588bd377ce7c8a1b75 to start an election
I20260709 13:05:53.550769 19633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198"
dest_uuid: "37776c8ae93f49588bd377ce7c8a1b75"
 from {username='slave'} at 127.0.0.1:38492
I20260709 13:05:53.551378 19633 raft_consensus.cc:493] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.551712 19633 raft_consensus.cc:3060] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.558861 19633 raft_consensus.cc:515] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:53.560595 19633 leader_election.cc:290] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 3 election: Requested vote from peers d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955), 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193)
I20260709 13:05:53.561336 19486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0479c7f55b243b7b6093626504d266d"
I20260709 13:05:53.561575 19561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b415265a7fe45a1bd1296cfafdb1198" candidate_uuid: "37776c8ae93f49588bd377ce7c8a1b75" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29aef9a1cf614f47958c16d7a3d39f19"
I20260709 13:05:53.561950 19486 raft_consensus.cc:3055] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:53.562201 19561 raft_consensus.cc:3060] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.562408 19486 raft_consensus.cc:740] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d0479c7f55b243b7b6093626504d266d, State: Running, Role: LEADER
I20260709 13:05:53.563232 19486 consensus_queue.cc:260] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:53.564215 19486 raft_consensus.cc:3060] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.566870 19561 raft_consensus.cc:2468] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 3.
I20260709 13:05:53.568300 19600 leader_election.cc:304] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29aef9a1cf614f47958c16d7a3d39f19, 37776c8ae93f49588bd377ce7c8a1b75; no voters: 
I20260709 13:05:53.569561 19934 raft_consensus.cc:2804] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:53.570107 19486 raft_consensus.cc:2468] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37776c8ae93f49588bd377ce7c8a1b75 in term 3.
I20260709 13:05:53.570212 19934 raft_consensus.cc:697] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 LEADER]: Becoming Leader. State: Replica: 37776c8ae93f49588bd377ce7c8a1b75, State: Running, Role: LEADER
I20260709 13:05:53.571427 19934 consensus_queue.cc:237] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } }
I20260709 13:05:53.579408 19382 catalog_manager.cc:5697] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 reported cstate change: term changed from 2 to 3, leader changed from d0479c7f55b243b7b6093626504d266d (127.7.41.193) to 37776c8ae93f49588bd377ce7c8a1b75 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "37776c8ae93f49588bd377ce7c8a1b75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37776c8ae93f49588bd377ce7c8a1b75" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.747417 19486 raft_consensus.cc:1275] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:53.748754 19934 consensus_queue.cc:1048] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.760404 19561 raft_consensus.cc:1275] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:53.761828 19851 consensus_queue.cc:1048] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.836378 19486 raft_consensus.cc:1275] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:53.837637 19940 consensus_queue.cc:1048] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.845623 19560 raft_consensus.cc:1275] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:53.847179 19934 consensus_queue.cc:1048] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:53.969044 19486 raft_consensus.cc:1275] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:53.970280 19934 consensus_queue.cc:1048] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0479c7f55b243b7b6093626504d266d" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.978456 19561 raft_consensus.cc:1275] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Refusing update from remote peer 37776c8ae93f49588bd377ce7c8a1b75: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:53.980814 19934 consensus_queue.cc:1048] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29aef9a1cf614f47958c16d7a3d39f19" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:54.149771  7335 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:05:54.155884  7335 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:05:54.156397  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:54.164259  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:05:54.164785  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:55.193114  7335 tablet_server.cc:179] TabletServer@127.7.41.193:0 shutting down...
I20260709 13:05:55.220275  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:55.221098  7335 tablet_replica.cc:333] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.221910  7335 raft_consensus.cc:2243] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.222539  7335 raft_consensus.cc:2272] T 44604e0e855f4279a2bb5edca42723e9 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.224685  7335 tablet_replica.cc:333] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.225370  7335 raft_consensus.cc:2243] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.225843  7335 raft_consensus.cc:2272] T 86a592376cce4ee2b91ca76b9c5bb0fe P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.228008  7335 tablet_replica.cc:333] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.228646  7335 raft_consensus.cc:2243] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.229128  7335 raft_consensus.cc:2272] T dc6a6f295c29495bb96d4f9d8b1d79f3 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.231393  7335 tablet_replica.cc:333] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.231976  7335 raft_consensus.cc:2243] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.232460  7335 raft_consensus.cc:2272] T 794c2c688ff843229b3ca40d7668ba35 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.234535  7335 tablet_replica.cc:333] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.235024  7335 raft_consensus.cc:2243] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.235374  7335 raft_consensus.cc:2272] T 81ac3d8cb14941548d0c3baef77d029c P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.237360  7335 tablet_replica.cc:333] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.237973  7335 raft_consensus.cc:2243] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.238987  7335 raft_consensus.cc:2272] T f59c14d708e144d6b61dea112358952b P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.241704  7335 tablet_replica.cc:333] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.242590  7335 raft_consensus.cc:2243] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.243059  7335 raft_consensus.cc:2272] T 2e6ab9eea9d84a36bea7d114842c1fc9 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.245102  7335 tablet_replica.cc:333] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.245692  7335 raft_consensus.cc:2243] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.246601  7335 raft_consensus.cc:2272] T 2474c53e0e3d47f9b3c9237ac11a4045 P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.249219  7335 tablet_replica.cc:333] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.249909  7335 raft_consensus.cc:2243] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.250545  7335 raft_consensus.cc:2272] T 423d54e2d6c945bd952cf46755a0b0a1 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.253325  7335 tablet_replica.cc:333] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.253855  7335 raft_consensus.cc:2243] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.254848  7335 raft_consensus.cc:2272] T 93450d6918fe4d958c327c2f75516daf P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.257490  7335 tablet_replica.cc:333] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.258050  7335 raft_consensus.cc:2243] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.258427  7335 raft_consensus.cc:2272] T 5b415265a7fe45a1bd1296cfafdb1198 P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.260632  7335 tablet_replica.cc:333] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.261132  7335 raft_consensus.cc:2243] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.261879  7335 raft_consensus.cc:2272] T f45e3c99c5e24c028f1ff3728c454967 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.264351  7335 tablet_replica.cc:333] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.265084  7335 raft_consensus.cc:2243] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.265653  7335 raft_consensus.cc:2272] T bad169a236f045d7ad9ad781a28fa8c5 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:55.265815 19527 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 13:05:55.268613  7335 tablet_replica.cc:333] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
W20260709 13:05:55.268960 19527 consensus_peers.cc:597] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 -> Peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Couldn't send request to peer d0479c7f55b243b7b6093626504d266d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.269523  7335 raft_consensus.cc:2243] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.269989  7335 raft_consensus.cc:2272] T 2088bde43a6b476eb51297cfda3ac214 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.272203  7335 tablet_replica.cc:333] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.272886  7335 raft_consensus.cc:2243] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.274034  7335 raft_consensus.cc:2272] T c0532b1070b64cf496ba1708d67e6206 P d0479c7f55b243b7b6093626504d266d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:55.275983 19601 consensus_peers.cc:597] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 -> Peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Couldn't send request to peer d0479c7f55b243b7b6093626504d266d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.276823  7335 tablet_replica.cc:333] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.277477  7335 raft_consensus.cc:2243] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.277949  7335 raft_consensus.cc:2272] T e87ed645b59244d8900748909544dfe2 P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.280242  7335 tablet_replica.cc:333] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.280781  7335 raft_consensus.cc:2243] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.281232  7335 raft_consensus.cc:2272] T d25ac713a1ea470e8d4d40d751446b7c P d0479c7f55b243b7b6093626504d266d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.283317  7335 tablet_replica.cc:333] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d: stopping tablet replica
I20260709 13:05:55.283804  7335 raft_consensus.cc:2243] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.284584  7335 raft_consensus.cc:2272] T 4d1a9a7451e24c88a965530eb1aac51b P d0479c7f55b243b7b6093626504d266d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:55.300017 19601 consensus_peers.cc:597] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 -> Peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Couldn't send request to peer d0479c7f55b243b7b6093626504d266d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:55.305086 19601 consensus_peers.cc:597] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 -> Peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Couldn't send request to peer d0479c7f55b243b7b6093626504d266d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.326607  7335 tablet_server.cc:196] TabletServer@127.7.41.193:0 shutdown complete.
W20260709 13:05:55.331426 19527 consensus_peers.cc:597] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 -> Peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Couldn't send request to peer d0479c7f55b243b7b6093626504d266d. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43955: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:55.348369 19527 consensus_peers.cc:597] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 -> Peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Couldn't send request to peer d0479c7f55b243b7b6093626504d266d. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43955: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.368312  7335 tablet_server.cc:179] TabletServer@127.7.41.194:0 shutting down...
W20260709 13:05:55.397306 19527 consensus_peers.cc:597] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 -> Peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Couldn't send request to peer d0479c7f55b243b7b6093626504d266d. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43955: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.402253  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:55.403192  7335 tablet_replica.cc:333] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.404210  7335 raft_consensus.cc:2243] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.404914  7335 raft_consensus.cc:2272] T 44604e0e855f4279a2bb5edca42723e9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:55.405254 19601 consensus_peers.cc:597] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 -> Peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Couldn't send request to peer d0479c7f55b243b7b6093626504d266d. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43955: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.407516  7335 tablet_replica.cc:333] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.408299  7335 raft_consensus.cc:2243] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.408797  7335 raft_consensus.cc:2272] T f59c14d708e144d6b61dea112358952b P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.411285  7335 tablet_replica.cc:333] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
W20260709 13:05:55.411371 19601 consensus_peers.cc:597] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 -> Peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Couldn't send request to peer d0479c7f55b243b7b6093626504d266d. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43955: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.411984  7335 raft_consensus.cc:2243] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.412842  7335 raft_consensus.cc:2272] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.414945  7335 tablet_replica.cc:333] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.415575  7335 raft_consensus.cc:2243] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.416545  7335 raft_consensus.cc:2272] T 86a592376cce4ee2b91ca76b9c5bb0fe P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.419127  7335 tablet_replica.cc:333] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.419929  7335 raft_consensus.cc:2243] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:55.419968 19600 consensus_peers.cc:597] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 -> Peer 29aef9a1cf614f47958c16d7a3d39f19 (127.7.41.194:34193): Couldn't send request to peer 29aef9a1cf614f47958c16d7a3d39f19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.420769  7335 raft_consensus.cc:2272] T 794c2c688ff843229b3ca40d7668ba35 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.422938  7335 tablet_replica.cc:333] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.423519  7335 raft_consensus.cc:2243] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.423962  7335 raft_consensus.cc:2272] T 81ac3d8cb14941548d0c3baef77d029c P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.425969  7335 tablet_replica.cc:333] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.426616  7335 raft_consensus.cc:2243] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.427068  7335 raft_consensus.cc:2272] T 2088bde43a6b476eb51297cfda3ac214 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.429164  7335 tablet_replica.cc:333] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.429749  7335 raft_consensus.cc:2243] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.430217  7335 raft_consensus.cc:2272] T c0532b1070b64cf496ba1708d67e6206 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.432150  7335 tablet_replica.cc:333] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.432703  7335 raft_consensus.cc:2243] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.433504  7335 raft_consensus.cc:2272] T e87ed645b59244d8900748909544dfe2 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.435716  7335 tablet_replica.cc:333] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.436252  7335 raft_consensus.cc:2243] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.437033  7335 raft_consensus.cc:2272] T bad169a236f045d7ad9ad781a28fa8c5 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.439100  7335 tablet_replica.cc:333] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.439610  7335 raft_consensus.cc:2243] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.440066  7335 raft_consensus.cc:2272] T f45e3c99c5e24c028f1ff3728c454967 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.442281  7335 tablet_replica.cc:333] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.442893  7335 raft_consensus.cc:2243] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.443365  7335 raft_consensus.cc:2272] T 5b415265a7fe45a1bd1296cfafdb1198 P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.445353  7335 tablet_replica.cc:333] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.445878  7335 raft_consensus.cc:2243] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.446722  7335 raft_consensus.cc:2272] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 29aef9a1cf614f47958c16d7a3d39f19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.448848  7335 tablet_replica.cc:333] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.449388  7335 raft_consensus.cc:2243] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.449851  7335 raft_consensus.cc:2272] T 93450d6918fe4d958c327c2f75516daf P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.451859  7335 tablet_replica.cc:333] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.452406  7335 raft_consensus.cc:2243] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.452883  7335 raft_consensus.cc:2272] T 2474c53e0e3d47f9b3c9237ac11a4045 P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.454847  7335 tablet_replica.cc:333] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.455374  7335 raft_consensus.cc:2243] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.455803  7335 raft_consensus.cc:2272] T 423d54e2d6c945bd952cf46755a0b0a1 P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.457791  7335 tablet_replica.cc:333] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.458304  7335 raft_consensus.cc:2243] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.458765  7335 raft_consensus.cc:2272] T 4d1a9a7451e24c88a965530eb1aac51b P 29aef9a1cf614f47958c16d7a3d39f19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.460816  7335 tablet_replica.cc:333] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19: stopping tablet replica
I20260709 13:05:55.461354  7335 raft_consensus.cc:2243] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.461748  7335 raft_consensus.cc:2272] T d25ac713a1ea470e8d4d40d751446b7c P 29aef9a1cf614f47958c16d7a3d39f19 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:55.465659 19601 consensus_peers.cc:597] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 -> Peer d0479c7f55b243b7b6093626504d266d (127.7.41.193:43955): Couldn't send request to peer d0479c7f55b243b7b6093626504d266d. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:43955: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.502516  7335 tablet_server.cc:196] TabletServer@127.7.41.194:0 shutdown complete.
I20260709 13:05:55.542539  7335 tablet_server.cc:179] TabletServer@127.7.41.195:0 shutting down...
I20260709 13:05:55.574373  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:55.575074  7335 tablet_replica.cc:333] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.575784  7335 raft_consensus.cc:2243] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.576681  7335 raft_consensus.cc:2272] T 44604e0e855f4279a2bb5edca42723e9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.578858  7335 tablet_replica.cc:333] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.579469  7335 raft_consensus.cc:2243] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.580214  7335 raft_consensus.cc:2272] T 2088bde43a6b476eb51297cfda3ac214 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.582222  7335 tablet_replica.cc:333] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.582805  7335 raft_consensus.cc:2243] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.583250  7335 raft_consensus.cc:2272] T c0532b1070b64cf496ba1708d67e6206 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.585175  7335 tablet_replica.cc:333] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.585719  7335 raft_consensus.cc:2243] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.586263  7335 raft_consensus.cc:2272] T dc6a6f295c29495bb96d4f9d8b1d79f3 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.588178  7335 tablet_replica.cc:333] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.588688  7335 raft_consensus.cc:2243] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.589088  7335 raft_consensus.cc:2272] T 86a592376cce4ee2b91ca76b9c5bb0fe P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.591092  7335 tablet_replica.cc:333] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.591580  7335 raft_consensus.cc:2243] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.591961  7335 raft_consensus.cc:2272] T 794c2c688ff843229b3ca40d7668ba35 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.593797  7335 tablet_replica.cc:333] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.594383  7335 raft_consensus.cc:2243] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.595098  7335 raft_consensus.cc:2272] T 81ac3d8cb14941548d0c3baef77d029c P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.597024  7335 tablet_replica.cc:333] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.597541  7335 raft_consensus.cc:2243] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.597927  7335 raft_consensus.cc:2272] T f59c14d708e144d6b61dea112358952b P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.599890  7335 tablet_replica.cc:333] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.600334  7335 raft_consensus.cc:2243] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.600737  7335 raft_consensus.cc:2272] T 2474c53e0e3d47f9b3c9237ac11a4045 P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.602736  7335 tablet_replica.cc:333] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.603199  7335 raft_consensus.cc:2243] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.603953  7335 raft_consensus.cc:2272] T 423d54e2d6c945bd952cf46755a0b0a1 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.605866  7335 tablet_replica.cc:333] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.606336  7335 raft_consensus.cc:2243] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.606734  7335 raft_consensus.cc:2272] T 2e6ab9eea9d84a36bea7d114842c1fc9 P 37776c8ae93f49588bd377ce7c8a1b75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.608526  7335 tablet_replica.cc:333] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.609009  7335 raft_consensus.cc:2243] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.609380  7335 raft_consensus.cc:2272] T 93450d6918fe4d958c327c2f75516daf P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.611320  7335 tablet_replica.cc:333] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.611771  7335 raft_consensus.cc:2243] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.612146  7335 raft_consensus.cc:2272] T f45e3c99c5e24c028f1ff3728c454967 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.614087  7335 tablet_replica.cc:333] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.614564  7335 raft_consensus.cc:2243] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.615283  7335 raft_consensus.cc:2272] T 5b415265a7fe45a1bd1296cfafdb1198 P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.617868  7335 tablet_replica.cc:333] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.618453  7335 raft_consensus.cc:2243] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.618932  7335 raft_consensus.cc:2272] T e87ed645b59244d8900748909544dfe2 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.620994  7335 tablet_replica.cc:333] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.621513  7335 raft_consensus.cc:2243] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.622057  7335 raft_consensus.cc:2272] T bad169a236f045d7ad9ad781a28fa8c5 P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.624230  7335 tablet_replica.cc:333] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.624755  7335 raft_consensus.cc:2243] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:55.625197  7335 raft_consensus.cc:2272] T 4d1a9a7451e24c88a965530eb1aac51b P 37776c8ae93f49588bd377ce7c8a1b75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.627223  7335 tablet_replica.cc:333] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75: stopping tablet replica
I20260709 13:05:55.627737  7335 raft_consensus.cc:2243] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.628613  7335 raft_consensus.cc:2272] T d25ac713a1ea470e8d4d40d751446b7c P 37776c8ae93f49588bd377ce7c8a1b75 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.667977  7335 tablet_server.cc:196] TabletServer@127.7.41.195:0 shutdown complete.
I20260709 13:05:55.700901  7335 master.cc:562] Master@127.7.41.254:39975 shutting down...
I20260709 13:05:55.725107  7335 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:55.725699  7335 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:55.726128  7335 tablet_replica.cc:333] T 00000000000000000000000000000000 P ac0d376da43d46c2b5da928a495d4239: stopping tablet replica
I20260709 13:05:55.747301  7335 master.cc:584] Master@127.7.41.254:39975 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12393 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:05:55.798308  7335 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.41.254:36045
I20260709 13:05:55.799448  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:55.805239 19952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:55.805578 19953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:55.808104 19955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:55.808176  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:55.809396  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:55.809615  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:55.809773  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602355809757 us; error 0 us; skew 500 ppm
I20260709 13:05:55.810782  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:55.813271  7335 webserver.cc:533] Webserver started at http://127.7.41.254:44703/ using document root <none> and password file <none>
I20260709 13:05:55.813783  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:55.813994  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:55.814340  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:55.815442  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/master-0-root/instance:
uuid: "5f23619eaf344464be9490c5e341b951"
format_stamp: "Formatted at 2026-07-09 13:05:55 on dist-test-slave-fh5z"
I20260709 13:05:55.819788  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:55.823102 19960 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:55.823967  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:05:55.824208  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/master-0-root
uuid: "5f23619eaf344464be9490c5e341b951"
format_stamp: "Formatted at 2026-07-09 13:05:55 on dist-test-slave-fh5z"
I20260709 13:05:55.824460  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:55.865976  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:55.867175  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:55.904107  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.254:36045
I20260709 13:05:55.904214 20011 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.254:36045 every 8 connection(s)
I20260709 13:05:55.908139 20012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:55.918696 20012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951: Bootstrap starting.
I20260709 13:05:55.923470 20012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.927764 20012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951: No bootstrap required, opened a new log
I20260709 13:05:55.929917 20012 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f23619eaf344464be9490c5e341b951" member_type: VOTER }
I20260709 13:05:55.930330 20012 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.930579 20012 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f23619eaf344464be9490c5e341b951, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.931300 20012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f23619eaf344464be9490c5e341b951" member_type: VOTER }
I20260709 13:05:55.931993 20012 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:55.932232 20012 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:55.932456 20012 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.936936 20012 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f23619eaf344464be9490c5e341b951" member_type: VOTER }
I20260709 13:05:55.937381 20012 leader_election.cc:304] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f23619eaf344464be9490c5e341b951; no voters: 
I20260709 13:05:55.938482 20012 leader_election.cc:290] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:55.938803 20015 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.940591 20015 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 1 LEADER]: Becoming Leader. State: Replica: 5f23619eaf344464be9490c5e341b951, State: Running, Role: LEADER
I20260709 13:05:55.941255 20012 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:55.941243 20015 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f23619eaf344464be9490c5e341b951" member_type: VOTER }
I20260709 13:05:55.945564 20016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f23619eaf344464be9490c5e341b951" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f23619eaf344464be9490c5e341b951" member_type: VOTER } }
I20260709 13:05:55.946172 20016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:55.947124 20017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f23619eaf344464be9490c5e341b951. Latest consensus state: current_term: 1 leader_uuid: "5f23619eaf344464be9490c5e341b951" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f23619eaf344464be9490c5e341b951" member_type: VOTER } }
I20260709 13:05:55.947770 20017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:55.951035 20023 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:55.957512 20023 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:55.958499  7335 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:55.966159 20023 catalog_manager.cc:1383] Generated new cluster ID: c7efc76d2b354ced808d6e09d3a36f18
I20260709 13:05:55.966465 20023 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:55.983440 20023 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:55.984719 20023 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:55.999053 20023 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951: Generated new TSK 0
I20260709 13:05:55.999722 20023 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:56.025205  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:56.031093 20033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:56.032593 20034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:56.033748 20036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:56.034498  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:56.035441  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:56.035655  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:56.035840  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602356035803 us; error 0 us; skew 500 ppm
I20260709 13:05:56.036360  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:56.038656  7335 webserver.cc:533] Webserver started at http://127.7.41.193:46361/ using document root <none> and password file <none>
I20260709 13:05:56.039140  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:56.039336  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:56.039647  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:56.040696  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-0-root/instance:
uuid: "0b233561181d4924b529443e3df945f3"
format_stamp: "Formatted at 2026-07-09 13:05:56 on dist-test-slave-fh5z"
I20260709 13:05:56.045258  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:56.048591 20041 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:56.049512  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:56.049758  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-0-root
uuid: "0b233561181d4924b529443e3df945f3"
format_stamp: "Formatted at 2026-07-09 13:05:56 on dist-test-slave-fh5z"
I20260709 13:05:56.049997  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:56.076078  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:56.077226  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:56.078629  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:56.080786  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:56.080969  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:56.081264  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:56.081454  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:56.120703  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.193:37699
I20260709 13:05:56.120775 20103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.193:37699 every 8 connection(s)
I20260709 13:05:56.125780  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:56.133383 20108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:56.134582 20109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:56.137629  7335 server_base.cc:1061] running on GCE node
W20260709 13:05:56.138401 20111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:56.139730 20104 heartbeater.cc:344] Connected to a master server at 127.7.41.254:36045
I20260709 13:05:56.139727  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:56.140184 20104 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:56.140185  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:56.140583  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602356140564 us; error 0 us; skew 500 ppm
I20260709 13:05:56.141069 20104 heartbeater.cc:507] Master 127.7.41.254:36045 requested a full tablet report, sending...
I20260709 13:05:56.141228  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:56.143455 19977 ts_manager.cc:194] Registered new tserver with Master: 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699)
I20260709 13:05:56.144006  7335 webserver.cc:533] Webserver started at http://127.7.41.194:44329/ using document root <none> and password file <none>
I20260709 13:05:56.144526  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:56.144728  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:56.144987  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:56.145447 19977 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47794
I20260709 13:05:56.146234  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-1-root/instance:
uuid: "8dd33bce196a4ee2a9a6576b9e926326"
format_stamp: "Formatted at 2026-07-09 13:05:56 on dist-test-slave-fh5z"
I20260709 13:05:56.150624  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:56.153885 20116 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:56.154635  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:56.154948  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-1-root
uuid: "8dd33bce196a4ee2a9a6576b9e926326"
format_stamp: "Formatted at 2026-07-09 13:05:56 on dist-test-slave-fh5z"
I20260709 13:05:56.155225  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:56.170815  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:56.171897  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:56.173264  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:56.175417  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:56.175634  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:56.175870  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:56.176036  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:56.215241  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.194:38087
I20260709 13:05:56.215349 20178 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.194:38087 every 8 connection(s)
I20260709 13:05:56.219648  7335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:56.227283 20182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:56.229311 20183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:56.233767 20179 heartbeater.cc:344] Connected to a master server at 127.7.41.254:36045
I20260709 13:05:56.234339 20179 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:56.234360 20185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:56.235190  7335 server_base.cc:1061] running on GCE node
I20260709 13:05:56.235275 20179 heartbeater.cc:507] Master 127.7.41.254:36045 requested a full tablet report, sending...
I20260709 13:05:56.236416  7335 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:56.236605  7335 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:56.236860  7335 hybrid_clock.cc:648] HybridClock initialized: now 1783602356236840 us; error 0 us; skew 500 ppm
I20260709 13:05:56.237641  7335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:56.237807 19977 ts_manager.cc:194] Registered new tserver with Master: 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:56.239784 19977 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47804
I20260709 13:05:56.240358  7335 webserver.cc:533] Webserver started at http://127.7.41.195:46511/ using document root <none> and password file <none>
I20260709 13:05:56.240980  7335 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:56.241237  7335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:56.241549  7335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:56.243091  7335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-2-root/instance:
uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
format_stamp: "Formatted at 2026-07-09 13:05:56 on dist-test-slave-fh5z"
I20260709 13:05:56.247282  7335 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:05:56.250447 20190 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:56.251261  7335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:56.251552  7335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-2-root
uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
format_stamp: "Formatted at 2026-07-09 13:05:56 on dist-test-slave-fh5z"
I20260709 13:05:56.251871  7335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJIoVgL/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601985998407-7335-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:56.266011  7335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:56.267235  7335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:56.268666  7335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:56.270843  7335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:56.271062  7335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:56.271294  7335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:56.271461  7335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:56.310469  7335 rpc_server.cc:307] RPC server started. Bound to: 127.7.41.195:45935
I20260709 13:05:56.310575 20252 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.41.195:45935 every 8 connection(s)
I20260709 13:05:56.324144 20253 heartbeater.cc:344] Connected to a master server at 127.7.41.254:36045
I20260709 13:05:56.324589 20253 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:56.325310 20253 heartbeater.cc:507] Master 127.7.41.254:36045 requested a full tablet report, sending...
I20260709 13:05:56.327340 19977 ts_manager.cc:194] Registered new tserver with Master: f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:56.328118  7335 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014448766s
I20260709 13:05:56.328995 19977 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47810
I20260709 13:05:56.352077 19977 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47816:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:56.354831 19977 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:56.422279 20218 tablet_service.cc:1511] Processing CreateTablet for tablet 8895e208df7f42d49bc30edbf6fc8974 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:56.424427 20218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8895e208df7f42d49bc30edbf6fc8974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.427608 20217 tablet_service.cc:1511] Processing CreateTablet for tablet cd9a8456ccf5487785e48fb37c556d0d (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:56.429359 20217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9a8456ccf5487785e48fb37c556d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.431159 20216 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd280a52a6a48d383c5860cc086629e (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:56.432785 20216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd280a52a6a48d383c5860cc086629e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.435420 20215 tablet_service.cc:1511] Processing CreateTablet for tablet 46c8fb0892a64afdab2330b4d78e21c0 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:56.437012 20215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c8fb0892a64afdab2330b4d78e21c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.442830 20214 tablet_service.cc:1511] Processing CreateTablet for tablet 1511d4e52f11422da222323c32a4d742 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:56.444413 20214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1511d4e52f11422da222323c32a4d742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.447424 20069 tablet_service.cc:1511] Processing CreateTablet for tablet 8895e208df7f42d49bc30edbf6fc8974 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:56.448938 20069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8895e208df7f42d49bc30edbf6fc8974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.449218 20066 tablet_service.cc:1511] Processing CreateTablet for tablet 46c8fb0892a64afdab2330b4d78e21c0 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:56.450596 20066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c8fb0892a64afdab2330b4d78e21c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.451238 20068 tablet_service.cc:1511] Processing CreateTablet for tablet cd9a8456ccf5487785e48fb37c556d0d (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:56.452622 20068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9a8456ccf5487785e48fb37c556d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.453637 20065 tablet_service.cc:1511] Processing CreateTablet for tablet 1511d4e52f11422da222323c32a4d742 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:56.454442 20067 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd280a52a6a48d383c5860cc086629e (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:56.455093 20065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1511d4e52f11422da222323c32a4d742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.455765 20067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd280a52a6a48d383c5860cc086629e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.483042 20064 tablet_service.cc:1511] Processing CreateTablet for tablet 97fdfbaaffaa48a79eb2dd5559102ae5 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:56.484551 20064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97fdfbaaffaa48a79eb2dd5559102ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.489923 20213 tablet_service.cc:1511] Processing CreateTablet for tablet 97fdfbaaffaa48a79eb2dd5559102ae5 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:56.491382 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97fdfbaaffaa48a79eb2dd5559102ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.495251 20063 tablet_service.cc:1511] Processing CreateTablet for tablet fb1abb5dd5fd44cda4616d66a3010c2e (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:56.496773 20063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1abb5dd5fd44cda4616d66a3010c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.499728 20062 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb76cddaf9b42fb8273600e72fee895 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:56.501171 20062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb76cddaf9b42fb8273600e72fee895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.505077 20061 tablet_service.cc:1511] Processing CreateTablet for tablet d96b8881e37041c7863da60abab91b1b (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:56.506443 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96b8881e37041c7863da60abab91b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.520118 20212 tablet_service.cc:1511] Processing CreateTablet for tablet fb1abb5dd5fd44cda4616d66a3010c2e (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:56.520552 20211 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb76cddaf9b42fb8273600e72fee895 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:56.521708 20212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1abb5dd5fd44cda4616d66a3010c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.522794 20211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb76cddaf9b42fb8273600e72fee895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.528648 20218 tablet_service.cc:1511] Processing CreateTablet for tablet d96b8881e37041c7863da60abab91b1b (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:56.530118 20218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96b8881e37041c7863da60abab91b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.536149 20144 tablet_service.cc:1511] Processing CreateTablet for tablet 8895e208df7f42d49bc30edbf6fc8974 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:56.536429 20143 tablet_service.cc:1511] Processing CreateTablet for tablet cd9a8456ccf5487785e48fb37c556d0d (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:56.537719 20143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9a8456ccf5487785e48fb37c556d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.538964 20136 tablet_service.cc:1511] Processing CreateTablet for tablet d96b8881e37041c7863da60abab91b1b (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:56.539067 20142 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd280a52a6a48d383c5860cc086629e (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:56.540796 20141 tablet_service.cc:1511] Processing CreateTablet for tablet 46c8fb0892a64afdab2330b4d78e21c0 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:56.543217 20140 tablet_service.cc:1511] Processing CreateTablet for tablet 1511d4e52f11422da222323c32a4d742 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:56.545641 20139 tablet_service.cc:1511] Processing CreateTablet for tablet 97fdfbaaffaa48a79eb2dd5559102ae5 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:56.548060 20138 tablet_service.cc:1511] Processing CreateTablet for tablet fb1abb5dd5fd44cda4616d66a3010c2e (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:56.550925 20137 tablet_service.cc:1511] Processing CreateTablet for tablet 7eb76cddaf9b42fb8273600e72fee895 (DEFAULT_TABLE table=test-workload [id=ef41ee804bdb461588f6dd2cf4b46cb9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:56.558710 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd280a52a6a48d383c5860cc086629e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.559593 20140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1511d4e52f11422da222323c32a4d742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.560339 20137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eb76cddaf9b42fb8273600e72fee895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.564715 20141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c8fb0892a64afdab2330b4d78e21c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.566476 20136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96b8881e37041c7863da60abab91b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.567819 20267 tablet_bootstrap.cc:492] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:05:56.578429 20144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8895e208df7f42d49bc30edbf6fc8974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.579347 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1abb5dd5fd44cda4616d66a3010c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.582475 20139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97fdfbaaffaa48a79eb2dd5559102ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:56.592409 20268 tablet_bootstrap.cc:492] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:05:56.599428 20268 tablet_bootstrap.cc:654] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.632715 20267 tablet_bootstrap.cc:654] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.668671 20267 tablet_bootstrap.cc:492] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:05:56.669212 20267 ts_tablet_manager.cc:1403] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.019s
I20260709 13:05:56.676766 20271 tablet_bootstrap.cc:492] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:05:56.672097 20267 raft_consensus.cc:359] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:56.690452 20267 raft_consensus.cc:385] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.690872 20267 raft_consensus.cc:740] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.691570 20267 consensus_queue.cc:260] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:56.695293 20267 ts_tablet_manager.cc:1434] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 13:05:56.696112 20253 heartbeater.cc:499] Master 127.7.41.254:36045 was elected leader, sending a full tablet report...
I20260709 13:05:56.696424 20267 tablet_bootstrap.cc:492] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:05:56.697463 20271 tablet_bootstrap.cc:654] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.700670 20268 tablet_bootstrap.cc:492] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:05:56.701157 20268 ts_tablet_manager.cc:1403] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.109s	user 0.021s	sys 0.027s
I20260709 13:05:56.704113 20267 tablet_bootstrap.cc:654] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.705428 20268 raft_consensus.cc:359] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.706270 20268 raft_consensus.cc:385] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.706576 20268 raft_consensus.cc:740] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.707520 20268 consensus_queue.cc:260] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.716775 20268 ts_tablet_manager.cc:1434] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:05:56.717499 20104 heartbeater.cc:499] Master 127.7.41.254:36045 was elected leader, sending a full tablet report...
I20260709 13:05:56.725979 20268 tablet_bootstrap.cc:492] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:05:56.727545 20271 tablet_bootstrap.cc:492] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:05:56.728171 20271 ts_tablet_manager.cc:1403] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.016s
I20260709 13:05:56.731223 20271 raft_consensus.cc:359] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.732127 20271 raft_consensus.cc:385] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.732492 20271 raft_consensus.cc:740] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.733485 20271 consensus_queue.cc:260] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.735356 20268 tablet_bootstrap.cc:654] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.742323 20267 tablet_bootstrap.cc:492] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:05:56.743076 20267 ts_tablet_manager.cc:1403] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.013s
I20260709 13:05:56.747084 20179 heartbeater.cc:499] Master 127.7.41.254:36045 was elected leader, sending a full tablet report...
I20260709 13:05:56.746788 20267 raft_consensus.cc:359] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.747583 20267 raft_consensus.cc:385] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.747879 20267 raft_consensus.cc:740] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.748279 20268 tablet_bootstrap.cc:492] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:05:56.748873 20268 ts_tablet_manager.cc:1403] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 13:05:56.748626 20267 consensus_queue.cc:260] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.750952 20271 ts_tablet_manager.cc:1434] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.006s
I20260709 13:05:56.752185 20271 tablet_bootstrap.cc:492] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:05:56.752185 20268 raft_consensus.cc:359] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.753103 20268 raft_consensus.cc:385] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.753422 20268 raft_consensus.cc:740] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.754290 20268 consensus_queue.cc:260] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.756448 20268 ts_tablet_manager.cc:1434] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:05:56.757547 20268 tablet_bootstrap.cc:492] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:05:56.759696 20267 ts_tablet_manager.cc:1434] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:05:56.760355 20271 tablet_bootstrap.cc:654] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.760842 20267 tablet_bootstrap.cc:492] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:05:56.766750 20268 tablet_bootstrap.cc:654] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.767688 20267 tablet_bootstrap.cc:654] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.772627 20271 tablet_bootstrap.cc:492] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:05:56.773365 20271 ts_tablet_manager.cc:1403] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:05:56.777186 20271 raft_consensus.cc:359] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.778143 20271 raft_consensus.cc:385] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.778496 20271 raft_consensus.cc:740] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.779237 20268 tablet_bootstrap.cc:492] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:05:56.779930 20268 ts_tablet_manager.cc:1403] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.001s
I20260709 13:05:56.779394 20271 consensus_queue.cc:260] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.782200 20271 ts_tablet_manager.cc:1434] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:56.783314 20271 tablet_bootstrap.cc:492] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:05:56.783069 20268 raft_consensus.cc:359] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:56.783888 20268 raft_consensus.cc:385] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.784207 20268 raft_consensus.cc:740] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.785182 20268 consensus_queue.cc:260] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:56.789994 20267 tablet_bootstrap.cc:492] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:05:56.790613 20267 ts_tablet_manager.cc:1403] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 13:05:56.790972 20268 ts_tablet_manager.cc:1434] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:56.792130 20268 tablet_bootstrap.cc:492] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:05:56.792179 20271 tablet_bootstrap.cc:654] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.793557 20267 raft_consensus.cc:359] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.794387 20267 raft_consensus.cc:385] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.794689 20267 raft_consensus.cc:740] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.795579 20267 consensus_queue.cc:260] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.800916 20268 tablet_bootstrap.cc:654] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.804641 20267 ts_tablet_manager.cc:1434] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:05:56.804858 20271 tablet_bootstrap.cc:492] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:05:56.805917 20271 ts_tablet_manager.cc:1403] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.013s
I20260709 13:05:56.808169 20267 tablet_bootstrap.cc:492] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:05:56.810819 20271 raft_consensus.cc:359] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.811657 20271 raft_consensus.cc:385] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.812011 20271 raft_consensus.cc:740] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.813334 20268 tablet_bootstrap.cc:492] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:05:56.812919 20271 consensus_queue.cc:260] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.813889 20268 ts_tablet_manager.cc:1403] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.012s
I20260709 13:05:56.815241 20271 ts_tablet_manager.cc:1434] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:56.815847 20267 tablet_bootstrap.cc:654] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.816365 20271 tablet_bootstrap.cc:492] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:05:56.816983 20268 raft_consensus.cc:359] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.817759 20268 raft_consensus.cc:385] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.818161 20268 raft_consensus.cc:740] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.819046 20268 consensus_queue.cc:260] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.823971 20268 ts_tablet_manager.cc:1434] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:56.825042 20268 tablet_bootstrap.cc:492] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:05:56.825491 20271 tablet_bootstrap.cc:654] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.831517 20268 tablet_bootstrap.cc:654] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.839570 20267 tablet_bootstrap.cc:492] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:05:56.839956 20271 tablet_bootstrap.cc:492] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:05:56.840085 20267 ts_tablet_manager.cc:1403] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.008s
I20260709 13:05:56.840586 20271 ts_tablet_manager.cc:1403] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.012s
I20260709 13:05:56.843380 20267 raft_consensus.cc:359] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.843683 20271 raft_consensus.cc:359] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.844213 20267 raft_consensus.cc:385] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.844398 20271 raft_consensus.cc:385] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.844566 20267 raft_consensus.cc:740] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.845255 20268 tablet_bootstrap.cc:492] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:05:56.845281 20271 raft_consensus.cc:740] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.846071 20268 ts_tablet_manager.cc:1403] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 13:05:56.845991 20267 consensus_queue.cc:260] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.846351 20271 consensus_queue.cc:260] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.848320 20267 ts_tablet_manager.cc:1434] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:56.849401 20267 tablet_bootstrap.cc:492] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:05:56.849251 20268 raft_consensus.cc:359] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.850122 20268 raft_consensus.cc:385] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.850478 20268 raft_consensus.cc:740] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.851260 20268 consensus_queue.cc:260] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.852840 20271 ts_tablet_manager.cc:1434] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:56.853735 20268 ts_tablet_manager.cc:1434] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:05:56.854066 20271 tablet_bootstrap.cc:492] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:05:56.854722 20268 tablet_bootstrap.cc:492] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:05:56.856479 20267 tablet_bootstrap.cc:654] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.858104 20276 raft_consensus.cc:493] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.858629 20276 raft_consensus.cc:515] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.862088 20268 tablet_bootstrap.cc:654] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.865682 20276 leader_election.cc:290] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:56.873637 20271 tablet_bootstrap.cc:654] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.878683 20267 tablet_bootstrap.cc:492] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:05:56.879297 20267 ts_tablet_manager.cc:1403] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.004s
I20260709 13:05:56.884369 20267 raft_consensus.cc:359] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.885427 20267 raft_consensus.cc:385] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.885840 20267 raft_consensus.cc:740] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.889590 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:05:56.890645 20079 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 0.
I20260709 13:05:56.892280 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:05:56.892565 20118 leader_election.cc:304] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:05:56.893105 20228 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 0.
I20260709 13:05:56.893493 20276 raft_consensus.cc:2804] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.894014 20276 raft_consensus.cc:493] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.894380 20276 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.895220 20268 tablet_bootstrap.cc:492] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:05:56.896234 20268 ts_tablet_manager.cc:1403] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.042s	user 0.032s	sys 0.008s
I20260709 13:05:56.896713 20267 consensus_queue.cc:260] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.897888 20271 tablet_bootstrap.cc:492] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:05:56.898463 20271 ts_tablet_manager.cc:1403] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.003s
I20260709 13:05:56.899235 20267 ts_tablet_manager.cc:1434] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:05:56.900321 20267 tablet_bootstrap.cc:492] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:05:56.900089 20268 raft_consensus.cc:359] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.900975 20268 raft_consensus.cc:385] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.901180 20274 raft_consensus.cc:493] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.901357 20268 raft_consensus.cc:740] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.901528 20271 raft_consensus.cc:359] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.901705 20274 raft_consensus.cc:515] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.902384 20271 raft_consensus.cc:385] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.902748 20271 raft_consensus.cc:740] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.902570 20268 consensus_queue.cc:260] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.903740 20271 consensus_queue.cc:260] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.908520 20267 tablet_bootstrap.cc:654] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.910606 20272 raft_consensus.cc:493] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.911114 20272 raft_consensus.cc:515] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:56.915840 20272 leader_election.cc:290] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:56.922293 20274 leader_election.cc:290] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:56.948449 20276 raft_consensus.cc:515] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
W20260709 13:05:56.954304 20025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:56.997658 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:56.998634 20228 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.033310 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:05:57.034262 20079 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.027889 20276 leader_election.cc:290] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.063593 20228 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 1.
I20260709 13:05:57.065500 20117 leader_election.cc:304] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:05:57.066818 20276 raft_consensus.cc:2804] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.081950 20299 raft_consensus.cc:493] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.082651 20299 raft_consensus.cc:515] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.086751 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511d4e52f11422da222323c32a4d742" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
W20260709 13:05:57.088797 20118 leader_election.cc:343] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.093199 20276 raft_consensus.cc:697] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:05:57.094609 20276 consensus_queue.cc:237] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.102557 20272 raft_consensus.cc:493] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.103571 20272 raft_consensus.cc:515] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.106495 20274 raft_consensus.cc:493] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.107203 20274 raft_consensus.cc:515] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.108753 20272 leader_election.cc:290] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:57.111069 20274 leader_election.cc:290] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.115394 20274 raft_consensus.cc:493] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.116171 20274 raft_consensus.cc:515] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.119306 20274 leader_election.cc:290] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.120396 20272 raft_consensus.cc:493] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.121075 20272 raft_consensus.cc:515] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:57.123663 20272 leader_election.cc:290] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:57.134748 20292 raft_consensus.cc:493] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.135479 20292 raft_consensus.cc:515] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.136382 20271 ts_tablet_manager.cc:1434] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.238s	user 0.069s	sys 0.165s
I20260709 13:05:57.137948 20271 tablet_bootstrap.cc:492] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:05:57.139912 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:05:57.140627 20078 raft_consensus.cc:2468] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 0.
I20260709 13:05:57.141166 20268 ts_tablet_manager.cc:1434] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.245s	user 0.086s	sys 0.140s
I20260709 13:05:57.045647 20079 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 1.
I20260709 13:05:57.144284 20268 tablet_bootstrap.cc:492] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:05:57.144682 20271 tablet_bootstrap.cc:654] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.146340 20299 leader_election.cc:290] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.148530 20292 leader_election.cc:290] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.150195 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:05:57.151651 20268 tablet_bootstrap.cc:654] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:57.151832 20117 leader_election.cc:343] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.154554 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:05:57.157179 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
W20260709 13:05:57.157510 20043 leader_election.cc:343] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.158836 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:05:57.159684 20154 raft_consensus.cc:2468] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
W20260709 13:05:57.161265 20043 leader_election.cc:343] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.162051 20043 leader_election.cc:304] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:05:57.163008 20291 raft_consensus.cc:2804] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.163450 20291 raft_consensus.cc:493] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.165529 20291 raft_consensus.cc:3060] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.164773 20268 tablet_bootstrap.cc:492] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:05:57.168522 20268 ts_tablet_manager.cc:1403] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 13:05:57.171703 20268 raft_consensus.cc:359] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.172432 20268 raft_consensus.cc:385] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.172763 20268 raft_consensus.cc:740] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.173561 20268 consensus_queue.cc:260] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.174789 20118 leader_election.cc:304] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:05:57.176023 20292 raft_consensus.cc:2804] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.176160 20268 ts_tablet_manager.cc:1434] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:57.176445 20292 raft_consensus.cc:493] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.176841 20292 raft_consensus.cc:3060] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.177489 20268 tablet_bootstrap.cc:492] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:05:57.184725 20268 tablet_bootstrap.cc:654] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.185478 20274 raft_consensus.cc:493] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.186046 20274 raft_consensus.cc:515] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.188217 20274 leader_election.cc:290] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.190444 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:05:57.191226 20227 raft_consensus.cc:2468] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:05:57.194113 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:05:57.196117 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:05:57.197194 20268 tablet_bootstrap.cc:492] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:05:57.197382 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:05:57.197825 20268 ts_tablet_manager.cc:1403] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:05:57.198956 20042 leader_election.cc:304] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 8dd33bce196a4ee2a9a6576b9e926326
W20260709 13:05:57.201854 20042 leader_election.cc:343] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.202505 20042 leader_election.cc:304] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b233561181d4924b529443e3df945f3; no voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:05:57.200621 20268 raft_consensus.cc:359] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.203775 20268 raft_consensus.cc:385] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.204113 20268 raft_consensus.cc:740] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.204779 20268 consensus_queue.cc:260] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.205483 20274 raft_consensus.cc:2804] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.205901 20274 raft_consensus.cc:493] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.206342 20274 raft_consensus.cc:3060] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.210486 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:05:57.211297 20154 raft_consensus.cc:2468] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:05:57.212803 20043 leader_election.cc:304] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:05:57.214730 20306 raft_consensus.cc:2749] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.215835 20268 ts_tablet_manager.cc:1434] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.006s
I20260709 13:05:57.218959 20292 raft_consensus.cc:515] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.220036 20306 raft_consensus.cc:2804] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.221540 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511d4e52f11422da222323c32a4d742" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:05:57.221846 20306 raft_consensus.cc:493] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.222781 20306 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.221127 20268 tablet_bootstrap.cc:492] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:05:57.222314 20228 raft_consensus.cc:2468] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 0.
I20260709 13:05:57.239377 20117 leader_election.cc:304] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3
I20260709 13:05:57.249020 20291 raft_consensus.cc:515] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.251392 20299 raft_consensus.cc:2804] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.252019 20299 raft_consensus.cc:493] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.252468 20299 raft_consensus.cc:3060] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.255731 20268 tablet_bootstrap.cc:654] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.256578 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511d4e52f11422da222323c32a4d742" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:05:57.257939 20152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8895e208df7f42d49bc30edbf6fc8974" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:05:57.258853 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1abb5dd5fd44cda4616d66a3010c2e" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:05:57.259198 20267 tablet_bootstrap.cc:492] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:05:57.263543 20267 ts_tablet_manager.cc:1403] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.363s	user 0.079s	sys 0.159s
I20260709 13:05:57.264045 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
W20260709 13:05:57.265352 20117 leader_election.cc:343] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:57.266381 20192 leader_election.cc:343] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.265859 20299 raft_consensus.cc:515] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.266821 20267 raft_consensus.cc:359] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.267628 20292 leader_election.cc:290] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.268024 20267 raft_consensus.cc:385] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:57.268271 20043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.194:38087, user_credentials={real_user=slave}} blocked reactor thread for 55566.4us
I20260709 13:05:57.258778 20306 raft_consensus.cc:515] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.268456 20267 raft_consensus.cc:740] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.272339 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1abb5dd5fd44cda4616d66a3010c2e" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
W20260709 13:05:57.269064 20192 leader_election.cc:343] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.273288 20267 consensus_queue.cc:260] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.269333 20153 raft_consensus.cc:2393] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f86e2e4f00df4b1697e60e97dbbe8d88 in current term 1: Already voted for candidate 8dd33bce196a4ee2a9a6576b9e926326 in this term.
I20260709 13:05:57.275353 20306 leader_election.cc:290] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.273298 20079 raft_consensus.cc:2468] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 0.
I20260709 13:05:57.279755 20299 leader_election.cc:290] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.282438 20299 raft_consensus.cc:493] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.283456 20267 ts_tablet_manager.cc:1434] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.007s
I20260709 13:05:57.285239 20268 tablet_bootstrap.cc:492] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:05:57.286090 20268 ts_tablet_manager.cc:1403] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.000s
I20260709 13:05:57.286180 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511d4e52f11422da222323c32a4d742" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:57.287053 20228 raft_consensus.cc:3060] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.284874 20267 tablet_bootstrap.cc:492] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:05:57.290555 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511d4e52f11422da222323c32a4d742" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:05:57.292480 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8895e208df7f42d49bc30edbf6fc8974" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:05:57.293291 20079 raft_consensus.cc:2468] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 0.
I20260709 13:05:57.295778 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:05:57.296525 20153 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.302595 20192 leader_election.cc:304] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:05:57.304244 20192 leader_election.cc:304] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:05:57.289875 20268 raft_consensus.cc:359] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.305274 20272 raft_consensus.cc:2804] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.305564 20268 raft_consensus.cc:385] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.305840 20272 raft_consensus.cc:493] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.306087 20268 raft_consensus.cc:740] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.306532 20272 raft_consensus.cc:3060] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.309535 20291 leader_election.cc:290] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.310488 20268 consensus_queue.cc:260] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.311774 20078 raft_consensus.cc:2468] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 0.
I20260709 13:05:57.309664 20267 tablet_bootstrap.cc:654] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.315425 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:05:57.316263 20154 raft_consensus.cc:2393] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b233561181d4924b529443e3df945f3 in current term 1: Already voted for candidate 8dd33bce196a4ee2a9a6576b9e926326 in this term.
I20260709 13:05:57.316001 20153 raft_consensus.cc:2468] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:05:57.283473 20299 raft_consensus.cc:515] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.320708 20268 ts_tablet_manager.cc:1434] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:05:57.320866 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97fdfbaaffaa48a79eb2dd5559102ae5" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
W20260709 13:05:57.322368 20117 leader_election.cc:343] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.313506 20274 raft_consensus.cc:515] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.328253 20299 leader_election.cc:290] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.336443 20274 leader_election.cc:290] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.326224 20043 leader_election.cc:304] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:05:57.337957 20267 tablet_bootstrap.cc:492] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:05:57.338985 20309 raft_consensus.cc:2804] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.339699 20267 ts_tablet_manager.cc:1403] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.004s
I20260709 13:05:57.339691 20274 raft_consensus.cc:2804] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.339939 20309 raft_consensus.cc:493] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.343194 20271 tablet_bootstrap.cc:492] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:05:57.343554 20309 raft_consensus.cc:3060] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.343904 20271 ts_tablet_manager.cc:1403] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.206s	user 0.071s	sys 0.125s
I20260709 13:05:57.338241 20228 raft_consensus.cc:2468] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 1.
I20260709 13:05:57.345175 20267 raft_consensus.cc:359] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.347141 20267 raft_consensus.cc:385] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.347227 20117 leader_election.cc:304] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:05:57.347483 20267 raft_consensus.cc:740] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.348229 20299 raft_consensus.cc:2804] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.348410 20271 raft_consensus.cc:359] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.345551 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:05:57.349480 20299 raft_consensus.cc:697] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:05:57.349512 20271 raft_consensus.cc:385] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.348354 20267 consensus_queue.cc:260] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.350173 20271 raft_consensus.cc:740] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.350546 20299 consensus_queue.cc:237] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.346625 20274 raft_consensus.cc:697] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:05:57.351186 20271 consensus_queue.cc:260] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.352451 20274 consensus_queue.cc:237] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.353040 20309 raft_consensus.cc:515] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:57.354882 20271 ts_tablet_manager.cc:1434] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:05:57.355044 20309 leader_election.cc:290] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:57.356877 20271 tablet_bootstrap.cc:492] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
W20260709 13:05:57.367543 20043 leader_election.cc:343] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.368312 20192 leader_election.cc:304] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:05:57.368084 19975 catalog_manager.cc:5697] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.369374 20309 raft_consensus.cc:2764] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:05:57.369578 20272 raft_consensus.cc:515] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.371122 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8895e208df7f42d49bc30edbf6fc8974" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:05:57.372184 20272 leader_election.cc:290] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:57.367936 20271 tablet_bootstrap.cc:654] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.373261 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8895e208df7f42d49bc30edbf6fc8974" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:05:57.373853 20078 raft_consensus.cc:3060] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.377985 20267 ts_tablet_manager.cc:1434] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.013s
I20260709 13:05:57.379217 20267 tablet_bootstrap.cc:492] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
W20260709 13:05:57.380668 20042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.195:45935, user_credentials={real_user=slave}} blocked reactor thread for 178836us
W20260709 13:05:57.381676 20042 leader_election.cc:343] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.386890 20267 tablet_bootstrap.cc:654] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:57.387163 20042 leader_election.cc:343] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.390548 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:57.391330 20228 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.393450 20271 tablet_bootstrap.cc:492] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:05:57.393993 20271 ts_tablet_manager.cc:1403] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.001s
I20260709 13:05:57.394510 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:57.395320 20227 raft_consensus.cc:3060] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.398629 20271 raft_consensus.cc:359] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.399199 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:57.399691 20271 raft_consensus.cc:385] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.400040 20226 raft_consensus.cc:3060] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.400142 20271 raft_consensus.cc:740] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.401515 20271 consensus_queue.cc:260] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.402534 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511d4e52f11422da222323c32a4d742" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:05:57.403388 20077 raft_consensus.cc:3060] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.404489 20271 ts_tablet_manager.cc:1434] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:05:57.405900 20271 tablet_bootstrap.cc:492] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:05:57.406538 20076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97fdfbaaffaa48a79eb2dd5559102ae5" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:05:57.407440 20076 raft_consensus.cc:2468] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 0.
I20260709 13:05:57.398515 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:05:57.410974 20079 raft_consensus.cc:2393] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dd33bce196a4ee2a9a6576b9e926326 in current term 1: Already voted for candidate 0b233561181d4924b529443e3df945f3 in this term.
I20260709 13:05:57.414052 20271 tablet_bootstrap.cc:654] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.437036 20078 raft_consensus.cc:2468] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 1.
I20260709 13:05:57.461902 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1abb5dd5fd44cda4616d66a3010c2e" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:05:57.462905 20154 raft_consensus.cc:3060] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:57.470614 20192 leader_election.cc:343] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.472599 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1abb5dd5fd44cda4616d66a3010c2e" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:05:57.473532 20079 raft_consensus.cc:3060] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.486129 20077 raft_consensus.cc:2468] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 1.
I20260709 13:05:57.495162 20118 leader_election.cc:304] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:05:57.496835 20299 raft_consensus.cc:2804] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.497326 20299 raft_consensus.cc:493] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.497761 20299 raft_consensus.cc:3060] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.508533 20299 raft_consensus.cc:515] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.510236 20118 leader_election.cc:304] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326; no voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:05:57.542660 20276 raft_consensus.cc:2749] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.527032 20228 raft_consensus.cc:2468] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:05:57.516980 20192 leader_election.cc:304] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:05:57.545540 20311 raft_consensus.cc:2804] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.546204 20311 raft_consensus.cc:697] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Becoming Leader. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:05:57.513705 20227 raft_consensus.cc:2468] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:05:57.547298 20311 consensus_queue.cc:237] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:57.548840 20042 leader_election.cc:304] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:05:57.516047 20226 raft_consensus.cc:2468] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:05:57.550107 20274 raft_consensus.cc:2804] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.550751 20274 raft_consensus.cc:697] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:05:57.551879 20274 consensus_queue.cc:237] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.550864 20042 leader_election.cc:304] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:05:57.553614 20291 raft_consensus.cc:2804] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.554119 20291 raft_consensus.cc:697] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:05:57.554924 20291 consensus_queue.cc:237] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.557044 20299 leader_election.cc:290] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.537660 20154 raft_consensus.cc:2468] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 1.
I20260709 13:05:57.536458 20079 raft_consensus.cc:2468] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 1.
I20260709 13:05:57.559408 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97fdfbaaffaa48a79eb2dd5559102ae5" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:57.565418 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97fdfbaaffaa48a79eb2dd5559102ae5" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
W20260709 13:05:57.568140 20117 leader_election.cc:343] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.568300 20078 raft_consensus.cc:3060] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.569029 20192 leader_election.cc:304] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:05:57.569850 20272 raft_consensus.cc:2804] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.570343 20272 raft_consensus.cc:697] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Becoming Leader. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:05:57.571125 20272 consensus_queue.cc:237] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.572175 19976 catalog_manager.cc:5697] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.581337 20078 raft_consensus.cc:2468] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 1.
I20260709 13:05:57.586956 20299 consensus_queue.cc:1048] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.587929 20118 leader_election.cc:304] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:05:57.593631 20267 tablet_bootstrap.cc:492] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:05:57.594357 20267 ts_tablet_manager.cc:1403] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.215s	user 0.091s	sys 0.076s
I20260709 13:05:57.595773 20271 tablet_bootstrap.cc:492] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:05:57.596325 20271 ts_tablet_manager.cc:1403] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.191s	user 0.048s	sys 0.097s
I20260709 13:05:57.599170 20299 raft_consensus.cc:2804] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.600025 20299 raft_consensus.cc:697] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:05:57.604195 20299 consensus_queue.cc:237] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.605412 20271 raft_consensus.cc:359] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:57.606626 20271 raft_consensus.cc:385] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.607147 20271 raft_consensus.cc:740] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.608233 20271 consensus_queue.cc:260] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:57.606410 20267 raft_consensus.cc:359] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.609985 20267 raft_consensus.cc:385] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.610332 20267 raft_consensus.cc:740] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.611430 20271 ts_tablet_manager.cc:1434] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 13:05:57.612183 20267 consensus_queue.cc:260] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.612905 20271 tablet_bootstrap.cc:492] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:05:57.615893 20267 ts_tablet_manager.cc:1434] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:05:57.617069 20267 tablet_bootstrap.cc:492] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:05:57.624894 20267 tablet_bootstrap.cc:654] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.630443 20271 tablet_bootstrap.cc:654] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.638244 20292 consensus_queue.cc:1048] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.666234 19977 catalog_manager.cc:5697] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.674785 20267 tablet_bootstrap.cc:492] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:05:57.675355 20267 ts_tablet_manager.cc:1403] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.017s
I20260709 13:05:57.677940 20267 raft_consensus.cc:359] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.678603 20267 raft_consensus.cc:385] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.678865 20267 raft_consensus.cc:740] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.679512 20267 consensus_queue.cc:260] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.680871 20267 ts_tablet_manager.cc:1434] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:57.684738 20271 tablet_bootstrap.cc:492] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:05:57.685375 20271 ts_tablet_manager.cc:1403] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.001s
I20260709 13:05:57.685454 19974 catalog_manager.cc:5697] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.688011 20271 raft_consensus.cc:359] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.688727 20271 raft_consensus.cc:385] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.689025 20271 raft_consensus.cc:740] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.689697 20271 consensus_queue.cc:260] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.691915 20271 ts_tablet_manager.cc:1434] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:05:57.687613 19974 catalog_manager.cc:5697] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.695127 20292 raft_consensus.cc:493] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.695696 20292 raft_consensus.cc:515] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.697798 20292 leader_election.cc:290] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:57.698552 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:05:57.699586 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:05:57.700482 20227 raft_consensus.cc:2393] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dd33bce196a4ee2a9a6576b9e926326 in current term 1: Already voted for candidate 0b233561181d4924b529443e3df945f3 in this term.
I20260709 13:05:57.701606 20117 leader_election.cc:304] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326; no voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:05:57.702481 20292 raft_consensus.cc:3060] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.706899 19976 catalog_manager.cc:5697] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.709827 20292 raft_consensus.cc:2749] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.720153 19977 catalog_manager.cc:5697] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 reported cstate change: term changed from 0 to 1, leader changed from <none> to f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.721928 19977 catalog_manager.cc:5697] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 reported cstate change: term changed from 0 to 1, leader changed from <none> to f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:57.753291 20291 consensus_queue.cc:1048] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.753928 20292 consensus_queue.cc:1048] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.767752 20307 consensus_queue.cc:1048] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.778152 20299 consensus_queue.cc:1048] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.804389 20311 raft_consensus.cc:493] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.804913 20311 raft_consensus.cc:515] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.807101 20311 leader_election.cc:290] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:57.808312 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:05:57.808249 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:05:57.809228 20078 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 0.
I20260709 13:05:57.809294 20154 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 0.
I20260709 13:05:57.810354 20192 leader_election.cc:304] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:05:57.811105 20311 raft_consensus.cc:2804] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.811487 20311 raft_consensus.cc:493] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.811821 20311 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.819774 20311 raft_consensus.cc:515] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.822291 20311 leader_election.cc:290] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:57.822989 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:05:57.823715 20078 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.823729 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:05:57.824452 20154 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.831315 20078 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 1.
I20260709 13:05:57.831319 20154 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 1.
I20260709 13:05:57.832804 20192 leader_election.cc:304] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:05:57.833520 20311 raft_consensus.cc:2804] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.834062 20311 raft_consensus.cc:697] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Becoming Leader. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:05:57.835526 20311 consensus_queue.cc:237] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.844954 19977 catalog_manager.cc:5697] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 reported cstate change: term changed from 0 to 1, leader changed from <none> to f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:57.870411 20299 raft_consensus.cc:493] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.871011 20299 raft_consensus.cc:515] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:57.872789 20299 leader_election.cc:290] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935), 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699)
I20260709 13:05:57.873535 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8895e208df7f42d49bc30edbf6fc8974" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:05:57.873924 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8895e208df7f42d49bc30edbf6fc8974" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:05:57.874789 20078 raft_consensus.cc:2393] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dd33bce196a4ee2a9a6576b9e926326 in current term 1: Already voted for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in this term.
I20260709 13:05:57.875787 20118 leader_election.cc:304] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326; no voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:05:57.876616 20299 raft_consensus.cc:3060] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.881508 20299 raft_consensus.cc:2749] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.953043 20311 consensus_queue.cc:1048] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.967640 20338 consensus_queue.cc:1048] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.973830 20338 consensus_queue.cc:1048] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.984236 20309 raft_consensus.cc:493] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.984745 20309 raft_consensus.cc:515] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:57.986853 20309 leader_election.cc:290] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:57.987347 20309 consensus_queue.cc:1048] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.987897 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97fdfbaaffaa48a79eb2dd5559102ae5" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:05:57.988809 20079 raft_consensus.cc:2393] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f86e2e4f00df4b1697e60e97dbbe8d88 in current term 1: Already voted for candidate 8dd33bce196a4ee2a9a6576b9e926326 in this term.
I20260709 13:05:57.987897 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97fdfbaaffaa48a79eb2dd5559102ae5" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:05:57.990919 20192 leader_election.cc:304] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:05:57.992043 20309 raft_consensus.cc:3060] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.002169 20309 raft_consensus.cc:2749] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.025430 20299 consensus_queue.cc:1048] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.029711 20307 consensus_queue.cc:1048] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.038239 20276 consensus_queue.cc:1048] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.048148 20307 consensus_queue.cc:1048] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.108003 20307 consensus_queue.cc:1048] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.120186 20291 consensus_queue.cc:1048] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.202119 20226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8895e208df7f42d49bc30edbf6fc8974"
dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
mode: GRACEFUL
new_leader_uuid: "0b233561181d4924b529443e3df945f3"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:05:58.202600 20226 raft_consensus.cc:606] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Received request to transfer leadership to TS 0b233561181d4924b529443e3df945f3
I20260709 13:05:58.207381 20226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d"
dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
mode: GRACEFUL
new_leader_uuid: "0b233561181d4924b529443e3df945f3"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:05:58.207821 20226 raft_consensus.cc:606] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Received request to transfer leadership to TS 0b233561181d4924b529443e3df945f3
I20260709 13:05:58.222715 20153 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0"
dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
mode: GRACEFUL
new_leader_uuid: "0b233561181d4924b529443e3df945f3"
 from {username='slave'} at 127.0.0.1:45942
I20260709 13:05:58.223254 20153 raft_consensus.cc:606] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Received request to transfer leadership to TS 0b233561181d4924b529443e3df945f3
I20260709 13:05:58.233273 20226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb1abb5dd5fd44cda4616d66a3010c2e"
dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
mode: GRACEFUL
new_leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:05:58.233788 20226 raft_consensus.cc:606] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Received request to transfer leadership to TS 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:05:58.246062 20079 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895"
dest_uuid: "0b233561181d4924b529443e3df945f3"
mode: GRACEFUL
new_leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:05:58.246598 20079 raft_consensus.cc:606] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Received request to transfer leadership to TS 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:05:58.251677 20079 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b"
dest_uuid: "0b233561181d4924b529443e3df945f3"
mode: GRACEFUL
new_leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:05:58.252218 20079 raft_consensus.cc:606] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Received request to transfer leadership to TS f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:05:58.274786 20309 consensus_queue.cc:1048] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.289773 20272 consensus_queue.cc:1048] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.297070 20338 raft_consensus.cc:993] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88: : Instructing follower 0b233561181d4924b529443e3df945f3 to start an election
I20260709 13:05:58.297528 20272 raft_consensus.cc:1081] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Signalling peer 0b233561181d4924b529443e3df945f3 to start an election
I20260709 13:05:58.298980 20079 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d"
dest_uuid: "0b233561181d4924b529443e3df945f3"
 from {username='slave'} at 127.0.0.1:55868
I20260709 13:05:58.299450 20079 raft_consensus.cc:493] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.299736 20079 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.304545 20079 raft_consensus.cc:515] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.306640 20079 leader_election.cc:290] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:58.307227 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:58.307883 20226 raft_consensus.cc:3055] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.306910 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:05:58.308197 20226 raft_consensus.cc:740] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:05:58.308393 20153 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.309119 20226 consensus_queue.cc:260] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.310493 20226 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.315697 20153 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:05:58.317080 20043 leader_election.cc:304] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:05:58.317432 20226 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:05:58.317816 20291 raft_consensus.cc:2804] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.318408 20291 raft_consensus.cc:697] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:05:58.319216 20291 consensus_queue.cc:237] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.325553 19976 catalog_manager.cc:5697] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 1 to 2, leader changed from f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195) to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 2 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.416369 20311 raft_consensus.cc:993] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88: : Instructing follower 0b233561181d4924b529443e3df945f3 to start an election
I20260709 13:05:58.416850 20272 raft_consensus.cc:1081] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Signalling peer 0b233561181d4924b529443e3df945f3 to start an election
I20260709 13:05:58.418640 20079 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8895e208df7f42d49bc30edbf6fc8974"
dest_uuid: "0b233561181d4924b529443e3df945f3"
 from {username='slave'} at 127.0.0.1:55868
I20260709 13:05:58.419260 20079 raft_consensus.cc:493] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.419624 20079 raft_consensus.cc:3060] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.424902 20079 raft_consensus.cc:515] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:58.426769 20079 leader_election.cc:290] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 election: Requested vote from peers f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:58.427596 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8895e208df7f42d49bc30edbf6fc8974" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:58.427774 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8895e208df7f42d49bc30edbf6fc8974" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:05:58.428297 20226 raft_consensus.cc:3055] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.428303 20153 raft_consensus.cc:3060] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.428864 20226 raft_consensus.cc:740] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:05:58.429708 20226 consensus_queue.cc:260] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:58.430985 20226 raft_consensus.cc:3060] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.435899 20153 raft_consensus.cc:2468] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:05:58.437325 20043 leader_election.cc:304] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:05:58.438216 20291 raft_consensus.cc:2804] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.438262 20226 raft_consensus.cc:2468] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:05:58.438679 20291 raft_consensus.cc:697] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:05:58.439633 20291 consensus_queue.cc:237] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } }
I20260709 13:05:58.446123 19976 catalog_manager.cc:5697] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 1 to 2, leader changed from f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195) to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 2 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.492105 20292 raft_consensus.cc:993] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326: : Instructing follower 0b233561181d4924b529443e3df945f3 to start an election
I20260709 13:05:58.492614 20299 raft_consensus.cc:1081] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Signalling peer 0b233561181d4924b529443e3df945f3 to start an election
I20260709 13:05:58.493975 20079 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0"
dest_uuid: "0b233561181d4924b529443e3df945f3"
 from {username='slave'} at 127.0.0.1:55858
I20260709 13:05:58.494526 20079 raft_consensus.cc:493] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.494851 20079 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.499646 20079 raft_consensus.cc:515] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.501385 20079 leader_election.cc:290] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:58.502250 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:05:58.502558 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:58.503000 20153 raft_consensus.cc:3055] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.503219 20226 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.503444 20153 raft_consensus.cc:740] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:05:58.504283 20153 consensus_queue.cc:260] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.505235 20153 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.508559 20226 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:05:58.509732 20042 leader_election.cc:304] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:05:58.510140 20153 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:05:58.510480 20291 raft_consensus.cc:2804] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.511052 20291 raft_consensus.cc:697] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:05:58.511864 20291 consensus_queue.cc:237] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.518424 19976 catalog_manager.cc:5697] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 1 to 2, leader changed from 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194) to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 2 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.551688 20338 raft_consensus.cc:993] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88: : Instructing follower 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:05:58.552219 20272 raft_consensus.cc:1081] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Signalling peer 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:05:58.554222 20153 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb1abb5dd5fd44cda4616d66a3010c2e"
dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:45940
I20260709 13:05:58.554853 20153 raft_consensus.cc:493] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.555253 20153 raft_consensus.cc:3060] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.560972 20153 raft_consensus.cc:515] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.562973 20153 leader_election.cc:290] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:58.563701 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1abb5dd5fd44cda4616d66a3010c2e" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:05:58.564047 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1abb5dd5fd44cda4616d66a3010c2e" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:58.564491 20079 raft_consensus.cc:3060] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.564637 20226 raft_consensus.cc:3055] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.565084 20226 raft_consensus.cc:740] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:05:58.565740 20226 consensus_queue.cc:260] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.566758 20226 raft_consensus.cc:3060] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.569949 20079 raft_consensus.cc:2468] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:05:58.571084 20118 leader_election.cc:304] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:05:58.571743 20226 raft_consensus.cc:2468] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:05:58.571839 20299 raft_consensus.cc:2804] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.572477 20299 raft_consensus.cc:697] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:05:58.573258 20299 consensus_queue.cc:237] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.579936 19976 catalog_manager.cc:5697] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 1 to 2, leader changed from f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195) to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.693384 20305 raft_consensus.cc:993] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3: : Instructing follower 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:05:58.693822 20291 raft_consensus.cc:1081] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Signalling peer 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:05:58.695250 20153 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895"
dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:45936
I20260709 13:05:58.695737 20153 raft_consensus.cc:493] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.696048 20153 raft_consensus.cc:3060] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.700918 20153 raft_consensus.cc:515] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.703167 20153 leader_election.cc:290] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:05:58.704142 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:05:58.704545 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:05:58.705016 20079 raft_consensus.cc:3055] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.705329 20226 raft_consensus.cc:3060] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.705494 20079 raft_consensus.cc:740] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:05:58.706743 20079 consensus_queue.cc:260] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.708621 20079 raft_consensus.cc:3060] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.714455 20226 raft_consensus.cc:2468] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:05:58.715811 20117 leader_election.cc:304] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:05:58.716615 20299 raft_consensus.cc:2804] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.716692 20079 raft_consensus.cc:2468] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:05:58.717123 20299 raft_consensus.cc:697] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:05:58.718086 20299 consensus_queue.cc:237] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.724084 19976 catalog_manager.cc:5697] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 1 to 2, leader changed from 0b233561181d4924b529443e3df945f3 (127.7.41.193) to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.746013 20305 raft_consensus.cc:993] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3: : Instructing follower f86e2e4f00df4b1697e60e97dbbe8d88 to start an election
I20260709 13:05:58.746593 20291 raft_consensus.cc:1081] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Signalling peer f86e2e4f00df4b1697e60e97dbbe8d88 to start an election
I20260709 13:05:58.748353 20226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b"
dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:05:58.748871 20226 raft_consensus.cc:493] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:58.749186 20226 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.754520 20226 raft_consensus.cc:515] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.756640 20226 leader_election.cc:290] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 2 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:05:58.757855 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:05:58.757855 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:05:58.758821 20079 raft_consensus.cc:3055] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:58.758875 20153 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.759162 20079 raft_consensus.cc:740] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:05:58.759995 20079 consensus_queue.cc:260] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.760982 20079 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.764295 20153 raft_consensus.cc:2468] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 2.
I20260709 13:05:58.765476 20192 leader_election.cc:304] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:05:58.766186 20272 raft_consensus.cc:2804] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.766306 20079 raft_consensus.cc:2468] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 2.
I20260709 13:05:58.766597 20272 raft_consensus.cc:697] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 LEADER]: Becoming Leader. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:05:58.767565 20272 consensus_queue.cc:237] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:05:58.773315 19976 catalog_manager.cc:5697] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 reported cstate change: term changed from 1 to 2, leader changed from 0b233561181d4924b529443e3df945f3 (127.7.41.193) to f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.834246 20226 raft_consensus.cc:1275] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.835456 20291 consensus_queue.cc:1048] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.844615 20153 raft_consensus.cc:1275] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.846510 20291 consensus_queue.cc:1048] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.884357 20153 raft_consensus.cc:1275] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.885650 20291 consensus_queue.cc:1048] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:58.893862 20226 raft_consensus.cc:1275] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.896209 20291 consensus_queue.cc:1048] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.970917 20226 raft_consensus.cc:1275] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.972340 20292 consensus_queue.cc:1048] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.983632 20079 raft_consensus.cc:1275] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.986212 20358 consensus_queue.cc:1048] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:58.993175 20226 raft_consensus.cc:1275] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:58.994437 20291 consensus_queue.cc:1048] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.010784 20153 raft_consensus.cc:1275] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.012238 20357 consensus_queue.cc:1048] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.172829 20079 raft_consensus.cc:1275] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Refusing update from remote peer f86e2e4f00df4b1697e60e97dbbe8d88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.174194 20272 consensus_queue.cc:1048] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.182711 20153 raft_consensus.cc:1275] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Refusing update from remote peer f86e2e4f00df4b1697e60e97dbbe8d88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.184772 20338 consensus_queue.cc:1048] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.271153 20079 raft_consensus.cc:1275] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.272421 20358 consensus_queue.cc:1048] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:59.281519 20227 raft_consensus.cc:1275] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.283320 20292 consensus_queue.cc:1048] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.283916 19976 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47824:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:06:01.287045 19976 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:06:01.339361 20065 tablet_service.cc:1511] Processing CreateTablet for tablet 8a66188048044bb5893342edf9f7c8b2 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:01.340617 20143 tablet_service.cc:1511] Processing CreateTablet for tablet 8a66188048044bb5893342edf9f7c8b2 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:01.341387 20065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a66188048044bb5893342edf9f7c8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.342487 20143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a66188048044bb5893342edf9f7c8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.342648 20213 tablet_service.cc:1511] Processing CreateTablet for tablet 8a66188048044bb5893342edf9f7c8b2 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:06:01.345049 20063 tablet_service.cc:1511] Processing CreateTablet for tablet b5b036449152445b8d219cdd220ed37e (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:01.346370 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a66188048044bb5893342edf9f7c8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.346531 20063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b036449152445b8d219cdd220ed37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.346134 20144 tablet_service.cc:1511] Processing CreateTablet for tablet b5b036449152445b8d219cdd220ed37e (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:01.347826 20144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b036449152445b8d219cdd220ed37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.356993 20217 tablet_service.cc:1511] Processing CreateTablet for tablet b5b036449152445b8d219cdd220ed37e (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:06:01.358491 20217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b036449152445b8d219cdd220ed37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.365113 20142 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5b6d6732ea4b65bddaae19c516208a (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:01.366696 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5b6d6732ea4b65bddaae19c516208a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.368234 20218 tablet_service.cc:1511] Processing CreateTablet for tablet 59fd337b41e24150abb97d2775731ecf (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:01.368287 20211 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5b6d6732ea4b65bddaae19c516208a (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:01.369719 20218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59fd337b41e24150abb97d2775731ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.370559 20211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5b6d6732ea4b65bddaae19c516208a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.371356 20140 tablet_service.cc:1511] Processing CreateTablet for tablet 59fd337b41e24150abb97d2775731ecf (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:01.372845 20140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59fd337b41e24150abb97d2775731ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.375362 20064 tablet_service.cc:1511] Processing CreateTablet for tablet 7c5b6d6732ea4b65bddaae19c516208a (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:06:01.376852 20064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c5b6d6732ea4b65bddaae19c516208a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.379333 20061 tablet_service.cc:1511] Processing CreateTablet for tablet 59fd337b41e24150abb97d2775731ecf (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:06:01.380729 20061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59fd337b41e24150abb97d2775731ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.425616 20380 tablet_bootstrap.cc:492] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:06:01.429159 20066 tablet_service.cc:1511] Processing CreateTablet for tablet 594e55ae1ea64787b7ab66769c13bf50 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:01.430644 20066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594e55ae1ea64787b7ab66769c13bf50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.432720 20144 tablet_service.cc:1511] Processing CreateTablet for tablet 594e55ae1ea64787b7ab66769c13bf50 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:01.437458 20144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594e55ae1ea64787b7ab66769c13bf50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.442147 20143 tablet_service.cc:1511] Processing CreateTablet for tablet f4a9872a984e43b38febbae36104df5c (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:01.443576 20143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a9872a984e43b38febbae36104df5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.442250 20217 tablet_service.cc:1511] Processing CreateTablet for tablet 594e55ae1ea64787b7ab66769c13bf50 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:06:01.451924 20217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594e55ae1ea64787b7ab66769c13bf50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.455642 20211 tablet_service.cc:1511] Processing CreateTablet for tablet f4a9872a984e43b38febbae36104df5c (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:01.452697 20065 tablet_service.cc:1511] Processing CreateTablet for tablet f4a9872a984e43b38febbae36104df5c (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:06:01.457227 20211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a9872a984e43b38febbae36104df5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.457976 20065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a9872a984e43b38febbae36104df5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.456601 20381 tablet_bootstrap.cc:492] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:06:01.451151 20380 tablet_bootstrap.cc:654] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.461874 20382 tablet_bootstrap.cc:492] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:06:01.471341 20064 tablet_service.cc:1511] Processing CreateTablet for tablet f92752cec50545219352d982b12ea7b6 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:01.472759 20064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92752cec50545219352d982b12ea7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.472651 20142 tablet_service.cc:1511] Processing CreateTablet for tablet f92752cec50545219352d982b12ea7b6 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:01.473851 20213 tablet_service.cc:1511] Processing CreateTablet for tablet f92752cec50545219352d982b12ea7b6 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:06:01.479647 20213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92752cec50545219352d982b12ea7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.486393 20214 tablet_service.cc:1511] Processing CreateTablet for tablet 201d21d72ab54454b00568774c51be9d (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:01.487759 20382 tablet_bootstrap.cc:654] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.487900 20214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 201d21d72ab54454b00568774c51be9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.488391 20142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92752cec50545219352d982b12ea7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.491401 20143 tablet_service.cc:1511] Processing CreateTablet for tablet 201d21d72ab54454b00568774c51be9d (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:01.498679 20381 tablet_bootstrap.cc:654] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.498970 20143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 201d21d72ab54454b00568774c51be9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.492007 20066 tablet_service.cc:1511] Processing CreateTablet for tablet 201d21d72ab54454b00568774c51be9d (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:06:01.502859 20066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 201d21d72ab54454b00568774c51be9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.508111 20063 tablet_service.cc:1511] Processing CreateTablet for tablet b2628c5d7ca3417c8fb8ed6952625b50 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:01.509506 20063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2628c5d7ca3417c8fb8ed6952625b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.517423 20144 tablet_service.cc:1511] Processing CreateTablet for tablet b2628c5d7ca3417c8fb8ed6952625b50 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:01.518891 20144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2628c5d7ca3417c8fb8ed6952625b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.519795 20218 tablet_service.cc:1511] Processing CreateTablet for tablet b2628c5d7ca3417c8fb8ed6952625b50 (DEFAULT_TABLE table=soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:06:01.520828 20380 tablet_bootstrap.cc:492] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:06:01.521106 20218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2628c5d7ca3417c8fb8ed6952625b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:01.521394 20380 ts_tablet_manager.cc:1403] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.006s
I20260709 13:06:01.533036 20380 raft_consensus.cc:359] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.534189 20380 raft_consensus.cc:385] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.549474 20381 tablet_bootstrap.cc:492] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:06:01.534608 20380 raft_consensus.cc:740] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.550381 20381 ts_tablet_manager.cc:1403] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.000s
I20260709 13:06:01.550683 20380 consensus_queue.cc:260] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.554382 20381 raft_consensus.cc:359] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.555812 20382 tablet_bootstrap.cc:492] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:06:01.556058 20381 raft_consensus.cc:385] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.556457 20382 ts_tablet_manager.cc:1403] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.004s
I20260709 13:06:01.556502 20381 raft_consensus.cc:740] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.557765 20381 consensus_queue.cc:260] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.559639 20382 raft_consensus.cc:359] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.560468 20382 raft_consensus.cc:385] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.560811 20382 raft_consensus.cc:740] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.561789 20381 ts_tablet_manager.cc:1434] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:06:01.563246 20381 tablet_bootstrap.cc:492] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:06:01.570508 20381 tablet_bootstrap.cc:654] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.561655 20382 consensus_queue.cc:260] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.574002 20380 ts_tablet_manager.cc:1434] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.001s
I20260709 13:06:01.574450 20367 raft_consensus.cc:493] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.575294 20380 tablet_bootstrap.cc:492] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:06:01.574939 20367 raft_consensus.cc:515] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.584587 20367 leader_election.cc:290] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:01.584800 20382 ts_tablet_manager.cc:1434] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.010s
I20260709 13:06:01.586000 20382 tablet_bootstrap.cc:492] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:06:01.585932 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5b6d6732ea4b65bddaae19c516208a" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:01.589247 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5b6d6732ea4b65bddaae19c516208a" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:01.590015 20226 raft_consensus.cc:2468] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:06:01.591985 20042 leader_election.cc:304] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:01.593994 20382 tablet_bootstrap.cc:654] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:01.594151 20043 leader_election.cc:343] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.598017 20381 tablet_bootstrap.cc:492] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:06:01.598546 20381 ts_tablet_manager.cc:1403] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.011s
I20260709 13:06:01.599536 20382 tablet_bootstrap.cc:492] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:06:01.600031 20382 ts_tablet_manager.cc:1403] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 13:06:01.601819 20381 raft_consensus.cc:359] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.602752 20381 raft_consensus.cc:385] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.602787 20382 raft_consensus.cc:359] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.603155 20367 raft_consensus.cc:2804] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.603188 20381 raft_consensus.cc:740] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.603739 20382 raft_consensus.cc:385] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.603888 20367 raft_consensus.cc:493] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.604176 20382 raft_consensus.cc:740] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.604363 20367 raft_consensus.cc:3060] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.604362 20381 consensus_queue.cc:260] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.605146 20382 consensus_queue.cc:260] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.607955 20382 ts_tablet_manager.cc:1434] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:06:01.609027 20382 tablet_bootstrap.cc:492] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:06:01.610013 20381 ts_tablet_manager.cc:1434] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:06:01.612852 20367 raft_consensus.cc:515] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.614588 20380 tablet_bootstrap.cc:654] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.616227 20367 leader_election.cc:290] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:01.616617 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5b6d6732ea4b65bddaae19c516208a" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:01.616909 20382 tablet_bootstrap.cc:654] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.626004 20380 tablet_bootstrap.cc:492] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:06:01.626644 20380 ts_tablet_manager.cc:1403] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.000s
I20260709 13:06:01.626919 20381 tablet_bootstrap.cc:492] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
W20260709 13:06:01.627203 20043 leader_election.cc:343] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.629839 20380 raft_consensus.cc:359] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.630785 20380 raft_consensus.cc:385] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.631156 20380 raft_consensus.cc:740] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.632004 20380 consensus_queue.cc:260] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.634660 20380 ts_tablet_manager.cc:1434] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:06:01.636062 20380 tablet_bootstrap.cc:492] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
W20260709 13:06:01.636644 20254 tablet.cc:2406] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:01.643270 20381 tablet_bootstrap.cc:654] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.645352 20380 tablet_bootstrap.cc:654] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.647220 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5b6d6732ea4b65bddaae19c516208a" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:01.647913 20226 raft_consensus.cc:3060] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.657819 20389 raft_consensus.cc:493] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.658727 20389 raft_consensus.cc:515] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.663038 20226 raft_consensus.cc:2468] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:06:01.665504 20389 leader_election.cc:290] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:01.666340 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59fd337b41e24150abb97d2775731ecf" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:01.667110 20382 tablet_bootstrap.cc:492] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:06:01.667784 20382 ts_tablet_manager.cc:1403] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.013s
W20260709 13:06:01.667793 20043 leader_election.cc:343] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.668951 20381 tablet_bootstrap.cc:492] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:06:01.669538 20381 ts_tablet_manager.cc:1403] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.001s
I20260709 13:06:01.669979 20042 leader_election.cc:304] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:01.671048 20387 raft_consensus.cc:2804] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:01.671468 20382 raft_consensus.cc:359] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.672091 20380 tablet_bootstrap.cc:492] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:06:01.672264 20382 raft_consensus.cc:385] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.672633 20382 raft_consensus.cc:740] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.672643 20380 ts_tablet_manager.cc:1403] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.037s	user 0.002s	sys 0.018s
I20260709 13:06:01.671515 20387 raft_consensus.cc:697] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:01.672750 20381 raft_consensus.cc:359] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.674095 20381 raft_consensus.cc:385] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.673648 20382 consensus_queue.cc:260] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.674484 20381 raft_consensus.cc:740] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.674189 20387 consensus_queue.cc:237] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.675374 20381 consensus_queue.cc:260] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.676321 20382 ts_tablet_manager.cc:1434] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:01.677455 20382 tablet_bootstrap.cc:492] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:06:01.677764 20381 ts_tablet_manager.cc:1434] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:01.678995 20381 tablet_bootstrap.cc:492] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:06:01.679406 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59fd337b41e24150abb97d2775731ecf" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
W20260709 13:06:01.681111 20042 leader_election.cc:343] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.681275 20380 raft_consensus.cc:359] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.681649 20042 leader_election.cc:304] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b233561181d4924b529443e3df945f3; no voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:01.682152 20380 raft_consensus.cc:385] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.682539 20380 raft_consensus.cc:740] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.683226 20389 raft_consensus.cc:2749] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:01.683350 20380 consensus_queue.cc:260] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.687162 20381 tablet_bootstrap.cc:654] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.692962 20380 ts_tablet_manager.cc:1434] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:06:01.696930 20382 tablet_bootstrap.cc:654] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.697449 20380 tablet_bootstrap.cc:492] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:06:01.701439 20389 raft_consensus.cc:493] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.702091 20389 raft_consensus.cc:515] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.705147 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a66188048044bb5893342edf9f7c8b2" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:01.705811 20153 raft_consensus.cc:2468] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:06:01.706820 20043 leader_election.cc:304] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:01.708130 20387 raft_consensus.cc:2804] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.708585 20387 raft_consensus.cc:493] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.707823 19976 catalog_manager.cc:5697] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.709084 20387 raft_consensus.cc:3060] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.709813 20380 tablet_bootstrap.cc:654] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.712687 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a66188048044bb5893342edf9f7c8b2" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:01.713371 20226 raft_consensus.cc:2468] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:06:01.714772 20389 leader_election.cc:290] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:01.717437 20381 tablet_bootstrap.cc:492] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:06:01.717702 20382 tablet_bootstrap.cc:492] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:06:01.718313 20381 ts_tablet_manager.cc:1403] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.004s
I20260709 13:06:01.718336 20382 ts_tablet_manager.cc:1403] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.041s	user 0.000s	sys 0.013s
I20260709 13:06:01.720868 20380 tablet_bootstrap.cc:492] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:06:01.721437 20380 ts_tablet_manager.cc:1403] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.005s
I20260709 13:06:01.721824 20381 raft_consensus.cc:359] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.722124 20382 raft_consensus.cc:359] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.722788 20381 raft_consensus.cc:385] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.722950 20382 raft_consensus.cc:385] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.723204 20381 raft_consensus.cc:740] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.723382 20382 raft_consensus.cc:740] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.724534 20382 consensus_queue.cc:260] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.724799 20380 raft_consensus.cc:359] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.725596 20380 raft_consensus.cc:385] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.725991 20380 raft_consensus.cc:740] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.727272 20382 ts_tablet_manager.cc:1434] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:06:01.727088 20387 raft_consensus.cc:515] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.728415 20382 tablet_bootstrap.cc:492] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:06:01.724140 20381 consensus_queue.cc:260] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.731616 20381 ts_tablet_manager.cc:1434] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:01.732663 20381 tablet_bootstrap.cc:492] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:06:01.733096 20380 consensus_queue.cc:260] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.735816 20380 ts_tablet_manager.cc:1434] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 13:06:01.736888 20380 tablet_bootstrap.cc:492] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:06:01.739107 20382 tablet_bootstrap.cc:654] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.739355 20381 tablet_bootstrap.cc:654] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.743567 20380 tablet_bootstrap.cc:654] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.752676 20382 tablet_bootstrap.cc:492] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:06:01.753290 20382 ts_tablet_manager.cc:1403] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.002s
I20260709 13:06:01.756539 20380 tablet_bootstrap.cc:492] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:06:01.756369 20382 raft_consensus.cc:359] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.757359 20380 ts_tablet_manager.cc:1403] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:06:01.758040 20338 raft_consensus.cc:493] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.758574 20338 raft_consensus.cc:515] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.760787 20338 leader_election.cc:290] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:01.762681 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59fd337b41e24150abb97d2775731ecf" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:01.761711 20380 raft_consensus.cc:359] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.763346 20380 raft_consensus.cc:385] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.757330 20382 raft_consensus.cc:385] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.763398 20153 raft_consensus.cc:2468] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 0.
I20260709 13:06:01.763758 20380 raft_consensus.cc:740] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.763833 20382 raft_consensus.cc:740] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.763442 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59fd337b41e24150abb97d2775731ecf" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:01.764789 20079 raft_consensus.cc:2468] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 0.
I20260709 13:06:01.764963 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a66188048044bb5893342edf9f7c8b2" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:01.765194 20387 leader_election.cc:290] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:01.765702 20154 raft_consensus.cc:3060] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.766263 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a66188048044bb5893342edf9f7c8b2" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:01.766760 20192 leader_election.cc:304] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:01.764921 20382 consensus_queue.cc:260] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.766808 20226 raft_consensus.cc:3060] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.769276 20382 ts_tablet_manager.cc:1434] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.005s
I20260709 13:06:01.770284 20382 tablet_bootstrap.cc:492] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:06:01.775399 20382 tablet_bootstrap.cc:654] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.775159 20380 consensus_queue.cc:260] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.775823 20338 raft_consensus.cc:2804] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.776314 20338 raft_consensus.cc:493] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.773984 20154 raft_consensus.cc:2468] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:06:01.776494 20226 raft_consensus.cc:2468] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:06:01.777403 20043 leader_election.cc:304] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:01.778512 20387 raft_consensus.cc:2804] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:01.778959 20380 ts_tablet_manager.cc:1434] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:06:01.779037 20387 raft_consensus.cc:697] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:01.780588 20380 tablet_bootstrap.cc:492] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:06:01.776726 20338 raft_consensus.cc:3060] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.786303 20387 consensus_queue.cc:237] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.787941 20380 tablet_bootstrap.cc:654] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.799937 20381 tablet_bootstrap.cc:492] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:06:01.800731 20381 ts_tablet_manager.cc:1403] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.008s
I20260709 13:06:01.800271 20380 tablet_bootstrap.cc:492] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:06:01.803474 20380 ts_tablet_manager.cc:1403] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:06:01.805124 20382 tablet_bootstrap.cc:492] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:06:01.805778 20382 ts_tablet_manager.cc:1403] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.024s
I20260709 13:06:01.806056 20380 raft_consensus.cc:359] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.806711 20380 raft_consensus.cc:385] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.807003 20380 raft_consensus.cc:740] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.807679 20380 consensus_queue.cc:260] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.808772 20382 raft_consensus.cc:359] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.809644 20382 raft_consensus.cc:385] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.809060 19974 catalog_manager.cc:5697] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.809911 20380 ts_tablet_manager.cc:1434] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:06:01.809994 20382 raft_consensus.cc:740] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.811159 20380 tablet_bootstrap.cc:492] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:06:01.811597 20382 consensus_queue.cc:260] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.812597 20381 raft_consensus.cc:359] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.816776 20381 raft_consensus.cc:385] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.817113 20381 raft_consensus.cc:740] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.818248 20380 tablet_bootstrap.cc:654] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.817917 20381 consensus_queue.cc:260] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.814283 20382 ts_tablet_manager.cc:1434] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:01.815989 20338 raft_consensus.cc:515] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.823452 20382 tablet_bootstrap.cc:492] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:06:01.824275 20338 leader_election.cc:290] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:01.826848 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59fd337b41e24150abb97d2775731ecf" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:01.833549 20154 raft_consensus.cc:3060] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.827642 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59fd337b41e24150abb97d2775731ecf" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:01.829941 20380 tablet_bootstrap.cc:492] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:06:01.830684 20382 tablet_bootstrap.cc:654] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.838480 20079 raft_consensus.cc:3060] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.838621 20380 ts_tablet_manager.cc:1403] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.012s
I20260709 13:06:01.841017 20154 raft_consensus.cc:2468] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 1.
I20260709 13:06:01.841858 20380 raft_consensus.cc:359] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.842423 20192 leader_election.cc:304] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:01.843739 20380 raft_consensus.cc:385] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.844075 20380 raft_consensus.cc:740] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.844180 20338 raft_consensus.cc:2804] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:01.844729 20338 raft_consensus.cc:697] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Becoming Leader. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:06:01.845283 20382 tablet_bootstrap.cc:492] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:06:01.844945 20380 consensus_queue.cc:260] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.845783 20382 ts_tablet_manager.cc:1403] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.007s
I20260709 13:06:01.845495 20338 consensus_queue.cc:237] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.847581 20380 ts_tablet_manager.cc:1434] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:01.848554 20079 raft_consensus.cc:2468] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 1.
I20260709 13:06:01.849141 20380 tablet_bootstrap.cc:492] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:06:01.851398 20381 ts_tablet_manager.cc:1434] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.004s
I20260709 13:06:01.848889 20382 raft_consensus.cc:359] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.853559 20382 raft_consensus.cc:385] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.853890 20382 raft_consensus.cc:740] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.855008 20382 consensus_queue.cc:260] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.856637 20380 tablet_bootstrap.cc:654] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.858235 20382 ts_tablet_manager.cc:1434] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:06:01.859416 20382 tablet_bootstrap.cc:492] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:06:01.859705 20381 tablet_bootstrap.cc:492] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:06:01.868515 20381 tablet_bootstrap.cc:654] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.874754 20382 tablet_bootstrap.cc:654] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.877925 20380 tablet_bootstrap.cc:492] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:06:01.878592 20380 ts_tablet_manager.cc:1403] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.007s
I20260709 13:06:01.882264 20380 raft_consensus.cc:359] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.883307 20380 raft_consensus.cc:385] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.882697 19974 catalog_manager.cc:5697] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 reported cstate change: term changed from 0 to 1, leader changed from <none> to f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:01.885236 20381 tablet_bootstrap.cc:492] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:06:01.885771 20381 ts_tablet_manager.cc:1403] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.001s
I20260709 13:06:01.888968 20381 raft_consensus.cc:359] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.889658 20381 raft_consensus.cc:385] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.883790 20380 raft_consensus.cc:740] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.889950 20381 raft_consensus.cc:740] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.890677 20380 consensus_queue.cc:260] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.890959 20381 consensus_queue.cc:260] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.893669 20380 ts_tablet_manager.cc:1434] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:01.895519 20369 raft_consensus.cc:493] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.896129 20380 tablet_bootstrap.cc:492] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326: Bootstrap starting.
I20260709 13:06:01.896020 20369 raft_consensus.cc:515] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.900096 20411 raft_consensus.cc:493] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.900691 20411 raft_consensus.cc:515] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.901206 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5b6d6732ea4b65bddaae19c516208a" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:01.903796 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b036449152445b8d219cdd220ed37e" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:01.904469 20078 raft_consensus.cc:2468] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 0.
I20260709 13:06:01.905087 20380 tablet_bootstrap.cc:654] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.906138 20118 leader_election.cc:304] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:01.909017 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c5b6d6732ea4b65bddaae19c516208a" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:01.909742 20226 raft_consensus.cc:2393] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dd33bce196a4ee2a9a6576b9e926326 in current term 1: Already voted for candidate 0b233561181d4924b529443e3df945f3 in this term.
I20260709 13:06:01.914578 20369 leader_election.cc:290] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:01.915303 20369 raft_consensus.cc:2804] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.915740 20369 raft_consensus.cc:493] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.916142 20369 raft_consensus.cc:3060] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.918395 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b036449152445b8d219cdd220ed37e" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:01.919131 20226 raft_consensus.cc:2468] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 0.
I20260709 13:06:01.921054 20411 leader_election.cc:290] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:01.926779 20118 leader_election.cc:304] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326; no voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:01.934703 20381 ts_tablet_manager.cc:1434] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:06:01.936154 20381 tablet_bootstrap.cc:492] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:06:01.937237 20411 raft_consensus.cc:3060] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.953095 20382 tablet_bootstrap.cc:492] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:06:01.953835 20382 ts_tablet_manager.cc:1403] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.095s	user 0.051s	sys 0.035s
I20260709 13:06:01.954249 20369 raft_consensus.cc:515] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.956568 20369 leader_election.cc:290] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:01.957126 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b036449152445b8d219cdd220ed37e" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:01.957057 20382 raft_consensus.cc:359] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.957808 20079 raft_consensus.cc:3060] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.958096 20382 raft_consensus.cc:385] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.958362 20382 raft_consensus.cc:740] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.959026 20382 consensus_queue.cc:260] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.960045 20389 raft_consensus.cc:493] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.960525 20389 raft_consensus.cc:515] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.961018 20382 ts_tablet_manager.cc:1434] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:06:01.961993 20382 tablet_bootstrap.cc:492] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3: Bootstrap starting.
I20260709 13:06:01.962780 20389 leader_election.cc:290] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:01.962000 20381 tablet_bootstrap.cc:654] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.965637 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594e55ae1ea64787b7ab66769c13bf50" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:01.967698 20226 raft_consensus.cc:2468] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:06:01.968209 20382 tablet_bootstrap.cc:654] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.969514 20042 leader_election.cc:304] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:01.972990 20079 raft_consensus.cc:2468] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 1.
I20260709 13:06:01.974611 20389 raft_consensus.cc:2804] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.975047 20389 raft_consensus.cc:493] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.975374 20389 raft_consensus.cc:3060] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.976658 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b036449152445b8d219cdd220ed37e" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:01.977459 20226 raft_consensus.cc:3060] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.982774 20118 leader_election.cc:304] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:01.982838 20389 raft_consensus.cc:515] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.984184 20369 raft_consensus.cc:2804] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:01.989955 20226 raft_consensus.cc:2468] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 1.
I20260709 13:06:01.990628 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594e55ae1ea64787b7ab66769c13bf50" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:01.990991 20411 raft_consensus.cc:2749] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:01.991325 20154 raft_consensus.cc:2468] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:06:01.984700 20369 raft_consensus.cc:697] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:06:01.992960 20369 consensus_queue.cc:237] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:01.995978 20380 tablet_bootstrap.cc:492] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326: No bootstrap required, opened a new log
I20260709 13:06:01.996632 20380 ts_tablet_manager.cc:1403] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326: Time spent bootstrapping tablet: real 0.101s	user 0.031s	sys 0.048s
I20260709 13:06:01.996742 20389 leader_election.cc:290] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:01.996888 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594e55ae1ea64787b7ab66769c13bf50" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:01.997735 20154 raft_consensus.cc:3060] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.998500 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594e55ae1ea64787b7ab66769c13bf50" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:01.999022 20226 raft_consensus.cc:3060] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.999785 20380 raft_consensus.cc:359] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.000546 20380 raft_consensus.cc:385] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.000878 20380 raft_consensus.cc:740] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.001623 20380 consensus_queue.cc:260] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.003641 20380 ts_tablet_manager.cc:1434] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:02.006341 20389 raft_consensus.cc:493] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.006538 20226 raft_consensus.cc:2468] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:06:02.007129 20389 raft_consensus.cc:515] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.008049 20042 leader_election.cc:304] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:02.009317 20387 raft_consensus.cc:2804] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.009976 20387 raft_consensus.cc:697] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:02.011364 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a9872a984e43b38febbae36104df5c" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:02.011195 20387 consensus_queue.cc:237] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
W20260709 13:06:02.012739 20042 leader_election.cc:343] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.015803 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a9872a984e43b38febbae36104df5c" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:02.016708 20153 raft_consensus.cc:2468] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:06:02.018399 20043 leader_election.cc:304] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:02.020062 20367 raft_consensus.cc:2804] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.020522 20367 raft_consensus.cc:493] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.020964 20367 raft_consensus.cc:3060] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:02.021409 20025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:02.009749 20389 leader_election.cc:290] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:02.036586 20382 tablet_bootstrap.cc:492] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3: No bootstrap required, opened a new log
I20260709 13:06:02.037266 20382 ts_tablet_manager.cc:1403] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.006s
I20260709 13:06:02.037606 20338 raft_consensus.cc:493] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.037806 20154 raft_consensus.cc:2468] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:06:02.033205 20367 raft_consensus.cc:515] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.038159 20338 raft_consensus.cc:515] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.043215 20338 leader_election.cc:290] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:02.045039 20367 leader_election.cc:290] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:02.045121 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92752cec50545219352d982b12ea7b6" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:02.045876 20153 raft_consensus.cc:2468] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 0.
I20260709 13:06:02.033967 19977 catalog_manager.cc:5697] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.046208 19974 catalog_manager.cc:5697] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 1 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.047179 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a9872a984e43b38febbae36104df5c" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:02.048312 20192 leader_election.cc:304] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:02.048550 20381 tablet_bootstrap.cc:492] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
W20260709 13:06:02.048671 20042 leader_election.cc:343] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.049194 20381 ts_tablet_manager.cc:1403] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.113s	user 0.027s	sys 0.024s
I20260709 13:06:02.041409 20382 raft_consensus.cc:359] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.050038 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a9872a984e43b38febbae36104df5c" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:02.050254 20382 raft_consensus.cc:385] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.050690 20382 raft_consensus.cc:740] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.051195 20338 raft_consensus.cc:2804] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.051450 20382 consensus_queue.cc:260] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.050700 20153 raft_consensus.cc:3060] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.052111 20338 raft_consensus.cc:493] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.052595 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92752cec50545219352d982b12ea7b6" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:02.060654 20079 raft_consensus.cc:2468] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 0.
I20260709 13:06:02.060747 20382 ts_tablet_manager.cc:1434] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:06:02.061504 20338 raft_consensus.cc:3060] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.052501 20381 raft_consensus.cc:359] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.064433 20381 raft_consensus.cc:385] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.064782 20381 raft_consensus.cc:740] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.065593 20381 consensus_queue.cc:260] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.069450 20381 ts_tablet_manager.cc:1434] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:06:02.070484 20338 raft_consensus.cc:515] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.071501 20367 raft_consensus.cc:493] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.071967 20367 raft_consensus.cc:515] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.072994 20338 leader_election.cc:290] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:02.070503 20381 tablet_bootstrap.cc:492] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:06:02.076134 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92752cec50545219352d982b12ea7b6" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:02.076684 20079 raft_consensus.cc:3060] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.076969 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2628c5d7ca3417c8fb8ed6952625b50" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:02.077669 20154 raft_consensus.cc:2468] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:06:02.079686 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2628c5d7ca3417c8fb8ed6952625b50" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
W20260709 13:06:02.081228 20042 leader_election.cc:343] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.083379 20079 raft_consensus.cc:2468] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 1.
I20260709 13:06:02.084793 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92752cec50545219352d982b12ea7b6" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:02.085481 20192 leader_election.cc:304] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:02.085983 20154 raft_consensus.cc:3060] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.087001 20043 leader_election.cc:304] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:02.087934 20387 raft_consensus.cc:2804] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:02.088131 20338 raft_consensus.cc:2804] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.088416 20387 raft_consensus.cc:493] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.088677 20338 raft_consensus.cc:697] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Becoming Leader. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:06:02.088935 20387 raft_consensus.cc:3060] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.089645 20338 consensus_queue.cc:237] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.074009 20367 leader_election.cc:290] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:02.093717 20154 raft_consensus.cc:2468] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 1.
I20260709 13:06:02.094754 20153 raft_consensus.cc:2468] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:06:02.097409 20387 raft_consensus.cc:515] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.100718 20381 tablet_bootstrap.cc:654] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.101320 20387 leader_election.cc:290] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:02.102607 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2628c5d7ca3417c8fb8ed6952625b50" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
W20260709 13:06:02.104561 20042 leader_election.cc:343] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:02.105115 20043 leader_election.cc:304] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:02.107087 20367 raft_consensus.cc:2804] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.107602 20367 raft_consensus.cc:697] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:02.108480 20367 consensus_queue.cc:237] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.115876 20381 tablet_bootstrap.cc:492] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:06:02.116520 20381 ts_tablet_manager.cc:1403] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.004s
I20260709 13:06:02.121526 20381 raft_consensus.cc:359] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.122531 20381 raft_consensus.cc:385] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.122926 20381 raft_consensus.cc:740] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.123729 20381 consensus_queue.cc:260] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.130532 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2628c5d7ca3417c8fb8ed6952625b50" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:02.131699 20153 raft_consensus.cc:3060] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:02.133683 20381 ts_tablet_manager.cc:1434] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:06:02.134171 20389 consensus_queue.cc:1048] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:02.135289 20381 tablet_bootstrap.cc:492] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88: Bootstrap starting.
I20260709 13:06:02.139523 20153 raft_consensus.cc:2468] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:06:02.140877 20043 leader_election.cc:304] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:02.141830 20381 tablet_bootstrap.cc:654] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:02.156999 20387 raft_consensus.cc:2804] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:02.163115 20381 tablet_bootstrap.cc:492] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88: No bootstrap required, opened a new log
I20260709 13:06:02.163694 20381 ts_tablet_manager.cc:1403] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 13:06:02.167796 20381 raft_consensus.cc:359] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.168553 20381 raft_consensus.cc:385] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:02.168922 20381 raft_consensus.cc:740] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Initialized, Role: FOLLOWER
I20260709 13:06:02.169612 20381 consensus_queue.cc:260] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:02.171475 20381 ts_tablet_manager.cc:1434] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:06:03.079036 20025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:03.266286 20424 raft_consensus.cc:493] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.266997 20424 raft_consensus.cc:515] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.269178 20424 leader_election.cc:290] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:03.270778 20424 raft_consensus.cc:493] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b233561181d4924b529443e3df945f3)
I20260709 13:06:03.271344 20424 raft_consensus.cc:515] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.273402 20424 leader_election.cc:290] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:03.269356 20425 raft_consensus.cc:493] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b233561181d4924b529443e3df945f3)
I20260709 13:06:03.274127 20425 raft_consensus.cc:515] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.276203 20425 leader_election.cc:290] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.287946 20424 raft_consensus.cc:493] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.288564 20424 raft_consensus.cc:515] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.290818 20424 leader_election.cc:290] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:03.337342 20424 raft_consensus.cc:493] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dd33bce196a4ee2a9a6576b9e926326)
I20260709 13:06:03.337909 20424 raft_consensus.cc:515] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.340616 20424 leader_election.cc:290] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:03.341784 20147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.345191 20424 consensus_queue.cc:1048] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.349160 20387 raft_consensus.cc:697] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:03.350005 20150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a9872a984e43b38febbae36104df5c" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.350988 20150 raft_consensus.cc:2393] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f86e2e4f00df4b1697e60e97dbbe8d88 in current term 1: Already voted for candidate 0b233561181d4924b529443e3df945f3 in this term.
I20260709 13:06:03.350672 20387 consensus_queue.cc:237] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.349277 20428 raft_consensus.cc:493] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.353075 20428 raft_consensus.cc:515] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.355746 20428 leader_election.cc:290] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.356159 20429 raft_consensus.cc:493] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dd33bce196a4ee2a9a6576b9e926326)
I20260709 13:06:03.357497 20429 raft_consensus.cc:515] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.360255 20429 leader_election.cc:290] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.371717 20151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.374485 20424 consensus_queue.cc:1048] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.381297 20433 raft_consensus.cc:493] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dd33bce196a4ee2a9a6576b9e926326)
I20260709 13:06:03.382113 20433 raft_consensus.cc:515] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.384476 20433 leader_election.cc:290] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.385684 20152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2628c5d7ca3417c8fb8ed6952625b50" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.386937 20152 raft_consensus.cc:2393] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f86e2e4f00df4b1697e60e97dbbe8d88 in current term 1: Already voted for candidate 0b233561181d4924b529443e3df945f3 in this term.
I20260709 13:06:03.391675 20369 raft_consensus.cc:493] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f86e2e4f00df4b1697e60e97dbbe8d88)
I20260709 13:06:03.392237 20369 raft_consensus.cc:515] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.392582 20432 raft_consensus.cc:493] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dd33bce196a4ee2a9a6576b9e926326)
I20260709 13:06:03.392391 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:03.393805 20432 raft_consensus.cc:515] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.395978 20432 leader_election.cc:290] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.396469 20432 raft_consensus.cc:493] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f86e2e4f00df4b1697e60e97dbbe8d88)
I20260709 13:06:03.396968 20432 raft_consensus.cc:515] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.398952 20432 leader_election.cc:290] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.400743 20412 raft_consensus.cc:493] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b233561181d4924b529443e3df945f3)
I20260709 13:06:03.401558 20412 raft_consensus.cc:515] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.403304 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:03.405055 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a9872a984e43b38febbae36104df5c" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:03.406723 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:03.409649 20150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201d21d72ab54454b00568774c51be9d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.410060 20192 leader_election.cc:304] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:03.410337 20150 raft_consensus.cc:2468] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:06:03.411355 20192 leader_election.cc:304] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:03.412329 20192 leader_election.cc:304] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:03.413699 20437 raft_consensus.cc:493] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b233561181d4924b529443e3df945f3)
I20260709 13:06:03.414224 20437 raft_consensus.cc:515] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.416320 20437 leader_election.cc:290] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:03.416815 20437 raft_consensus.cc:2749] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.417450 20437 raft_consensus.cc:3060] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.425354 20437 raft_consensus.cc:2749] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.426163 20437 raft_consensus.cc:2749] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.426333 20369 leader_election.cc:290] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.428200 20154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45936 (request call id 66) took 1290 ms. Trace:
I20260709 13:06:03.430972 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:03.433524 20146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511d4e52f11422da222323c32a4d742" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.432014 20150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97fdfbaaffaa48a79eb2dd5559102ae5" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.433811 20043 leader_election.cc:304] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:03.434583 20148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1abb5dd5fd44cda4616d66a3010c2e" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.435242 20145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.435163 20433 raft_consensus.cc:2804] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:03.436841 20433 raft_consensus.cc:493] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.436935 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2628c5d7ca3417c8fb8ed6952625b50" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:03.437304 20433 raft_consensus.cc:3060] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.437258 20430 consensus_queue.cc:1048] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.439550 20192 leader_election.cc:304] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:03.434865 20154 rpcz_store.cc:276] 0709 13:06:02.137889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.138092 (+   203us) service_pool.cc:224] Handling call
0709 13:06:02.138702 (+   610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:02.139191 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:02.139237 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:02.139874 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:06:02.155806 (+ 15932us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:06:02.155871 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.156218 (+   347us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.427848 (+1271630us) raft_consensus.cc:1685] finished
0709 13:06:03.427878 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.428097 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1704,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":15410,"threads_started":1,"wal-append.queue_time_us":64612}
I20260709 13:06:03.444516 20404 raft_consensus.cc:493] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.445868 20338 raft_consensus.cc:493] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0b233561181d4924b529443e3df945f3)
I20260709 13:06:03.446456 20404 raft_consensus.cc:515] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.448287 20430 consensus_queue.cc:1048] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.446494 20338 raft_consensus.cc:515] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.448210 20412 leader_election.cc:290] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.451736 20338 leader_election.cc:290] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:03.452360 20338 raft_consensus.cc:3060] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.452585 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:03.453143 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:03.453295 20226 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:06:03.453861 20228 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:06:03.448975 20404 leader_election.cc:290] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:03.448969 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:03.456787 19976 catalog_manager.cc:5697] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 reported cstate change: term changed from 0 to 1, leader changed from <none> to f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195). New cstate: current_term: 1 leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.458515 20432 consensus_queue.cc:1048] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.462666 19977 catalog_manager.cc:5697] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.467221 20149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.456822 20117 leader_election.cc:304] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:03.471204 20369 raft_consensus.cc:2804] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.471714 20369 raft_consensus.cc:493] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b233561181d4924b529443e3df945f3)
I20260709 13:06:03.471705 20117 leader_election.cc:304] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:03.480336 20369 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.492709 20412 raft_consensus.cc:2804] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.493155 20412 raft_consensus.cc:493] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0b233561181d4924b529443e3df945f3)
I20260709 13:06:03.493566 20412 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.499068 20425 consensus_queue.cc:1048] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.501530 20338 raft_consensus.cc:2749] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.494915 20433 raft_consensus.cc:515] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.515909 20433 leader_election.cc:290] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.520539 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:03.521453 20079 raft_consensus.cc:2468] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
W20260709 13:06:03.518884 20192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.41.193:37699, user_credentials={real_user=slave}} blocked reactor thread for 79425.6us
I20260709 13:06:03.526911 20147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201d21d72ab54454b00568774c51be9d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:03.527601 20147 raft_consensus.cc:3060] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.533823 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:03.529645 20369 raft_consensus.cc:515] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.535907 20118 leader_election.cc:304] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:03.539824 20411 raft_consensus.cc:2804] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.540217 20411 raft_consensus.cc:493] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f86e2e4f00df4b1697e60e97dbbe8d88)
I20260709 13:06:03.540560 20411 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:03.546514 20008 debug-util.cc:398] Leaking SignalData structure 0x7b0800086da0 after lost signal to thread 7338
I20260709 13:06:03.549844 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201d21d72ab54454b00568774c51be9d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:03.550069 20412 raft_consensus.cc:515] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.550608 20228 raft_consensus.cc:2468] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 0.
I20260709 13:06:03.551065 20425 consensus_queue.cc:1048] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.552997 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:03.554690 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97fdfbaaffaa48a79eb2dd5559102ae5" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:03.557605 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201d21d72ab54454b00568774c51be9d" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:03.558768 20077 raft_consensus.cc:2393] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f86e2e4f00df4b1697e60e97dbbe8d88 in current term 1: Already voted for candidate 0b233561181d4924b529443e3df945f3 in this term.
I20260709 13:06:03.559142 20228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1abb5dd5fd44cda4616d66a3010c2e" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:03.559587 20412 leader_election.cc:290] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.560207 20369 leader_election.cc:290] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.561272 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:03.560566 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
W20260709 13:06:03.566696 20008 debug-util.cc:398] Leaking SignalData structure 0x7b080008a4c0 after lost signal to thread 20011
I20260709 13:06:03.571494 20227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511d4e52f11422da222323c32a4d742" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
W20260709 13:06:03.571736 20008 debug-util.cc:398] Leaking SignalData structure 0x7b08001511a0 after lost signal to thread 20103
I20260709 13:06:03.572372 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:03.578557 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201d21d72ab54454b00568774c51be9d" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.579548 20411 raft_consensus.cc:515] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.581151 20147 raft_consensus.cc:2468] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:06:03.581856 20411 leader_election.cc:290] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.582458 20043 leader_election.cc:304] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:03.582459 20117 leader_election.cc:304] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326; no voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:03.583184 20079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:03.584035 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:03.561326 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:03.587586 20117 leader_election.cc:304] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326; no voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:03.589063 20428 raft_consensus.cc:2804] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:03.589485 20226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201d21d72ab54454b00568774c51be9d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:03.590157 20226 raft_consensus.cc:3060] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:03.591542 20118 leader_election.cc:304] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326; no voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:03.589601 20428 raft_consensus.cc:697] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:03.594453 20428 consensus_queue.cc:237] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.596403 20431 consensus_queue.cc:1048] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.596858 20429 consensus_queue.cc:1048] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:03.593086 20008 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4240 after lost signal to thread 20178
W20260709 13:06:03.599210 20008 debug-util.cc:398] Leaking SignalData structure 0x7b08002b6040 after lost signal to thread 20252
W20260709 13:06:03.599557 20008 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4e00 after lost signal to thread 20253
I20260709 13:06:03.600158 20438 raft_consensus.cc:2749] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.586558 20425 raft_consensus.cc:2749] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.600991 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:03.603741 20154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.605154 20431 consensus_queue.cc:1048] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.605476 20042 leader_election.cc:304] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b233561181d4924b529443e3df945f3; no voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:03.606884 20431 raft_consensus.cc:2749] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.616463 20226 raft_consensus.cc:2468] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 1.
I20260709 13:06:03.618085 20429 consensus_queue.cc:1048] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.619160 20192 leader_election.cc:304] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:03.620241 20338 raft_consensus.cc:2749] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.591190 20411 raft_consensus.cc:2749] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.620210 20042 leader_election.cc:304] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b233561181d4924b529443e3df945f3; no voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:03.629125 20042 leader_election.cc:304] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b233561181d4924b529443e3df945f3; no voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:03.633689 20432 raft_consensus.cc:2749] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.628659 20437 consensus_queue.cc:1048] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:06:03.643697 20428 raft_consensus.cc:2749] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.643458 20437 consensus_queue.cc:1048] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:03.649598 20192 leader_election.cc:304] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:03.650759 20042 leader_election.cc:304] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b233561181d4924b529443e3df945f3; no voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:03.651011 20192 leader_election.cc:304] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:03.652290 20428 raft_consensus.cc:2749] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.654541 20149 raft_consensus.cc:1240] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Rejecting Update request from peer f86e2e4f00df4b1697e60e97dbbe8d88 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:03.655992 20404 raft_consensus.cc:2749] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.657032 20338 raft_consensus.cc:2749] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:03.686335 20404 consensus_queue.cc:1059] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:06:03.712335 20338 raft_consensus.cc:3055] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:03.726491 20338 raft_consensus.cc:740] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:06:03.727521 20338 consensus_queue.cc:260] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
W20260709 13:06:03.730583 20192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38087, user_credentials={real_user=slave}} blocked reactor thread for 70669.3us
W20260709 13:06:03.757624 20448 log.cc:927] Time spent T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3: Append to log took a long time: real 0.138s	user 0.003s	sys 0.003s
I20260709 13:06:03.778549 20338 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.796932 20428 raft_consensus.cc:493] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.798377 20428 raft_consensus.cc:515] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.807879 20428 leader_election.cc:290] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:03.808753 20147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92752cec50545219352d982b12ea7b6" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:03.809985 20224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92752cec50545219352d982b12ea7b6" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:03.812832 20042 leader_election.cc:304] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b233561181d4924b529443e3df945f3; no voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:03.816452 20432 consensus_queue.cc:1048] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.844830 20149 raft_consensus.cc:1240] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Rejecting Update request from peer 0b233561181d4924b529443e3df945f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:03.846632 20432 consensus_queue.cc:1059] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:03.847626 20432 raft_consensus.cc:3055] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:03.847895 20432 raft_consensus.cc:740] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:03.848784 20432 consensus_queue.cc:260] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.846652 20428 raft_consensus.cc:2749] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.857637 20147 raft_consensus.cc:1240] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Rejecting Update request from peer 0b233561181d4924b529443e3df945f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:03.864153 20429 consensus_queue.cc:1048] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.865653 19976 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47810 (request call id 59) took 1691 ms. Trace:
I20260709 13:06:03.866122 19976 rpcz_store.cc:276] 0709 13:06:02.174465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.176190 (+  1725us) service_pool.cc:224] Handling call
0709 13:06:03.865573 (+1689383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:03.500115 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:03.500745 (+   630us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:03.500784 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:06:03.500807 (+    23us) tablet.cc:662] Decoding operations
0709 13:06:03.501166 (+   359us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:03.501250 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:03.501287 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:03.531916 (+ 30629us) tablet.cc:701] Row locks acquired
0709 13:06:03.532149 (+   233us) write_op.cc:260] PREPARE: finished
0709 13:06:03.534937 (+  2788us) write_op.cc:270] Start()
0709 13:06:03.539394 (+  4457us) write_op.cc:276] Timestamp: P: 1783602363534580 usec, L: 0
0709 13:06:03.541851 (+  2457us) op_driver.cc:348] REPLICATION: starting
0709 13:06:03.607796 (+ 65945us) log.cc:844] Serialized 537 byte log entry
0709 13:06:03.761194 (+153398us) op_driver.cc:464] REPLICATION: finished
0709 13:06:03.834827 (+ 73633us) write_op.cc:301] APPLY: starting
0709 13:06:03.835336 (+   509us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:03.836672 (+  1336us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:03.843245 (+  6573us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:03.843476 (+   231us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:03.843630 (+   154us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:03.843678 (+    48us) write_op.cc:312] APPLY: finished
0709 13:06:03.849580 (+  5902us) log.cc:844] Serialized 22 byte log entry
0709 13:06:03.851700 (+  2120us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:03.851782 (+    82us) write_op.cc:454] Released schema lock
0709 13:06:03.851824 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:03.852216 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:03.852247 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12146,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":65284,"apply.run_cpu_time_us":1826,"apply.run_wall_time_us":18261,"num_ops":1,"prepare.queue_time_us":38623,"prepare.run_cpu_time_us":13712,"prepare.run_wall_time_us":145642,"raft.queue_time_us":109267,"raft.run_cpu_time_us":29709,"raft.run_wall_time_us":74736,"replication_time_us":219140,"thread_start_us":141367,"threads_started":4,"wal-append.queue_time_us":58458}]]}
I20260709 13:06:03.872499 20429 consensus_queue.cc:1059] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:03.873968 20429 raft_consensus.cc:3055] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:03.874435 20429 raft_consensus.cc:740] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:03.868451 20432 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.885831 20429 consensus_queue.cc:260] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:03.901568 20429 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.909114 19977 catalog_manager.cc:5697] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } } }
I20260709 13:06:03.935058 19976 catalog_manager.cc:5697] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 1 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.052472 20154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5b036449152445b8d219cdd220ed37e"
dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
mode: GRACEFUL
new_leader_uuid: "0b233561181d4924b529443e3df945f3"
 from {username='slave'} at 127.0.0.1:45942
I20260709 13:06:04.053339 20154 raft_consensus.cc:606] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Received request to transfer leadership to TS 0b233561181d4924b529443e3df945f3
I20260709 13:06:04.064158 20225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59fd337b41e24150abb97d2775731ecf"
dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
mode: GRACEFUL
new_leader_uuid: "0b233561181d4924b529443e3df945f3"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:06:04.064831 20225 raft_consensus.cc:606] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Received request to transfer leadership to TS 0b233561181d4924b529443e3df945f3
I20260709 13:06:04.067313 20432 consensus_queue.cc:1048] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.073038 20439 raft_consensus.cc:993] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88: : Instructing follower 0b233561181d4924b529443e3df945f3 to start an election
I20260709 13:06:04.073488 20439 raft_consensus.cc:1081] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Signalling peer 0b233561181d4924b529443e3df945f3 to start an election
I20260709 13:06:04.076030 20078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59fd337b41e24150abb97d2775731ecf"
dest_uuid: "0b233561181d4924b529443e3df945f3"
 from {username='slave'} at 127.0.0.1:55868
I20260709 13:06:04.076676 20078 raft_consensus.cc:493] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.077059 20078 raft_consensus.cc:3060] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.084818 20077 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "594e55ae1ea64787b7ab66769c13bf50"
dest_uuid: "0b233561181d4924b529443e3df945f3"
mode: GRACEFUL
new_leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:06:04.085680 20077 raft_consensus.cc:606] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Received request to transfer leadership to TS 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:04.092131 20078 raft_consensus.cc:515] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.093109 20077 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4a9872a984e43b38febbae36104df5c"
dest_uuid: "0b233561181d4924b529443e3df945f3"
mode: GRACEFUL
new_leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:06:04.093904 20077 raft_consensus.cc:606] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Received request to transfer leadership to TS 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:04.110184 20432 consensus_queue.cc:1048] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:04.114341 20078 leader_election.cc:290] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:04.115793 20225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59fd337b41e24150abb97d2775731ecf" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:04.116559 20225 raft_consensus.cc:3055] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.116922 20225 raft_consensus.cc:740] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:06:04.117786 20225 consensus_queue.cc:260] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.119194 20225 raft_consensus.cc:3060] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.123726 20223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f92752cec50545219352d982b12ea7b6"
dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
mode: GRACEFUL
new_leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:06:04.124488 20223 raft_consensus.cc:606] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Received request to transfer leadership to TS 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:04.125862 20147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59fd337b41e24150abb97d2775731ecf" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:04.126677 20147 raft_consensus.cc:3060] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.140285 20338 raft_consensus.cc:993] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88: : Instructing follower 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:06:04.140909 20338 raft_consensus.cc:1081] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Signalling peer 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:06:04.143472 20225 raft_consensus.cc:2468] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:06:04.144809 20042 leader_election.cc:304] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:04.145913 20429 raft_consensus.cc:2804] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.146450 20429 raft_consensus.cc:697] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:04.146595 20149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f92752cec50545219352d982b12ea7b6"
dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:45940
I20260709 13:06:04.147367 20149 raft_consensus.cc:493] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.147783 20149 raft_consensus.cc:3060] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.147373 20429 consensus_queue.cc:237] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.155278 20078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "201d21d72ab54454b00568774c51be9d"
dest_uuid: "0b233561181d4924b529443e3df945f3"
mode: GRACEFUL
new_leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:06:04.156004 20078 raft_consensus.cc:606] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Received request to transfer leadership to TS 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:04.157450 20428 raft_consensus.cc:993] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3: : Instructing follower 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:06:04.157933 20428 raft_consensus.cc:1081] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Signalling peer 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:06:04.192373 20147 raft_consensus.cc:2468] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:06:04.196161 20078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2628c5d7ca3417c8fb8ed6952625b50"
dest_uuid: "0b233561181d4924b529443e3df945f3"
mode: GRACEFUL
new_leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
 from {username='slave'} at 127.0.0.1:55884
I20260709 13:06:04.201201 20078 raft_consensus.cc:606] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Received request to transfer leadership to TS f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:04.203131 20149 raft_consensus.cc:515] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.206887 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92752cec50545219352d982b12ea7b6" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:04.207185 20147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "201d21d72ab54454b00568774c51be9d"
dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:45936
I20260709 13:06:04.207573 20078 raft_consensus.cc:3060] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.207922 20147 raft_consensus.cc:493] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.208357 20147 raft_consensus.cc:3060] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.215648 20078 raft_consensus.cc:2468] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:06:04.218377 19975 catalog_manager.cc:5697] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 1 to 2, leader changed from f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195) to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 2 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.222406 20432 raft_consensus.cc:993] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3: : Instructing follower 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:06:04.222951 20431 raft_consensus.cc:1081] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Signalling peer 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:06:04.219340 20147 raft_consensus.cc:515] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.220487 20118 leader_election.cc:304] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:04.227641 20154 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "594e55ae1ea64787b7ab66769c13bf50"
dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:45936
I20260709 13:06:04.228276 20154 raft_consensus.cc:493] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.228629 20154 raft_consensus.cc:3060] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.230381 20369 raft_consensus.cc:2804] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.230937 20369 raft_consensus.cc:697] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:06:04.231740 20369 consensus_queue.cc:237] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.236457 20154 raft_consensus.cc:515] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.242574 20154 leader_election.cc:290] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:04.244355 20225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594e55ae1ea64787b7ab66769c13bf50" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:04.244551 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594e55ae1ea64787b7ab66769c13bf50" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:04.245103 20225 raft_consensus.cc:3060] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.245347 20078 raft_consensus.cc:3055] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.246279 20149 leader_election.cc:290] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:04.247467 20224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92752cec50545219352d982b12ea7b6" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:04.248158 20224 raft_consensus.cc:3055] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.248503 20224 raft_consensus.cc:740] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:06:04.248605 20147 leader_election.cc:290] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:04.249629 19974 catalog_manager.cc:5697] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 1 to 2, leader changed from f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195) to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.251470 20223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201d21d72ab54454b00568774c51be9d" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:04.252135 20223 raft_consensus.cc:3060] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.254463 20225 raft_consensus.cc:2468] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:06:04.255769 20117 leader_election.cc:304] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:04.256842 20369 raft_consensus.cc:2804] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.249491 20224 consensus_queue.cc:260] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.258210 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "201d21d72ab54454b00568774c51be9d" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:04.258430 20224 raft_consensus.cc:3060] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.258975 20077 raft_consensus.cc:3055] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.259356 20077 raft_consensus.cc:740] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:04.260977 20077 consensus_queue.cc:260] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.262524 20077 raft_consensus.cc:3060] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.267558 20224 raft_consensus.cc:2468] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:06:04.263152 20369 raft_consensus.cc:697] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:06:04.245880 20078 raft_consensus.cc:740] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:04.268996 20369 consensus_queue.cc:237] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.269328 20078 consensus_queue.cc:260] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.270499 20077 raft_consensus.cc:2468] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:06:04.270845 20078 raft_consensus.cc:3060] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.271821 20118 leader_election.cc:304] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:04.272676 20438 raft_consensus.cc:2804] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.273180 20438 raft_consensus.cc:697] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:06:04.274049 20438 consensus_queue.cc:237] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.281634 20078 raft_consensus.cc:2468] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:06:04.281093 19974 catalog_manager.cc:5697] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 1 to 2, leader changed from 0b233561181d4924b529443e3df945f3 (127.7.41.193) to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.282213 20223 raft_consensus.cc:2468] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:06:04.297443 19974 catalog_manager.cc:5697] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 1 to 2, leader changed from 0b233561181d4924b529443e3df945f3 (127.7.41.193) to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.390275 20369 raft_consensus.cc:993] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326: : Instructing follower 0b233561181d4924b529443e3df945f3 to start an election
I20260709 13:06:04.390808 20438 raft_consensus.cc:1081] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Signalling peer 0b233561181d4924b529443e3df945f3 to start an election
I20260709 13:06:04.392521 20078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5b036449152445b8d219cdd220ed37e"
dest_uuid: "0b233561181d4924b529443e3df945f3"
 from {username='slave'} at 127.0.0.1:55858
I20260709 13:06:04.393014 20078 raft_consensus.cc:493] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.393307 20078 raft_consensus.cc:3060] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.399454 20078 raft_consensus.cc:515] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.401160 20078 leader_election.cc:290] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:04.402284 20147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b036449152445b8d219cdd220ed37e" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:04.402964 20147 raft_consensus.cc:3055] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.403249 20223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5b036449152445b8d219cdd220ed37e" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:04.403992 20223 raft_consensus.cc:3060] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.403271 20147 raft_consensus.cc:740] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:06:04.405748 20147 consensus_queue.cc:260] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.407332 20147 raft_consensus.cc:3060] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.409355 20223 raft_consensus.cc:2468] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:06:04.410445 20042 leader_election.cc:304] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:04.411142 20431 raft_consensus.cc:2804] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.411569 20431 raft_consensus.cc:697] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:04.412309 20431 consensus_queue.cc:237] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.415587 20147 raft_consensus.cc:2468] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:06:04.419436 19974 catalog_manager.cc:5697] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 1 to 2, leader changed from 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194) to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 2 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.430357 20429 raft_consensus.cc:993] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3: : Instructing follower 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:06:04.430853 20431 raft_consensus.cc:1081] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Signalling peer 8dd33bce196a4ee2a9a6576b9e926326 to start an election
I20260709 13:06:04.432323 20147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4a9872a984e43b38febbae36104df5c"
dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
 from {username='slave'} at 127.0.0.1:45936
I20260709 13:06:04.432878 20147 raft_consensus.cc:493] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.433168 20147 raft_consensus.cc:3060] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.439731 20147 raft_consensus.cc:515] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.442291 20147 leader_election.cc:290] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:04.443174 20223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a9872a984e43b38febbae36104df5c" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:04.444010 20223 raft_consensus.cc:3060] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.444976 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4a9872a984e43b38febbae36104df5c" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:04.445544 20078 raft_consensus.cc:3055] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.445833 20078 raft_consensus.cc:740] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:04.446568 20078 consensus_queue.cc:260] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.448001 20078 raft_consensus.cc:3060] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.453092 20223 raft_consensus.cc:2468] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:06:04.453948 20078 raft_consensus.cc:2468] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 2.
I20260709 13:06:04.454571 20117 leader_election.cc:304] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:04.455606 20438 raft_consensus.cc:2804] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.456046 20438 raft_consensus.cc:697] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:06:04.456776 20438 consensus_queue.cc:237] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.463675 19974 catalog_manager.cc:5697] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 1 to 2, leader changed from 0b233561181d4924b529443e3df945f3 (127.7.41.193) to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 2 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.473023 20431 raft_consensus.cc:993] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3: : Instructing follower f86e2e4f00df4b1697e60e97dbbe8d88 to start an election
I20260709 13:06:04.473701 20431 raft_consensus.cc:1081] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Signalling peer f86e2e4f00df4b1697e60e97dbbe8d88 to start an election
I20260709 13:06:04.475898 20223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2628c5d7ca3417c8fb8ed6952625b50"
dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:06:04.476540 20223 raft_consensus.cc:493] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:04.476971 20223 raft_consensus.cc:3060] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.483150 20223 raft_consensus.cc:515] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.484762 20223 leader_election.cc:290] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 2 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:04.486186 20147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2628c5d7ca3417c8fb8ed6952625b50" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:04.486073 20078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2628c5d7ca3417c8fb8ed6952625b50" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:04.486896 20147 raft_consensus.cc:3060] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.487046 20078 raft_consensus.cc:3055] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.487571 20078 raft_consensus.cc:740] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:04.488487 20078 consensus_queue.cc:260] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.490015 20078 raft_consensus.cc:3060] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.493098 20147 raft_consensus.cc:2468] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 2.
I20260709 13:06:04.494702 20192 leader_election.cc:304] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:04.495739 20439 raft_consensus.cc:2804] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.496291 20439 raft_consensus.cc:697] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 LEADER]: Becoming Leader. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:06:04.497222 20439 consensus_queue.cc:237] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:04.501187 20078 raft_consensus.cc:2468] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 2.
I20260709 13:06:04.507373 19975 catalog_manager.cc:5697] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 reported cstate change: term changed from 1 to 2, leader changed from 0b233561181d4924b529443e3df945f3 (127.7.41.193) to f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.670555 20223 raft_consensus.cc:1275] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.672173 20431 consensus_queue.cc:1048] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.683003 20147 raft_consensus.cc:1275] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.684916 20432 consensus_queue.cc:1048] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:04.716064 20224 raft_consensus.cc:1275] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.717342 20438 consensus_queue.cc:1048] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.724515 20078 raft_consensus.cc:1275] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.726086 20369 consensus_queue.cc:1048] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.795683 20224 raft_consensus.cc:1275] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.797508 20477 consensus_queue.cc:1048] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.803920 20224 raft_consensus.cc:1275] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.807725 20078 raft_consensus.cc:1275] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.809954 20477 consensus_queue.cc:1048] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.810673 20369 consensus_queue.cc:1048] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.826658 20078 raft_consensus.cc:1275] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.828310 20477 consensus_queue.cc:1048] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.924510 20224 raft_consensus.cc:1275] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.926156 20432 consensus_queue.cc:1048] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.939685 20149 raft_consensus.cc:1275] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.941685 20487 consensus_queue.cc:1048] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:04.967984 20149 raft_consensus.cc:1275] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Refusing update from remote peer f86e2e4f00df4b1697e60e97dbbe8d88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.969422 20460 consensus_queue.cc:1048] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.971112 20077 raft_consensus.cc:1275] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Refusing update from remote peer f86e2e4f00df4b1697e60e97dbbe8d88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:04.972952 20460 consensus_queue.cc:1048] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.051748 20224 raft_consensus.cc:1275] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.053301 20485 consensus_queue.cc:1048] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.063527 20077 raft_consensus.cc:1275] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:05.065439 20438 consensus_queue.cc:1048] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:05.066990 20431 raft_consensus.cc:493] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.067579 20431 raft_consensus.cc:515] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.069823 20431 leader_election.cc:290] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:05.071786 20149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:05.072088 20223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:05.072732 20149 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 3.
I20260709 13:06:05.072830 20223 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:06:05.074493 20042 leader_election.cc:304] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:05.075906 20431 raft_consensus.cc:2804] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:05.076305 20431 raft_consensus.cc:493] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.076651 20431 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.086652 20431 raft_consensus.cc:515] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.088812 20431 leader_election.cc:290] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 4 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:05.089414 20149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:05.090102 20149 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.094264 20224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c8fb0892a64afdab2330b4d78e21c0" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:05.094905 20224 raft_consensus.cc:3060] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.098627 20149 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 4.
I20260709 13:06:05.099851 20043 leader_election.cc:304] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:05.100103 20224 raft_consensus.cc:2468] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 4.
I20260709 13:06:05.100735 20431 raft_consensus.cc:2804] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:05.101277 20431 raft_consensus.cc:697] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 4 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:05.102169 20431 consensus_queue.cc:237] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.111155 19976 catalog_manager.cc:5697] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.122360 20431 raft_consensus.cc:493] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.122985 20431 raft_consensus.cc:515] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.125303 20431 leader_election.cc:290] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:05.126015 20149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:05.126433 20224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:05.126919 20149 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 3.
I20260709 13:06:05.127198 20224 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 2.
I20260709 13:06:05.128032 20043 leader_election.cc:304] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:05.128842 20431 raft_consensus.cc:2804] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:05.129236 20431 raft_consensus.cc:493] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.129576 20431 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.138859 20431 raft_consensus.cc:515] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.141603 20149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:05.142227 20149 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.144639 20431 leader_election.cc:290] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 4 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:05.145671 20224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9a8456ccf5487785e48fb37c556d0d" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:05.146325 20224 raft_consensus.cc:3060] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.150089 20149 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 4.
I20260709 13:06:05.151309 20043 leader_election.cc:304] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, 8dd33bce196a4ee2a9a6576b9e926326; no voters: 
I20260709 13:06:05.151558 20224 raft_consensus.cc:2468] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 4.
I20260709 13:06:05.152163 20431 raft_consensus.cc:2804] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:05.152784 20431 raft_consensus.cc:697] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 4 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:05.153582 20431 consensus_queue.cc:237] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.161381 19976 catalog_manager.cc:5697] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.192022 20431 raft_consensus.cc:493] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f86e2e4f00df4b1697e60e97dbbe8d88)
I20260709 13:06:05.192488 20431 raft_consensus.cc:515] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.194262 20431 leader_election.cc:290] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:05.194954 20149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326" is_pre_election: true
I20260709 13:06:05.195537 20224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:05.195863 20149 raft_consensus.cc:2393] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b233561181d4924b529443e3df945f3 in current term 3: Already voted for candidate 8dd33bce196a4ee2a9a6576b9e926326 in this term.
I20260709 13:06:05.196167 20224 raft_consensus.cc:2468] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 3.
I20260709 13:06:05.197227 20042 leader_election.cc:304] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:05.197837 20431 raft_consensus.cc:2804] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.198252 20431 raft_consensus.cc:493] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f86e2e4f00df4b1697e60e97dbbe8d88)
I20260709 13:06:05.198568 20431 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.203496 20431 raft_consensus.cc:515] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.205706 20431 leader_election.cc:290] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 3 election: Requested vote from peers 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:05.205896 20149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:05.206792 20149 raft_consensus.cc:2393] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b233561181d4924b529443e3df945f3 in current term 3: Already voted for candidate 8dd33bce196a4ee2a9a6576b9e926326 in this term.
I20260709 13:06:05.206921 20224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "0b233561181d4924b529443e3df945f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:05.221776 20224 raft_consensus.cc:2468] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b233561181d4924b529443e3df945f3 in term 3.
I20260709 13:06:05.223021 20042 leader_election.cc:304] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 8dd33bce196a4ee2a9a6576b9e926326
I20260709 13:06:05.223763 20431 raft_consensus.cc:2804] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:05.224272 20431 raft_consensus.cc:697] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 3 LEADER]: Becoming Leader. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:05.225142 20431 consensus_queue.cc:237] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.238724 19976 catalog_manager.cc:5697] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 reported cstate change: term changed from 2 to 3, leader changed from f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195) to 0b233561181d4924b529443e3df945f3 (127.7.41.193). New cstate: current_term: 3 leader_uuid: "0b233561181d4924b529443e3df945f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.299773 20438 raft_consensus.cc:493] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.300233 20438 raft_consensus.cc:515] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.302368 20438 leader_election.cc:290] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:05.302671 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3" is_pre_election: true
I20260709 13:06:05.303122 20224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" is_pre_election: true
I20260709 13:06:05.303751 20224 raft_consensus.cc:2468] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 3.
I20260709 13:06:05.304703 20117 leader_election.cc:304] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3
I20260709 13:06:05.305392 20438 raft_consensus.cc:2804] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:05.305783 20438 raft_consensus.cc:493] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.306083 20438 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.311293 20438 raft_consensus.cc:515] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.312937 20438 leader_election.cc:290] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 4 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195:45935)
I20260709 13:06:05.313800 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:05.313949 20224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96b8881e37041c7863da60abab91b1b" candidate_uuid: "8dd33bce196a4ee2a9a6576b9e926326" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
I20260709 13:06:05.314618 20224 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.319383 20224 raft_consensus.cc:2468] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd33bce196a4ee2a9a6576b9e926326 in term 4.
I20260709 13:06:05.320356 20117 leader_election.cc:304] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dd33bce196a4ee2a9a6576b9e926326, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 0b233561181d4924b529443e3df945f3
I20260709 13:06:05.321043 20438 raft_consensus.cc:2804] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:05.321563 20438 raft_consensus.cc:697] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 LEADER]: Becoming Leader. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:06:05.322490 20438 consensus_queue.cc:237] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.331828 19976 catalog_manager.cc:5697] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 reported cstate change: term changed from 3 to 4, leader changed from 0b233561181d4924b529443e3df945f3 (127.7.41.193) to 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194). New cstate: current_term: 4 leader_uuid: "8dd33bce196a4ee2a9a6576b9e926326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.491605 20224 raft_consensus.cc:1275] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:05.493360 20431 consensus_queue.cc:1048] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.504807 20149 raft_consensus.cc:1275] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:05.506546 20487 consensus_queue.cc:1048] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.549340 20149 raft_consensus.cc:1275] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:05.550665 20487 consensus_queue.cc:1048] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.563473 20224 raft_consensus.cc:1275] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Refusing update from remote peer 0b233561181d4924b529443e3df945f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:05.564968 20431 consensus_queue.cc:1048] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.808969 20224 raft_consensus.cc:1275] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:05.810668 20477 consensus_queue.cc:1048] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.811298 20224 raft_consensus.cc:1240] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Rejecting Update request from peer 0b233561181d4924b529443e3df945f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:05.813086 20431 consensus_queue.cc:1059] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.814306 20429 raft_consensus.cc:3055] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:05.814688 20429 raft_consensus.cc:740] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:05.815559 20429 consensus_queue.cc:260] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:05.816663 20149 raft_consensus.cc:1240] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 LEADER]: Rejecting Update request from peer 0b233561181d4924b529443e3df945f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:05.816808 20429 raft_consensus.cc:3060] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.832552 20077 raft_consensus.cc:1275] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 4 FOLLOWER]: Refusing update from remote peer 8dd33bce196a4ee2a9a6576b9e926326: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:05.832923 20077 pending_rounds.cc:85] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3: Aborting all ops after (but not including) 2
I20260709 13:06:05.833187 20077 pending_rounds.cc:107] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:05.833496 20077 raft_consensus.cc:2889] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:05.835716 20438 consensus_queue.cc:1048] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:07.429523 19974 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47824:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:06:07.449087 19974 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47824:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
W20260709 13:06:07.575419 20249 debug-util.cc:398] Leaking SignalData structure 0x7b080012abc0 after lost signal to thread 7338
W20260709 13:06:07.577034 20249 debug-util.cc:398] Leaking SignalData structure 0x7b080010bf60 after lost signal to thread 20011
W20260709 13:06:07.591157 20249 debug-util.cc:398] Leaking SignalData structure 0x7b08000aba80 after lost signal to thread 20103
W20260709 13:06:07.592963 20249 debug-util.cc:398] Leaking SignalData structure 0x7b0800129060 after lost signal to thread 20178
W20260709 13:06:07.596102 20249 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2520 after lost signal to thread 20252
I20260709 13:06:07.620360 20541 tablet.cc:1724] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:07.626513 20117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.195:45935, user_credentials={real_user=slave}} blocked reactor thread for 52135us
I20260709 13:06:07.676182 20548 tablet.cc:1724] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:07.692565 20118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.193:37699, user_credentials={real_user=slave}} blocked reactor thread for 162225us
I20260709 13:06:07.697701 20555 tablet.cc:1724] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.719646  7335 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:07.680575 20547 tablet.cc:1724] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.776875 20559 tablet.cc:1724] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.814641 20560 tablet.cc:1724] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.815920 20561 tablet.cc:1724] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.822685 20555 tablet.cc:1724] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:06:07.850878 20043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.41.194:38087, user_credentials={real_user=slave}} blocked reactor thread for 44994.3us
W20260709 13:06:07.864919 20550 log.cc:927] Time spent T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:06:07.872062 20567 tablet.cc:1724] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.906560 20568 tablet.cc:1724] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.911073 20548 tablet.cc:1724] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.926326 20541 tablet.cc:1724] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.905287 20547 tablet.cc:1724] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.896879 20560 tablet.cc:1724] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:07.996629 20560 tablet.cc:1724] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.007126 20555 tablet.cc:1724] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.015944 20577 tablet.cc:1724] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.020078 20559 tablet.cc:1724] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.022949 20576 tablet.cc:1724] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.030390 20548 tablet.cc:1724] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.037935 20567 tablet.cc:1724] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.045663 20560 tablet.cc:1724] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.035001 20579 tablet.cc:1724] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.009987 20561 tablet.cc:1724] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.064617 20541 tablet.cc:1724] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.081923 20561 tablet.cc:1724] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.085984 20152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1511d4e52f11422da222323c32a4d742"
dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
mode: GRACEFUL
new_leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:06:08.086674 20152 raft_consensus.cc:606] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Received request to transfer leadership to TS f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:08.139458 20544 raft_consensus.cc:993] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326: : Instructing follower f86e2e4f00df4b1697e60e97dbbe8d88 to start an election
I20260709 13:06:08.140560 20544 raft_consensus.cc:1081] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Signalling peer f86e2e4f00df4b1697e60e97dbbe8d88 to start an election
I20260709 13:06:08.138495 20547 tablet.cc:1724] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:06:08.147039 20223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1511d4e52f11422da222323c32a4d742"
dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
 from {username='slave'} at 127.0.0.1:49772
I20260709 13:06:08.147629 20223 raft_consensus.cc:493] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:08.147967 20223 raft_consensus.cc:3060] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.166901 20223 raft_consensus.cc:515] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:08.169064 20223 leader_election.cc:290] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 2 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:08.169675 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511d4e52f11422da222323c32a4d742" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:08.170395 20077 raft_consensus.cc:3060] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.173686 20152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1511d4e52f11422da222323c32a4d742" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:08.174425 20152 raft_consensus.cc:3055] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.174715 20152 raft_consensus.cc:740] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:06:08.175489 20152 consensus_queue.cc:260] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:08.176229 20077 raft_consensus.cc:2468] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 2.
I20260709 13:06:08.176839 20152 raft_consensus.cc:3060] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.177840 20192 leader_election.cc:304] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:08.178763 20507 raft_consensus.cc:2804] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:08.179829 20507 raft_consensus.cc:697] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 LEADER]: Becoming Leader. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:06:08.180939 20507 consensus_queue.cc:237] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:08.193784 20152 raft_consensus.cc:2468] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 2.
I20260709 13:06:08.203733 20077 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e"
dest_uuid: "0b233561181d4924b529443e3df945f3"
mode: GRACEFUL
new_leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
 from {username='slave'} at 127.0.0.1:53728
I20260709 13:06:08.204499 20077 raft_consensus.cc:606] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Received request to transfer leadership to TS f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:08.208756 20152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895"
dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
mode: GRACEFUL
new_leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:06:08.209458 20152 raft_consensus.cc:606] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Received request to transfer leadership to TS f86e2e4f00df4b1697e60e97dbbe8d88
I20260709 13:06:08.210976  7335 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:08.211640  7335 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:08.217738 19975 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951: soft_deleted_table [id=42fb40958aa747d88c75702f73b44e06] alter complete (version 1)
I20260709 13:06:08.236855 19976 catalog_manager.cc:5697] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 reported cstate change: term changed from 1 to 2, leader changed from 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194) to f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.597867 20554 raft_consensus.cc:993] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3: : Instructing follower f86e2e4f00df4b1697e60e97dbbe8d88 to start an election
I20260709 13:06:08.598414 20586 raft_consensus.cc:1081] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Signalling peer f86e2e4f00df4b1697e60e97dbbe8d88 to start an election
I20260709 13:06:08.599917 20222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e"
dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
 from {username='slave'} at 127.0.0.1:49788
I20260709 13:06:08.600414 20222 raft_consensus.cc:493] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:08.600805 20222 raft_consensus.cc:3060] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.606199 20222 raft_consensus.cc:515] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:08.609696 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:08.610433 20077 raft_consensus.cc:3055] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.610918 20077 raft_consensus.cc:740] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b233561181d4924b529443e3df945f3, State: Running, Role: LEADER
I20260709 13:06:08.612063 20153 raft_consensus.cc:1275] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Refusing update from remote peer f86e2e4f00df4b1697e60e97dbbe8d88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.611904 20077 consensus_queue.cc:260] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:08.613107 20077 raft_consensus.cc:3060] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.613965 20507 consensus_queue.cc:1048] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:08.618168 20222 leader_election.cc:290] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 2 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:08.619273 20152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd280a52a6a48d383c5860cc086629e" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:08.619961 20152 raft_consensus.cc:3060] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.623114 20077 raft_consensus.cc:2468] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 2.
I20260709 13:06:08.624549 20192 leader_election.cc:304] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:08.625356 20580 raft_consensus.cc:2804] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:08.640815 20580 raft_consensus.cc:697] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 LEADER]: Becoming Leader. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:06:08.646265 20152 raft_consensus.cc:2468] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 2.
I20260709 13:06:08.647910 20580 consensus_queue.cc:237] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:08.656196 20077 raft_consensus.cc:1275] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Refusing update from remote peer f86e2e4f00df4b1697e60e97dbbe8d88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:08.660219 20580 consensus_queue.cc:1048] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:08.672492 19976 catalog_manager.cc:5697] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 reported cstate change: term changed from 1 to 2, leader changed from 0b233561181d4924b529443e3df945f3 (127.7.41.193) to f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195). New cstate: current_term: 2 leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.719550 20538 raft_consensus.cc:993] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326: : Instructing follower f86e2e4f00df4b1697e60e97dbbe8d88 to start an election
I20260709 13:06:08.720109 20536 raft_consensus.cc:1081] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Signalling peer f86e2e4f00df4b1697e60e97dbbe8d88 to start an election
I20260709 13:06:08.722072 20222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895"
dest_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88"
 from {username='slave'} at 127.0.0.1:49772
I20260709 13:06:08.722690 20222 raft_consensus.cc:493] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:08.723075 20222 raft_consensus.cc:3060] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.737730 20222 raft_consensus.cc:515] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:08.740254 20222 leader_election.cc:290] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 3 election: Requested vote from peers 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699), 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087)
I20260709 13:06:08.741367 20077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b233561181d4924b529443e3df945f3"
I20260709 13:06:08.741607 20153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eb76cddaf9b42fb8273600e72fee895" candidate_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8dd33bce196a4ee2a9a6576b9e926326"
I20260709 13:06:08.742138 20077 raft_consensus.cc:3060] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.742367 20153 raft_consensus.cc:3055] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.742789 20153 raft_consensus.cc:740] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8dd33bce196a4ee2a9a6576b9e926326, State: Running, Role: LEADER
I20260709 13:06:08.743620 20153 consensus_queue.cc:260] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:08.744778 20153 raft_consensus.cc:3060] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.752533 20077 raft_consensus.cc:2468] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 3.
I20260709 13:06:08.752564 20153 raft_consensus.cc:2468] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86e2e4f00df4b1697e60e97dbbe8d88 in term 3.
I20260709 13:06:08.754000 20192 leader_election.cc:304] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b233561181d4924b529443e3df945f3, f86e2e4f00df4b1697e60e97dbbe8d88; no voters: 
I20260709 13:06:08.755333 20580 raft_consensus.cc:2804] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:08.755848 20580 raft_consensus.cc:697] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 3 LEADER]: Becoming Leader. State: Replica: f86e2e4f00df4b1697e60e97dbbe8d88, State: Running, Role: LEADER
I20260709 13:06:08.756757 20580 consensus_queue.cc:237] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } }
I20260709 13:06:08.766902 19976 catalog_manager.cc:5697] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 reported cstate change: term changed from 2 to 3, leader changed from 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194) to f86e2e4f00df4b1697e60e97dbbe8d88 (127.7.41.195). New cstate: current_term: 3 leader_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f86e2e4f00df4b1697e60e97dbbe8d88" member_type: VOTER last_known_addr { host: "127.7.41.195" port: 45935 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:09.140671 20077 raft_consensus.cc:1275] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Refusing update from remote peer f86e2e4f00df4b1697e60e97dbbe8d88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:09.142146 20580 consensus_queue.cc:1048] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:09.160625 20153 raft_consensus.cc:1275] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Refusing update from remote peer f86e2e4f00df4b1697e60e97dbbe8d88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:09.162825 20589 consensus_queue.cc:1048] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:09.226697 20077 raft_consensus.cc:1275] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Refusing update from remote peer f86e2e4f00df4b1697e60e97dbbe8d88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:09.228281 20580 consensus_queue.cc:1048] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b233561181d4924b529443e3df945f3" member_type: VOTER last_known_addr { host: "127.7.41.193" port: 37699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:09.278754 20153 raft_consensus.cc:1275] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Refusing update from remote peer f86e2e4f00df4b1697e60e97dbbe8d88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:09.280682 20589 consensus_queue.cc:1048] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dd33bce196a4ee2a9a6576b9e926326" member_type: VOTER last_known_addr { host: "127.7.41.194" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:09.306362  7335 tablet_server.cc:179] TabletServer@127.7.41.193:0 shutting down...
W20260709 13:06:09.314774 20118 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:06:09.317795 20118 consensus_peers.cc:597] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 -> Peer 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699): Couldn't send request to peer 0b233561181d4924b529443e3df945f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.354362  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:09.355370  7335 tablet_replica.cc:333] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.356339  7335 raft_consensus.cc:2243] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.356999  7335 raft_consensus.cc:2272] T b2628c5d7ca3417c8fb8ed6952625b50 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.359030  7335 tablet_replica.cc:333] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.359625  7335 raft_consensus.cc:2243] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.360073  7335 raft_consensus.cc:2272] T f4a9872a984e43b38febbae36104df5c P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.361819  7335 tablet_replica.cc:333] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.362404  7335 raft_consensus.cc:2243] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.362841  7335 raft_consensus.cc:2272] T 594e55ae1ea64787b7ab66769c13bf50 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.364789  7335 tablet_replica.cc:333] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.365319  7335 raft_consensus.cc:2243] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.366150  7335 raft_consensus.cc:2272] T b5b036449152445b8d219cdd220ed37e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.367888  7335 tablet_replica.cc:333] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.368419  7335 raft_consensus.cc:2243] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.369206  7335 raft_consensus.cc:2272] T 8a66188048044bb5893342edf9f7c8b2 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.371213  7335 tablet_replica.cc:333] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.371812  7335 raft_consensus.cc:2243] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.372527  7335 raft_consensus.cc:2272] T 46c8fb0892a64afdab2330b4d78e21c0 P 0b233561181d4924b529443e3df945f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.374815  7335 tablet_replica.cc:333] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.375383  7335 raft_consensus.cc:2243] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.375808  7335 raft_consensus.cc:2272] T 1511d4e52f11422da222323c32a4d742 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.378710  7335 tablet_replica.cc:333] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.379268  7335 raft_consensus.cc:2243] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.380019  7335 raft_consensus.cc:2272] T 59fd337b41e24150abb97d2775731ecf P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.381933  7335 tablet_replica.cc:333] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.382524  7335 raft_consensus.cc:2243] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.383399  7335 raft_consensus.cc:2272] T 7c5b6d6732ea4b65bddaae19c516208a P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.385672  7335 tablet_replica.cc:333] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.386509  7335 raft_consensus.cc:2243] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.387060  7335 raft_consensus.cc:2272] T fb1abb5dd5fd44cda4616d66a3010c2e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:09.387470 20118 consensus_peers.cc:597] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 -> Peer 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699): Couldn't send request to peer 0b233561181d4924b529443e3df945f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.390007  7335 tablet_replica.cc:333] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.390697  7335 raft_consensus.cc:2243] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.391144  7335 raft_consensus.cc:2272] T f92752cec50545219352d982b12ea7b6 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.392930  7335 tablet_replica.cc:333] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.393455  7335 raft_consensus.cc:2243] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.393872  7335 raft_consensus.cc:2272] T d96b8881e37041c7863da60abab91b1b P 0b233561181d4924b529443e3df945f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.395926  7335 tablet_replica.cc:333] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.396528  7335 raft_consensus.cc:2243] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.396993  7335 raft_consensus.cc:2272] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 0b233561181d4924b529443e3df945f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.399205  7335 tablet_replica.cc:333] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.399842  7335 raft_consensus.cc:2243] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.400612  7335 raft_consensus.cc:2272] T cd9a8456ccf5487785e48fb37c556d0d P 0b233561181d4924b529443e3df945f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.403163  7335 tablet_replica.cc:333] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.403687  7335 raft_consensus.cc:2243] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.404112  7335 raft_consensus.cc:2272] T 5bd280a52a6a48d383c5860cc086629e P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.406883  7335 tablet_replica.cc:333] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.407423  7335 raft_consensus.cc:2243] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.407860  7335 raft_consensus.cc:2272] T 201d21d72ab54454b00568774c51be9d P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.409584  7335 tablet_replica.cc:333] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.410195  7335 raft_consensus.cc:2243] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.410683  7335 raft_consensus.cc:2272] T 7eb76cddaf9b42fb8273600e72fee895 P 0b233561181d4924b529443e3df945f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.413026  7335 tablet_replica.cc:333] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3: stopping tablet replica
I20260709 13:06:09.413497  7335 raft_consensus.cc:2243] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.414390  7335 raft_consensus.cc:2272] T 8895e208df7f42d49bc30edbf6fc8974 P 0b233561181d4924b529443e3df945f3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:09.437469 20118 consensus_peers.cc:597] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 -> Peer 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699): Couldn't send request to peer 0b233561181d4924b529443e3df945f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.458278  7335 tablet_server.cc:196] TabletServer@127.7.41.193:0 shutdown complete.
I20260709 13:06:09.507547  7335 tablet_server.cc:179] TabletServer@127.7.41.194:0 shutting down...
W20260709 13:06:09.524427 20118 consensus_peers.cc:597] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 -> Peer 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699): Couldn't send request to peer 0b233561181d4924b529443e3df945f3. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:37699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.547009  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:09.548014  7335 tablet_replica.cc:333] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.548882  7335 raft_consensus.cc:2243] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.549489  7335 raft_consensus.cc:2272] T b2628c5d7ca3417c8fb8ed6952625b50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.552170  7335 tablet_replica.cc:333] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.552960  7335 raft_consensus.cc:2243] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.553943  7335 raft_consensus.cc:2272] T 594e55ae1ea64787b7ab66769c13bf50 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:09.554545 20192 consensus_peers.cc:597] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 -> Peer 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699): Couldn't send request to peer 0b233561181d4924b529443e3df945f3. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:37699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.556077  7335 tablet_replica.cc:333] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.556790  7335 raft_consensus.cc:2243] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.557705  7335 raft_consensus.cc:2272] T f4a9872a984e43b38febbae36104df5c P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:09.559621 20192 consensus_peers.cc:597] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 -> Peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Couldn't send request to peer 8dd33bce196a4ee2a9a6576b9e926326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.560137  7335 tablet_replica.cc:333] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.560778  7335 raft_consensus.cc:2243] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.561239  7335 raft_consensus.cc:2272] T 7c5b6d6732ea4b65bddaae19c516208a P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.563185  7335 tablet_replica.cc:333] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.563804  7335 raft_consensus.cc:2243] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.564271  7335 raft_consensus.cc:2272] T 8a66188048044bb5893342edf9f7c8b2 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.566196  7335 tablet_replica.cc:333] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.566752  7335 raft_consensus.cc:2243] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.567231  7335 raft_consensus.cc:2272] T 8895e208df7f42d49bc30edbf6fc8974 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.569468  7335 tablet_replica.cc:333] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.570171  7335 raft_consensus.cc:2243] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.570966  7335 raft_consensus.cc:2272] T fb1abb5dd5fd44cda4616d66a3010c2e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.573288  7335 tablet_replica.cc:333] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.573836  7335 raft_consensus.cc:2243] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.574318  7335 raft_consensus.cc:2272] T 59fd337b41e24150abb97d2775731ecf P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.576205  7335 tablet_replica.cc:333] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.576892  7335 raft_consensus.cc:2243] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.577328  7335 raft_consensus.cc:2272] T 46c8fb0892a64afdab2330b4d78e21c0 P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.580027  7335 tablet_replica.cc:333] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.580653  7335 raft_consensus.cc:2243] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.581108  7335 raft_consensus.cc:2272] T 1511d4e52f11422da222323c32a4d742 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.584301  7335 tablet_replica.cc:333] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.584975  7335 raft_consensus.cc:2243] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.585511  7335 raft_consensus.cc:2272] T cd9a8456ccf5487785e48fb37c556d0d P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.587770  7335 tablet_replica.cc:333] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.588331  7335 raft_consensus.cc:2243] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.588898  7335 raft_consensus.cc:2272] T 5bd280a52a6a48d383c5860cc086629e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.591737  7335 tablet_replica.cc:333] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.592288  7335 raft_consensus.cc:2243] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.593106  7335 raft_consensus.cc:2272] T 201d21d72ab54454b00568774c51be9d P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.595016  7335 tablet_replica.cc:333] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.595616  7335 raft_consensus.cc:2243] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.596041  7335 raft_consensus.cc:2272] T 7eb76cddaf9b42fb8273600e72fee895 P 8dd33bce196a4ee2a9a6576b9e926326 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.598642  7335 tablet_replica.cc:333] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.599187  7335 raft_consensus.cc:2243] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.600003  7335 raft_consensus.cc:2272] T 97fdfbaaffaa48a79eb2dd5559102ae5 P 8dd33bce196a4ee2a9a6576b9e926326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.602224  7335 tablet_replica.cc:333] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.602739  7335 raft_consensus.cc:2243] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.603523  7335 raft_consensus.cc:2272] T f92752cec50545219352d982b12ea7b6 P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.605537  7335 tablet_replica.cc:333] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.606120  7335 raft_consensus.cc:2243] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.606881  7335 raft_consensus.cc:2272] T d96b8881e37041c7863da60abab91b1b P 8dd33bce196a4ee2a9a6576b9e926326 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.608848  7335 tablet_replica.cc:333] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326: stopping tablet replica
I20260709 13:06:09.609308  7335 raft_consensus.cc:2243] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.609836  7335 raft_consensus.cc:2272] T b5b036449152445b8d219cdd220ed37e P 8dd33bce196a4ee2a9a6576b9e926326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.643354  7335 tablet_server.cc:196] TabletServer@127.7.41.194:0 shutdown complete.
W20260709 13:06:09.676568 20192 consensus_peers.cc:597] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 -> Peer 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699): Couldn't send request to peer 0b233561181d4924b529443e3df945f3. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:37699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.678288  7335 tablet_server.cc:179] TabletServer@127.7.41.195:0 shutting down...
I20260709 13:06:09.710705  7335 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:09.711570  7335 tablet_replica.cc:333] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.712536  7335 raft_consensus.cc:2243] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.713608  7335 raft_consensus.cc:2272] T b2628c5d7ca3417c8fb8ed6952625b50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.716023  7335 tablet_replica.cc:333] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.716670  7335 raft_consensus.cc:2243] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.717257  7335 raft_consensus.cc:2272] T f4a9872a984e43b38febbae36104df5c P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.719383  7335 tablet_replica.cc:333] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.719991  7335 raft_consensus.cc:2243] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.720605  7335 raft_consensus.cc:2272] T 594e55ae1ea64787b7ab66769c13bf50 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:09.721753 20192 consensus_peers.cc:597] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 -> Peer 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699): Couldn't send request to peer 0b233561181d4924b529443e3df945f3. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:37699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.724339  7335 tablet_replica.cc:333] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.725517  7335 raft_consensus.cc:2243] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.726079  7335 raft_consensus.cc:2272] T 8a66188048044bb5893342edf9f7c8b2 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.728596  7335 tablet_replica.cc:333] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
W20260709 13:06:09.729074 20192 consensus_peers.cc:597] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 -> Peer 0b233561181d4924b529443e3df945f3 (127.7.41.193:37699): Couldn't send request to peer 0b233561181d4924b529443e3df945f3. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.193:37699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.729319  7335 raft_consensus.cc:2243] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:09.729782 20192 consensus_peers.cc:597] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 -> Peer 8dd33bce196a4ee2a9a6576b9e926326 (127.7.41.194:38087): Couldn't send request to peer 8dd33bce196a4ee2a9a6576b9e926326. Status: Network error: Client connection negotiation failed: client connection to 127.7.41.194:38087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.730072  7335 raft_consensus.cc:2272] T 7c5b6d6732ea4b65bddaae19c516208a P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.732393  7335 tablet_replica.cc:333] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.732959  7335 raft_consensus.cc:2243] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.733420  7335 raft_consensus.cc:2272] T f92752cec50545219352d982b12ea7b6 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.735307  7335 tablet_replica.cc:333] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.735874  7335 raft_consensus.cc:2243] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.736292  7335 raft_consensus.cc:2272] T d96b8881e37041c7863da60abab91b1b P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.738449  7335 tablet_replica.cc:333] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.738989  7335 raft_consensus.cc:2243] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.739499  7335 raft_consensus.cc:2272] T fb1abb5dd5fd44cda4616d66a3010c2e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.741677  7335 tablet_replica.cc:333] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.742285  7335 raft_consensus.cc:2243] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.742720  7335 raft_consensus.cc:2272] T 59fd337b41e24150abb97d2775731ecf P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.744488  7335 tablet_replica.cc:333] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.745078  7335 raft_consensus.cc:2243] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.745509  7335 raft_consensus.cc:2272] T 46c8fb0892a64afdab2330b4d78e21c0 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.747515  7335 tablet_replica.cc:333] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.748070  7335 raft_consensus.cc:2243] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.748930  7335 raft_consensus.cc:2272] T 1511d4e52f11422da222323c32a4d742 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.750892  7335 tablet_replica.cc:333] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.751438  7335 raft_consensus.cc:2243] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.751855  7335 raft_consensus.cc:2272] T 97fdfbaaffaa48a79eb2dd5559102ae5 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.753859  7335 tablet_replica.cc:333] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.754376  7335 raft_consensus.cc:2243] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.754803  7335 raft_consensus.cc:2272] T cd9a8456ccf5487785e48fb37c556d0d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.756773  7335 tablet_replica.cc:333] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.757265  7335 raft_consensus.cc:2243] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.757694  7335 raft_consensus.cc:2272] T 201d21d72ab54454b00568774c51be9d P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.759447  7335 tablet_replica.cc:333] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.759949  7335 raft_consensus.cc:2243] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.760759  7335 raft_consensus.cc:2272] T 7eb76cddaf9b42fb8273600e72fee895 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.763264  7335 tablet_replica.cc:333] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.763841  7335 raft_consensus.cc:2243] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:06:09.764621  7335 raft_consensus.cc:2272] T 5bd280a52a6a48d383c5860cc086629e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.767050  7335 tablet_replica.cc:333] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.767558  7335 raft_consensus.cc:2243] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.767987  7335 raft_consensus.cc:2272] T b5b036449152445b8d219cdd220ed37e P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:09.769740  7335 tablet_replica.cc:333] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88: stopping tablet replica
I20260709 13:06:09.770263  7335 raft_consensus.cc:2243] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:09.770680  7335 raft_consensus.cc:2272] T 8895e208df7f42d49bc30edbf6fc8974 P f86e2e4f00df4b1697e60e97dbbe8d88 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:10.807657  7335 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 20249)
I20260709 13:06:11.363752  7335 tablet_server.cc:196] TabletServer@127.7.41.195:0 shutdown complete.
I20260709 13:06:11.434327  7335 master.cc:562] Master@127.7.41.254:36045 shutting down...
I20260709 13:06:11.458312  7335 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:11.459144  7335 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.459520  7335 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5f23619eaf344464be9490c5e341b951: stopping tablet replica
I20260709 13:06:11.503796  7335 master.cc:584] Master@127.7.41.254:36045 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (15769 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (28163 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (385404 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:06:11.571764  7335 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 422 messages since previous log ~18 seconds ago
I20260709 13:06:11.572019  7335 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 421 messages since previous log ~18 seconds ago
I20260709 13:06:11.572216  7335 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 417 messages since previous log ~18 seconds ago
I20260709 13:06:11.572434  7335 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:06:11.572639  7335 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:06:11.572840  7335 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~83 seconds ago
I20260709 13:06:11.573045  7335 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~146 seconds ago
I20260709 13:06:11.573316  7335 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~2 seconds ago
I20260709 13:06:11.573626  7335 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~9 seconds ago
